[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:02:44.211498 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:35593
I20260709 13:02:44.213057 14036 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:02:44.214123 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:44.231743 14043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:44.231763 14042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:44.231770 14045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:44.233443 14036 server_base.cc:1061] running on GCE node
I20260709 13:02:45.426486 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:45.426888 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:45.427253 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602165427221 us; error 0 us; skew 500 ppm
I20260709 13:02:45.428694 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:45.436740 14036 webserver.cc:533] Webserver started at http://127.13.181.62:42475/ using document root <none> and password file <none>
I20260709 13:02:45.437681 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:45.437893 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:45.438306 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:45.444608 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "25efc7dac02245b28da00216a963f930"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-28ks"
I20260709 13:02:45.453133 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:02:45.458783 14051 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.460027 14036 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:02:45.460420 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "25efc7dac02245b28da00216a963f930"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-28ks"
I20260709 13:02:45.460728 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:45.523825 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:45.525374 14036 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:02:45.525852 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:45.597086 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:35593
I20260709 13:02:45.597196 14102 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:35593 every 8 connection(s)
I20260709 13:02:45.604935 14103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.626724 14103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930: Bootstrap starting.
I20260709 13:02:45.633189 14103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.635133 14103 log.cc:826] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930: Log is configured to *not* fsync() on all Append() calls
I20260709 13:02:45.639914 14103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930: No bootstrap required, opened a new log
I20260709 13:02:45.663938 14103 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25efc7dac02245b28da00216a963f930" member_type: VOTER }
I20260709 13:02:45.664564 14103 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.664860 14103 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25efc7dac02245b28da00216a963f930, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.665855 14103 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25efc7dac02245b28da00216a963f930" member_type: VOTER }
I20260709 13:02:45.666451 14103 raft_consensus.cc:399] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:45.666776 14103 raft_consensus.cc:493] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:45.667174 14103 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.671787 14103 raft_consensus.cc:515] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25efc7dac02245b28da00216a963f930" member_type: VOTER }
I20260709 13:02:45.672591 14103 leader_election.cc:304] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25efc7dac02245b28da00216a963f930; no voters: 
I20260709 13:02:45.674417 14103 leader_election.cc:290] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:45.674722 14106 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.677659 14106 raft_consensus.cc:697] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 1 LEADER]: Becoming Leader. State: Replica: 25efc7dac02245b28da00216a963f930, State: Running, Role: LEADER
I20260709 13:02:45.678659 14106 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25efc7dac02245b28da00216a963f930" member_type: VOTER }
I20260709 13:02:45.679842 14103 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:45.691303 14108 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25efc7dac02245b28da00216a963f930. Latest consensus state: current_term: 1 leader_uuid: "25efc7dac02245b28da00216a963f930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25efc7dac02245b28da00216a963f930" member_type: VOTER } }
I20260709 13:02:45.691241 14107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25efc7dac02245b28da00216a963f930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25efc7dac02245b28da00216a963f930" member_type: VOTER } }
I20260709 13:02:45.692055 14108 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:45.692087 14107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:45.695150 14116 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:45.709523 14116 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:45.712069 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:45.726922 14116 catalog_manager.cc:1383] Generated new cluster ID: 1bb7dab26e0a4b96bf215306456bc9e4
I20260709 13:02:45.727290 14116 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:45.749490 14116 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:45.751632 14116 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:45.769125 14116 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930: Generated new TSK 0
I20260709 13:02:45.770080 14116 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:45.779753 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:45.789302 14125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.793798 14128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.794134 14126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:45.794850 14036 server_base.cc:1061] running on GCE node
I20260709 13:02:45.795599 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:45.795831 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:45.796006 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602165795984 us; error 0 us; skew 500 ppm
I20260709 13:02:45.796671 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:45.801748 14036 webserver.cc:533] Webserver started at http://127.13.181.1:44811/ using document root <none> and password file <none>
I20260709 13:02:45.802364 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:45.802608 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:45.802920 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:45.804205 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "836a43194ee246fda621da9042c02947"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-28ks"
I20260709 13:02:45.810716 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:45.815560 14133 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.816501 14036 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:02:45.816833 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "836a43194ee246fda621da9042c02947"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-28ks"
I20260709 13:02:45.817137 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:45.845139 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:45.846614 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:45.849678 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:45.854729 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:45.854974 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.855355 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:45.855531 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.972544 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:45357
I20260709 13:02:45.972661 14195 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:45357 every 8 connection(s)
I20260709 13:02:45.980755 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:45.993103 14200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:46.000674 14201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:46.006171 14203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:46.012188 14036 server_base.cc:1061] running on GCE node
I20260709 13:02:46.013095 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:46.013388 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:46.013609 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602166013590 us; error 0 us; skew 500 ppm
I20260709 13:02:46.014287 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:46.020996 14196 heartbeater.cc:344] Connected to a master server at 127.13.181.62:35593
I20260709 13:02:46.021523 14196 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:46.022821 14196 heartbeater.cc:507] Master 127.13.181.62:35593 requested a full tablet report, sending...
I20260709 13:02:46.024380 14036 webserver.cc:533] Webserver started at http://127.13.181.2:46073/ using document root <none> and password file <none>
I20260709 13:02:46.024978 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:46.025286 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:46.025620 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:46.027204 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-28ks"
I20260709 13:02:46.028261 14068 ts_manager.cc:194] Registered new tserver with Master: 836a43194ee246fda621da9042c02947 (127.13.181.1:45357)
I20260709 13:02:46.031267 14068 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40408
I20260709 13:02:46.033667 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:46.038822 14208 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.039752 14036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:46.040071 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-28ks"
I20260709 13:02:46.040417 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:46.074553 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:46.076277 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:46.078784 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:46.082548 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:46.082814 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.083112 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:46.083324 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.170585 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:34917
I20260709 13:02:46.170825 14270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:34917 every 8 connection(s)
I20260709 13:02:46.178692 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:46.188175 14274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:46.191347 14271 heartbeater.cc:344] Connected to a master server at 127.13.181.62:35593
I20260709 13:02:46.191835 14271 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:46.193161 14271 heartbeater.cc:507] Master 127.13.181.62:35593 requested a full tablet report, sending...
I20260709 13:02:46.196341 14068 ts_manager.cc:194] Registered new tserver with Master: 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
W20260709 13:02:46.197939 14275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:46.198531 14068 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40412
I20260709 13:02:46.199435 14036 server_base.cc:1061] running on GCE node
W20260709 13:02:46.199577 14277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:46.200953 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:46.201205 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:46.201495 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602166201475 us; error 0 us; skew 500 ppm
I20260709 13:02:46.202224 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:46.205072 14036 webserver.cc:533] Webserver started at http://127.13.181.3:34833/ using document root <none> and password file <none>
I20260709 13:02:46.205646 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:46.205869 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:46.206180 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:46.207711 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "b716dd732b0e4f75801634fa3345caed"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-28ks"
I20260709 13:02:46.213420 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:46.217305 14282 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.218145 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260709 13:02:46.218474 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "b716dd732b0e4f75801634fa3345caed"
format_stamp: "Formatted at 2026-07-09 13:02:46 on dist-test-slave-28ks"
I20260709 13:02:46.218783 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:46.238186 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:46.239504 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:46.241559 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:46.244654 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:46.244891 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.245133 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:46.245311 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:46.334641 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:46223
I20260709 13:02:46.335186 14344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:46223 every 8 connection(s)
I20260709 13:02:46.351117 14345 heartbeater.cc:344] Connected to a master server at 127.13.181.62:35593
I20260709 13:02:46.351486 14345 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:46.352238 14345 heartbeater.cc:507] Master 127.13.181.62:35593 requested a full tablet report, sending...
I20260709 13:02:46.354176 14068 ts_manager.cc:194] Registered new tserver with Master: b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:46.355103 14036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013516344s
I20260709 13:02:46.355556 14068 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40414
I20260709 13:02:46.410058 14068 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40420:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:46.413697 14068 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:46.534155 14310 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc8c700a45343308bb08aeff954690f (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:46.535845 14310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc8c700a45343308bb08aeff954690f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.541795 14306 tablet_service.cc:1511] Processing CreateTablet for tablet d040bc2cb94d44159ef1408eee5473f4 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:46.543252 14306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d040bc2cb94d44159ef1408eee5473f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.547766 14161 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc8c700a45343308bb08aeff954690f (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:46.549448 14161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc8c700a45343308bb08aeff954690f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.555606 14308 tablet_service.cc:1511] Processing CreateTablet for tablet 4b77042a0a114cb393caafe5430976a0 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:46.560869 14308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b77042a0a114cb393caafe5430976a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.562676 14309 tablet_service.cc:1511] Processing CreateTablet for tablet d5be2a359a1649bca8cb4e99b1936e19 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:46.570451 14302 tablet_service.cc:1511] Processing CreateTablet for tablet f74867cb4141438a915c2484406a6556 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:46.571700 14309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5be2a359a1649bca8cb4e99b1936e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.558178 14305 tablet_service.cc:1511] Processing CreateTablet for tablet 8550ec10194747499535e97718d07fa7 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:46.564380 14159 tablet_service.cc:1511] Processing CreateTablet for tablet 4b77042a0a114cb393caafe5430976a0 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:46.573674 14307 tablet_service.cc:1511] Processing CreateTablet for tablet efa4b320978c4ed68a8f05ef506a0654 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:46.573155 14304 tablet_service.cc:1511] Processing CreateTablet for tablet 40053ff3405844498a54827a2a5a3f43 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:46.577365 14302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74867cb4141438a915c2484406a6556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.578879 14158 tablet_service.cc:1511] Processing CreateTablet for tablet efa4b320978c4ed68a8f05ef506a0654 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:46.573238 14303 tablet_service.cc:1511] Processing CreateTablet for tablet d303e866ada741989732053cd89bb0cb (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:46.580282 14305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8550ec10194747499535e97718d07fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.577992 14160 tablet_service.cc:1511] Processing CreateTablet for tablet d5be2a359a1649bca8cb4e99b1936e19 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:46.582567 14159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b77042a0a114cb393caafe5430976a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.582038 14303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d303e866ada741989732053cd89bb0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.586683 14157 tablet_service.cc:1511] Processing CreateTablet for tablet d040bc2cb94d44159ef1408eee5473f4 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:46.589406 14304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40053ff3405844498a54827a2a5a3f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.591977 14160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5be2a359a1649bca8cb4e99b1936e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.592413 14307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa4b320978c4ed68a8f05ef506a0654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.600271 14236 tablet_service.cc:1511] Processing CreateTablet for tablet 3cc8c700a45343308bb08aeff954690f (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:46.600994 14158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa4b320978c4ed68a8f05ef506a0654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.594689 14156 tablet_service.cc:1511] Processing CreateTablet for tablet 8550ec10194747499535e97718d07fa7 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:46.604157 14157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d040bc2cb94d44159ef1408eee5473f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.617519 14236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cc8c700a45343308bb08aeff954690f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.604928 14234 tablet_service.cc:1511] Processing CreateTablet for tablet 4b77042a0a114cb393caafe5430976a0 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:46.604174 14235 tablet_service.cc:1511] Processing CreateTablet for tablet d5be2a359a1649bca8cb4e99b1936e19 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:46.620733 14233 tablet_service.cc:1511] Processing CreateTablet for tablet efa4b320978c4ed68a8f05ef506a0654 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:46.617659 14155 tablet_service.cc:1511] Processing CreateTablet for tablet 40053ff3405844498a54827a2a5a3f43 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:46.630604 14156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8550ec10194747499535e97718d07fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.634370 14234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b77042a0a114cb393caafe5430976a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.636171 14153 tablet_service.cc:1511] Processing CreateTablet for tablet f74867cb4141438a915c2484406a6556 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:46.664691 14233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa4b320978c4ed68a8f05ef506a0654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.633302 14154 tablet_service.cc:1511] Processing CreateTablet for tablet d303e866ada741989732053cd89bb0cb (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:46.675402 14230 tablet_service.cc:1511] Processing CreateTablet for tablet 40053ff3405844498a54827a2a5a3f43 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:46.677094 14363 tablet_bootstrap.cc:492] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:46.677407 14155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40053ff3405844498a54827a2a5a3f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.633375 14232 tablet_service.cc:1511] Processing CreateTablet for tablet d040bc2cb94d44159ef1408eee5473f4 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:46.695871 14231 tablet_service.cc:1511] Processing CreateTablet for tablet 8550ec10194747499535e97718d07fa7 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:46.705554 14230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40053ff3405844498a54827a2a5a3f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.708513 14153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74867cb4141438a915c2484406a6556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.711756 14154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d303e866ada741989732053cd89bb0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.722059 14232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d040bc2cb94d44159ef1408eee5473f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:46.723105 14115 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:46.742031 14231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8550ec10194747499535e97718d07fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.745925 14228 tablet_service.cc:1511] Processing CreateTablet for tablet f74867cb4141438a915c2484406a6556 (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:46.747524 14235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5be2a359a1649bca8cb4e99b1936e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.756790 14229 tablet_service.cc:1511] Processing CreateTablet for tablet d303e866ada741989732053cd89bb0cb (DEFAULT_TABLE table=test-workload [id=75587ca4c12046c6b981f18457cb110a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:46.762293 14228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f74867cb4141438a915c2484406a6556. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.767490 14229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d303e866ada741989732053cd89bb0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:46.854732 14364 tablet_bootstrap.cc:492] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:46.877947 14363 tablet_bootstrap.cc:654] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.968429 14365 tablet_bootstrap.cc:492] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:46.981801 14363 tablet_bootstrap.cc:492] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:46.982875 14363 ts_tablet_manager.cc:1403] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.344s	user 0.012s	sys 0.010s
I20260709 13:02:46.984921 14365 tablet_bootstrap.cc:654] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.985117 14364 tablet_bootstrap.cc:654] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.989609 14363 raft_consensus.cc:359] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:46.990726 14363 raft_consensus.cc:385] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.991163 14363 raft_consensus.cc:740] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.994238 14363 consensus_queue.cc:260] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:46.997834 14365 tablet_bootstrap.cc:492] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:46.998370 14365 ts_tablet_manager.cc:1403] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.000s
I20260709 13:02:46.998652 14364 tablet_bootstrap.cc:492] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:46.999156 14364 ts_tablet_manager.cc:1403] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.183s	user 0.009s	sys 0.011s
I20260709 13:02:47.001447 14365 raft_consensus.cc:359] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.002235 14365 raft_consensus.cc:385] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.002570 14365 raft_consensus.cc:740] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.003425 14365 consensus_queue.cc:260] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.003360 14364 raft_consensus.cc:359] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.004609 14364 raft_consensus.cc:385] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.005019 14364 raft_consensus.cc:740] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.005833 14364 consensus_queue.cc:260] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.007128 14363 ts_tablet_manager.cc:1434] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.001s
I20260709 13:02:47.008298 14345 heartbeater.cc:499] Master 127.13.181.62:35593 was elected leader, sending a full tablet report...
I20260709 13:02:47.008704 14363 tablet_bootstrap.cc:492] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.015106 14196 heartbeater.cc:499] Master 127.13.181.62:35593 was elected leader, sending a full tablet report...
I20260709 13:02:47.015618 14364 ts_tablet_manager.cc:1434] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.013s
I20260709 13:02:47.016631 14364 tablet_bootstrap.cc:492] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.017683 14363 tablet_bootstrap.cc:654] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.024885 14364 tablet_bootstrap.cc:654] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.032889 14363 tablet_bootstrap.cc:492] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.033427 14363 ts_tablet_manager.cc:1403] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:02:47.036994 14363 raft_consensus.cc:359] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.037900 14363 raft_consensus.cc:385] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.038246 14363 raft_consensus.cc:740] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.039280 14363 consensus_queue.cc:260] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.040645 14364 tablet_bootstrap.cc:492] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:47.041225 14364 ts_tablet_manager.cc:1403] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:02:47.042343 14363 ts_tablet_manager.cc:1434] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:02:47.043529 14363 tablet_bootstrap.cc:492] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.044349 14364 raft_consensus.cc:359] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.045146 14364 raft_consensus.cc:385] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.045483 14364 raft_consensus.cc:740] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.046130 14271 heartbeater.cc:499] Master 127.13.181.62:35593 was elected leader, sending a full tablet report...
I20260709 13:02:47.046277 14364 consensus_queue.cc:260] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.047539 14365 ts_tablet_manager.cc:1434] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.049s	user 0.020s	sys 0.017s
I20260709 13:02:47.048426 14365 tablet_bootstrap.cc:492] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.049091 14364 ts_tablet_manager.cc:1434] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:47.050127 14364 tablet_bootstrap.cc:492] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.057291 14365 tablet_bootstrap.cc:654] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.057292 14364 tablet_bootstrap.cc:654] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.060405 14371 raft_consensus.cc:493] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.061007 14371 raft_consensus.cc:515] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.064965 14363 tablet_bootstrap.cc:654] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.066726 14371 leader_election.cc:290] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
W20260709 13:02:47.094305 14346 tablet.cc:2406] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:47.118012 14364 tablet_bootstrap.cc:492] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:47.118862 14364 ts_tablet_manager.cc:1403] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.069s	user 0.032s	sys 0.025s
I20260709 13:02:47.119127 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.120465 14246 raft_consensus.cc:2468] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 0.
I20260709 13:02:47.122555 14135 leader_election.cc:304] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:47.123591 14371 raft_consensus.cc:2804] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.123979 14371 raft_consensus.cc:493] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.124434 14371 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.125993 14365 tablet_bootstrap.cc:492] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.126516 14365 ts_tablet_manager.cc:1403] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.078s	user 0.042s	sys 0.012s
I20260709 13:02:47.132220 14371 raft_consensus.cc:515] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.133282 14363 tablet_bootstrap.cc:492] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.133771 14363 ts_tablet_manager.cc:1403] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.008s
I20260709 13:02:47.135322 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.135941 14246 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.139997 14364 raft_consensus.cc:359] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.141561 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
I20260709 13:02:47.141614 14365 raft_consensus.cc:359] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.142374 14364 raft_consensus.cc:385] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.143206 14365 raft_consensus.cc:385] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.143620 14365 raft_consensus.cc:740] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.143314 14364 raft_consensus.cc:740] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
W20260709 13:02:47.144737 14136 leader_election.cc:343] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.144582 14365 consensus_queue.cc:260] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.145454 14371 leader_election.cc:290] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.147486 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:47.145908 14364 consensus_queue.cc:260] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.147742 14365 ts_tablet_manager.cc:1434] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:02:47.148850 14365 tablet_bootstrap.cc:492] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.149451 14364 ts_tablet_manager.cc:1434] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:02:47.150382 14364 tablet_bootstrap.cc:492] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.151580 14246 raft_consensus.cc:2468] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.153321 14135 leader_election.cc:304] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:47.155429 14371 raft_consensus.cc:2804] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.155948 14371 raft_consensus.cc:697] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:47.156798 14371 consensus_queue.cc:237] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.143332 14363 raft_consensus.cc:359] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.158668 14363 raft_consensus.cc:385] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.158946 14363 raft_consensus.cc:740] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.159875 14363 consensus_queue.cc:260] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.160642 14320 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.164849 14365 tablet_bootstrap.cc:654] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.166869 14320 raft_consensus.cc:2468] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.172104 14363 ts_tablet_manager.cc:1434] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.003s
I20260709 13:02:47.172974 14363 tablet_bootstrap.cc:492] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.173262 14364 tablet_bootstrap.cc:654] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.179940 14365 tablet_bootstrap.cc:492] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.180469 14365 ts_tablet_manager.cc:1403] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.001s
I20260709 13:02:47.184618 14363 tablet_bootstrap.cc:654] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.184999 14365 raft_consensus.cc:359] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.185824 14365 raft_consensus.cc:385] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.186177 14365 raft_consensus.cc:740] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.186982 14365 consensus_queue.cc:260] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.186358 14067 catalog_manager.cc:5697] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.189723 14365 ts_tablet_manager.cc:1434] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:47.190788 14365 tablet_bootstrap.cc:492] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.193534 14364 tablet_bootstrap.cc:492] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:47.195550 14364 ts_tablet_manager.cc:1403] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.007s
I20260709 13:02:47.200461 14365 tablet_bootstrap.cc:654] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.202840 14370 raft_consensus.cc:493] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.203472 14370 raft_consensus.cc:515] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.210736 14371 raft_consensus.cc:493] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.208331 14370 leader_election.cc:290] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.212724 14371 raft_consensus.cc:515] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.211140 14364 raft_consensus.cc:359] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.214994 14364 raft_consensus.cc:385] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.215539 14364 raft_consensus.cc:740] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.216089 14371 leader_election.cc:290] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.216292 14364 consensus_queue.cc:260] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.217324 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
W20260709 13:02:47.219360 14135 leader_election.cc:343] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.219415 14364 ts_tablet_manager.cc:1434] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.006s
I20260709 13:02:47.226478 14364 tablet_bootstrap.cc:492] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.228708 14363 tablet_bootstrap.cc:492] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.229207 14363 ts_tablet_manager.cc:1403] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.008s
I20260709 13:02:47.243909 14365 tablet_bootstrap.cc:492] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.244717 14365 ts_tablet_manager.cc:1403] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.054s	user 0.005s	sys 0.012s
I20260709 13:02:47.254962 14365 raft_consensus.cc:359] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.256127 14365 raft_consensus.cc:385] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.256573 14365 raft_consensus.cc:740] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.264557 14365 consensus_queue.cc:260] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.266870 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
I20260709 13:02:47.267223 14364 tablet_bootstrap.cc:654] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.266763 14363 raft_consensus.cc:359] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.267879 14363 raft_consensus.cc:385] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.268224 14363 raft_consensus.cc:740] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.269767 14365 ts_tablet_manager.cc:1434] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.003s
W20260709 13:02:47.270243 14136 leader_election.cc:343] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.270298 14363 consensus_queue.cc:260] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.270817 14136 leader_election.cc:304] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 836a43194ee246fda621da9042c02947; no voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed
I20260709 13:02:47.271899 14371 raft_consensus.cc:2749] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.270794 14365 tablet_bootstrap.cc:492] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.283797 14364 tablet_bootstrap.cc:492] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:47.284291 14364 ts_tablet_manager.cc:1403] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.009s
I20260709 13:02:47.285926 14369 raft_consensus.cc:493] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.286435 14369 raft_consensus.cc:515] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.287379 14364 raft_consensus.cc:359] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.288122 14364 raft_consensus.cc:385] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.288966 14364 raft_consensus.cc:740] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.289139 14369 leader_election.cc:290] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.289733 14364 consensus_queue.cc:260] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.292222 14364 ts_tablet_manager.cc:1434] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:02:47.293357 14364 tablet_bootstrap.cc:492] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.299935 14364 tablet_bootstrap.cc:654] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.307188 14363 ts_tablet_manager.cc:1434] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 13:02:47.308238 14363 tablet_bootstrap.cc:492] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.311735 14364 tablet_bootstrap.cc:492] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:47.312281 14364 ts_tablet_manager.cc:1403] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:02:47.315085 14364 raft_consensus.cc:359] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.315817 14364 raft_consensus.cc:385] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.316113 14364 raft_consensus.cc:740] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.316820 14364 consensus_queue.cc:260] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.319376 14364 ts_tablet_manager.cc:1434] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:47.320614 14364 tablet_bootstrap.cc:492] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.321102 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947" is_pre_election: true
W20260709 13:02:47.323514 14210 leader_election.cc:343] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 836a43194ee246fda621da9042c02947 (127.13.181.1:45357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.327322 14364 tablet_bootstrap.cc:654] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.332434 14363 tablet_bootstrap.cc:654] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.339308 14365 tablet_bootstrap.cc:654] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.347774 14365 tablet_bootstrap.cc:492] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.348263 14365 ts_tablet_manager.cc:1403] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.004s
I20260709 13:02:47.354436 14365 raft_consensus.cc:359] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.355255 14365 raft_consensus.cc:385] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.355574 14365 raft_consensus.cc:740] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.358217 14365 consensus_queue.cc:260] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.360430 14365 ts_tablet_manager.cc:1434] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:02:47.361377 14365 tablet_bootstrap.cc:492] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.365615 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947" is_pre_election: true
I20260709 13:02:47.366254 14171 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.369801 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
W20260709 13:02:47.371274 14211 leader_election.cc:343] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.371711 14211 leader_election.cc:304] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36; no voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed
I20260709 13:02:47.372815 14370 raft_consensus.cc:2749] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.374512 14284 leader_election.cc:304] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.375916 14369 raft_consensus.cc:2804] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.376065 14365 tablet_bootstrap.cc:654] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.376297 14369 raft_consensus.cc:493] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.376655 14369 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.383476 14369 raft_consensus.cc:515] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.385206 14364 tablet_bootstrap.cc:492] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:47.385720 14364 ts_tablet_manager.cc:1403] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.020s
I20260709 13:02:47.386621 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:47.387204 14171 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.388748 14364 raft_consensus.cc:359] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.389711 14364 raft_consensus.cc:385] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.390090 14364 raft_consensus.cc:740] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.391364 14370 raft_consensus.cc:493] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.390990 14364 consensus_queue.cc:260] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.391810 14370 raft_consensus.cc:515] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.393147 14365 tablet_bootstrap.cc:492] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.393651 14365 ts_tablet_manager.cc:1403] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 13:02:47.393776 14370 leader_election.cc:290] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.394785 14170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947" is_pre_election: true
I20260709 13:02:47.395581 14371 raft_consensus.cc:493] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.396018 14371 raft_consensus.cc:515] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
W20260709 13:02:47.396384 14210 leader_election.cc:343] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 836a43194ee246fda621da9042c02947 (127.13.181.1:45357): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.398088 14371 leader_election.cc:290] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.398748 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74867cb4141438a915c2484406a6556" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.399222 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74867cb4141438a915c2484406a6556" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
I20260709 13:02:47.401553 14365 raft_consensus.cc:359] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.399013 14364 ts_tablet_manager.cc:1434] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
W20260709 13:02:47.403949 14135 leader_election.cc:343] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:47.405287 14136 leader_election.cc:343] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.405571 14364 tablet_bootstrap.cc:492] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.405718 14136 leader_election.cc:304] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 836a43194ee246fda621da9042c02947; no voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed
I20260709 13:02:47.406471 14371 raft_consensus.cc:2749] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.398463 14171 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.407673 14369 leader_election.cc:290] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.408725 14284 leader_election.cc:304] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.410018 14369 raft_consensus.cc:2804] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.410743 14365 raft_consensus.cc:385] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.411116 14365 raft_consensus.cc:740] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.411091 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
W20260709 13:02:47.413080 14211 leader_election.cc:343] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.412117 14365 consensus_queue.cc:260] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.413515 14211 leader_election.cc:304] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36; no voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed
I20260709 13:02:47.414192 14400 raft_consensus.cc:493] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.415073 14364 tablet_bootstrap.cc:654] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.415516 14370 raft_consensus.cc:2749] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.416064 14363 tablet_bootstrap.cc:492] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.416555 14363 ts_tablet_manager.cc:1403] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.002s
I20260709 13:02:47.419922 14365 ts_tablet_manager.cc:1434] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:02:47.422413 14363 raft_consensus.cc:359] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.423429 14363 raft_consensus.cc:385] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.423805 14363 raft_consensus.cc:740] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.424677 14363 consensus_queue.cc:260] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.427354 14365 tablet_bootstrap.cc:492] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.429843 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.430450 14246 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.432502 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.434414 14246 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.414671 14400 raft_consensus.cc:515] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.434867 14365 tablet_bootstrap.cc:654] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.445298 14400 leader_election.cc:290] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.446051 14363 ts_tablet_manager.cc:1434] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.002s
I20260709 13:02:47.446792 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947" is_pre_election: true
I20260709 13:02:47.447360 14363 tablet_bootstrap.cc:492] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.447431 14171 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.449620 14284 leader_election.cc:304] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.449728 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.450415 14245 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.453387 14400 raft_consensus.cc:2804] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.457187 14369 raft_consensus.cc:697] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:47.457494 14400 raft_consensus.cc:493] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.458012 14400 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.452769 14246 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.459568 14371 raft_consensus.cc:493] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.458438 14369 consensus_queue.cc:237] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.460210 14371 raft_consensus.cc:515] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.462932 14371 leader_election.cc:290] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.464215 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
I20260709 13:02:47.464339 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.465095 14320 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 0.
I20260709 13:02:47.465353 14246 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 0.
I20260709 13:02:47.466342 14136 leader_election.cc:304] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.467106 14371 raft_consensus.cc:2804] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.467725 14371 raft_consensus.cc:493] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.468266 14371 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.477095 14371 raft_consensus.cc:515] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.477504 14363 tablet_bootstrap.cc:654] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.483733 14365 tablet_bootstrap.cc:492] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.484217 14365 ts_tablet_manager.cc:1403] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.057s	user 0.019s	sys 0.000s
I20260709 13:02:47.481927 14371 leader_election.cc:290] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.484628 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:47.486181 14320 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.494019 14364 tablet_bootstrap.cc:492] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
W20260709 13:02:47.486315 14211 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46223, user_credentials={real_user=slave}} blocked reactor thread for 72694.4us
I20260709 13:02:47.500909 14364 ts_tablet_manager.cc:1403] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.014s
I20260709 13:02:47.498090 14320 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.503399 14363 tablet_bootstrap.cc:492] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.503199 14364 raft_consensus.cc:359] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.503878 14363 ts_tablet_manager.cc:1403] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.010s
I20260709 13:02:47.504045 14364 raft_consensus.cc:385] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.504448 14364 raft_consensus.cc:740] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.504511 14136 leader_election.cc:304] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.505430 14371 raft_consensus.cc:2804] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.500154 14400 raft_consensus.cc:515] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.506006 14371 raft_consensus.cc:697] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:47.506860 14371 consensus_queue.cc:237] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.507198 14363 raft_consensus.cc:359] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.507889 14363 raft_consensus.cc:385] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.508045 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:47.508209 14363 raft_consensus.cc:740] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.508687 14171 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.509167 14363 consensus_queue.cc:260] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.510252 14364 consensus_queue.cc:260] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.511960 14363 ts_tablet_manager.cc:1434] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:47.512882 14363 tablet_bootstrap.cc:492] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.493680 14068 catalog_manager.cc:5697] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 0 to 1, leader changed from <none> to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 1 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.514634 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.515192 14245 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.516287 14171 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.517446 14284 leader_election.cc:304] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.518375 14369 raft_consensus.cc:2804] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.518396 14400 leader_election.cc:290] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.486503 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.518920 14369 raft_consensus.cc:697] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:47.497030 14365 raft_consensus.cc:359] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.519241 14246 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.524706 14363 tablet_bootstrap.cc:654] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.519971 14365 raft_consensus.cc:385] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.528434 14365 raft_consensus.cc:740] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.529175 14365 consensus_queue.cc:260] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.519891 14369 consensus_queue.cc:237] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.531515 14365 ts_tablet_manager.cc:1434] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:02:47.537428 14365 tablet_bootstrap.cc:492] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.539827 14067 catalog_manager.cc:5697] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.533331 14246 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.512223 14364 ts_tablet_manager.cc:1434] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.002s
I20260709 13:02:47.543592 14364 tablet_bootstrap.cc:492] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947: Bootstrap starting.
I20260709 13:02:47.522625 14245 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.554672 14364 tablet_bootstrap.cc:654] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.556995 14365 tablet_bootstrap.cc:654] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.567772 14066 catalog_manager.cc:5697] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 0 to 1, leader changed from <none> to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 1 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.572731 14363 tablet_bootstrap.cc:492] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.573388 14363 ts_tablet_manager.cc:1403] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.000s
I20260709 13:02:47.576439 14364 tablet_bootstrap.cc:492] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947: No bootstrap required, opened a new log
I20260709 13:02:47.576905 14364 ts_tablet_manager.cc:1403] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:02:47.580560 14363 raft_consensus.cc:359] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.582257 14363 raft_consensus.cc:385] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.582820 14363 raft_consensus.cc:740] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.583799 14364 raft_consensus.cc:359] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.584645 14364 raft_consensus.cc:385] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.584108 14363 consensus_queue.cc:260] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.585007 14364 raft_consensus.cc:740] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.586863 14364 consensus_queue.cc:260] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.587642 14363 ts_tablet_manager.cc:1434] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:02:47.588867 14363 tablet_bootstrap.cc:492] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.593164 14365 tablet_bootstrap.cc:492] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.593665 14365 ts_tablet_manager.cc:1403] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.007s
I20260709 13:02:47.596078 14363 tablet_bootstrap.cc:654] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.596771 14365 raft_consensus.cc:359] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.597584 14365 raft_consensus.cc:385] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.599728 14364 ts_tablet_manager.cc:1434] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:02:47.601557 14365 raft_consensus.cc:740] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.602777 14365 consensus_queue.cc:260] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.608441 14365 ts_tablet_manager.cc:1434] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:02:47.608490 14363 tablet_bootstrap.cc:492] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.609241 14363 ts_tablet_manager.cc:1403] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:02:47.609534 14365 tablet_bootstrap.cc:492] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: Bootstrap starting.
I20260709 13:02:47.612282 14363 raft_consensus.cc:359] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.613164 14363 raft_consensus.cc:385] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.613534 14363 raft_consensus.cc:740] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.614483 14363 consensus_queue.cc:260] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.616060 14365 tablet_bootstrap.cc:654] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.616791 14363 ts_tablet_manager.cc:1434] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:47.617816 14363 tablet_bootstrap.cc:492] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed: Bootstrap starting.
I20260709 13:02:47.626230 14363 tablet_bootstrap.cc:654] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.638118 14365 tablet_bootstrap.cc:492] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: No bootstrap required, opened a new log
I20260709 13:02:47.638509 14363 tablet_bootstrap.cc:492] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed: No bootstrap required, opened a new log
I20260709 13:02:47.638564 14365 ts_tablet_manager.cc:1403] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 13:02:47.639003 14363 ts_tablet_manager.cc:1403] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:02:47.641224 14363 raft_consensus.cc:359] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.641235 14365 raft_consensus.cc:359] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.641863 14363 raft_consensus.cc:385] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.641994 14365 raft_consensus.cc:385] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.642211 14363 raft_consensus.cc:740] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.642313 14365 raft_consensus.cc:740] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.643015 14363 consensus_queue.cc:260] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.642997 14365 consensus_queue.cc:260] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.645177 14363 ts_tablet_manager.cc:1434] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:47.646344 14365 ts_tablet_manager.cc:1434] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:02:47.649381 14369 raft_consensus.cc:493] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.649899 14369 raft_consensus.cc:515] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.652149 14369 leader_election.cc:290] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.654270 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74867cb4141438a915c2484406a6556" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.654697 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74867cb4141438a915c2484406a6556" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947" is_pre_election: true
I20260709 13:02:47.654976 14245 raft_consensus.cc:2468] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.655342 14171 raft_consensus.cc:2468] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.656541 14284 leader_election.cc:304] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.656771 14403 raft_consensus.cc:493] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.658125 14403 raft_consensus.cc:515] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.659646 14369 raft_consensus.cc:2804] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.660315 14369 raft_consensus.cc:493] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.660506 14403 leader_election.cc:290] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.660706 14369 raft_consensus.cc:3060] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.661873 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947" is_pre_election: true
I20260709 13:02:47.662187 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
I20260709 13:02:47.662559 14171 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 0.
I20260709 13:02:47.662838 14320 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 0.
I20260709 13:02:47.663902 14210 leader_election.cc:304] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:47.664964 14403 raft_consensus.cc:2804] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.665302 14403 raft_consensus.cc:493] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.665625 14403 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.667263 14369 raft_consensus.cc:515] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.668800 14371 raft_consensus.cc:493] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.669166 14369 leader_election.cc:290] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.669330 14371 raft_consensus.cc:515] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.670640 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74867cb4141438a915c2484406a6556" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:47.671295 14171 raft_consensus.cc:3060] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.671440 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f74867cb4141438a915c2484406a6556" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.672050 14245 raft_consensus.cc:3060] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.672948 14403 raft_consensus.cc:515] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.674830 14403 leader_election.cc:290] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.676043 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:47.676656 14320 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.676717 14170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:47.677332 14170 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.679003 14171 raft_consensus.cc:2468] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.680086 14284 leader_election.cc:304] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.683645 14371 leader_election.cc:290] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.685259 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
I20260709 13:02:47.685958 14319 raft_consensus.cc:2468] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 0.
I20260709 13:02:47.686126 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.686770 14246 raft_consensus.cc:2468] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 0.
I20260709 13:02:47.683756 14369 raft_consensus.cc:2804] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.687463 14136 leader_election.cc:304] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.687215 14170 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 1.
I20260709 13:02:47.688870 14380 raft_consensus.cc:2804] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.690099 14380 raft_consensus.cc:493] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.690511 14380 raft_consensus.cc:3060] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.691226 14245 raft_consensus.cc:2468] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.693276 14210 leader_election.cc:304] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:47.692827 14320 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 1.
I20260709 13:02:47.694236 14369 raft_consensus.cc:697] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:47.695120 14369 consensus_queue.cc:237] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.698302 14403 raft_consensus.cc:2804] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.698962 14403 raft_consensus.cc:697] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:47.699885 14371 consensus_queue.cc:1048] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.701488 14380 raft_consensus.cc:515] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.704209 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.704771 14245 raft_consensus.cc:3060] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.706624 14067 catalog_manager.cc:5697] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 0 to 1, leader changed from <none> to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 1 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.699882 14403 consensus_queue.cc:237] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.712507 14380 leader_election.cc:290] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.713826 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:47.714422 14320 raft_consensus.cc:3060] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.715883 14245 raft_consensus.cc:2468] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.716984 14135 leader_election.cc:304] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:47.717806 14380 raft_consensus.cc:2804] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.718261 14380 raft_consensus.cc:697] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:47.719628 14380 consensus_queue.cc:237] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.723197 14320 raft_consensus.cc:2468] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.727171 14371 raft_consensus.cc:493] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.727697 14371 raft_consensus.cc:515] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
W20260709 13:02:47.728557 14115 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:47.729885 14371 leader_election.cc:290] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.730511 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.731247 14245 raft_consensus.cc:2468] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 0.
I20260709 13:02:47.732268 14135 leader_election.cc:304] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:47.732583 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed" is_pre_election: true
I20260709 13:02:47.733458 14320 raft_consensus.cc:2468] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 0.
I20260709 13:02:47.732700 14067 catalog_manager.cc:5697] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.735905 14371 raft_consensus.cc:2804] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.736312 14371 raft_consensus.cc:493] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.736774 14371 raft_consensus.cc:3060] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.756668 14423 consensus_queue.cc:1048] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.762092 14371 raft_consensus.cc:515] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.765971 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.766590 14246 raft_consensus.cc:3060] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.771211 14371 leader_election.cc:290] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:47.773316 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:47.774220 14319 raft_consensus.cc:3060] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.775792 14246 raft_consensus.cc:2468] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.779222 14369 raft_consensus.cc:493] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.779783 14369 raft_consensus.cc:515] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.779529 14067 catalog_manager.cc:5697] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.782097 14369 leader_election.cc:290] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.784540 14244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" is_pre_election: true
I20260709 13:02:47.785290 14170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947" is_pre_election: true
I20260709 13:02:47.785394 14244 raft_consensus.cc:2468] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.785918 14170 raft_consensus.cc:2468] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 0.
I20260709 13:02:47.786862 14284 leader_election.cc:304] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.788213 14369 raft_consensus.cc:2804] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.788568 14369 raft_consensus.cc:493] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.789019 14369 raft_consensus.cc:3060] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.787427 14135 leader_election.cc:304] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:47.791283 14380 raft_consensus.cc:2804] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.791811 14380 raft_consensus.cc:697] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:47.793246 14380 consensus_queue.cc:237] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.801508 14369 raft_consensus.cc:515] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.804924 14319 raft_consensus.cc:2468] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 1.
I20260709 13:02:47.810281 14369 leader_election.cc:290] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:47.812244 14170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:47.812821 14170 raft_consensus.cc:3060] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.812747 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:47.813691 14246 raft_consensus.cc:3060] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.817050 14067 catalog_manager.cc:5697] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 0 to 1, leader changed from <none> to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.829159 14170 raft_consensus.cc:2468] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.830405 14284 leader_election.cc:304] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:47.831351 14369 raft_consensus.cc:2804] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.832531 14246 raft_consensus.cc:2468] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 1.
I20260709 13:02:47.832533 14369 raft_consensus.cc:697] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:47.834352 14369 consensus_queue.cc:237] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:47.850631 14065 catalog_manager.cc:5697] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 0 to 1, leader changed from <none> to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 1 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.905798 14421 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.917480 14423 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.921314 14402 consensus_queue.cc:1048] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.942525 14402 consensus_queue.cc:1048] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.979221 14245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
mode: GRACEFUL
new_leader_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:50354
I20260709 13:02:47.979825 14245 raft_consensus.cc:606] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 LEADER]: Received request to transfer leadership to TS 836a43194ee246fda621da9042c02947
I20260709 13:02:47.997188 14319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:02:47.997814 14319 raft_consensus.cc:606] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:48.002597 14319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8550ec10194747499535e97718d07fa7"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:02:48.003196 14319 raft_consensus.cc:606] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:48.017979 14170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43"
dest_uuid: "836a43194ee246fda621da9042c02947"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:37972
I20260709 13:02:48.018483 14170 raft_consensus.cc:606] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:48.024060 14319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d303e866ada741989732053cd89bb0cb"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:02:48.024703 14319 raft_consensus.cc:606] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:48.026409 14402 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.033172 14402 raft_consensus.cc:993] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.036152 14405 raft_consensus.cc:1081] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.040939 14245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:02:48.041359 14400 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.041620 14245 raft_consensus.cc:493] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.042157 14245 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.053118 14245 raft_consensus.cc:515] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.057718 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:48.057758 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:48.058451 14319 raft_consensus.cc:3055] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.059966 14171 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.059980 14319 raft_consensus.cc:740] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:48.061013 14319 consensus_queue.cc:260] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.062275 14319 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.057111 14245 leader_election.cc:290] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:48.067195 14171 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:48.068243 14210 leader_election.cc:304] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:48.069005 14403 raft_consensus.cc:2804] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.069528 14403 raft_consensus.cc:697] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:48.070325 14403 consensus_queue.cc:237] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.070775 14319 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:48.077469 14065 catalog_manager.cc:5697] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 1 to 2, leader changed from b716dd732b0e4f75801634fa3345caed (127.13.181.3) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.078251 14405 consensus_queue.cc:1048] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.091168 14369 consensus_queue.cc:1048] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.122069 14421 consensus_queue.cc:1048] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.134744 14422 consensus_queue.cc:1048] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:48.173977 14422 consensus_queue.cc:1048] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.180166 14423 raft_consensus.cc:993] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.180608 14423 raft_consensus.cc:1081] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.184933 14423 consensus_queue.cc:1048] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.185436 14246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:02:48.185961 14246 raft_consensus.cc:493] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.186319 14246 raft_consensus.cc:3060] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.191762 14403 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.193737 14246 raft_consensus.cc:515] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.196350 14246 leader_election.cc:290] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:48.196995 14320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:48.199954 14170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40053ff3405844498a54827a2a5a3f43" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:48.200507 14170 raft_consensus.cc:3055] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.200907 14170 raft_consensus.cc:740] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:48.201740 14170 consensus_queue.cc:260] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.202951 14170 raft_consensus.cc:3060] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.212314 14170 raft_consensus.cc:2468] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:48.213599 14210 leader_election.cc:304] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: b716dd732b0e4f75801634fa3345caed
I20260709 13:02:48.215335 14403 raft_consensus.cc:2804] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.223260 14403 raft_consensus.cc:697] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:48.224207 14403 consensus_queue.cc:237] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.226130 14449 raft_consensus.cc:993] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: : Instructing follower 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:48.227067 14448 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.228756 14403 raft_consensus.cc:1081] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 LEADER]: Signalling peer 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:48.235551 14171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0"
dest_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:37962
I20260709 13:02:48.236294 14171 raft_consensus.cc:493] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.236742 14171 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.240901 14067 catalog_manager.cc:5697] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 1 to 2, leader changed from 836a43194ee246fda621da9042c02947 (127.13.181.1) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.246915 14171 raft_consensus.cc:515] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.250581 14246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:48.251171 14246 raft_consensus.cc:3055] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.251494 14246 raft_consensus.cc:740] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:48.252481 14246 consensus_queue.cc:260] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.253708 14246 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.262831 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:48.263873 14319 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.267211 14171 leader_election.cc:290] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 2 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:48.270298 14246 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 2.
I20260709 13:02:48.271690 14135 leader_election.cc:304] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:48.272317 14319 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 2.
I20260709 13:02:48.272596 14380 raft_consensus.cc:2804] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.273130 14380 raft_consensus.cc:697] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:48.273949 14380 consensus_queue.cc:237] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.282212 14067 catalog_manager.cc:5697] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 1 to 2, leader changed from 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2) to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.306998 14369 consensus_queue.cc:1048] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.314611 14402 raft_consensus.cc:993] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.315074 14402 raft_consensus.cc:1081] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.317201 14245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d303e866ada741989732053cd89bb0cb"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:02:48.317790 14245 raft_consensus.cc:493] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.318187 14245 raft_consensus.cc:3060] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.322717 14402 consensus_queue.cc:1048] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.325146 14245 raft_consensus.cc:515] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.326900 14246 raft_consensus.cc:1240] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Rejecting Update request from peer b716dd732b0e4f75801634fa3345caed for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:48.329012 14170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:48.330642 14402 consensus_queue.cc:1059] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.331449 14402 raft_consensus.cc:3055] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.331780 14402 raft_consensus.cc:740] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:48.332654 14245 leader_election.cc:290] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:48.332553 14402 consensus_queue.cc:260] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.333520 14402 raft_consensus.cc:3060] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.336539 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d303e866ada741989732053cd89bb0cb" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:48.349053 14319 raft_consensus.cc:2468] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:48.350761 14211 leader_election.cc:304] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed; no voters: 836a43194ee246fda621da9042c02947
I20260709 13:02:48.351636 14450 raft_consensus.cc:2804] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.352124 14450 raft_consensus.cc:697] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:48.352959 14450 consensus_queue.cc:237] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.360559 14067 catalog_manager.cc:5697] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 1 to 2, leader changed from b716dd732b0e4f75801634fa3345caed (127.13.181.3) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.461746 14369 raft_consensus.cc:993] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.462235 14369 raft_consensus.cc:1081] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:48.463944 14246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8550ec10194747499535e97718d07fa7"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:02:48.464443 14246 raft_consensus.cc:493] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:48.464753 14246 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.469043 14246 raft_consensus.cc:515] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.470633 14246 leader_election.cc:290] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:48.471613 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:48.471861 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:48.472196 14171 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.472419 14319 raft_consensus.cc:3055] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:48.472785 14319 raft_consensus.cc:740] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:48.473481 14319 consensus_queue.cc:260] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.474375 14319 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.478623 14319 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:48.478617 14171 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:48.479926 14210 leader_election.cc:304] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:48.480700 14450 raft_consensus.cc:2804] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:48.481161 14450 raft_consensus.cc:697] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:48.481925 14450 consensus_queue.cc:237] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:48.489487 14066 catalog_manager.cc:5697] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 1 to 2, leader changed from b716dd732b0e4f75801634fa3345caed (127.13.181.3) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.609329 14171 raft_consensus.cc:1275] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.610988 14450 consensus_queue.cc:1048] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.621344 14319 raft_consensus.cc:3060] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.630954 14319 raft_consensus.cc:1275] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.632328 14450 consensus_queue.cc:1048] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.640945 14319 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.642647 14450 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.650754 14171 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.658262 14450 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.660907 14245 raft_consensus.cc:1275] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.663553 14380 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.672339 14319 raft_consensus.cc:1275] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.674002 14421 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.757157 14319 raft_consensus.cc:1275] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.758463 14450 consensus_queue.cc:1048] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.765874 14170 raft_consensus.cc:3060] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:48.772203 14170 raft_consensus.cc:1275] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.773815 14450 consensus_queue.cc:1048] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.916893 14170 raft_consensus.cc:1275] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.918128 14450 consensus_queue.cc:1048] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.925041 14319 raft_consensus.cc:1275] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.926411 14450 consensus_queue.cc:1048] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.056975 14036 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:02:51.057868 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:51.079003 14245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
mode: GRACEFUL
new_leader_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:50366
I20260709 13:02:51.079550 14245 raft_consensus.cc:606] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Received request to transfer leadership to TS b716dd732b0e4f75801634fa3345caed
I20260709 13:02:51.089794 14171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19"
dest_uuid: "836a43194ee246fda621da9042c02947"
mode: GRACEFUL
new_leader_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:37984
I20260709 13:02:51.090370 14171 raft_consensus.cc:606] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Received request to transfer leadership to TS b716dd732b0e4f75801634fa3345caed
I20260709 13:02:51.091535 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:51.091938 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:51.351316 14460 raft_consensus.cc:993] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: : Instructing follower b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:51.351755 14450 raft_consensus.cc:1081] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Signalling peer b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:51.353101 14319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:54340
I20260709 13:02:51.353569 14319 raft_consensus.cc:493] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.353932 14319 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.358723 14319 raft_consensus.cc:515] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:51.360229 14319 leader_election.cc:290] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 3 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:51.360934 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:51.361346 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:51.361445 14171 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.361953 14245 raft_consensus.cc:3055] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:51.362249 14245 raft_consensus.cc:740] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:51.362840 14245 consensus_queue.cc:260] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:51.363744 14245 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:51.366245 14171 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 3.
I20260709 13:02:51.367348 14284 leader_election.cc:304] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:51.368007 14455 raft_consensus.cc:2804] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:51.368160 14245 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 3.
I20260709 13:02:51.369307 14455 raft_consensus.cc:697] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:51.370047 14455 consensus_queue.cc:237] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:51.379391 14067 catalog_manager.cc:5697] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 2 to 3, leader changed from 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2) to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 3 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.404156 14421 raft_consensus.cc:993] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947: : Instructing follower b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:51.404568 14458 raft_consensus.cc:1081] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Signalling peer b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:51.405922 14319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:54330
I20260709 13:02:51.406352 14319 raft_consensus.cc:493] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.406648 14319 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.410346 14319 raft_consensus.cc:515] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:51.411734 14319 leader_election.cc:290] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 2 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:51.412590 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:51.412765 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:51.413118 14171 raft_consensus.cc:3055] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.413276 14245 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.413422 14171 raft_consensus.cc:740] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:51.414191 14171 consensus_queue.cc:260] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:51.415078 14171 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.417783 14245 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 2.
I20260709 13:02:51.418774 14284 leader_election.cc:304] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:51.419687 14455 raft_consensus.cc:2804] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.420096 14171 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 2.
I20260709 13:02:51.420174 14455 raft_consensus.cc:697] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:51.421043 14455 consensus_queue.cc:237] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:51.427556 14067 catalog_manager.cc:5697] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 1 to 2, leader changed from 836a43194ee246fda621da9042c02947 (127.13.181.1) to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 2 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.765652 14245 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:51.766805 14455 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:51.779258 14171 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:51.783663 14470 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.956240 14171 raft_consensus.cc:1275] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.957454 14470 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.965515 14245 raft_consensus.cc:1275] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.967356 14455 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.092659 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:52.102167 14171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f"
dest_uuid: "836a43194ee246fda621da9042c02947"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:37972
I20260709 13:02:52.102722 14171 raft_consensus.cc:606] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:52.107252 14319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:02:52.107724 14319 raft_consensus.cc:606] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:52.112087 14171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0"
dest_uuid: "836a43194ee246fda621da9042c02947"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:37972
I20260709 13:02:52.112545 14171 raft_consensus.cc:606] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:52.116693 14171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654"
dest_uuid: "836a43194ee246fda621da9042c02947"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:37972
I20260709 13:02:52.117149 14171 raft_consensus.cc:606] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:52.121387 14319 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
mode: GRACEFUL
new_leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:54356
I20260709 13:02:52.121812 14319 raft_consensus.cc:606] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 LEADER]: Received request to transfer leadership to TS 2441e587bc404ae2a6ecfcea07ac2f36
I20260709 13:02:52.292719 14461 raft_consensus.cc:993] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.293151 14455 raft_consensus.cc:1081] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.294621 14245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:02:52.295115 14245 raft_consensus.cc:493] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:52.295409 14245 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:52.299360 14245 raft_consensus.cc:515] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.300737 14245 leader_election.cc:290] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 4 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:52.301532 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:52.301877 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:52.302114 14171 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:52.302373 14319 raft_consensus.cc:3055] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:52.302685 14319 raft_consensus.cc:740] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:52.303427 14319 consensus_queue.cc:260] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.304512 14319 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:52.308537 14171 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 4.
I20260709 13:02:52.309599 14210 leader_election.cc:304] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:52.310081 14319 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 4.
I20260709 13:02:52.310250 14450 raft_consensus.cc:2804] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:52.311285 14450 raft_consensus.cc:697] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:52.312038 14450 consensus_queue.cc:237] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.315582 14458 raft_consensus.cc:993] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.315984 14477 raft_consensus.cc:1081] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.317447 14245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:02:52.317893 14245 raft_consensus.cc:493] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:52.318168 14245 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.318454 14066 catalog_manager.cc:5697] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 3 to 4, leader changed from b716dd732b0e4f75801634fa3345caed (127.13.181.3) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 4 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.322827 14245 raft_consensus.cc:515] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.324433 14245 leader_election.cc:290] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 3 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:52.325331 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:52.325343 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:52.326030 14171 raft_consensus.cc:3055] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:52.326041 14319 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.326400 14171 raft_consensus.cc:740] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:52.327201 14171 consensus_queue.cc:260] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.328491 14171 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.332321 14319 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 3.
I20260709 13:02:52.333209 14211 leader_election.cc:304] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:52.333777 14171 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 3.
I20260709 13:02:52.333938 14450 raft_consensus.cc:2804] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:52.334419 14450 raft_consensus.cc:697] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:52.335209 14450 consensus_queue.cc:237] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.341257 14066 catalog_manager.cc:5697] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 2 to 3, leader changed from 836a43194ee246fda621da9042c02947 (127.13.181.1) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 3 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.406579 14458 raft_consensus.cc:993] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.407015 14458 raft_consensus.cc:1081] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.408404 14245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:02:52.408823 14245 raft_consensus.cc:493] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:52.409103 14245 raft_consensus.cc:3060] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:52.412935 14245 raft_consensus.cc:515] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.414311 14245 leader_election.cc:290] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:52.415349 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:52.415480 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa4b320978c4ed68a8f05ef506a0654" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:52.415786 14171 raft_consensus.cc:3055] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:52.415977 14319 raft_consensus.cc:3060] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:52.416080 14171 raft_consensus.cc:740] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:52.416707 14171 consensus_queue.cc:260] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.417506 14171 raft_consensus.cc:3060] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:52.420233 14319 raft_consensus.cc:2468] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:52.421193 14211 leader_election.cc:304] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:52.421550 14171 raft_consensus.cc:2468] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:52.421839 14450 raft_consensus.cc:2804] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:52.422215 14450 raft_consensus.cc:697] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:52.422977 14450 consensus_queue.cc:237] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.429298 14066 catalog_manager.cc:5697] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 1 to 2, leader changed from 836a43194ee246fda621da9042c02947 (127.13.181.1) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.484932 14461 raft_consensus.cc:993] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.485436 14483 raft_consensus.cc:1081] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.487098 14245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50342
I20260709 13:02:52.487630 14245 raft_consensus.cc:493] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:52.487974 14245 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.491868 14245 raft_consensus.cc:515] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.493178 14245 leader_election.cc:290] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 3 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:52.494130 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:52.494175 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:52.494786 14171 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.494817 14319 raft_consensus.cc:3055] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:52.495359 14319 raft_consensus.cc:740] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:52.496071 14319 consensus_queue.cc:260] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.497149 14319 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:52.501009 14171 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 3.
I20260709 13:02:52.502099 14210 leader_election.cc:304] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, 836a43194ee246fda621da9042c02947; no voters: 
I20260709 13:02:52.502666 14319 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 3.
I20260709 13:02:52.502785 14450 raft_consensus.cc:2804] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:52.503266 14450 raft_consensus.cc:697] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:52.504065 14450 consensus_queue.cc:237] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.509254 14066 catalog_manager.cc:5697] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 2 to 3, leader changed from b716dd732b0e4f75801634fa3345caed (127.13.181.3) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 3 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.550459 14477 raft_consensus.cc:993] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947: : Instructing follower 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.550886 14458 raft_consensus.cc:1081] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Signalling peer 2441e587bc404ae2a6ecfcea07ac2f36 to start an election
I20260709 13:02:52.552337 14245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
 from {username='slave'} at 127.0.0.1:50340
I20260709 13:02:52.552873 14245 raft_consensus.cc:493] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:52.553177 14245 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:52.557593 14245 raft_consensus.cc:515] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.559687 14245 leader_election.cc:290] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:52.559906 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:52.560204 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:52.560524 14171 raft_consensus.cc:3055] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:52.560810 14319 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:52.560873 14171 raft_consensus.cc:740] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:52.561651 14171 consensus_queue.cc:260] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.562705 14171 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:52.566838 14319 raft_consensus.cc:2468] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:52.567890 14211 leader_election.cc:304] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2441e587bc404ae2a6ecfcea07ac2f36, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:52.568240 14171 raft_consensus.cc:2468] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2441e587bc404ae2a6ecfcea07ac2f36 in term 2.
I20260709 13:02:52.568552 14450 raft_consensus.cc:2804] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:52.569036 14450 raft_consensus.cc:697] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Leader. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:52.569783 14450 consensus_queue.cc:237] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:52.575712 14066 catalog_manager.cc:5697] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 reported cstate change: term changed from 1 to 2, leader changed from 836a43194ee246fda621da9042c02947 (127.13.181.1) to 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:52.732661 14171 raft_consensus.cc:1275] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:52.733845 14450 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:52.740346 14319 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:52.741806 14450 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:52.748274 14319 raft_consensus.cc:1275] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:52.750331 14450 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:52.755017 14171 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:52.757309 14488 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:02:52.935961 14320 raft_consensus.cc:1275] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.937122 14488 consensus_queue.cc:1048] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.945397 14171 raft_consensus.cc:1275] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.947234 14450 consensus_queue.cc:1048] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.998799 14171 raft_consensus.cc:1275] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:53.000097 14450 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.006497 14320 raft_consensus.cc:1275] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:53.008013 14450 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:53.081182 14319 raft_consensus.cc:1275] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:53.081812 14171 raft_consensus.cc:1275] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Refusing update from remote peer 2441e587bc404ae2a6ecfcea07ac2f36: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:53.082643 14488 consensus_queue.cc:1048] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:53.083283 14450 consensus_queue.cc:1048] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:55.132877 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.139846 14245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
mode: GRACEFUL
new_leader_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:50366
I20260709 13:02:55.140434 14245 raft_consensus.cc:606] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Received request to transfer leadership to TS 836a43194ee246fda621da9042c02947
I20260709 13:02:55.143088 14245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
mode: GRACEFUL
new_leader_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:50366
I20260709 13:02:55.143469 14245 raft_consensus.cc:606] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Received request to transfer leadership to TS 836a43194ee246fda621da9042c02947
I20260709 13:02:55.145459 14245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8550ec10194747499535e97718d07fa7"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
mode: GRACEFUL
new_leader_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:50366
I20260709 13:02:55.145807 14245 raft_consensus.cc:606] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Received request to transfer leadership to TS 836a43194ee246fda621da9042c02947
I20260709 13:02:55.148043 14245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
mode: GRACEFUL
new_leader_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:50366
I20260709 13:02:55.148386 14245 raft_consensus.cc:606] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 LEADER]: Received request to transfer leadership to TS b716dd732b0e4f75801634fa3345caed
I20260709 13:02:55.150337 14245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19"
dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
mode: GRACEFUL
new_leader_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:50366
I20260709 13:02:55.150681 14245 raft_consensus.cc:606] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Received request to transfer leadership to TS b716dd732b0e4f75801634fa3345caed
I20260709 13:02:55.151575 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:55.151932 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:55.161904 14500 raft_consensus.cc:993] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: : Instructing follower b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:55.162431 14498 raft_consensus.cc:1081] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 LEADER]: Signalling peer b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:55.163942 14319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:54340
I20260709 13:02:55.164330 14319 raft_consensus.cc:493] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.164583 14319 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:55.169106 14319 raft_consensus.cc:515] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.170678 14319 leader_election.cc:290] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 5 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:55.171681 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:55.171669 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d040bc2cb94d44159ef1408eee5473f4" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:55.172396 14245 raft_consensus.cc:3055] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:55.172425 14171 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:55.172708 14245 raft_consensus.cc:740] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:55.173460 14245 consensus_queue.cc:260] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.174290 14245 raft_consensus.cc:3060] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:55.177323 14171 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 5.
I20260709 13:02:55.178516 14245 raft_consensus.cc:2468] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 5.
I20260709 13:02:55.178592 14284 leader_election.cc:304] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:55.179438 14483 raft_consensus.cc:2804] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:55.180344 14483 raft_consensus.cc:697] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 5 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:55.181164 14483 consensus_queue.cc:237] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.187793 14066 catalog_manager.cc:5697] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 4 to 5, leader changed from 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2) to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 5 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.241967 14500 raft_consensus.cc:993] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: : Instructing follower 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:55.242403 14498 raft_consensus.cc:1081] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Signalling peer 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:55.243911 14171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0"
dest_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:37962
I20260709 13:02:55.244380 14171 raft_consensus.cc:493] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.244644 14171 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.248471 14171 raft_consensus.cc:515] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.249878 14171 leader_election.cc:290] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 4 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:55.250833 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:55.250970 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b77042a0a114cb393caafe5430976a0" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:55.251367 14245 raft_consensus.cc:3055] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:55.251504 14319 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.251716 14245 raft_consensus.cc:740] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:55.252463 14245 consensus_queue.cc:260] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.253252 14245 raft_consensus.cc:3060] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.255867 14319 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 4.
I20260709 13:02:55.257141 14136 leader_election.cc:304] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:55.257488 14245 raft_consensus.cc:2468] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 4.
I20260709 13:02:55.259107 14507 raft_consensus.cc:2804] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:55.260118 14507 raft_consensus.cc:697] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 4 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:55.260906 14507 consensus_queue.cc:237] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.267664 14066 catalog_manager.cc:5697] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 3 to 4, leader changed from 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2) to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.277869 14500 raft_consensus.cc:993] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36: : Instructing follower 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:55.278280 14500 raft_consensus.cc:1081] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Signalling peer 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:55.279692 14171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f"
dest_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:37962
I20260709 13:02:55.280117 14171 raft_consensus.cc:493] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.280365 14171 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.284240 14171 raft_consensus.cc:515] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.285585 14171 leader_election.cc:290] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 3 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:55.286338 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:55.286516 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cc8c700a45343308bb08aeff954690f" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:55.286784 14245 raft_consensus.cc:3055] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:55.287046 14319 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.287106 14245 raft_consensus.cc:740] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:55.287782 14245 consensus_queue.cc:260] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.288568 14245 raft_consensus.cc:3060] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.291244 14319 raft_consensus.cc:2468] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 3.
I20260709 13:02:55.292141 14136 leader_election.cc:304] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:55.292438 14245 raft_consensus.cc:2468] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 3.
I20260709 13:02:55.292941 14507 raft_consensus.cc:2804] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.293490 14507 raft_consensus.cc:697] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 3 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:55.294335 14507 consensus_queue.cc:237] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.300668 14066 catalog_manager.cc:5697] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 2 to 3, leader changed from 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2) to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.482915 14498 raft_consensus.cc:993] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36: : Instructing follower b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:55.483330 14500 raft_consensus.cc:1081] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Signalling peer b716dd732b0e4f75801634fa3345caed to start an election
I20260709 13:02:55.484550 14319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19"
dest_uuid: "b716dd732b0e4f75801634fa3345caed"
 from {username='slave'} at 127.0.0.1:54340
I20260709 13:02:55.485055 14319 raft_consensus.cc:493] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.485350 14319 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.489257 14319 raft_consensus.cc:515] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.490614 14319 leader_election.cc:290] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 4 election: Requested vote from peers 836a43194ee246fda621da9042c02947 (127.13.181.1:45357), 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917)
I20260709 13:02:55.491498 14171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "836a43194ee246fda621da9042c02947"
I20260709 13:02:55.491704 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5be2a359a1649bca8cb4e99b1936e19" candidate_uuid: "b716dd732b0e4f75801634fa3345caed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:55.491961 14171 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.492282 14245 raft_consensus.cc:3055] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:55.492519 14245 raft_consensus.cc:740] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:55.493050 14245 consensus_queue.cc:260] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.493803 14245 raft_consensus.cc:3060] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:55.496201 14171 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 4.
I20260709 13:02:55.497041 14284 leader_election.cc:304] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:55.497762 14483 raft_consensus.cc:2804] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:55.498247 14483 raft_consensus.cc:697] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 4 LEADER]: Becoming Leader. State: Replica: b716dd732b0e4f75801634fa3345caed, State: Running, Role: LEADER
I20260709 13:02:55.498348 14245 raft_consensus.cc:2468] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b716dd732b0e4f75801634fa3345caed in term 4.
I20260709 13:02:55.498963 14483 consensus_queue.cc:237] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.506522 14066 catalog_manager.cc:5697] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed reported cstate change: term changed from 3 to 4, leader changed from 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2) to b716dd732b0e4f75801634fa3345caed (127.13.181.3). New cstate: current_term: 4 leader_uuid: "b716dd732b0e4f75801634fa3345caed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.626825 14171 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 5 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:55.628000 14483 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:55.638039 14245 raft_consensus.cc:1275] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 5 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:02:55.640403 14514 consensus_queue.cc:1048] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:55.689477 14498 raft_consensus.cc:993] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36: : Instructing follower 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:55.689939 14500 raft_consensus.cc:1081] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Signalling peer 836a43194ee246fda621da9042c02947 to start an election
I20260709 13:02:55.691262 14171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8550ec10194747499535e97718d07fa7"
dest_uuid: "836a43194ee246fda621da9042c02947"
 from {username='slave'} at 127.0.0.1:37962
I20260709 13:02:55.691738 14171 raft_consensus.cc:493] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.692065 14171 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.696357 14171 raft_consensus.cc:515] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.697886 14171 leader_election.cc:290] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 3 election: Requested vote from peers 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917), b716dd732b0e4f75801634fa3345caed (127.13.181.3:46223)
I20260709 13:02:55.698578 14245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2441e587bc404ae2a6ecfcea07ac2f36"
I20260709 13:02:55.698856 14319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8550ec10194747499535e97718d07fa7" candidate_uuid: "836a43194ee246fda621da9042c02947" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b716dd732b0e4f75801634fa3345caed"
I20260709 13:02:55.699188 14245 raft_consensus.cc:3055] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:55.699422 14319 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.699564 14245 raft_consensus.cc:740] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2441e587bc404ae2a6ecfcea07ac2f36, State: Running, Role: LEADER
I20260709 13:02:55.700399 14245 consensus_queue.cc:260] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.701275 14245 raft_consensus.cc:3060] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.703655 14319 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 3.
I20260709 13:02:55.704535 14136 leader_election.cc:304] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 836a43194ee246fda621da9042c02947, b716dd732b0e4f75801634fa3345caed; no voters: 
I20260709 13:02:55.705194 14507 raft_consensus.cc:2804] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.705679 14507 raft_consensus.cc:697] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 3 LEADER]: Becoming Leader. State: Replica: 836a43194ee246fda621da9042c02947, State: Running, Role: LEADER
I20260709 13:02:55.706259 14319 raft_consensus.cc:1275] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:55.706696 14245 raft_consensus.cc:2468] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 836a43194ee246fda621da9042c02947 in term 3.
I20260709 13:02:55.706609 14507 consensus_queue.cc:237] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } }
I20260709 13:02:55.707479 14508 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:55.716334 14066 catalog_manager.cc:5697] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 reported cstate change: term changed from 2 to 3, leader changed from 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2) to 836a43194ee246fda621da9042c02947 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "836a43194ee246fda621da9042c02947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:55.720135 14245 raft_consensus.cc:1275] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:55.721927 14246 raft_consensus.cc:1275] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.721863 14520 consensus_queue.cc:1048] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:55.723704 14507 consensus_queue.cc:1048] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.739427 14319 raft_consensus.cc:1275] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.741024 14508 consensus_queue.cc:1048] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.075482 14246 raft_consensus.cc:1275] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:56.076764 14514 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.084434 14171 raft_consensus.cc:1275] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Refusing update from remote peer b716dd732b0e4f75801634fa3345caed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:56.087173 14483 consensus_queue.cc:1048] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [LEADER]: Connected to new peer: Peer: permanent_uuid: "836a43194ee246fda621da9042c02947" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:56.151733 14246 raft_consensus.cc:1275] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.152844 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:56.153182 14523 consensus_queue.cc:1048] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2441e587bc404ae2a6ecfcea07ac2f36" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 34917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:56.160537 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
I20260709 13:02:56.166815 14319 raft_consensus.cc:1275] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Refusing update from remote peer 836a43194ee246fda621da9042c02947: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:56.168707 14523 consensus_queue.cc:1048] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b716dd732b0e4f75801634fa3345caed" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.204716 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:56.205528 14036 tablet_replica.cc:333] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.206199 14036 raft_consensus.cc:2243] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.206713 14036 raft_consensus.cc:2272] T 40053ff3405844498a54827a2a5a3f43 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.208875 14036 tablet_replica.cc:333] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.209394 14036 raft_consensus.cc:2243] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.209818 14036 raft_consensus.cc:2272] T d303e866ada741989732053cd89bb0cb P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.211412 14036 tablet_replica.cc:333] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.211867 14036 raft_consensus.cc:2243] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.212236 14036 raft_consensus.cc:2272] T efa4b320978c4ed68a8f05ef506a0654 P 836a43194ee246fda621da9042c02947 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.213691 14036 tablet_replica.cc:333] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.214152 14036 raft_consensus.cc:2243] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.214871 14036 raft_consensus.cc:2272] T 8550ec10194747499535e97718d07fa7 P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.216943 14036 tablet_replica.cc:333] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.217403 14036 raft_consensus.cc:2243] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.218061 14036 raft_consensus.cc:2272] T 4b77042a0a114cb393caafe5430976a0 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.220935 14036 tablet_replica.cc:333] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.221393 14036 raft_consensus.cc:2243] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.221801 14036 raft_consensus.cc:2272] T d5be2a359a1649bca8cb4e99b1936e19 P 836a43194ee246fda621da9042c02947 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.223661 14036 tablet_replica.cc:333] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.224108 14036 raft_consensus.cc:2243] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.224463 14036 raft_consensus.cc:2272] T f74867cb4141438a915c2484406a6556 P 836a43194ee246fda621da9042c02947 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.226032 14036 tablet_replica.cc:333] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.226492 14036 raft_consensus.cc:2243] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.226886 14036 raft_consensus.cc:2272] T d040bc2cb94d44159ef1408eee5473f4 P 836a43194ee246fda621da9042c02947 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.229211 14036 tablet_replica.cc:333] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947: stopping tablet replica
I20260709 13:02:56.229631 14036 raft_consensus.cc:2243] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.230312 14036 raft_consensus.cc:2272] T 3cc8c700a45343308bb08aeff954690f P 836a43194ee246fda621da9042c02947 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.322012 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
I20260709 13:02:56.341542 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
W20260709 13:02:56.341981 14210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45357: connect: Connection refused (error 111)
W20260709 13:02:56.347018 14210 consensus_peers.cc:597] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 -> Peer 836a43194ee246fda621da9042c02947 (127.13.181.1:45357): Couldn't send request to peer 836a43194ee246fda621da9042c02947. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.366685 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:56.367399 14036 tablet_replica.cc:333] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.367976 14036 raft_consensus.cc:2243] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.368417 14036 raft_consensus.cc:2272] T f74867cb4141438a915c2484406a6556 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.370133 14036 tablet_replica.cc:333] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.370621 14036 raft_consensus.cc:2243] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.371001 14036 raft_consensus.cc:2272] T 4b77042a0a114cb393caafe5430976a0 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.373047 14036 tablet_replica.cc:333] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.373546 14036 raft_consensus.cc:2243] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.373915 14036 raft_consensus.cc:2272] T d5be2a359a1649bca8cb4e99b1936e19 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.375892 14036 tablet_replica.cc:333] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.376379 14036 raft_consensus.cc:2243] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.377103 14036 raft_consensus.cc:2272] T efa4b320978c4ed68a8f05ef506a0654 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.378592 14036 tablet_replica.cc:333] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.379130 14036 raft_consensus.cc:2243] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.379491 14036 raft_consensus.cc:2272] T 8550ec10194747499535e97718d07fa7 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.381358 14036 tablet_replica.cc:333] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.381812 14036 raft_consensus.cc:2243] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.382491 14036 raft_consensus.cc:2272] T 40053ff3405844498a54827a2a5a3f43 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.384104 14036 tablet_replica.cc:333] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.384546 14036 raft_consensus.cc:2243] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.384912 14036 raft_consensus.cc:2272] T 3cc8c700a45343308bb08aeff954690f P 2441e587bc404ae2a6ecfcea07ac2f36 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.386747 14036 tablet_replica.cc:333] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.387228 14036 raft_consensus.cc:2243] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.387609 14036 raft_consensus.cc:2272] T d040bc2cb94d44159ef1408eee5473f4 P 2441e587bc404ae2a6ecfcea07ac2f36 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.389585 14036 tablet_replica.cc:333] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36: stopping tablet replica
I20260709 13:02:56.390013 14036 raft_consensus.cc:2243] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.390749 14036 raft_consensus.cc:2272] T d303e866ada741989732053cd89bb0cb P 2441e587bc404ae2a6ecfcea07ac2f36 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:56.397857 14284 consensus_peers.cc:597] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed -> Peer 836a43194ee246fda621da9042c02947 (127.13.181.1:45357): Couldn't send request to peer 836a43194ee246fda621da9042c02947. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45357: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.418138 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
W20260709 13:02:56.425895 14284 consensus_peers.cc:597] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed -> Peer 2441e587bc404ae2a6ecfcea07ac2f36 (127.13.181.2:34917): Couldn't send request to peer 2441e587bc404ae2a6ecfcea07ac2f36. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:34917: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:56.435765 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
I20260709 13:02:56.458683 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:56.459362 14036 tablet_replica.cc:333] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.459908 14036 raft_consensus.cc:2243] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.460354 14036 raft_consensus.cc:2272] T d303e866ada741989732053cd89bb0cb P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.462144 14036 tablet_replica.cc:333] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.462580 14036 raft_consensus.cc:2243] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.463341 14036 raft_consensus.cc:2272] T f74867cb4141438a915c2484406a6556 P b716dd732b0e4f75801634fa3345caed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.464855 14036 tablet_replica.cc:333] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.465288 14036 raft_consensus.cc:2243] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.465862 14036 raft_consensus.cc:2272] T d040bc2cb94d44159ef1408eee5473f4 P b716dd732b0e4f75801634fa3345caed [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.467875 14036 tablet_replica.cc:333] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.468302 14036 raft_consensus.cc:2243] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.468649 14036 raft_consensus.cc:2272] T 3cc8c700a45343308bb08aeff954690f P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.470391 14036 tablet_replica.cc:333] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.470813 14036 raft_consensus.cc:2243] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.471210 14036 raft_consensus.cc:2272] T efa4b320978c4ed68a8f05ef506a0654 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.472637 14036 tablet_replica.cc:333] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.473026 14036 raft_consensus.cc:2243] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.473369 14036 raft_consensus.cc:2272] T 8550ec10194747499535e97718d07fa7 P b716dd732b0e4f75801634fa3345caed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.475091 14036 tablet_replica.cc:333] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.475497 14036 raft_consensus.cc:2243] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.475839 14036 raft_consensus.cc:2272] T 4b77042a0a114cb393caafe5430976a0 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.477507 14036 tablet_replica.cc:333] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.477903 14036 raft_consensus.cc:2243] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.478513 14036 raft_consensus.cc:2272] T d5be2a359a1649bca8cb4e99b1936e19 P b716dd732b0e4f75801634fa3345caed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.480269 14036 tablet_replica.cc:333] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed: stopping tablet replica
I20260709 13:02:56.480636 14036 raft_consensus.cc:2243] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:56.480955 14036 raft_consensus.cc:2272] T 40053ff3405844498a54827a2a5a3f43 P b716dd732b0e4f75801634fa3345caed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.505507 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
I20260709 13:02:56.520866 14036 master.cc:562] Master@127.13.181.62:35593 shutting down...
I20260709 13:02:56.567509 14123 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:02:56.732797 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:56.733367 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:56.733639 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 25efc7dac02245b28da00216a963f930: stopping tablet replica
I20260709 13:02:56.753562 14036 master.cc:584] Master@127.13.181.62:35593 shutdown complete.
2441e587bc404ae2a6ecfcea07ac2f36  4
836a43194ee246fda621da9042c02947  4
b716dd732b0e4f75801634fa3345caed  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12585 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:02:56.793555 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:33541
I20260709 13:02:56.794670 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:56.800513 14534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:56.800642 14535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:56.801328 14537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:56.802495 14036 server_base.cc:1061] running on GCE node
I20260709 13:02:56.803439 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:56.803658 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:56.803823 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602176803805 us; error 0 us; skew 500 ppm
I20260709 13:02:56.804339 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:56.806646 14036 webserver.cc:533] Webserver started at http://127.13.181.62:43615/ using document root <none> and password file <none>
I20260709 13:02:56.807425 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:56.807631 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:56.807928 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:56.809281 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "e49d31e6ea9a4a9b87d2633752b22996"
format_stamp: "Formatted at 2026-07-09 13:02:56 on dist-test-slave-28ks"
I20260709 13:02:56.813599 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:02:56.816922 14542 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:56.817731 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:56.818076 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "e49d31e6ea9a4a9b87d2633752b22996"
format_stamp: "Formatted at 2026-07-09 13:02:56 on dist-test-slave-28ks"
I20260709 13:02:56.818320 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:56.836901 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:56.838057 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:56.874182 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:33541
I20260709 13:02:56.874275 14593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:33541 every 8 connection(s)
I20260709 13:02:56.878319 14594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:56.887260 14594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996: Bootstrap starting.
I20260709 13:02:56.891736 14594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:56.895710 14594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996: No bootstrap required, opened a new log
I20260709 13:02:56.897684 14594 raft_consensus.cc:359] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49d31e6ea9a4a9b87d2633752b22996" member_type: VOTER }
I20260709 13:02:56.898075 14594 raft_consensus.cc:385] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:56.898250 14594 raft_consensus.cc:740] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49d31e6ea9a4a9b87d2633752b22996, State: Initialized, Role: FOLLOWER
I20260709 13:02:56.898708 14594 consensus_queue.cc:260] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49d31e6ea9a4a9b87d2633752b22996" member_type: VOTER }
I20260709 13:02:56.899179 14594 raft_consensus.cc:399] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:56.899464 14594 raft_consensus.cc:493] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:56.899821 14594 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:56.903949 14594 raft_consensus.cc:515] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49d31e6ea9a4a9b87d2633752b22996" member_type: VOTER }
I20260709 13:02:56.904467 14594 leader_election.cc:304] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e49d31e6ea9a4a9b87d2633752b22996; no voters: 
I20260709 13:02:56.905603 14594 leader_election.cc:290] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:56.906004 14597 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:56.907307 14597 raft_consensus.cc:697] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 1 LEADER]: Becoming Leader. State: Replica: e49d31e6ea9a4a9b87d2633752b22996, State: Running, Role: LEADER
I20260709 13:02:56.907979 14597 consensus_queue.cc:237] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49d31e6ea9a4a9b87d2633752b22996" member_type: VOTER }
I20260709 13:02:56.908504 14594 sys_catalog.cc:565] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:56.912333 14598 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e49d31e6ea9a4a9b87d2633752b22996" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49d31e6ea9a4a9b87d2633752b22996" member_type: VOTER } }
I20260709 13:02:56.912791 14599 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e49d31e6ea9a4a9b87d2633752b22996. Latest consensus state: current_term: 1 leader_uuid: "e49d31e6ea9a4a9b87d2633752b22996" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49d31e6ea9a4a9b87d2633752b22996" member_type: VOTER } }
I20260709 13:02:56.913173 14598 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:56.913547 14599 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:56.918891 14604 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:56.924494 14604 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:56.925594 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:56.933143 14604 catalog_manager.cc:1383] Generated new cluster ID: 380f5b894f954b9fb69ccb7e5c2983f2
I20260709 13:02:56.933454 14604 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:56.956874 14604 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:56.958120 14604 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:56.971657 14604 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996: Generated new TSK 0
I20260709 13:02:56.972291 14604 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:56.992460 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:56.998400 14615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:56.999485 14616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:57.001536 14618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:57.001767 14036 server_base.cc:1061] running on GCE node
I20260709 13:02:57.002592 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:57.002810 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:57.002940 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602177002929 us; error 0 us; skew 500 ppm
I20260709 13:02:57.003449 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:57.005573 14036 webserver.cc:533] Webserver started at http://127.13.181.1:39541/ using document root <none> and password file <none>
I20260709 13:02:57.006011 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:57.006162 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:57.006366 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:57.007402 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "727207cc1acf46328d17331555d87be8"
format_stamp: "Formatted at 2026-07-09 13:02:57 on dist-test-slave-28ks"
I20260709 13:02:57.012003 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:02:57.015343 14623 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.016141 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:57.016454 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "727207cc1acf46328d17331555d87be8"
format_stamp: "Formatted at 2026-07-09 13:02:57 on dist-test-slave-28ks"
I20260709 13:02:57.016770 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:57.034950 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:57.036612 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:57.038739 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:57.041194 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:57.041369 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.041550 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:57.041687 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.080093 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:46063
I20260709 13:02:57.080181 14685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:46063 every 8 connection(s)
I20260709 13:02:57.084933 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:57.093101 14690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:57.093312 14691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:57.096335 14036 server_base.cc:1061] running on GCE node
W20260709 13:02:57.097141 14694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:57.098013 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:57.098269 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:57.098479 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602177098461 us; error 0 us; skew 500 ppm
I20260709 13:02:57.099145 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:57.101598 14686 heartbeater.cc:344] Connected to a master server at 127.13.181.62:33541
I20260709 13:02:57.102029 14686 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:57.102088 14036 webserver.cc:533] Webserver started at http://127.13.181.2:45183/ using document root <none> and password file <none>
I20260709 13:02:57.102747 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:57.102989 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:57.102938 14686 heartbeater.cc:507] Master 127.13.181.62:33541 requested a full tablet report, sending...
I20260709 13:02:57.103433 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:57.104847 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
format_stamp: "Formatted at 2026-07-09 13:02:57 on dist-test-slave-28ks"
I20260709 13:02:57.105298 14559 ts_manager.cc:194] Registered new tserver with Master: 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:02:57.107019 14559 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42082
I20260709 13:02:57.110154 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:57.113513 14698 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.114305 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:02:57.114642 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
format_stamp: "Formatted at 2026-07-09 13:02:57 on dist-test-slave-28ks"
I20260709 13:02:57.114961 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:57.124678 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:57.125864 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:57.127380 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:57.129559 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:57.129738 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.130057 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:57.130199 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.168953 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:35567
I20260709 13:02:57.169054 14760 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:35567 every 8 connection(s)
I20260709 13:02:57.173470 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:57.181385 14764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:57.182706 14765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:57.185809 14767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:57.186282 14036 server_base.cc:1061] running on GCE node
I20260709 13:02:57.186789 14761 heartbeater.cc:344] Connected to a master server at 127.13.181.62:33541
I20260709 13:02:57.187209 14761 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:57.187353 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:57.187621 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:57.187821 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602177187800 us; error 0 us; skew 500 ppm
I20260709 13:02:57.188053 14761 heartbeater.cc:507] Master 127.13.181.62:33541 requested a full tablet report, sending...
I20260709 13:02:57.188602 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:57.190407 14559 ts_manager.cc:194] Registered new tserver with Master: 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:57.191459 14036 webserver.cc:533] Webserver started at http://127.13.181.3:43793/ using document root <none> and password file <none>
I20260709 13:02:57.192080 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:57.192224 14559 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42094
I20260709 13:02:57.192322 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:57.192754 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:57.194173 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "fc7e35df5c8f4668a17e400068b33ea8"
format_stamp: "Formatted at 2026-07-09 13:02:57 on dist-test-slave-28ks"
I20260709 13:02:57.198628 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:02:57.201717 14772 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.202459 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:57.202770 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "fc7e35df5c8f4668a17e400068b33ea8"
format_stamp: "Formatted at 2026-07-09 13:02:57 on dist-test-slave-28ks"
I20260709 13:02:57.203092 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:57.219620 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:57.221002 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:57.222411 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:57.224575 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:57.224821 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.225072 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:57.225246 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:57.265347 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:36883
I20260709 13:02:57.265463 14834 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:36883 every 8 connection(s)
I20260709 13:02:57.279557 14835 heartbeater.cc:344] Connected to a master server at 127.13.181.62:33541
I20260709 13:02:57.279924 14835 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:57.280625 14835 heartbeater.cc:507] Master 127.13.181.62:33541 requested a full tablet report, sending...
I20260709 13:02:57.282487 14559 ts_manager.cc:194] Registered new tserver with Master: fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:57.283066 14036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014528488s
I20260709 13:02:57.284127 14559 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42104
I20260709 13:02:57.307551 14559 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42120:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:57.310271 14559 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:57.376092 14799 tablet_service.cc:1511] Processing CreateTablet for tablet b10d8d4dacb243e7aaac381da834268a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:57.376269 14800 tablet_service.cc:1511] Processing CreateTablet for tablet 22b2f0531fd6461f978b176760c2d5f3 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:57.377611 14799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10d8d4dacb243e7aaac381da834268a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.378294 14800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b2f0531fd6461f978b176760c2d5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.388705 14798 tablet_service.cc:1511] Processing CreateTablet for tablet 34bdee2f5b594fae8d75a5e5974d486a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:57.390167 14798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bdee2f5b594fae8d75a5e5974d486a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.392059 14797 tablet_service.cc:1511] Processing CreateTablet for tablet cec534d1933d4914968d52565b76ebd0 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:57.393617 14797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cec534d1933d4914968d52565b76ebd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.395143 14726 tablet_service.cc:1511] Processing CreateTablet for tablet 22b2f0531fd6461f978b176760c2d5f3 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:57.396448 14726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b2f0531fd6461f978b176760c2d5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.396656 14723 tablet_service.cc:1511] Processing CreateTablet for tablet cec534d1933d4914968d52565b76ebd0 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:57.397948 14723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cec534d1933d4914968d52565b76ebd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.400274 14725 tablet_service.cc:1511] Processing CreateTablet for tablet b10d8d4dacb243e7aaac381da834268a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:57.400391 14796 tablet_service.cc:1511] Processing CreateTablet for tablet 10d37a06e3914f13ab14f4657b95083a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:57.401618 14725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10d8d4dacb243e7aaac381da834268a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.401753 14796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d37a06e3914f13ab14f4657b95083a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.404616 14724 tablet_service.cc:1511] Processing CreateTablet for tablet 34bdee2f5b594fae8d75a5e5974d486a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:57.405395 14722 tablet_service.cc:1511] Processing CreateTablet for tablet 10d37a06e3914f13ab14f4657b95083a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:57.405966 14724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bdee2f5b594fae8d75a5e5974d486a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.406688 14722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d37a06e3914f13ab14f4657b95083a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.413277 14651 tablet_service.cc:1511] Processing CreateTablet for tablet 22b2f0531fd6461f978b176760c2d5f3 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:57.414002 14649 tablet_service.cc:1511] Processing CreateTablet for tablet 34bdee2f5b594fae8d75a5e5974d486a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:57.417657 14650 tablet_service.cc:1511] Processing CreateTablet for tablet b10d8d4dacb243e7aaac381da834268a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:57.419685 14648 tablet_service.cc:1511] Processing CreateTablet for tablet cec534d1933d4914968d52565b76ebd0 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:57.421288 14651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b2f0531fd6461f978b176760c2d5f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.415853 14647 tablet_service.cc:1511] Processing CreateTablet for tablet 10d37a06e3914f13ab14f4657b95083a (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:57.435537 14649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bdee2f5b594fae8d75a5e5974d486a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.438174 14650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b10d8d4dacb243e7aaac381da834268a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.439980 14648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cec534d1933d4914968d52565b76ebd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.443001 14647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10d37a06e3914f13ab14f4657b95083a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.449829 14646 tablet_service.cc:1511] Processing CreateTablet for tablet 16ec387a07c1438b8a6c177a6e5c3aeb (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:57.451987 14721 tablet_service.cc:1511] Processing CreateTablet for tablet 16ec387a07c1438b8a6c177a6e5c3aeb (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:57.453341 14721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ec387a07c1438b8a6c177a6e5c3aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.459357 14646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ec387a07c1438b8a6c177a6e5c3aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.484023 14800 tablet_service.cc:1511] Processing CreateTablet for tablet 16ec387a07c1438b8a6c177a6e5c3aeb (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:57.485463 14800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ec387a07c1438b8a6c177a6e5c3aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.490295 14850 tablet_bootstrap.cc:492] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.507941 14851 tablet_bootstrap.cc:492] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:57.516659 14851 tablet_bootstrap.cc:654] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.519848 14650 tablet_service.cc:1511] Processing CreateTablet for tablet 036fec1d1a2344eeba7c85222c530396 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:57.521540 14650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036fec1d1a2344eeba7c85222c530396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.528127 14724 tablet_service.cc:1511] Processing CreateTablet for tablet 036fec1d1a2344eeba7c85222c530396 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:57.529366 14724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036fec1d1a2344eeba7c85222c530396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.536295 14723 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6ccbeef5ba40d2b49bc2734d90f3a4 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:57.537541 14723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6ccbeef5ba40d2b49bc2734d90f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.538280 14651 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6ccbeef5ba40d2b49bc2734d90f3a4 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:57.539505 14651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6ccbeef5ba40d2b49bc2734d90f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.540354 14647 tablet_service.cc:1511] Processing CreateTablet for tablet 7e858d3dc3ef491ab3ea354a4791fb1d (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:57.541530 14647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e858d3dc3ef491ab3ea354a4791fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.546146 14726 tablet_service.cc:1511] Processing CreateTablet for tablet 7e858d3dc3ef491ab3ea354a4791fb1d (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:57.550778 14796 tablet_service.cc:1511] Processing CreateTablet for tablet 7e858d3dc3ef491ab3ea354a4791fb1d (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:57.552103 14796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e858d3dc3ef491ab3ea354a4791fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.551980 14800 tablet_service.cc:1511] Processing CreateTablet for tablet 036fec1d1a2344eeba7c85222c530396 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:57.553911 14726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e858d3dc3ef491ab3ea354a4791fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.554123 14800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 036fec1d1a2344eeba7c85222c530396. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.558902 14797 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6ccbeef5ba40d2b49bc2734d90f3a4 (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:57.553874 14649 tablet_service.cc:1511] Processing CreateTablet for tablet 39ba54e2af004ab1892ecfbd57ef98ee (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:57.561082 14797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6ccbeef5ba40d2b49bc2734d90f3a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.561677 14649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ba54e2af004ab1892ecfbd57ef98ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.564188 14722 tablet_service.cc:1511] Processing CreateTablet for tablet 39ba54e2af004ab1892ecfbd57ef98ee (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:57.565402 14722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ba54e2af004ab1892ecfbd57ef98ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.565423 14850 tablet_bootstrap.cc:654] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.578310 14798 tablet_service.cc:1511] Processing CreateTablet for tablet 39ba54e2af004ab1892ecfbd57ef98ee (DEFAULT_TABLE table=test-workload [id=a208fa49f4ae4bd6bb68e78d6c80df15]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:57.579636 14798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ba54e2af004ab1892ecfbd57ef98ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.596886 14851 tablet_bootstrap.cc:492] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:57.597388 14851 ts_tablet_manager.cc:1403] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.024s
I20260709 13:02:57.599051 14852 tablet_bootstrap.cc:492] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:57.600170 14851 raft_consensus.cc:359] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.603000 14851 raft_consensus.cc:385] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.603695 14851 raft_consensus.cc:740] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.604569 14851 consensus_queue.cc:260] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.609699 14852 tablet_bootstrap.cc:654] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.615483 14850 tablet_bootstrap.cc:492] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.615939 14850 ts_tablet_manager.cc:1403] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.126s	user 0.020s	sys 0.005s
I20260709 13:02:57.618988 14850 raft_consensus.cc:359] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.620803 14850 raft_consensus.cc:385] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.621097 14850 raft_consensus.cc:740] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.621548 14761 heartbeater.cc:499] Master 127.13.181.62:33541 was elected leader, sending a full tablet report...
I20260709 13:02:57.621819 14850 consensus_queue.cc:260] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.624411 14852 tablet_bootstrap.cc:492] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:57.624876 14852 ts_tablet_manager.cc:1403] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 13:02:57.625772 14851 ts_tablet_manager.cc:1434] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.015s
I20260709 13:02:57.626670 14851 tablet_bootstrap.cc:492] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:57.627640 14852 raft_consensus.cc:359] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.628310 14852 raft_consensus.cc:385] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.628609 14852 raft_consensus.cc:740] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.629310 14852 consensus_queue.cc:260] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.632977 14851 tablet_bootstrap.cc:654] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.635934 14835 heartbeater.cc:499] Master 127.13.181.62:33541 was elected leader, sending a full tablet report...
I20260709 13:02:57.636503 14850 ts_tablet_manager.cc:1434] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.004s
I20260709 13:02:57.637439 14850 tablet_bootstrap.cc:492] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.643838 14850 tablet_bootstrap.cc:654] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.647595 14686 heartbeater.cc:499] Master 127.13.181.62:33541 was elected leader, sending a full tablet report...
I20260709 13:02:57.650983 14852 ts_tablet_manager.cc:1434] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.002s
I20260709 13:02:57.651945 14852 tablet_bootstrap.cc:492] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:57.657240 14850 tablet_bootstrap.cc:492] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.657394 14852 tablet_bootstrap.cc:654] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.657744 14850 ts_tablet_manager.cc:1403] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:02:57.660699 14850 raft_consensus.cc:359] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.661444 14850 raft_consensus.cc:385] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.661739 14850 raft_consensus.cc:740] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.662439 14850 consensus_queue.cc:260] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.664788 14850 ts_tablet_manager.cc:1434] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:57.665742 14850 tablet_bootstrap.cc:492] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.669596 14852 tablet_bootstrap.cc:492] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:57.670192 14852 ts_tablet_manager.cc:1403] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:02:57.672160 14850 tablet_bootstrap.cc:654] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.674932 14852 raft_consensus.cc:359] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.675899 14852 raft_consensus.cc:385] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.676262 14852 raft_consensus.cc:740] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.677314 14852 consensus_queue.cc:260] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.682117 14852 ts_tablet_manager.cc:1434] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:02:57.683321 14852 tablet_bootstrap.cc:492] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:57.691993 14852 tablet_bootstrap.cc:654] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.693683 14851 tablet_bootstrap.cc:492] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:57.694317 14851 ts_tablet_manager.cc:1403] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.068s	user 0.027s	sys 0.030s
I20260709 13:02:57.698051 14851 raft_consensus.cc:359] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.698983 14851 raft_consensus.cc:385] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.699368 14851 raft_consensus.cc:740] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.700294 14851 consensus_queue.cc:260] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.703141 14851 ts_tablet_manager.cc:1434] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.005s
I20260709 13:02:57.704592 14851 tablet_bootstrap.cc:492] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:57.705466 14852 tablet_bootstrap.cc:492] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:57.705996 14852 ts_tablet_manager.cc:1403] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:02:57.709131 14852 raft_consensus.cc:359] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.709637 14851 tablet_bootstrap.cc:654] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.710816 14852 raft_consensus.cc:385] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.711318 14852 raft_consensus.cc:740] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.712366 14850 tablet_bootstrap.cc:492] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.712952 14850 ts_tablet_manager.cc:1403] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.047s	user 0.027s	sys 0.012s
I20260709 13:02:57.712303 14852 consensus_queue.cc:260] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.716001 14850 raft_consensus.cc:359] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.716698 14850 raft_consensus.cc:385] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.717031 14850 raft_consensus.cc:740] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.717788 14850 consensus_queue.cc:260] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.720477 14850 ts_tablet_manager.cc:1434] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:02:57.721486 14850 tablet_bootstrap.cc:492] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.723516 14852 ts_tablet_manager.cc:1434] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 13:02:57.728688 14850 tablet_bootstrap.cc:654] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.734059 14850 tablet_bootstrap.cc:492] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.734030 14852 tablet_bootstrap.cc:492] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:57.734896 14850 ts_tablet_manager.cc:1403] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:02:57.737053 14851 tablet_bootstrap.cc:492] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:57.737622 14851 ts_tablet_manager.cc:1403] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.022s
I20260709 13:02:57.737466 14850 raft_consensus.cc:359] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.738224 14850 raft_consensus.cc:385] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.738555 14850 raft_consensus.cc:740] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.739266 14850 consensus_queue.cc:260] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.741216 14850 ts_tablet_manager.cc:1434] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:02:57.741091 14851 raft_consensus.cc:359] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.741894 14852 tablet_bootstrap.cc:654] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.741912 14851 raft_consensus.cc:385] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.742202 14850 tablet_bootstrap.cc:492] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.742399 14851 raft_consensus.cc:740] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.743436 14851 consensus_queue.cc:260] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.748875 14850 tablet_bootstrap.cc:654] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.749229 14851 ts_tablet_manager.cc:1434] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:02:57.750263 14851 tablet_bootstrap.cc:492] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:57.758148 14852 tablet_bootstrap.cc:492] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:57.758672 14852 ts_tablet_manager.cc:1403] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.010s
I20260709 13:02:57.761140 14851 tablet_bootstrap.cc:654] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.761027 14852 raft_consensus.cc:359] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.761722 14852 raft_consensus.cc:385] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.762225 14852 raft_consensus.cc:740] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.763080 14852 consensus_queue.cc:260] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.764515 14850 tablet_bootstrap.cc:492] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.764994 14850 ts_tablet_manager.cc:1403] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.008s
I20260709 13:02:57.765390 14852 ts_tablet_manager.cc:1434] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:02:57.766414 14852 tablet_bootstrap.cc:492] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:57.768092 14850 raft_consensus.cc:359] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.768939 14850 raft_consensus.cc:385] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.769239 14850 raft_consensus.cc:740] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.769905 14850 consensus_queue.cc:260] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.774665 14852 tablet_bootstrap.cc:654] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.779465 14850 ts_tablet_manager.cc:1434] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:02:57.780516 14850 tablet_bootstrap.cc:492] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.780733 14851 tablet_bootstrap.cc:492] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:57.781212 14851 ts_tablet_manager.cc:1403] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.007s
I20260709 13:02:57.781306 14852 tablet_bootstrap.cc:492] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:57.781924 14852 ts_tablet_manager.cc:1403] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:02:57.784178 14851 raft_consensus.cc:359] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.785105 14851 raft_consensus.cc:385] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.785537 14851 raft_consensus.cc:740] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.785229 14852 raft_consensus.cc:359] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.786419 14851 consensus_queue.cc:260] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.786296 14852 raft_consensus.cc:385] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.787870 14850 tablet_bootstrap.cc:654] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.787817 14852 raft_consensus.cc:740] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.788823 14852 consensus_queue.cc:260] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.790351 14851 ts_tablet_manager.cc:1434] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:57.791373 14851 tablet_bootstrap.cc:492] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:57.794363 14852 ts_tablet_manager.cc:1434] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:02:57.795925 14852 tablet_bootstrap.cc:492] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:57.797855 14851 tablet_bootstrap.cc:654] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.799800 14850 tablet_bootstrap.cc:492] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.800971 14850 ts_tablet_manager.cc:1403] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:02:57.803161 14850 raft_consensus.cc:359] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.803825 14852 tablet_bootstrap.cc:654] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.803846 14850 raft_consensus.cc:385] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.806049 14850 raft_consensus.cc:740] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.806847 14850 consensus_queue.cc:260] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.808404 14851 tablet_bootstrap.cc:492] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:57.811024 14851 ts_tablet_manager.cc:1403] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.010s
I20260709 13:02:57.814610 14850 ts_tablet_manager.cc:1434] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:02:57.814493 14851 raft_consensus.cc:359] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.815392 14852 tablet_bootstrap.cc:492] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:57.815339 14851 raft_consensus.cc:385] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.815605 14850 tablet_bootstrap.cc:492] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.815801 14851 raft_consensus.cc:740] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.815965 14852 ts_tablet_manager.cc:1403] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:02:57.816694 14851 consensus_queue.cc:260] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.819301 14851 ts_tablet_manager.cc:1434] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:57.819463 14852 raft_consensus.cc:359] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.820230 14852 raft_consensus.cc:385] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.820433 14851 tablet_bootstrap.cc:492] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:57.820559 14852 raft_consensus.cc:740] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.821503 14852 consensus_queue.cc:260] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.822240 14850 tablet_bootstrap.cc:654] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.826582 14852 ts_tablet_manager.cc:1434] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:57.827684 14852 tablet_bootstrap.cc:492] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:57.827929 14851 tablet_bootstrap.cc:654] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.828481 14858 raft_consensus.cc:493] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.828986 14858 raft_consensus.cc:515] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.833626 14857 raft_consensus.cc:493] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.834152 14857 raft_consensus.cc:515] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.839226 14858 leader_election.cc:290] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:57.840049 14858 raft_consensus.cc:493] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.841001 14858 raft_consensus.cc:515] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.844403 14858 leader_election.cc:290] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:57.850152 14857 leader_election.cc:290] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:57.858608 14852 tablet_bootstrap.cc:654] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.865782 14850 tablet_bootstrap.cc:492] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.866377 14850 ts_tablet_manager.cc:1403] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.020s
I20260709 13:02:57.869782 14850 raft_consensus.cc:359] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.870849 14850 raft_consensus.cc:385] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.871286 14850 raft_consensus.cc:740] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.872257 14850 consensus_queue.cc:260] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.875268 14850 ts_tablet_manager.cc:1434] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:57.876510 14850 tablet_bootstrap.cc:492] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.885157 14850 tablet_bootstrap.cc:654] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.897948 14850 tablet_bootstrap.cc:492] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:57.898461 14850 ts_tablet_manager.cc:1403] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:02:57.898555 14877 raft_consensus.cc:493] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.901314 14850 raft_consensus.cc:359] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.902223 14850 raft_consensus.cc:385] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:57.902544 14850 raft_consensus.cc:740] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:57.903395 14850 consensus_queue.cc:260] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.902310 14877 raft_consensus.cc:515] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.906396 14857 raft_consensus.cc:493] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.906889 14857 raft_consensus.cc:515] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.906916 14877 leader_election.cc:290] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:57.908975 14857 leader_election.cc:290] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:57.909272 14736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:57.910175 14850 ts_tablet_manager.cc:1434] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:02:57.910175 14736 raft_consensus.cc:2468] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
I20260709 13:02:57.911350 14850 tablet_bootstrap.cc:492] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:57.911388 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:57.912307 14735 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
I20260709 13:02:57.913710 14775 leader_election.cc:304] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:57.914806 14775 leader_election.cc:304] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:57.917310 14850 tablet_bootstrap.cc:654] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:57.917225 14883 raft_consensus.cc:2804] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:57.917699 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:57.918093 14883 raft_consensus.cc:493] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.918443 14734 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 0.
I20260709 13:02:57.919926 14857 raft_consensus.cc:2804] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:57.918813 14883 raft_consensus.cc:3060] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:57.920312 14857 raft_consensus.cc:493] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.920888 14857 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:57.921336 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
W20260709 13:02:57.925508 14607 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:57.928314 14857 raft_consensus.cc:515] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.929643 14810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:57.930610 14810 raft_consensus.cc:2468] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 0.
I20260709 13:02:57.931658 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:57.932719 14808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:57.936443 14857 leader_election.cc:290] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:57.949424 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:57.964599 14857 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.964685 14735 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:57.965418 14857 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.937052 14855 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.937367 14808 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 0.
I20260709 13:02:57.967625 14855 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:57.941041 14736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:57.939167 14627 leader_election.cc:304] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:57.972026 14877 raft_consensus.cc:2804] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:57.972493 14877 raft_consensus.cc:493] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.972896 14877 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:57.983176 14627 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:36883, user_credentials={real_user=slave}} blocked reactor thread for 44160.2us
I20260709 13:02:57.984375 14627 leader_election.cc:304] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:57.985471 14858 raft_consensus.cc:2804] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:57.985934 14858 raft_consensus.cc:493] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.986359 14858 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:57.991508 14852 tablet_bootstrap.cc:492] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:57.992213 14852 ts_tablet_manager.cc:1403] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.165s	user 0.025s	sys 0.030s
I20260709 13:02:57.996105 14858 raft_consensus.cc:515] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:57.937214 14809 raft_consensus.cc:2393] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 727207cc1acf46328d17331555d87be8 in current term 1: Already voted for candidate fc7e35df5c8f4668a17e400068b33ea8 in this term.
I20260709 13:02:58.002053 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.003509 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:57.982756 14877 raft_consensus.cc:515] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.004406 14660 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
I20260709 13:02:58.004925 14659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.011716 14659 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.013494 14736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:58.014081 14736 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
I20260709 13:02:58.015179 14775 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
W20260709 13:02:58.006074 14774 leader_election.cc:343] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.017609 14857 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:02:58.018285 14857 raft_consensus.cc:493] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.020699 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:02:58.021543 14809 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.024338 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.025139 14660 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
I20260709 13:02:58.025449 14659 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:02:58.022292 14808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:02:58.027292 14808 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.027550 14774 leader_election.cc:304] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.029349 14883 raft_consensus.cc:515] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.032773 14852 raft_consensus.cc:359] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.033740 14852 raft_consensus.cc:385] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.034118 14852 raft_consensus.cc:740] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
W20260709 13:02:58.004042 14626 leader_election.cc:343] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.035815 14887 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.036298 14887 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:58.037336 14850 tablet_bootstrap.cc:492] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
I20260709 13:02:58.037802 14850 ts_tablet_manager.cc:1403] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.127s	user 0.037s	sys 0.076s
I20260709 13:02:58.011740 14855 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883), 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:02:58.038504 14887 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.039389 14810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:58.040910 14810 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 0.
I20260709 13:02:58.042236 14627 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.009487 14851 tablet_bootstrap.cc:492] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:58.018814 14857 raft_consensus.cc:515] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.043790 14659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.037616 14626 leader_election.cc:304] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 727207cc1acf46328d17331555d87be8; no voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:02:58.043889 14850 raft_consensus.cc:359] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.044866 14857 leader_election.cc:290] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.045089 14850 raft_consensus.cc:385] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.045470 14850 raft_consensus.cc:740] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.045488 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.046422 14850 consensus_queue.cc:260] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.006786 14858 leader_election.cc:290] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.047969 14858 raft_consensus.cc:2804] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:58.047147 14774 leader_election.cc:343] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.044636 14851 ts_tablet_manager.cc:1403] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.225s	user 0.036s	sys 0.045s
I20260709 13:02:58.009234 14877 leader_election.cc:290] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.051476 14810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:58.051649 14877 raft_consensus.cc:2749] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.034953 14808 raft_consensus.cc:2468] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 1.
I20260709 13:02:58.052353 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.034955 14852 consensus_queue.cc:260] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.048302 14883 leader_election.cc:290] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.052937 14734 raft_consensus.cc:3060] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.053151 14659 raft_consensus.cc:3060] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.054018 14851 raft_consensus.cc:359] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.054716 14851 raft_consensus.cc:385] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.055003 14851 raft_consensus.cc:740] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.055738 14851 consensus_queue.cc:260] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.060019 14734 raft_consensus.cc:2468] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:02:58.061108 14775 leader_election.cc:304] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.061249 14659 raft_consensus.cc:2468] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:02:58.048542 14850 ts_tablet_manager.cc:1434] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:58.051416 14736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:58.062153 14851 ts_tablet_manager.cc:1434] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
W20260709 13:02:58.063083 14775 leader_election.cc:343] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.063261 14851 tablet_bootstrap.cc:492] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:58.063416 14627 leader_election.cc:304] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.063526 14775 leader_election.cc:304] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc7e35df5c8f4668a17e400068b33ea8; no voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:02:58.064251 14887 raft_consensus.cc:2804] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.064728 14887 raft_consensus.cc:697] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:02:58.065276 14850 tablet_bootstrap.cc:492] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8: Bootstrap starting.
I20260709 13:02:58.065552 14887 consensus_queue.cc:237] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.069020 14852 ts_tablet_manager.cc:1434] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.003s
I20260709 13:02:58.070273 14852 tablet_bootstrap.cc:492] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:58.070901 14850 tablet_bootstrap.cc:654] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.045426 14857 raft_consensus.cc:2804] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.074420 14810 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 0.
I20260709 13:02:58.074976 14857 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.075374 14857 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.076409 14851 tablet_bootstrap.cc:654] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.049539 14889 raft_consensus.cc:2804] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.079792 14891 raft_consensus.cc:2749] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.079646 14735 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:02:58.069474 14883 raft_consensus.cc:2804] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.077157 14858 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:58.083415 14626 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:35567, user_credentials={real_user=slave}} blocked reactor thread for 47364.9us
I20260709 13:02:58.084939 14883 raft_consensus.cc:697] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:02:58.087692 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.088476 14735 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.088617 14883 consensus_queue.cc:237] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.082093 14889 raft_consensus.cc:697] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:02:58.096309 14890 raft_consensus.cc:493] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.093778 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:58.092561 14809 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 1.
I20260709 13:02:58.096395 14891 raft_consensus.cc:493] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.093106 14736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.096876 14890 raft_consensus.cc:515] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.085135 14858 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.101023 14891 raft_consensus.cc:515] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.105792 14702 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.112841 14852 tablet_bootstrap.cc:654] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.113639 14890 leader_election.cc:290] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.112594 14659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.100598 14734 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 0.
I20260709 13:02:58.116496 14627 leader_election.cc:304] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.117113 14855 raft_consensus.cc:2804] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.119524 14890 raft_consensus.cc:2804] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.120064 14890 raft_consensus.cc:697] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:02:58.120615 14855 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.120993 14855 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.120929 14890 consensus_queue.cc:237] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.104703 14857 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:58.124912 14857 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:02:58.126797 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.128456 14855 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
W20260709 13:02:58.118172 14626 leader_election.cc:343] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.129688 14734 raft_consensus.cc:2393] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc7e35df5c8f4668a17e400068b33ea8 in current term 1: Already voted for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in this term.
I20260709 13:02:58.133538 14810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:02:58.134305 14810 raft_consensus.cc:2393] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in current term 1: Already voted for candidate fc7e35df5c8f4668a17e400068b33ea8 in this term.
I20260709 13:02:58.136590 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:58.137262 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.138514 14891 leader_election.cc:290] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.139025 14700 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:02:58.140327 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.142647 14774 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc7e35df5c8f4668a17e400068b33ea8; no voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:02:58.096688 14889 consensus_queue.cc:237] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.144034 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.151746 14855 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 election: Requested vote from peers fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883), 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:02:58.151582 14891 raft_consensus.cc:2749] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.159791 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:58.160941 14850 tablet_bootstrap.cc:492] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8: No bootstrap required, opened a new log
W20260709 13:02:58.154248 14626 leader_election.cc:343] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.162565 14850 ts_tablet_manager.cc:1403] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8: Time spent bootstrapping tablet: real 0.097s	user 0.016s	sys 0.028s
I20260709 13:02:58.162734 14660 raft_consensus.cc:2468] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
W20260709 13:02:58.163395 14775 leader_election.cc:343] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.164712 14774 leader_election.cc:304] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:02:58.165450 14850 raft_consensus.cc:359] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.166227 14850 raft_consensus.cc:385] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.166066 14891 raft_consensus.cc:2804] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.166641 14850 raft_consensus.cc:740] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.156738 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:58.153189 14735 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 1.
I20260709 13:02:58.168633 14850 consensus_queue.cc:260] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.167462 14891 raft_consensus.cc:493] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.167124 14855 raft_consensus.cc:2749] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.165669 14557 catalog_manager.cc:5697] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.169906 14891 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.174773 14850 ts_tablet_manager.cc:1434] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.005s
I20260709 13:02:58.177546 14857 raft_consensus.cc:493] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.178843 14857 raft_consensus.cc:515] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.179505 14852 tablet_bootstrap.cc:492] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:58.179920 14852 ts_tablet_manager.cc:1403] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.011s
I20260709 13:02:58.179812 14891 raft_consensus.cc:515] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.180925 14809 raft_consensus.cc:2393] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 727207cc1acf46328d17331555d87be8 in current term 1: Already voted for candidate fc7e35df5c8f4668a17e400068b33ea8 in this term.
I20260709 13:02:58.180898 14857 leader_election.cc:290] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.182597 14627 leader_election.cc:304] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 727207cc1acf46328d17331555d87be8; no voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:02:58.183720 14890 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.184279 14851 tablet_bootstrap.cc:492] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:58.184746 14851 ts_tablet_manager.cc:1403] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.122s	user 0.024s	sys 0.014s
I20260709 13:02:58.184779 14891 leader_election.cc:290] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.185581 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.187331 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.189081 14852 raft_consensus.cc:359] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.189412 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.189755 14852 raft_consensus.cc:385] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:58.190063 14775 leader_election.cc:343] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.190076 14852 raft_consensus.cc:740] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.190496 14858 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:02:58.191298 14852 consensus_queue.cc:260] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.191701 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:58.191771 14659 raft_consensus.cc:2393] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in current term 1: Already voted for candidate 727207cc1acf46328d17331555d87be8 in this term.
I20260709 13:02:58.192943 14660 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
I20260709 13:02:58.193852 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:02:58.191309 14851 raft_consensus.cc:359] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.194628 14809 raft_consensus.cc:2393] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 727207cc1acf46328d17331555d87be8 in current term 1: Already voted for candidate fc7e35df5c8f4668a17e400068b33ea8 in this term.
I20260709 13:02:58.194717 14890 raft_consensus.cc:2749] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.194810 14851 raft_consensus.cc:385] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.195322 14851 raft_consensus.cc:740] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.195804 14774 leader_election.cc:304] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.196136 14851 consensus_queue.cc:260] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.196982 14891 raft_consensus.cc:2804] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.197147 14735 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 0.
I20260709 13:02:58.199295 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.200016 14734 raft_consensus.cc:2393] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 727207cc1acf46328d17331555d87be8 in current term 1: Already voted for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in this term.
I20260709 13:02:58.200770 14851 ts_tablet_manager.cc:1434] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:02:58.201738 14851 tablet_bootstrap.cc:492] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:58.201738 14626 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 727207cc1acf46328d17331555d87be8; no voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:02:58.203389 14887 raft_consensus.cc:2749] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.197402 14891 raft_consensus.cc:493] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.204406 14891 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.204977 14852 ts_tablet_manager.cc:1434] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:02:58.206679 14852 tablet_bootstrap.cc:492] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:58.207172 14661 raft_consensus.cc:2468] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:02:58.196739 14858 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Requested vote from peers fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.209105 14774 leader_election.cc:304] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:02:58.209774 14857 raft_consensus.cc:2804] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.210299 14857 raft_consensus.cc:697] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:02:58.211843 14857 consensus_queue.cc:237] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.213927 14896 raft_consensus.cc:493] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.214517 14896 raft_consensus.cc:515] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.218573 14852 tablet_bootstrap.cc:654] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.219782 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e858d3dc3ef491ab3ea354a4791fb1d" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.220199 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e858d3dc3ef491ab3ea354a4791fb1d" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:58.220836 14809 raft_consensus.cc:2468] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 0.
W20260709 13:02:58.221063 14700 leader_election.cc:343] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.222030 14702 leader_election.cc:304] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 727207cc1acf46328d17331555d87be8
I20260709 13:02:58.219447 14891 raft_consensus.cc:515] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.222823 14855 raft_consensus.cc:2804] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.220150 14896 leader_election.cc:290] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.223223 14855 raft_consensus.cc:493] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.211547 14851 tablet_bootstrap.cc:654] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.227420 14891 leader_election.cc:290] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:02:58.224462 14855 raft_consensus.cc:3060] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.228932 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.229740 14734 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.231835 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.233255 14661 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.238711 14855 raft_consensus.cc:515] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.241433 14852 tablet_bootstrap.cc:492] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:58.239729 14734 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:02:58.241870 14852 ts_tablet_manager.cc:1403] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.004s
I20260709 13:02:58.241564 14855 leader_election.cc:290] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.242311 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e858d3dc3ef491ab3ea354a4791fb1d" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.242952 14775 leader_election.cc:304] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
W20260709 13:02:58.243701 14700 leader_election.cc:343] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:58.244274 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e858d3dc3ef491ab3ea354a4791fb1d" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:02:58.244794 14809 raft_consensus.cc:3060] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.244861 14852 raft_consensus.cc:359] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.245518 14852 raft_consensus.cc:385] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.245806 14852 raft_consensus.cc:740] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.246019 14661 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:02:58.246426 14852 consensus_queue.cc:260] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.247283 14891 raft_consensus.cc:2804] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.247766 14891 raft_consensus.cc:697] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:02:58.248665 14852 ts_tablet_manager.cc:1434] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:58.248466 14891 consensus_queue.cc:237] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.249559 14852 tablet_bootstrap.cc:492] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8: Bootstrap starting.
I20260709 13:02:58.251116 14809 raft_consensus.cc:2468] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 1.
I20260709 13:02:58.252279 14702 leader_election.cc:304] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 727207cc1acf46328d17331555d87be8
I20260709 13:02:58.253444 14855 raft_consensus.cc:2804] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.253422 14558 catalog_manager.cc:5697] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.255024 14855 raft_consensus.cc:697] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 LEADER]: Becoming Leader. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:02:58.255352 14558 catalog_manager.cc:5697] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.258183 14890 raft_consensus.cc:493] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.256186 14855 consensus_queue.cc:237] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.258644 14890 raft_consensus.cc:515] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.260681 14852 tablet_bootstrap.cc:654] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.260833 14890 leader_election.cc:290] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.263880 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:02:58.264755 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:58.265379 14809 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 0.
I20260709 13:02:58.266446 14851 tablet_bootstrap.cc:492] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:58.266872 14851 ts_tablet_manager.cc:1403] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.006s
I20260709 13:02:58.264997 14734 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 0.
I20260709 13:02:58.262790 14557 catalog_manager.cc:5697] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.268790 14626 leader_election.cc:304] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:02:58.269569 14890 raft_consensus.cc:2804] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.269908 14890 raft_consensus.cc:493] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.270219 14890 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.270249 14851 raft_consensus.cc:359] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.271243 14851 raft_consensus.cc:385] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.271600 14851 raft_consensus.cc:740] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.272748 14851 consensus_queue.cc:260] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.275488 14851 ts_tablet_manager.cc:1434] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:58.276731 14851 tablet_bootstrap.cc:492] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:58.277225 14890 raft_consensus.cc:515] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.281654 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:02:58.282191 14734 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.290441 14734 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 1.
I20260709 13:02:58.291203 14890 leader_election.cc:290] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.292349 14626 leader_election.cc:304] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:02:58.293170 14890 raft_consensus.cc:2804] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.293785 14890 raft_consensus.cc:697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:02:58.294559 14890 consensus_queue.cc:237] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.297169 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:02:58.297734 14809 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.304159 14851 tablet_bootstrap.cc:654] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.305768 14852 tablet_bootstrap.cc:492] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8: No bootstrap required, opened a new log
I20260709 13:02:58.306209 14852 ts_tablet_manager.cc:1403] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.019s
I20260709 13:02:58.310537 14809 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 1.
I20260709 13:02:58.310779 14852 raft_consensus.cc:359] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.312276 14557 catalog_manager.cc:5697] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2). New cstate: current_term: 1 leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.315161 14852 raft_consensus.cc:385] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.315469 14852 raft_consensus.cc:740] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.315416 14559 catalog_manager.cc:5697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.316270 14852 consensus_queue.cc:260] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.318615 14852 ts_tablet_manager.cc:1434] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:58.321759 14851 tablet_bootstrap.cc:492] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:58.322167 14851 ts_tablet_manager.cc:1403] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:02:58.324605 14851 raft_consensus.cc:359] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.325225 14851 raft_consensus.cc:385] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.325497 14851 raft_consensus.cc:740] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.326138 14851 consensus_queue.cc:260] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.328020 14851 ts_tablet_manager.cc:1434] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:58.328912 14851 tablet_bootstrap.cc:492] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Bootstrap starting.
I20260709 13:02:58.328092 14558 catalog_manager.cc:5697] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.329989 14558 catalog_manager.cc:5697] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.334404 14851 tablet_bootstrap.cc:654] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:58.338482 14851 tablet_bootstrap.cc:492] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: No bootstrap required, opened a new log
I20260709 13:02:58.338888 14851 ts_tablet_manager.cc:1403] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent bootstrapping tablet: real 0.010s	user 0.001s	sys 0.007s
I20260709 13:02:58.341368 14851 raft_consensus.cc:359] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.342022 14851 raft_consensus.cc:385] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:58.342316 14851 raft_consensus.cc:740] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Initialized, Role: FOLLOWER
I20260709 13:02:58.342924 14851 consensus_queue.cc:260] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.344549 14851 ts_tablet_manager.cc:1434] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:58.525408 14890 consensus_queue.cc:1048] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.534653 14734 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.542865 14890 consensus_queue.cc:1048] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.556953 14855 raft_consensus.cc:493] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.557474 14855 raft_consensus.cc:515] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.559275 14855 leader_election.cc:290] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.559917 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.560236 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:58.560560 14661 raft_consensus.cc:2393] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in current term 1: Already voted for candidate fc7e35df5c8f4668a17e400068b33ea8 in this term.
I20260709 13:02:58.561535 14700 leader_election.cc:304] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:02:58.562166 14855 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.566278 14891 consensus_queue.cc:1048] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.567433 14855 raft_consensus.cc:2749] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:58.568651 14890 consensus_queue.cc:1048] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.579560 14883 consensus_queue.cc:1048] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.583442 14890 consensus_queue.cc:1048] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.611341 14855 raft_consensus.cc:493] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.611783 14855 raft_consensus.cc:515] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.613409 14855 leader_election.cc:290] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.614101 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:02:58.614288 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8" is_pre_election: true
I20260709 13:02:58.614611 14661 raft_consensus.cc:2468] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 0.
I20260709 13:02:58.614842 14809 raft_consensus.cc:2468] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 0.
I20260709 13:02:58.615653 14700 leader_election.cc:304] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:02:58.616238 14855 raft_consensus.cc:2804] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:58.616587 14855 raft_consensus.cc:493] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.616811 14855 raft_consensus.cc:3060] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.621325 14855 raft_consensus.cc:515] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.622848 14855 leader_election.cc:290] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:02:58.623575 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:02:58.623772 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:02:58.624058 14661 raft_consensus.cc:3060] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.624292 14809 raft_consensus.cc:3060] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.628724 14661 raft_consensus.cc:2468] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 1.
I20260709 13:02:58.628763 14809 raft_consensus.cc:2468] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 1.
I20260709 13:02:58.629808 14702 leader_election.cc:304] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:02:58.630460 14855 raft_consensus.cc:2804] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:58.630869 14855 raft_consensus.cc:697] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 LEADER]: Becoming Leader. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:02:58.631649 14855 consensus_queue.cc:237] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:02:58.638264 14558 catalog_manager.cc:5697] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2). New cstate: current_term: 1 leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.655309 14661 raft_consensus.cc:3060] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:58.660943 14855 consensus_queue.cc:1048] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.671597 14924 consensus_queue.cc:1048] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:58.673271 14891 consensus_queue.cc:1048] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.687978 14885 consensus_queue.cc:1048] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.693868 14883 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.700150 14889 consensus_queue.cc:1048] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.706926 14857 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.721310 14889 consensus_queue.cc:1048] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.754732 14890 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:58.764284 14858 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:58.926976 14607 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:59.032021 14924 consensus_queue.cc:1048] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:59.042318 14896 consensus_queue.cc:1048] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:59.928474 14607 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:00.189811 14885 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.190328 14885 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:00.191994 14885 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:03:00.192935 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" is_pre_election: true
I20260709 13:03:00.192955 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8" is_pre_election: true
I20260709 13:03:00.193849 14735 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:03:00.194389 14660 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 1.
I20260709 13:03:00.195092 14775 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:00.195925 14937 raft_consensus.cc:2804] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:00.196271 14937 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.196586 14937 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.200976 14937 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:00.202450 14937 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:03:00.203505 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:00.203596 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:00.204170 14734 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.204172 14660 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.210793 14734 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 2.
I20260709 13:03:00.210793 14660 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 2.
I20260709 13:03:00.212075 14774 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:00.212798 14937 raft_consensus.cc:2804] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:00.213315 14937 raft_consensus.cc:697] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:00.214143 14937 consensus_queue.cc:237] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:00.222525 14559 catalog_manager.cc:5697] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 0 to 2, leader changed from <none> to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.750142 14809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:40424
I20260709 13:03:00.750618 14809 raft_consensus.cc:606] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:00.755887 14809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:40424
I20260709 13:03:00.756448 14809 raft_consensus.cc:606] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:00.756819 14660 raft_consensus.cc:1275] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:00.758818 14937 consensus_queue.cc:1048] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:00.762300 14809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:40424
I20260709 13:03:00.762797 14809 raft_consensus.cc:606] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:00.768767 14937 raft_consensus.cc:993] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:00.769241 14947 raft_consensus.cc:1081] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:00.771535 14809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:40424
I20260709 13:03:00.772087 14734 raft_consensus.cc:1275] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:03:00.772099 14809 raft_consensus.cc:606] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:00.773890 14661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50070
I20260709 13:03:00.775138 14947 consensus_queue.cc:1048] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:00.782343 14661 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:00.782830 14661 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.786972 14809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
mode: GRACEFUL
new_leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:40424
I20260709 13:03:00.787853 14809 raft_consensus.cc:606] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Received request to transfer leadership to TS 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:03:00.789439 14661 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:00.797763 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:00.797782 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:00.799357 14809 raft_consensus.cc:3055] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:00.799870 14809 raft_consensus.cc:740] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:00.800979 14809 consensus_queue.cc:260] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:00.801957 14809 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:00.795984 14661 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Requested vote from peers fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:03:00.811223 14809 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:00.813045 14627 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:03:00.814237 14887 raft_consensus.cc:2804] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:00.814951 14887 raft_consensus.cc:697] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:00.816366 14887 consensus_queue.cc:237] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:00.828550 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:50092
I20260709 13:03:00.829113 14661 raft_consensus.cc:606] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Received request to transfer leadership to TS 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:03:00.829475 14558 catalog_manager.cc:5697] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 2 to 3, leader changed from fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:00.834332 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:50092
I20260709 13:03:00.834945 14661 raft_consensus.cc:606] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Received request to transfer leadership to TS 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:03:00.856349 14937 raft_consensus.cc:993] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8: : Instructing follower 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:00.856812 14937 raft_consensus.cc:1081] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Signalling peer 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:00.858880 14734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:41684
I20260709 13:03:00.859426 14735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
mode: GRACEFUL
new_leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:41692
I20260709 13:03:00.859472 14734 raft_consensus.cc:493] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:00.860208 14734 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.860205 14735 raft_consensus.cc:606] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 LEADER]: Received request to transfer leadership to TS fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:03:00.867830 14734 raft_consensus.cc:515] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.870477 14734 leader_election.cc:290] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 2 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:00.871287 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:00.871510 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:00.871883 14661 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.871994 14809 raft_consensus.cc:3055] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:00.872334 14809 raft_consensus.cc:740] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:00.873128 14809 consensus_queue.cc:260] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.874198 14809 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.878373 14947 raft_consensus.cc:993] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:00.878804 14937 raft_consensus.cc:1081] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:00.880206 14660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50070
I20260709 13:03:00.880182 14661 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 2.
I20260709 13:03:00.880939 14660 raft_consensus.cc:493] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:00.881096 14809 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 2.
I20260709 13:03:00.881330 14660 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.881798 14700 leader_election.cc:304] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:03:00.882730 14855 raft_consensus.cc:2804] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:00.884188 14855 raft_consensus.cc:697] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Becoming Leader. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:00.885015 14855 consensus_queue.cc:237] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.889166 14660 raft_consensus.cc:515] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.892158 14936 raft_consensus.cc:993] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8: : Instructing follower 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:00.893669 14887 raft_consensus.cc:1081] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Signalling peer 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:00.893993 14558 catalog_manager.cc:5697] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d reported cstate change: term changed from 1 to 2, leader changed from fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3) to 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2). New cstate: current_term: 2 leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.895481 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:00.896158 14809 raft_consensus.cc:3055] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:00.896535 14809 raft_consensus.cc:740] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:00.898046 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:00.897614 14809 consensus_queue.cc:260] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.898595 14734 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.898983 14809 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.899340 14735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:41670
I20260709 13:03:00.899881 14735 raft_consensus.cc:493] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:00.900218 14735 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.894737 14660 leader_election.cc:290] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 2 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:00.905870 14734 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 2.
I20260709 13:03:00.907088 14626 leader_election.cc:304] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:03:00.908064 14936 raft_consensus.cc:2804] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:00.908563 14936 raft_consensus.cc:697] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:00.909502 14936 consensus_queue.cc:237] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.910558 14809 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 2.
I20260709 13:03:00.910516 14735 raft_consensus.cc:515] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.913205 14735 leader_election.cc:290] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 2 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:00.913606 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:00.914268 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:00.914359 14660 raft_consensus.cc:3055] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:00.914865 14809 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.914857 14660 raft_consensus.cc:740] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:00.916106 14660 consensus_queue.cc:260] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.917706 14660 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:00.920454 14809 raft_consensus.cc:2468] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 2.
I20260709 13:03:00.921486 14702 leader_election.cc:304] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:00.922171 14855 raft_consensus.cc:2804] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:00.922603 14855 raft_consensus.cc:697] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Becoming Leader. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:00.923465 14855 consensus_queue.cc:237] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:00.925750 14660 raft_consensus.cc:2468] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 2.
I20260709 13:03:00.930717 14558 catalog_manager.cc:5697] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 1 to 2, leader changed from fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.934801 14559 catalog_manager.cc:5697] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d reported cstate change: term changed from 1 to 2, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2). New cstate: current_term: 2 leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.025573 14947 raft_consensus.cc:993] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:01.026021 14937 raft_consensus.cc:1081] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:01.027503 14660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50070
I20260709 13:03:01.027921 14660 raft_consensus.cc:493] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:01.028203 14660 raft_consensus.cc:3060] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.032840 14660 raft_consensus.cc:515] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.034430 14660 leader_election.cc:290] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 2 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:01.035337 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:01.035470 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cec534d1933d4914968d52565b76ebd0" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:01.036021 14735 raft_consensus.cc:3060] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.036046 14809 raft_consensus.cc:3055] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:01.036576 14809 raft_consensus.cc:740] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:01.037428 14809 consensus_queue.cc:260] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.038622 14809 raft_consensus.cc:3060] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.042975 14735 raft_consensus.cc:2468] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 2.
I20260709 13:03:01.044239 14626 leader_election.cc:304] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:03:01.044948 14936 raft_consensus.cc:2804] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:01.044919 14809 raft_consensus.cc:2468] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 2.
I20260709 13:03:01.045642 14936 raft_consensus.cc:697] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:01.046574 14936 consensus_queue.cc:237] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.054502 14559 catalog_manager.cc:5697] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 1 to 2, leader changed from fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.084683 14947 raft_consensus.cc:993] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:01.085137 14937 raft_consensus.cc:1081] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:01.086752 14660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50070
I20260709 13:03:01.087317 14660 raft_consensus.cc:493] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:01.087905 14660 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.092295 14660 raft_consensus.cc:515] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.093868 14660 leader_election.cc:290] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 2 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:01.094697 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:01.094955 14809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:01.095331 14735 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.095489 14809 raft_consensus.cc:3055] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:01.095834 14809 raft_consensus.cc:740] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:01.096652 14809 consensus_queue.cc:260] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.097836 14809 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.102375 14735 raft_consensus.cc:2468] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 2.
I20260709 13:03:01.103586 14626 leader_election.cc:304] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:03:01.104266 14936 raft_consensus.cc:2804] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:01.104616 14809 raft_consensus.cc:2468] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 2.
I20260709 13:03:01.104794 14936 raft_consensus.cc:697] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:01.105667 14936 consensus_queue.cc:237] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.112622 14559 catalog_manager.cc:5697] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 1 to 2, leader changed from fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.218729 14957 raft_consensus.cc:993] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d: : Instructing follower fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:01.219265 14855 raft_consensus.cc:1081] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 LEADER]: Signalling peer fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:01.220956 14809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40418
I20260709 13:03:01.221369 14809 raft_consensus.cc:493] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:01.221618 14809 raft_consensus.cc:3060] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.225925 14809 raft_consensus.cc:515] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.227520 14809 leader_election.cc:290] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:03:01.228374 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:01.228611 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ba54e2af004ab1892ecfbd57ef98ee" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:01.229054 14660 raft_consensus.cc:3060] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.229174 14735 raft_consensus.cc:3055] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:01.229537 14735 raft_consensus.cc:740] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:01.230410 14735 consensus_queue.cc:260] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.231760 14735 raft_consensus.cc:3060] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.236650 14660 raft_consensus.cc:2468] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 2.
I20260709 13:03:01.238067 14774 leader_election.cc:304] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:01.238785 14937 raft_consensus.cc:2804] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:01.238735 14735 raft_consensus.cc:2468] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 2.
I20260709 13:03:01.239465 14937 raft_consensus.cc:697] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:01.240397 14937 consensus_queue.cc:237] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.247741 14559 catalog_manager.cc:5697] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 1 to 2, leader changed from 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2) to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.347779 14809 raft_consensus.cc:1275] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:01.349242 14936 consensus_queue.cc:1048] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.350323 14959 raft_consensus.cc:993] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: : Instructing follower 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:01.350855 14936 raft_consensus.cc:1081] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Signalling peer 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:01.352492 14735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:41670
I20260709 13:03:01.353024 14735 raft_consensus.cc:493] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:01.353374 14735 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.355372 14809 raft_consensus.cc:1275] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.356842 14855 consensus_queue.cc:1048] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:01.361579 14735 raft_consensus.cc:515] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.363561 14734 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:01.365048 14660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:01.365828 14660 raft_consensus.cc:3055] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:01.366210 14660 raft_consensus.cc:740] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:01.368528 14735 leader_election.cc:290] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 2 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:01.368886 14810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:01.377283 14660 consensus_queue.cc:260] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.377854 14810 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.378479 14660 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:01.383488 14810 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 2.
I20260709 13:03:01.384850 14702 leader_election.cc:304] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:01.385782 14855 raft_consensus.cc:2804] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:01.388752 14855 raft_consensus.cc:697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Becoming Leader. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:01.392520 14855 consensus_queue.cc:237] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:01.386241 14660 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 2.
I20260709 13:03:01.398345 14808 raft_consensus.cc:1275] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.400369 14806 raft_consensus.cc:1275] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.400527 14936 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.401036 14734 raft_consensus.cc:1275] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:01.401837 14968 consensus_queue.cc:1048] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.402488 14959 consensus_queue.cc:1048] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.420869 14734 raft_consensus.cc:1275] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.422585 14887 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.447851 14660 raft_consensus.cc:1275] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.463773 14807 raft_consensus.cc:1275] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.464828 14558 catalog_manager.cc:5697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d reported cstate change: term changed from 1 to 2, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2). New cstate: current_term: 2 leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.465557 14887 consensus_queue.cc:1048] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.456197 14978 consensus_queue.cc:1048] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:03:01.471632 14660 raft_consensus.cc:1275] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.473410 14967 consensus_queue.cc:1048] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.487995 14734 raft_consensus.cc:1275] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.489795 14887 consensus_queue.cc:1048] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.548985 14734 raft_consensus.cc:1275] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.550254 14887 consensus_queue.cc:1048] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.558882 14806 raft_consensus.cc:1275] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.560909 14936 consensus_queue.cc:1048] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.828351 14734 raft_consensus.cc:1275] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.829497 14937 consensus_queue.cc:1048] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.837589 14661 raft_consensus.cc:1275] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.839869 14937 consensus_queue.cc:1048] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.986137 14661 raft_consensus.cc:1275] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.987480 14978 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:01.995478 14806 raft_consensus.cc:1275] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:01.997471 14978 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.891896 14036 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:03:03.892594 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:03.913115 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:03:03.913648 14661 raft_consensus.cc:606] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Received request to transfer leadership to TS fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:03:03.916060 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:03:03.916570 14661 raft_consensus.cc:606] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Received request to transfer leadership to TS fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:03:03.917563 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:03.917980 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:04.076470 14998 raft_consensus.cc:993] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8: : Instructing follower fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:04.076894 14994 raft_consensus.cc:1081] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Signalling peer fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:04.078253 14807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40408
I20260709 13:03:04.078716 14807 raft_consensus.cc:493] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:04.078991 14807 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:04.083971 14807 raft_consensus.cc:515] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:04.085608 14807 leader_election.cc:290] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:03:04.086354 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:04.086627 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:04.086963 14661 raft_consensus.cc:3055] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:04.087169 14734 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:04.087335 14661 raft_consensus.cc:740] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:04.088140 14661 consensus_queue.cc:260] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:04.089293 14661 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:04.093338 14734 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 2.
I20260709 13:03:04.094424 14775 leader_election.cc:304] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:04.095248 14937 raft_consensus.cc:2804] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:04.095615 14661 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 2.
I20260709 13:03:04.096377 14937 raft_consensus.cc:697] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:04.097146 14937 consensus_queue.cc:237] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:04.103364 14559 catalog_manager.cc:5697] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 1 to 2, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.173972 14998 raft_consensus.cc:993] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: : Instructing follower fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:04.174407 14994 raft_consensus.cc:1081] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Signalling peer fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:04.175877 14807 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40408
I20260709 13:03:04.176373 14807 raft_consensus.cc:493] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:04.176637 14807 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:04.181825 14807 raft_consensus.cc:515] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:04.183435 14807 leader_election.cc:290] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 3 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:03:04.184294 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:04.184460 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:04.184929 14734 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:04.184926 14661 raft_consensus.cc:3055] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:04.185447 14661 raft_consensus.cc:740] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:04.186218 14661 consensus_queue.cc:260] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:04.187389 14661 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:04.191138 14734 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 3.
I20260709 13:03:04.192261 14775 leader_election.cc:304] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:04.193148 14937 raft_consensus.cc:2804] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:04.193624 14937 raft_consensus.cc:697] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:04.193846 14661 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 3.
I20260709 13:03:04.194406 14937 consensus_queue.cc:237] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:04.201421 14559 catalog_manager.cc:5697] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 2 to 3, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:04.601929 14661 raft_consensus.cc:1275] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:04.603585 14937 consensus_queue.cc:1048] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:04.615496 14734 raft_consensus.cc:1275] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:04.617277 14937 consensus_queue.cc:1048] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:04.639110 14660 raft_consensus.cc:1275] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:04.640210 14937 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:04.651144 14734 raft_consensus.cc:1275] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:04.652514 15014 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:04.918967 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:04.935220 14807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:40424
I20260709 13:03:04.935953 14807 raft_consensus.cc:606] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:04.943281 14807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:40424
I20260709 13:03:04.943727 14807 raft_consensus.cc:606] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:04.948369 14734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:41692
I20260709 13:03:04.948837 14734 raft_consensus.cc:606] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:04.953775 14734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:41692
I20260709 13:03:04.954370 14734 raft_consensus.cc:606] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:04.958887 14734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
mode: GRACEFUL
new_leader_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:41692
I20260709 13:03:04.959362 14734 raft_consensus.cc:606] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Received request to transfer leadership to TS 727207cc1acf46328d17331555d87be8
I20260709 13:03:05.206025 15014 raft_consensus.cc:993] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.206519 15013 raft_consensus.cc:1081] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.207875 14661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50070
I20260709 13:03:05.208376 14661 raft_consensus.cc:493] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.208702 14661 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.214036 14661 raft_consensus.cc:515] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.215983 14661 leader_election.cc:290] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:05.217166 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:05.217253 14807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10d37a06e3914f13ab14f4657b95083a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:05.217868 14734 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.218066 14807 raft_consensus.cc:3055] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:05.218500 15017 raft_consensus.cc:993] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.218657 14807 raft_consensus.cc:740] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:05.219221 14992 raft_consensus.cc:1081] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.219812 14807 consensus_queue.cc:260] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.221107 14661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50080
I20260709 13:03:05.221302 14807 raft_consensus.cc:3060] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.221597 14661 raft_consensus.cc:493] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.222085 14661 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.226730 14734 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:05.227974 15013 raft_consensus.cc:993] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.228259 14626 leader_election.cc:304] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, 7c27edc1af3247f7b8d9ee2d2bbbac1d; no voters: 
I20260709 13:03:05.228593 14937 raft_consensus.cc:1081] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.229004 14807 raft_consensus.cc:2468] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:05.229346 14994 raft_consensus.cc:2804] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:05.228786 14661 raft_consensus.cc:515] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.230477 14660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50070
I20260709 13:03:05.230898 14994 raft_consensus.cc:697] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:05.231199 14660 raft_consensus.cc:493] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.231586 14660 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.232025 14661 leader_election.cc:290] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:05.231997 14994 consensus_queue.cc:237] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.233659 14807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:05.234243 14807 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.238327 14660 raft_consensus.cc:515] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.241258 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:05.241639 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "036fec1d1a2344eeba7c85222c530396" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:05.241763 14806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:05.242071 14807 raft_consensus.cc:2468] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:05.242252 14734 raft_consensus.cc:3055] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:05.242296 14806 raft_consensus.cc:3055] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:05.242733 14806 raft_consensus.cc:740] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:05.242884 14735 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.243573 14806 consensus_queue.cc:260] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.244752 14806 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:05.244421 14559 catalog_manager.cc:5697] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 2 to 3, leader changed from fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.247640 14627 leader_election.cc:304] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:05.248669 15018 raft_consensus.cc:2804] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:05.251518 14806 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 4.
I20260709 13:03:05.251879 14807 raft_consensus.cc:1240] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Rejecting Update request from peer 7c27edc1af3247f7b8d9ee2d2bbbac1d for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:05.253638 14992 consensus_queue.cc:1059] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.254218 14735 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 4.
I20260709 13:03:05.254410 14627 leader_election.cc:304] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:05.255343 14994 raft_consensus.cc:2804] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:05.255833 14994 raft_consensus.cc:697] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:05.256224 14660 leader_election.cc:290] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 4 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:05.256855 15018 raft_consensus.cc:697] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:05.257516 14734 raft_consensus.cc:740] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:05.256863 14994 consensus_queue.cc:237] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.258010 15018 consensus_queue.cc:237] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.263880 14992 raft_consensus.cc:993] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.264624 14992 raft_consensus.cc:1081] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.267088 14661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50080
I20260709 13:03:05.267683 14661 raft_consensus.cc:493] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.268170 14661 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.271502 14734 consensus_queue.cc:260] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.272825 14734 raft_consensus.cc:3060] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.274156 14661 raft_consensus.cc:515] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.276763 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:05.277158 14806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec387a07c1438b8a6c177a6e5c3aeb" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:05.277341 14735 raft_consensus.cc:3055] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:05.277668 14806 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.277720 14735 raft_consensus.cc:740] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:05.278764 14735 consensus_queue.cc:260] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.280040 14735 raft_consensus.cc:3060] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.284138 14734 raft_consensus.cc:2468] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
W20260709 13:03:05.284775 15017 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:03:05.287056 14806 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:05.288082 14735 raft_consensus.cc:2468] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:05.288102 14627 leader_election.cc:304] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:05.284612 14559 catalog_manager.cc:5697] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 2 to 3, leader changed from 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.289111 15018 raft_consensus.cc:2804] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:05.288787 14661 leader_election.cc:290] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:05.291293 15018 raft_consensus.cc:697] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:05.291481 14559 catalog_manager.cc:5697] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 3 to 4, leader changed from fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.292326 15018 consensus_queue.cc:237] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.303993 14559 catalog_manager.cc:5697] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 2 to 3, leader changed from 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.308694 14992 raft_consensus.cc:993] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: : Instructing follower 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.309144 15017 raft_consensus.cc:1081] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Signalling peer 727207cc1acf46328d17331555d87be8 to start an election
I20260709 13:03:05.310559 14661 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4"
dest_uuid: "727207cc1acf46328d17331555d87be8"
 from {username='slave'} at 127.0.0.1:50080
I20260709 13:03:05.311072 14661 raft_consensus.cc:493] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:05.311378 14661 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.315371 14661 raft_consensus.cc:515] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.316668 14661 leader_election.cc:290] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:05.317525 14735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:05.317720 14806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "727207cc1acf46328d17331555d87be8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:05.318001 14735 raft_consensus.cc:3055] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:05.318431 14806 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.318488 14735 raft_consensus.cc:740] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:05.319456 14735 consensus_queue.cc:260] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.320545 14735 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:05.324252 14806 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:05.325078 14735 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 727207cc1acf46328d17331555d87be8 in term 3.
I20260709 13:03:05.325393 14627 leader_election.cc:304] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 727207cc1acf46328d17331555d87be8, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:05.326228 15018 raft_consensus.cc:2804] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:05.326644 15018 raft_consensus.cc:697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Becoming Leader. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:05.327402 15018 consensus_queue.cc:237] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:05.333849 14559 catalog_manager.cc:5697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 reported cstate change: term changed from 2 to 3, leader changed from 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2) to 727207cc1acf46328d17331555d87be8 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "727207cc1acf46328d17331555d87be8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:05.675006 14806 raft_consensus.cc:1275] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.676209 15018 consensus_queue.cc:1048] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.684604 14735 raft_consensus.cc:1275] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.686156 15018 consensus_queue.cc:1048] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.700691 14806 raft_consensus.cc:1275] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.701944 14808 raft_consensus.cc:1275] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.702896 15018 consensus_queue.cc:1048] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.703444 15019 consensus_queue.cc:1048] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.710353 14735 raft_consensus.cc:1275] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.711933 14994 consensus_queue.cc:1048] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.736219 14806 raft_consensus.cc:1275] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:05.736714 14735 raft_consensus.cc:1275] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.737912 15019 consensus_queue.cc:1048] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.737886 15036 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:05.758991 14735 raft_consensus.cc:1275] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:05.760458 15036 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:05.796002 14808 raft_consensus.cc:1275] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.797163 15036 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.807067 14735 raft_consensus.cc:1275] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Refusing update from remote peer 727207cc1acf46328d17331555d87be8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:05.808805 15018 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:07.966691 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:07.974802 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:03:07.975487 14661 raft_consensus.cc:606] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Received request to transfer leadership to TS fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:03:07.977933 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:03:07.978359 14661 raft_consensus.cc:606] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 LEADER]: Received request to transfer leadership to TS fc7e35df5c8f4668a17e400068b33ea8
I20260709 13:03:07.980497 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:03:07.980890 14661 raft_consensus.cc:606] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Received request to transfer leadership to TS 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:03:07.982985 14661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a"
dest_uuid: "727207cc1acf46328d17331555d87be8"
mode: GRACEFUL
new_leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:40214
I20260709 13:03:07.983388 14661 raft_consensus.cc:606] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Received request to transfer leadership to TS 7c27edc1af3247f7b8d9ee2d2bbbac1d
I20260709 13:03:07.984326 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:07.984843 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:08.036002 15018 raft_consensus.cc:993] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8: : Instructing follower 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:08.036538 15045 raft_consensus.cc:1081] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Signalling peer 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:08.037850 14734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:41670
I20260709 13:03:08.038403 14734 raft_consensus.cc:493] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.038689 14734 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:08.042618 14734 raft_consensus.cc:515] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.044114 14734 leader_election.cc:290] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 3 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:08.045032 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:08.045204 14806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b10d8d4dacb243e7aaac381da834268a" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:08.045507 14661 raft_consensus.cc:3055] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:08.045778 14806 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:08.045814 14661 raft_consensus.cc:740] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:08.046706 14661 consensus_queue.cc:260] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.047683 14661 raft_consensus.cc:3060] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:08.050642 14806 raft_consensus.cc:2468] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 3.
I20260709 13:03:08.051949 14702 leader_election.cc:304] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:08.052296 14661 raft_consensus.cc:2468] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 3.
I20260709 13:03:08.052882 15017 raft_consensus.cc:2804] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:08.054105 15017 raft_consensus.cc:697] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 LEADER]: Becoming Leader. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:08.055011 15017 consensus_queue.cc:237] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.062660 14557 catalog_manager.cc:5697] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d reported cstate change: term changed from 2 to 3, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2). New cstate: current_term: 3 leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.233232 15018 raft_consensus.cc:993] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8: : Instructing follower fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:08.233721 15045 raft_consensus.cc:1081] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Signalling peer fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:08.235072 14806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40408
I20260709 13:03:08.235538 14806 raft_consensus.cc:493] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.235854 14806 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.240353 14806 raft_consensus.cc:515] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:08.242074 14806 leader_election.cc:290] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 4 election: Requested vote from peers 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567), 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063)
I20260709 13:03:08.242651 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:08.243104 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b2f0531fd6461f978b176760c2d5f3" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:08.243285 14734 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.243600 14661 raft_consensus.cc:3055] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:08.243845 14661 raft_consensus.cc:740] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:08.244451 14661 consensus_queue.cc:260] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:08.245225 14661 raft_consensus.cc:3060] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.247485 14734 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 4.
I20260709 13:03:08.248615 14775 leader_election.cc:304] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:08.249356 15014 raft_consensus.cc:2804] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:08.249660 14661 raft_consensus.cc:2468] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 4.
I20260709 13:03:08.251010 15014 raft_consensus.cc:697] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:08.251964 15014 consensus_queue.cc:237] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } }
I20260709 13:03:08.258980 14557 catalog_manager.cc:5697] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 3 to 4, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 4 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.368901 15018 raft_consensus.cc:993] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: : Instructing follower 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:08.369306 15045 raft_consensus.cc:1081] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Signalling peer 7c27edc1af3247f7b8d9ee2d2bbbac1d to start an election
I20260709 13:03:08.370631 14734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4"
dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
 from {username='slave'} at 127.0.0.1:41670
I20260709 13:03:08.371115 14734 raft_consensus.cc:493] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.371407 14734 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.375334 14734 raft_consensus.cc:515] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.376773 14734 leader_election.cc:290] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 4 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3:36883)
I20260709 13:03:08.377702 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:08.377759 14806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6ccbeef5ba40d2b49bc2734d90f3a4" candidate_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
I20260709 13:03:08.378270 14661 raft_consensus.cc:3055] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:08.378361 14806 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.378546 14661 raft_consensus.cc:740] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:08.379261 14661 consensus_queue.cc:260] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.380030 14661 raft_consensus.cc:3060] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:08.382831 14806 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 4.
I20260709 13:03:08.383718 14702 leader_election.cc:304] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:08.384392 15017 raft_consensus.cc:2804] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:08.384764 15017 raft_consensus.cc:697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 LEADER]: Becoming Leader. State: Replica: 7c27edc1af3247f7b8d9ee2d2bbbac1d, State: Running, Role: LEADER
I20260709 13:03:08.384904 14661 raft_consensus.cc:2468] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c27edc1af3247f7b8d9ee2d2bbbac1d in term 4.
I20260709 13:03:08.385469 15017 consensus_queue.cc:237] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.391788 14557 catalog_manager.cc:5697] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d reported cstate change: term changed from 3 to 4, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2). New cstate: current_term: 4 leader_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.511458 15018 raft_consensus.cc:993] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: : Instructing follower fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:08.511945 15045 raft_consensus.cc:1081] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 LEADER]: Signalling peer fc7e35df5c8f4668a17e400068b33ea8 to start an election
I20260709 13:03:08.513229 14806 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a"
dest_uuid: "fc7e35df5c8f4668a17e400068b33ea8"
 from {username='slave'} at 127.0.0.1:40408
I20260709 13:03:08.513700 14806 raft_consensus.cc:493] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.514026 14806 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:08.518213 14806 raft_consensus.cc:515] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.519784 14806 leader_election.cc:290] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 5 election: Requested vote from peers 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063), 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567)
I20260709 13:03:08.520579 14661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "727207cc1acf46328d17331555d87be8"
I20260709 13:03:08.520731 14734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bdee2f5b594fae8d75a5e5974d486a" candidate_uuid: "fc7e35df5c8f4668a17e400068b33ea8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d"
I20260709 13:03:08.521174 14661 raft_consensus.cc:3055] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:08.521246 14734 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:08.521509 14661 raft_consensus.cc:740] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 727207cc1acf46328d17331555d87be8, State: Running, Role: LEADER
I20260709 13:03:08.522156 14661 consensus_queue.cc:260] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.523000 14661 raft_consensus.cc:3060] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:08.525345 14734 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 5.
I20260709 13:03:08.526274 14775 leader_election.cc:304] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c27edc1af3247f7b8d9ee2d2bbbac1d, fc7e35df5c8f4668a17e400068b33ea8; no voters: 
I20260709 13:03:08.526959 15014 raft_consensus.cc:2804] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:08.527452 15014 raft_consensus.cc:697] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 5 LEADER]: Becoming Leader. State: Replica: fc7e35df5c8f4668a17e400068b33ea8, State: Running, Role: LEADER
I20260709 13:03:08.527467 14661 raft_consensus.cc:2468] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc7e35df5c8f4668a17e400068b33ea8 in term 5.
I20260709 13:03:08.528317 15014 consensus_queue.cc:237] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } }
I20260709 13:03:08.534960 14557 catalog_manager.cc:5697] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 reported cstate change: term changed from 4 to 5, leader changed from 727207cc1acf46328d17331555d87be8 (127.13.181.1) to fc7e35df5c8f4668a17e400068b33ea8 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "fc7e35df5c8f4668a17e400068b33ea8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.597630 14806 raft_consensus.cc:1275] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:08.598785 15017 consensus_queue.cc:1048] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.608090 14661 raft_consensus.cc:1275] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:08.609481 15017 consensus_queue.cc:1048] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.636500 14661 raft_consensus.cc:1275] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:08.637876 15014 consensus_queue.cc:1048] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.646445 14734 raft_consensus.cc:1275] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:08.647899 15052 consensus_queue.cc:1048] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.780493 14806 raft_consensus.cc:1275] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:08.781690 15017 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc7e35df5c8f4668a17e400068b33ea8" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:08.791349 14661 raft_consensus.cc:1275] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Refusing update from remote peer 7c27edc1af3247f7b8d9ee2d2bbbac1d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:08.792973 15017 consensus_queue.cc:1048] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "727207cc1acf46328d17331555d87be8" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 46063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:08.985764 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:08.992998 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
I20260709 13:03:09.019819 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:09.020764 14036 tablet_replica.cc:333] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.021741 14036 raft_consensus.cc:2243] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.022375 14036 raft_consensus.cc:2272] T 7e858d3dc3ef491ab3ea354a4791fb1d P 727207cc1acf46328d17331555d87be8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.024776 14036 tablet_replica.cc:333] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.025393 14036 raft_consensus.cc:2243] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.026154 14036 raft_consensus.cc:2272] T 16ec387a07c1438b8a6c177a6e5c3aeb P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.028167 14036 tablet_replica.cc:333] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.028890 14036 raft_consensus.cc:2243] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.029790 14036 raft_consensus.cc:2272] T 036fec1d1a2344eeba7c85222c530396 P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:09.030594 14700 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
I20260709 13:03:09.032106 14036 tablet_replica.cc:333] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.032652 14036 raft_consensus.cc:2243] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.033342 14036 raft_consensus.cc:2272] T 10d37a06e3914f13ab14f4657b95083a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.035375 14036 tablet_replica.cc:333] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.036114 14036 raft_consensus.cc:2243] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.037096 14036 raft_consensus.cc:2272] T cec534d1933d4914968d52565b76ebd0 P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:09.037992 14700 consensus_peers.cc:597] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d -> Peer 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063): Couldn't send request to peer 727207cc1acf46328d17331555d87be8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.038965 14036 tablet_replica.cc:333] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.039590 14036 raft_consensus.cc:2243] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.039959 14036 raft_consensus.cc:2272] T 34bdee2f5b594fae8d75a5e5974d486a P 727207cc1acf46328d17331555d87be8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.041936 14036 tablet_replica.cc:333] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.042423 14036 raft_consensus.cc:2243] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.042811 14036 raft_consensus.cc:2272] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.044952 14036 tablet_replica.cc:333] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.045439 14036 raft_consensus.cc:2243] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.045831 14036 raft_consensus.cc:2272] T b10d8d4dacb243e7aaac381da834268a P 727207cc1acf46328d17331555d87be8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.047767 14036 tablet_replica.cc:333] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.048326 14036 raft_consensus.cc:2243] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.048768 14036 raft_consensus.cc:2272] T 39ba54e2af004ab1892ecfbd57ef98ee P 727207cc1acf46328d17331555d87be8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.050835 14036 tablet_replica.cc:333] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8: stopping tablet replica
I20260709 13:03:09.051394 14036 raft_consensus.cc:2243] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.051887 14036 raft_consensus.cc:2272] T 22b2f0531fd6461f978b176760c2d5f3 P 727207cc1acf46328d17331555d87be8 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:09.053231 14774 consensus_peers.cc:597] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 -> Peer 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063): Couldn't send request to peer 727207cc1acf46328d17331555d87be8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.054561 14774 consensus_peers.cc:597] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 -> Peer 727207cc1acf46328d17331555d87be8 (127.13.181.1:46063): Couldn't send request to peer 727207cc1acf46328d17331555d87be8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.071509 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
I20260709 13:03:09.084589 14734 raft_consensus.cc:1275] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 5 FOLLOWER]: Refusing update from remote peer fc7e35df5c8f4668a17e400068b33ea8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:09.086613 15052 consensus_queue.cc:1048] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c27edc1af3247f7b8d9ee2d2bbbac1d" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.094056 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
W20260709 13:03:09.100855 14775 consensus_peers.cc:597] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 -> Peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Couldn't send request to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:09.107133 14775 consensus_peers.cc:597] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 -> Peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Couldn't send request to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.120334 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:09.121027 14036 tablet_replica.cc:333] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.121600 14036 raft_consensus.cc:2243] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.122033 14036 raft_consensus.cc:2272] T 16ec387a07c1438b8a6c177a6e5c3aeb P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.123759 14036 tablet_replica.cc:333] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.124289 14036 raft_consensus.cc:2243] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.125022 14036 raft_consensus.cc:2272] T b10d8d4dacb243e7aaac381da834268a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.127136 14036 tablet_replica.cc:333] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.127669 14036 raft_consensus.cc:2243] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.128377 14036 raft_consensus.cc:2272] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.130204 14036 tablet_replica.cc:333] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.130708 14036 raft_consensus.cc:2243] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.131161 14036 raft_consensus.cc:2272] T 036fec1d1a2344eeba7c85222c530396 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.132639 14036 tablet_replica.cc:333] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.133109 14036 raft_consensus.cc:2243] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.133495 14036 raft_consensus.cc:2272] T 10d37a06e3914f13ab14f4657b95083a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.135011 14036 tablet_replica.cc:333] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.135558 14036 raft_consensus.cc:2243] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.135922 14036 pending_rounds.cc:70] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Trying to abort 1 pending ops.
I20260709 13:03:09.136152 14036 pending_rounds.cc:77] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d: Aborting op as it isn't in flight: id { term: 5 index: 5 } timestamp: 7305634564218720256 op_type: NO_OP noop_request { }
I20260709 13:03:09.136511 14036 raft_consensus.cc:2889] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:03:09.136796 14036 raft_consensus.cc:2272] T 34bdee2f5b594fae8d75a5e5974d486a P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.138918 14036 tablet_replica.cc:333] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.139428 14036 raft_consensus.cc:2243] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.139828 14036 raft_consensus.cc:2272] T cec534d1933d4914968d52565b76ebd0 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.141383 14036 tablet_replica.cc:333] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.141974 14036 raft_consensus.cc:2243] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.142872 14036 raft_consensus.cc:2272] T 7e858d3dc3ef491ab3ea354a4791fb1d P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.145008 14036 tablet_replica.cc:333] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
W20260709 13:03:09.145390 14775 consensus_peers.cc:597] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 -> Peer 7c27edc1af3247f7b8d9ee2d2bbbac1d (127.13.181.2:35567): Couldn't send request to peer 7c27edc1af3247f7b8d9ee2d2bbbac1d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:09.145524 14036 raft_consensus.cc:2243] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.145985 14036 raft_consensus.cc:2272] T 39ba54e2af004ab1892ecfbd57ef98ee P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.147794 14036 tablet_replica.cc:333] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d: stopping tablet replica
I20260709 13:03:09.148239 14036 raft_consensus.cc:2243] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.148648 14036 raft_consensus.cc:2272] T 22b2f0531fd6461f978b176760c2d5f3 P 7c27edc1af3247f7b8d9ee2d2bbbac1d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.176437 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
I20260709 13:03:09.194790 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
I20260709 13:03:09.219374 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:09.220171 14036 tablet_replica.cc:333] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.220938 14036 raft_consensus.cc:2243] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.221410 14036 raft_consensus.cc:2272] T 7e858d3dc3ef491ab3ea354a4791fb1d P fc7e35df5c8f4668a17e400068b33ea8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.223176 14036 tablet_replica.cc:333] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.223665 14036 raft_consensus.cc:2243] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.224382 14036 raft_consensus.cc:2272] T 34bdee2f5b594fae8d75a5e5974d486a P fc7e35df5c8f4668a17e400068b33ea8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.226305 14036 tablet_replica.cc:333] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.226789 14036 raft_consensus.cc:2243] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.227195 14036 raft_consensus.cc:2272] T cec534d1933d4914968d52565b76ebd0 P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.228734 14036 tablet_replica.cc:333] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.229205 14036 raft_consensus.cc:2243] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.229592 14036 raft_consensus.cc:2272] T 036fec1d1a2344eeba7c85222c530396 P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.231133 14036 tablet_replica.cc:333] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.231660 14036 raft_consensus.cc:2243] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.232043 14036 raft_consensus.cc:2272] T 10d37a06e3914f13ab14f4657b95083a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.233528 14036 tablet_replica.cc:333] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.234015 14036 raft_consensus.cc:2243] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.234454 14036 raft_consensus.cc:2272] T 16ec387a07c1438b8a6c177a6e5c3aeb P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.235982 14036 tablet_replica.cc:333] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.236443 14036 raft_consensus.cc:2243] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.237179 14036 raft_consensus.cc:2272] T 39ba54e2af004ab1892ecfbd57ef98ee P fc7e35df5c8f4668a17e400068b33ea8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.238744 14036 tablet_replica.cc:333] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.239432 14036 raft_consensus.cc:2243] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.240173 14036 raft_consensus.cc:2272] T 22b2f0531fd6461f978b176760c2d5f3 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.242044 14036 tablet_replica.cc:333] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.242522 14036 raft_consensus.cc:2243] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.242939 14036 raft_consensus.cc:2272] T 3e6ccbeef5ba40d2b49bc2734d90f3a4 P fc7e35df5c8f4668a17e400068b33ea8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.244787 14036 tablet_replica.cc:333] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8: stopping tablet replica
I20260709 13:03:09.245239 14036 raft_consensus.cc:2243] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.245649 14036 raft_consensus.cc:2272] T b10d8d4dacb243e7aaac381da834268a P fc7e35df5c8f4668a17e400068b33ea8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.273470 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
I20260709 13:03:09.291220 14036 master.cc:562] Master@127.13.181.62:33541 shutting down...
I20260709 13:03:09.317731 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:09.318295 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.318634 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P e49d31e6ea9a4a9b87d2633752b22996: stopping tablet replica
I20260709 13:03:09.338964 14036 master.cc:584] Master@127.13.181.62:33541 shutdown complete.
727207cc1acf46328d17331555d87be8  5
7c27edc1af3247f7b8d9ee2d2bbbac1d  4
fc7e35df5c8f4668a17e400068b33ea8  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12585 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:03:09.379519 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:42621
I20260709 13:03:09.380651 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:09.385648 15070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:09.387109 15071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:09.387467 15073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:09.387925 14036 server_base.cc:1061] running on GCE node
I20260709 13:03:09.388674 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:09.388875 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:09.388983 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602189388972 us; error 0 us; skew 500 ppm
I20260709 13:03:09.389422 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:09.391801 14036 webserver.cc:533] Webserver started at http://127.13.181.62:39911/ using document root <none> and password file <none>
I20260709 13:03:09.392230 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:09.392382 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:09.392598 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:09.393642 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "d7ef35df06e147c6a6e7757620253191"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.397967 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:09.401182 15078 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.401929 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:09.402220 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "d7ef35df06e147c6a6e7757620253191"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.402534 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:09.415232 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:09.416445 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:09.458251 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:42621
I20260709 13:03:09.458370 15129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:42621 every 8 connection(s)
I20260709 13:03:09.462210 15130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:09.472648 15130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Bootstrap starting.
I20260709 13:03:09.477520 15130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:09.482019 15130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: No bootstrap required, opened a new log
I20260709 13:03:09.484287 15130 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ef35df06e147c6a6e7757620253191" member_type: VOTER }
I20260709 13:03:09.484707 15130 raft_consensus.cc:385] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:09.484958 15130 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7ef35df06e147c6a6e7757620253191, State: Initialized, Role: FOLLOWER
I20260709 13:03:09.485628 15130 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ef35df06e147c6a6e7757620253191" member_type: VOTER }
I20260709 13:03:09.486120 15130 raft_consensus.cc:399] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:09.486373 15130 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:09.486663 15130 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:09.490937 15130 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ef35df06e147c6a6e7757620253191" member_type: VOTER }
I20260709 13:03:09.491500 15130 leader_election.cc:304] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7ef35df06e147c6a6e7757620253191; no voters: 
I20260709 13:03:09.492599 15130 leader_election.cc:290] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:09.492934 15133 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:09.494300 15133 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 1 LEADER]: Becoming Leader. State: Replica: d7ef35df06e147c6a6e7757620253191, State: Running, Role: LEADER
I20260709 13:03:09.494967 15133 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ef35df06e147c6a6e7757620253191" member_type: VOTER }
I20260709 13:03:09.495888 15130 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:09.499915 15135 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7ef35df06e147c6a6e7757620253191. Latest consensus state: current_term: 1 leader_uuid: "d7ef35df06e147c6a6e7757620253191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ef35df06e147c6a6e7757620253191" member_type: VOTER } }
I20260709 13:03:09.500697 15135 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:09.501173 15134 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7ef35df06e147c6a6e7757620253191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7ef35df06e147c6a6e7757620253191" member_type: VOTER } }
I20260709 13:03:09.501708 15134 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:09.502889 15140 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:09.508016 15140 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:09.511397 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:09.516124 15140 catalog_manager.cc:1383] Generated new cluster ID: b5b7e9bd61e64699b99391d8da47ff5e
I20260709 13:03:09.516402 15140 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:09.540216 15140 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:09.541414 15140 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:09.560367 15140 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Generated new TSK 0
I20260709 13:03:09.560976 15140 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:09.577461 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:09.583384 15151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:09.584581 15152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:09.587370 14036 server_base.cc:1061] running on GCE node
W20260709 13:03:09.587651 15154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:09.589579 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:09.589761 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:09.589882 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602189589871 us; error 0 us; skew 500 ppm
I20260709 13:03:09.590333 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:09.592504 14036 webserver.cc:533] Webserver started at http://127.13.181.1:37845/ using document root <none> and password file <none>
I20260709 13:03:09.592911 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:09.593060 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:09.593428 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:09.594705 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.599100 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:03:09.602181 15159 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.602967 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:09.603336 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.603602 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:09.614193 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:09.615432 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:09.616972 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:09.619231 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:09.619441 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.619690 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:09.619871 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.658604 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:39515
I20260709 13:03:09.658691 15221 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:39515 every 8 connection(s)
I20260709 13:03:09.663511 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:09.670934 15226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:09.671204 15227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:09.673991 14036 server_base.cc:1061] running on GCE node
W20260709 13:03:09.674633 15229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:09.675516 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:09.675743 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:09.675923 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602189675906 us; error 0 us; skew 500 ppm
I20260709 13:03:09.676435 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:09.678794 14036 webserver.cc:533] Webserver started at http://127.13.181.2:36875/ using document root <none> and password file <none>
I20260709 13:03:09.679414 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:09.679666 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:09.679992 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:09.681519 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "f4ca86ee1d194023b1414bbe226f4798"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.682029 15222 heartbeater.cc:344] Connected to a master server at 127.13.181.62:42621
I20260709 13:03:09.682423 15222 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:09.683163 15222 heartbeater.cc:507] Master 127.13.181.62:42621 requested a full tablet report, sending...
I20260709 13:03:09.685051 15095 ts_manager.cc:194] Registered new tserver with Master: 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:09.686548 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:03:09.686781 15095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60908
I20260709 13:03:09.690092 15234 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.690838 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:03:09.691150 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "f4ca86ee1d194023b1414bbe226f4798"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.691442 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:09.707265 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:09.708436 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:09.709836 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:09.711947 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:09.712172 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.712414 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:09.712586 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.750236 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:41191
I20260709 13:03:09.750336 15296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:41191 every 8 connection(s)
I20260709 13:03:09.754845 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:09.762254 15300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:09.763180 15301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:09.765034 15303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:09.766299 14036 server_base.cc:1061] running on GCE node
I20260709 13:03:09.766985 15297 heartbeater.cc:344] Connected to a master server at 127.13.181.62:42621
I20260709 13:03:09.767396 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:09.767417 15297 heartbeater.cc:461] Registering TS with master...
W20260709 13:03:09.767697 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:09.767900 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602189767883 us; error 0 us; skew 500 ppm
I20260709 13:03:09.768328 15297 heartbeater.cc:507] Master 127.13.181.62:42621 requested a full tablet report, sending...
I20260709 13:03:09.768472 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:09.770243 15095 ts_manager.cc:194] Registered new tserver with Master: f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:09.771229 14036 webserver.cc:533] Webserver started at http://127.13.181.3:34251/ using document root <none> and password file <none>
I20260709 13:03:09.771713 15095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60922
I20260709 13:03:09.771873 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:09.772200 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:09.772483 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:09.773655 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.777921 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:09.781113 15308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.781847 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:09.782081 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
format_stamp: "Formatted at 2026-07-09 13:03:09 on dist-test-slave-28ks"
I20260709 13:03:09.782306 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:09.793704 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:09.794796 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:09.796231 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:09.798460 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:09.798693 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:09.798947 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:09.799201 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:03:09.837852 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:46145
I20260709 13:03:09.837946 15370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:46145 every 8 connection(s)
I20260709 13:03:09.851579 15371 heartbeater.cc:344] Connected to a master server at 127.13.181.62:42621
I20260709 13:03:09.851918 15371 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:09.852669 15371 heartbeater.cc:507] Master 127.13.181.62:42621 requested a full tablet report, sending...
I20260709 13:03:09.854532 15095 ts_manager.cc:194] Registered new tserver with Master: 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:09.855465 14036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014505287s
I20260709 13:03:09.855901 15095 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60926
I20260709 13:03:09.880625 15095 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60938:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:09.886638 15095 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:10.083685 15262 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb3da04f8ef4391ab70433e50f9700b (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:10.085224 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb3da04f8ef4391ab70433e50f9700b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.089483 15261 tablet_service.cc:1511] Processing CreateTablet for tablet c93533d7be6c4a0e8829e3256295bd39 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:10.093420 15260 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecbb94961244797af5928bce195f79f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:10.098217 15336 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb3da04f8ef4391ab70433e50f9700b (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:10.099578 15336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb3da04f8ef4391ab70433e50f9700b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.102847 15334 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecbb94961244797af5928bce195f79f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:10.104184 15334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecbb94961244797af5928bce195f79f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.104379 15335 tablet_service.cc:1511] Processing CreateTablet for tablet c93533d7be6c4a0e8829e3256295bd39 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:10.105652 15335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93533d7be6c4a0e8829e3256295bd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.107651 15181 tablet_service.cc:1511] Processing CreateTablet for tablet 11ca54a37ddc4e00b8e839d0559b4c60 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:10.108980 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ca54a37ddc4e00b8e839d0559b4c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.111621 15179 tablet_service.cc:1511] Processing CreateTablet for tablet 659b62cebe2e47e793145022f6eed4ba (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:10.112938 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659b62cebe2e47e793145022f6eed4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.115159 15178 tablet_service.cc:1511] Processing CreateTablet for tablet 45855d6a21ab45bf98e978ef6a3fd439 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:10.116456 15178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45855d6a21ab45bf98e978ef6a3fd439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.116237 15333 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8a0429d4024b20b2a1dbe68f14d55e (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:10.117549 15333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8a0429d4024b20b2a1dbe68f14d55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.121608 15186 tablet_service.cc:1511] Processing CreateTablet for tablet c93533d7be6c4a0e8829e3256295bd39 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:03:10.122601 15182 tablet_service.cc:1511] Processing CreateTablet for tablet 482b1159f7a94289b838ac9ce3753faa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:10.122990 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93533d7be6c4a0e8829e3256295bd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.128710 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 11ca54a37ddc4e00b8e839d0559b4c60 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:10.130378 15259 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8a0429d4024b20b2a1dbe68f14d55e (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:10.131043 15255 tablet_service.cc:1511] Processing CreateTablet for tablet cd30733283c2467f90c340ef580e1d8a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:10.132210 15258 tablet_service.cc:1511] Processing CreateTablet for tablet 155d48b4318a4f7da7c4bc8ef9b73267 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:10.135788 15254 tablet_service.cc:1511] Processing CreateTablet for tablet 659b62cebe2e47e793145022f6eed4ba (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:10.136444 15328 tablet_service.cc:1511] Processing CreateTablet for tablet 659b62cebe2e47e793145022f6eed4ba (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:03:10.121608 15180 tablet_service.cc:1511] Processing CreateTablet for tablet cd30733283c2467f90c340ef580e1d8a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:10.137826 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659b62cebe2e47e793145022f6eed4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.125700 15187 tablet_service.cc:1511] Processing CreateTablet for tablet 1bb3da04f8ef4391ab70433e50f9700b (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:03:10.140195 15257 tablet_service.cc:1511] Processing CreateTablet for tablet 482b1159f7a94289b838ac9ce3753faa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:10.142189 15330 tablet_service.cc:1511] Processing CreateTablet for tablet 11ca54a37ddc4e00b8e839d0559b4c60 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:03:10.143743 15330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ca54a37ddc4e00b8e839d0559b4c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.148136 15331 tablet_service.cc:1511] Processing CreateTablet for tablet 482b1159f7a94289b838ac9ce3753faa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:03:10.149632 15331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482b1159f7a94289b838ac9ce3753faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.152151 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 45855d6a21ab45bf98e978ef6a3fd439 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:10.153656 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45855d6a21ab45bf98e978ef6a3fd439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.156183 15329 tablet_service.cc:1511] Processing CreateTablet for tablet cd30733283c2467f90c340ef580e1d8a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:03:10.157572 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd30733283c2467f90c340ef580e1d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.161054 15261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c93533d7be6c4a0e8829e3256295bd39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.160710 15332 tablet_service.cc:1511] Processing CreateTablet for tablet 155d48b4318a4f7da7c4bc8ef9b73267 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:10.162801 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482b1159f7a94289b838ac9ce3753faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.163010 15332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155d48b4318a4f7da7c4bc8ef9b73267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.169761 15253 tablet_service.cc:1511] Processing CreateTablet for tablet 45855d6a21ab45bf98e978ef6a3fd439 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:03:10.124107 15184 tablet_service.cc:1511] Processing CreateTablet for tablet 0e8a0429d4024b20b2a1dbe68f14d55e (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:03:10.167418 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bb3da04f8ef4391ab70433e50f9700b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.125249 15185 tablet_service.cc:1511] Processing CreateTablet for tablet 9ecbb94961244797af5928bce195f79f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:03:10.125701 15183 tablet_service.cc:1511] Processing CreateTablet for tablet 155d48b4318a4f7da7c4bc8ef9b73267 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:03:10.179653 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155d48b4318a4f7da7c4bc8ef9b73267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.204452 15180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd30733283c2467f90c340ef580e1d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.211719 15183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 155d48b4318a4f7da7c4bc8ef9b73267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.212126 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 482b1159f7a94289b838ac9ce3753faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.212651 15185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecbb94961244797af5928bce195f79f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.215366 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd30733283c2467f90c340ef580e1d8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.201613 15334 tablet_service.cc:1511] Processing CreateTablet for tablet aee71b2a252a4ac8bc26aaed3987219f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:10.225915 15387 tablet_bootstrap.cc:492] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:10.225929 15262 tablet_service.cc:1511] Processing CreateTablet for tablet aee71b2a252a4ac8bc26aaed3987219f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:10.232338 15387 tablet_bootstrap.cc:654] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.235347 15184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8a0429d4024b20b2a1dbe68f14d55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.239272 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ca54a37ddc4e00b8e839d0559b4c60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.243537 15259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8a0429d4024b20b2a1dbe68f14d55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.269126 15386 tablet_bootstrap.cc:492] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:10.269846 15254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659b62cebe2e47e793145022f6eed4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.270570 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45855d6a21ab45bf98e978ef6a3fd439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.273924 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecbb94961244797af5928bce195f79f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.285851 15388 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:10.299223 15186 tablet_service.cc:1511] Processing CreateTablet for tablet ea59d818ff084b4eb5b080bf57d2e238 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:10.300606 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea59d818ff084b4eb5b080bf57d2e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.305610 15388 tablet_bootstrap.cc:654] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.307057 15329 tablet_service.cc:1511] Processing CreateTablet for tablet ea59d818ff084b4eb5b080bf57d2e238 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:10.311265 15255 tablet_service.cc:1511] Processing CreateTablet for tablet ea59d818ff084b4eb5b080bf57d2e238 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:03:10.321010 15331 tablet_service.cc:1511] Processing CreateTablet for tablet 10c43c77e8974262bb6e378d078a6ab5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:10.322265 15387 tablet_bootstrap.cc:492] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:10.322360 15183 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8ef022b8854b68ac36c434a5c64a1f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:10.322839 15387 ts_tablet_manager.cc:1403] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.097s	user 0.043s	sys 0.013s
I20260709 13:03:10.339792 15183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8ef022b8854b68ac36c434a5c64a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.340049 15253 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8ef022b8854b68ac36c434a5c64a1f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:10.342212 15387 raft_consensus.cc:359] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.343072 15387 raft_consensus.cc:385] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.343420 15387 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.344250 15387 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.317967 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee71b2a252a4ac8bc26aaed3987219f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.328157 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 1a8ef022b8854b68ac36c434a5c64a1f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:03:10.335958 15187 tablet_service.cc:1511] Processing CreateTablet for tablet 10c43c77e8974262bb6e378d078a6ab5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:10.338354 15260 tablet_service.cc:1511] Processing CreateTablet for tablet 10c43c77e8974262bb6e378d078a6ab5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:03:10.348019 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c43c77e8974262bb6e378d078a6ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.349448 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8ef022b8854b68ac36c434a5c64a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.363785 15178 tablet_service.cc:1511] Processing CreateTablet for tablet aee71b2a252a4ac8bc26aaed3987219f (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:03:10.356528 15334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee71b2a252a4ac8bc26aaed3987219f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.386425 15387 ts_tablet_manager.cc:1434] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.047s	user 0.012s	sys 0.025s
I20260709 13:03:10.392620 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea59d818ff084b4eb5b080bf57d2e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.395411 15371 heartbeater.cc:499] Master 127.13.181.62:42621 was elected leader, sending a full tablet report...
I20260709 13:03:10.397840 15331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c43c77e8974262bb6e378d078a6ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.398747 15387 tablet_bootstrap.cc:492] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:10.403342 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8ef022b8854b68ac36c434a5c64a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.411331 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea59d818ff084b4eb5b080bf57d2e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.412858 15261 tablet_service.cc:1511] Processing CreateTablet for tablet 6056d49d08dc4130887dbf154edc6675 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:10.414120 15261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6056d49d08dc4130887dbf154edc6675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.417918 15185 tablet_service.cc:1511] Processing CreateTablet for tablet 6056d49d08dc4130887dbf154edc6675 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:10.420789 15387 tablet_bootstrap.cc:654] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.423251 15178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee71b2a252a4ac8bc26aaed3987219f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.425067 15388 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:10.425515 15388 ts_tablet_manager.cc:1403] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.209s	user 0.012s	sys 0.005s
I20260709 13:03:10.426493 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0b675005cd4e229d4415a2bcdf807c (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:10.427755 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0b675005cd4e229d4415a2bcdf807c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.430707 15335 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0b675005cd4e229d4415a2bcdf807c (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:10.436873 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10c43c77e8974262bb6e378d078a6ab5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.438155 15336 tablet_service.cc:1511] Processing CreateTablet for tablet 6056d49d08dc4130887dbf154edc6675 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:03:10.439564 15335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0b675005cd4e229d4415a2bcdf807c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.443893 15257 tablet_service.cc:1511] Processing CreateTablet for tablet 380c5f9d7ddb4221b333ac415575e7fc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:10.445953 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380c5f9d7ddb4221b333ac415575e7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.445801 15255 tablet_service.cc:1511] Processing CreateTablet for tablet 3251a863683a43fd9e2d5c154e67b4f5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:10.432430 15333 tablet_service.cc:1511] Processing CreateTablet for tablet 380c5f9d7ddb4221b333ac415575e7fc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:10.432715 15388 raft_consensus.cc:359] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.447279 15388 raft_consensus.cc:385] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.447655 15388 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.448570 15388 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.451815 15333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380c5f9d7ddb4221b333ac415575e7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.455559 15336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6056d49d08dc4130887dbf154edc6675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.458151 15330 tablet_service.cc:1511] Processing CreateTablet for tablet 3251a863683a43fd9e2d5c154e67b4f5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:10.459614 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3251a863683a43fd9e2d5c154e67b4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.467625 15182 tablet_service.cc:1511] Processing CreateTablet for tablet 380c5f9d7ddb4221b333ac415575e7fc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:03:10.475564 15386 tablet_bootstrap.cc:654] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.478470 15185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6056d49d08dc4130887dbf154edc6675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.479249 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 380c5f9d7ddb4221b333ac415575e7fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.468371 15258 tablet_service.cc:1511] Processing CreateTablet for tablet 716a73e82c564a6aa345a1f893caf7df (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:10.469368 15181 tablet_service.cc:1511] Processing CreateTablet for tablet 3251a863683a43fd9e2d5c154e67b4f5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:03:10.438220 15180 tablet_service.cc:1511] Processing CreateTablet for tablet 9c0b675005cd4e229d4415a2bcdf807c (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:03:10.487365 15387 tablet_bootstrap.cc:492] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:10.513363 15254 tablet_service.cc:1511] Processing CreateTablet for tablet 35a9f3a7e30d4ada878a020a4a8fcdc6 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:10.504258 15179 tablet_service.cc:1511] Processing CreateTablet for tablet 716a73e82c564a6aa345a1f893caf7df (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 13:03:10.506381 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:10.513906 15387 ts_tablet_manager.cc:1403] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.115s	user 0.019s	sys 0.000s
I20260709 13:03:10.513782 15388 ts_tablet_manager.cc:1434] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.088s	user 0.010s	sys 0.001s
I20260709 13:03:10.517040 15330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3251a863683a43fd9e2d5c154e67b4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.517786 15391 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.518242 15391 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.523351 15222 heartbeater.cc:499] Master 127.13.181.62:42621 was elected leader, sending a full tablet report...
I20260709 13:03:10.524298 15391 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:10.513156 15261 tablet_service.cc:1511] Processing CreateTablet for tablet 7df15ef5ed244e05887f9af5ba36331a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:10.525197 15254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a9f3a7e30d4ada878a020a4a8fcdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.526309 15261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df15ef5ed244e05887f9af5ba36331a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.528438 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716a73e82c564a6aa345a1f893caf7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.534597 15183 tablet_service.cc:1511] Processing CreateTablet for tablet 35a9f3a7e30d4ada878a020a4a8fcdc6 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:10.506453 15184 tablet_service.cc:1511] Processing CreateTablet for tablet 7df15ef5ed244e05887f9af5ba36331a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:10.553685 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 40f6ff8071574893b4031710ebd49b6d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:10.555312 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f6ff8071574893b4031710ebd49b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.548254 15332 tablet_service.cc:1511] Processing CreateTablet for tablet 716a73e82c564a6aa345a1f893caf7df (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:03:10.550565 15329 tablet_service.cc:1511] Processing CreateTablet for tablet 7df15ef5ed244e05887f9af5ba36331a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:03:10.550738 15328 tablet_service.cc:1511] Processing CreateTablet for tablet 35a9f3a7e30d4ada878a020a4a8fcdc6 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:03:10.561386 15332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716a73e82c564a6aa345a1f893caf7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.571616 15187 tablet_service.cc:1511] Processing CreateTablet for tablet 40f6ff8071574893b4031710ebd49b6d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:10.572956 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f6ff8071574893b4031710ebd49b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.575767 15388 tablet_bootstrap.cc:492] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:10.580493 15180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0b675005cd4e229d4415a2bcdf807c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.582916 15253 tablet_service.cc:1511] Processing CreateTablet for tablet 40f6ff8071574893b4031710ebd49b6d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:03:10.583607 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3251a863683a43fd9e2d5c154e67b4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.584195 15184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df15ef5ed244e05887f9af5ba36331a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.584363 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f6ff8071574893b4031710ebd49b6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.592538 15183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a9f3a7e30d4ada878a020a4a8fcdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.598443 15388 tablet_bootstrap.cc:654] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.606976 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df15ef5ed244e05887f9af5ba36331a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.609831 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 716a73e82c564a6aa345a1f893caf7df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.595772 15387 raft_consensus.cc:359] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.631827 15186 tablet_service.cc:1511] Processing CreateTablet for tablet 4e05bb3e986e4b3a8f417f713423b82a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:10.635617 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e05bb3e986e4b3a8f417f713423b82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.618338 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a9f3a7e30d4ada878a020a4a8fcdc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.632093 15259 tablet_service.cc:1511] Processing CreateTablet for tablet c1011f7cfdb64b11bff42c90ec444dbe (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:10.640377 15259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1011f7cfdb64b11bff42c90ec444dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.617446 15387 raft_consensus.cc:385] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.641697 15387 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.642583 15387 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.644711 15387 ts_tablet_manager.cc:1434] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.128s	user 0.011s	sys 0.001s
I20260709 13:03:10.645684 15387 tablet_bootstrap.cc:492] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:10.651913 15178 tablet_service.cc:1511] Processing CreateTablet for tablet c1011f7cfdb64b11bff42c90ec444dbe (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:10.653293 15178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1011f7cfdb64b11bff42c90ec444dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.657114 15386 tablet_bootstrap.cc:492] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:10.657611 15386 ts_tablet_manager.cc:1403] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.389s	user 0.029s	sys 0.008s
I20260709 13:03:10.657553 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 4e05bb3e986e4b3a8f417f713423b82a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:10.636695 15182 tablet_service.cc:1511] Processing CreateTablet for tablet f50ce7cd90ad42439199d54f3a3d3950 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:10.660650 15386 raft_consensus.cc:359] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:10.682442 15386 raft_consensus.cc:385] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.682749 15386 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.683485 15386 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:10.658999 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e05bb3e986e4b3a8f417f713423b82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.696317 15387 tablet_bootstrap.cc:654] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.697270 15257 tablet_service.cc:1511] Processing CreateTablet for tablet f50ce7cd90ad42439199d54f3a3d3950 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:10.661572 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50ce7cd90ad42439199d54f3a3d3950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.698668 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50ce7cd90ad42439199d54f3a3d3950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.701771 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:10.662058 15331 tablet_service.cc:1511] Processing CreateTablet for tablet 4e05bb3e986e4b3a8f417f713423b82a (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:03:10.704341 15331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e05bb3e986e4b3a8f417f713423b82a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:10.708250 15309 leader_election.cc:343] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.723243 15386 ts_tablet_manager.cc:1434] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.008s
I20260709 13:03:10.724255 15386 tablet_bootstrap.cc:492] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:10.728327 15297 heartbeater.cc:499] Master 127.13.181.62:42621 was elected leader, sending a full tablet report...
I20260709 13:03:10.729184 15185 tablet_service.cc:1511] Processing CreateTablet for tablet bbda06dce1ef4632a18d727a37228d76 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:10.729822 15391 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.730453 15185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbda06dce1ef4632a18d727a37228d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.730266 15391 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.732347 15391 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:10.734136 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:10.735581 15309 leader_election.cc:343] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.735332 15186 tablet_service.cc:1511] Processing CreateTablet for tablet ca0c163c2e66421488cfcf267f5215be (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:10.736614 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0c163c2e66421488cfcf267f5215be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.741379 15261 tablet_service.cc:1511] Processing CreateTablet for tablet ca0c163c2e66421488cfcf267f5215be (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:10.742630 15261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0c163c2e66421488cfcf267f5215be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.662642 15334 tablet_service.cc:1511] Processing CreateTablet for tablet c1011f7cfdb64b11bff42c90ec444dbe (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:03:10.743508 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:10.743996 15334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1011f7cfdb64b11bff42c90ec444dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.744026 15255 tablet_service.cc:1511] Processing CreateTablet for tablet bbda06dce1ef4632a18d727a37228d76 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:10.742964 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:10.745332 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbda06dce1ef4632a18d727a37228d76. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:10.745707 15312 leader_election.cc:343] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.746119 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:10.747320 15312 leader_election.cc:343] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.747697 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:10.748631 15391 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:10.749233 15391 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:10.759284 15333 tablet_service.cc:1511] Processing CreateTablet for tablet f50ce7cd90ad42439199d54f3a3d3950 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:03:10.760607 15333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50ce7cd90ad42439199d54f3a3d3950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.767114 15330 tablet_service.cc:1511] Processing CreateTablet for tablet bbda06dce1ef4632a18d727a37228d76 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:03:10.768414 15330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbda06dce1ef4632a18d727a37228d76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.771163 15393 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.771432 15329 tablet_service.cc:1511] Processing CreateTablet for tablet ca0c163c2e66421488cfcf267f5215be (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:03:10.773108 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0c163c2e66421488cfcf267f5215be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.771633 15393 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.798830 15258 tablet_service.cc:1511] Processing CreateTablet for tablet e0b08eaff26447e0b420aa798c881192 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:10.800644 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b08eaff26447e0b420aa798c881192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.781744 15393 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:10.813732 15253 tablet_service.cc:1511] Processing CreateTablet for tablet 0faaa04570d144c9bd5a7d514ee23dc4 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:10.815822 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0faaa04570d144c9bd5a7d514ee23dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.820439 15386 tablet_bootstrap.cc:654] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:10.831791 15398 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.832311 15398 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:10.834883 15398 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
W20260709 13:03:10.821071 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 73778.3us
I20260709 13:03:10.855823 15328 tablet_service.cc:1511] Processing CreateTablet for tablet e0b08eaff26447e0b420aa798c881192 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:10.857188 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b08eaff26447e0b420aa798c881192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.863332 15388 tablet_bootstrap.cc:492] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:10.863839 15388 ts_tablet_manager.cc:1403] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.288s	user 0.016s	sys 0.009s
I20260709 13:03:10.872249 15186 tablet_service.cc:1511] Processing CreateTablet for tablet e0b08eaff26447e0b420aa798c881192 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:03:10.872550 15179 tablet_service.cc:1511] Processing CreateTablet for tablet 0faaa04570d144c9bd5a7d514ee23dc4 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:10.873613 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b08eaff26447e0b420aa798c881192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.874910 15185 tablet_service.cc:1511] Processing CreateTablet for tablet 5fce2f0ee66247f686730bc62ef5cdfb (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:10.876156 15185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fce2f0ee66247f686730bc62ef5cdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.880393 15178 tablet_service.cc:1511] Processing CreateTablet for tablet 49393a249e3f433db3840189ee7dc630 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:10.881765 15178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49393a249e3f433db3840189ee7dc630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.883867 15261 tablet_service.cc:1511] Processing CreateTablet for tablet ddce72028fce49eb8627f523baef9ad0 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:10.884135 15257 tablet_service.cc:1511] Processing CreateTablet for tablet 708015fd563e4389af835f3aca58eb01 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:10.885118 15261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddce72028fce49eb8627f523baef9ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.886394 15262 tablet_service.cc:1511] Processing CreateTablet for tablet 87f2fb4185c84ac7a09a309c58e0c6b5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:10.887624 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f2fb4185c84ac7a09a309c58e0c6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.892424 15260 tablet_service.cc:1511] Processing CreateTablet for tablet d932cad3925e47b28537cca64ba27320 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:10.894070 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d932cad3925e47b28537cca64ba27320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.893864 15259 tablet_service.cc:1511] Processing CreateTablet for tablet 5fce2f0ee66247f686730bc62ef5cdfb (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:10.895107 15259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fce2f0ee66247f686730bc62ef5cdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.895915 15254 tablet_service.cc:1511] Processing CreateTablet for tablet 49393a249e3f433db3840189ee7dc630 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:10.897441 15254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49393a249e3f433db3840189ee7dc630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.917016 15331 tablet_service.cc:1511] Processing CreateTablet for tablet 0faaa04570d144c9bd5a7d514ee23dc4 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:03:10.917356 15332 tablet_service.cc:1511] Processing CreateTablet for tablet 5fce2f0ee66247f686730bc62ef5cdfb (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:03:10.918592 15331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0faaa04570d144c9bd5a7d514ee23dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.920749 15336 tablet_service.cc:1511] Processing CreateTablet for tablet ddce72028fce49eb8627f523baef9ad0 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:03:10.920572 15335 tablet_service.cc:1511] Processing CreateTablet for tablet 49393a249e3f433db3840189ee7dc630 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:03:10.922271 15336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddce72028fce49eb8627f523baef9ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.924679 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 708015fd563e4389af835f3aca58eb01 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:10.926043 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708015fd563e4389af835f3aca58eb01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.930732 15387 tablet_bootstrap.cc:492] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:10.866801 15388 raft_consensus.cc:359] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.931530 15388 raft_consensus.cc:385] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.931852 15388 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.932592 15388 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.934764 15388 ts_tablet_manager.cc:1434] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.000s
I20260709 13:03:10.943727 15387 ts_tablet_manager.cc:1403] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.298s	user 0.011s	sys 0.006s
I20260709 13:03:10.951489 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708015fd563e4389af835f3aca58eb01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.953250 15331 tablet_service.cc:1511] Processing CreateTablet for tablet 87f2fb4185c84ac7a09a309c58e0c6b5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:10.955092 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0faaa04570d144c9bd5a7d514ee23dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.954980 15332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fce2f0ee66247f686730bc62ef5cdfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.958320 15335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49393a249e3f433db3840189ee7dc630. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.962827 15187 tablet_service.cc:1511] Processing CreateTablet for tablet 87f2fb4185c84ac7a09a309c58e0c6b5 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:03:10.964152 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f2fb4185c84ac7a09a309c58e0c6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.964147 15181 tablet_service.cc:1511] Processing CreateTablet for tablet 5df18975ee214645b49e472675883b73 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:10.965512 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df18975ee214645b49e472675883b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.966238 15183 tablet_service.cc:1511] Processing CreateTablet for tablet d932cad3925e47b28537cca64ba27320 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:10.966545 15184 tablet_service.cc:1511] Processing CreateTablet for tablet 99208c2982d748dd8e728ff51c224658 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:10.967527 15183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d932cad3925e47b28537cca64ba27320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.950541 15387 raft_consensus.cc:359] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.970500 15387 raft_consensus.cc:385] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:10.970880 15387 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:10.970757 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:10.971887 15184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99208c2982d748dd8e728ff51c224658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.971735 15387 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:10.972056 15180 tablet_service.cc:1511] Processing CreateTablet for tablet 56be0280937f422d83d9e7889c5f55aa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:10.973279 15180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56be0280937f422d83d9e7889c5f55aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.974273 15387 ts_tablet_manager.cc:1434] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:03:10.975827 15186 tablet_service.cc:1511] Processing CreateTablet for tablet 708015fd563e4389af835f3aca58eb01 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:03:10.977056 15186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 708015fd563e4389af835f3aca58eb01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.975827 15253 tablet_service.cc:1511] Processing CreateTablet for tablet 56be0280937f422d83d9e7889c5f55aa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:10.978998 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56be0280937f422d83d9e7889c5f55aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.985298 15182 tablet_service.cc:1511] Processing CreateTablet for tablet ddce72028fce49eb8627f523baef9ad0 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 13:03:10.975816 15162 leader_election.cc:343] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:10.986896 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddce72028fce49eb8627f523baef9ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.001012 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:11.003593 15160 leader_election.cc:343] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.004179 15160 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.005843 15393 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:10.995678 15388 tablet_bootstrap.cc:492] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.028930 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 5df18975ee214645b49e472675883b73 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:11.030221 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df18975ee214645b49e472675883b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.038183 15187 tablet_service.cc:1511] Processing CreateTablet for tablet d812963f3df640419e3d4986ba60b35d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:11.039633 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d812963f3df640419e3d4986ba60b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.041522 15255 tablet_service.cc:1511] Processing CreateTablet for tablet d812963f3df640419e3d4986ba60b35d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:11.042778 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d812963f3df640419e3d4986ba60b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.052968 15388 tablet_bootstrap.cc:654] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.024971 15387 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:11.026731 15331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87f2fb4185c84ac7a09a309c58e0c6b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:10.966238 15258 tablet_service.cc:1511] Processing CreateTablet for tablet 99208c2982d748dd8e728ff51c224658 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:11.073050 15253 tablet_service.cc:1511] Processing CreateTablet for tablet 29ea792889204a2e97dc9a7d427af0dc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:11.077955 15185 tablet_service.cc:1511] Processing CreateTablet for tablet 81d86ef88f7f41238f3a595588effaca (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:11.081666 15334 tablet_service.cc:1511] Processing CreateTablet for tablet d932cad3925e47b28537cca64ba27320 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:03:11.082036 15185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d86ef88f7f41238f3a595588effaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.082957 15260 tablet_service.cc:1511] Processing CreateTablet for tablet 81d86ef88f7f41238f3a595588effaca (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:11.097106 15187 tablet_service.cc:1511] Processing CreateTablet for tablet be59fc6c54f44b09ae8f08b1dcb46a62 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:11.102167 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be59fc6c54f44b09ae8f08b1dcb46a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.102754 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ea792889204a2e97dc9a7d427af0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.103408 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99208c2982d748dd8e728ff51c224658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.112192 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 56be0280937f422d83d9e7889c5f55aa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:03:11.113538 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56be0280937f422d83d9e7889c5f55aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.114600 15387 tablet_bootstrap.cc:654] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.115957 15386 tablet_bootstrap.cc:492] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.116446 15386 ts_tablet_manager.cc:1403] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.392s	user 0.012s	sys 0.026s
I20260709 13:03:11.114638 15336 tablet_service.cc:1511] Processing CreateTablet for tablet 99208c2982d748dd8e728ff51c224658 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:03:11.118880 15336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99208c2982d748dd8e728ff51c224658. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.120405 15330 tablet_service.cc:1511] Processing CreateTablet for tablet d812963f3df640419e3d4986ba60b35d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:03:11.121778 15330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d812963f3df640419e3d4986ba60b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.122866 15329 tablet_service.cc:1511] Processing CreateTablet for tablet 81d86ef88f7f41238f3a595588effaca (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:03:11.125227 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d86ef88f7f41238f3a595588effaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.120457 15333 tablet_service.cc:1511] Processing CreateTablet for tablet 29ea792889204a2e97dc9a7d427af0dc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:11.119019 15328 tablet_service.cc:1511] Processing CreateTablet for tablet 5df18975ee214645b49e472675883b73 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:03:11.127426 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df18975ee214645b49e472675883b73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.131333 15333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ea792889204a2e97dc9a7d427af0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.131283 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d86ef88f7f41238f3a595588effaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.135366 15334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d932cad3925e47b28537cca64ba27320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.160884 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.161039 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 929e7bd9064e489d8c24157abdd7499c (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:11.162358 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 929e7bd9064e489d8c24157abdd7499c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:11.163439 15238 leader_election.cc:343] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.165138 15185 tablet_service.cc:1511] Processing CreateTablet for tablet 929e7bd9064e489d8c24157abdd7499c (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:11.166363 15185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 929e7bd9064e489d8c24157abdd7499c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.169620 15262 tablet_service.cc:1511] Processing CreateTablet for tablet be59fc6c54f44b09ae8f08b1dcb46a62 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:11.173092 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be59fc6c54f44b09ae8f08b1dcb46a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.180733 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:11.182848 15237 leader_election.cc:343] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.183373 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:11.184237 15399 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.184727 15399 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.185819 15398 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.186794 15399 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:11.187435 15386 raft_consensus.cc:359] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.187737 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.188149 15386 raft_consensus.cc:385] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.188489 15386 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
W20260709 13:03:11.189229 15312 leader_election.cc:343] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.189314 15386 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.191435 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.196516 15386 ts_tablet_manager.cc:1434] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 13:03:11.197325 15180 tablet_service.cc:1511] Processing CreateTablet for tablet 29ea792889204a2e97dc9a7d427af0dc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:03:11.198686 15180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29ea792889204a2e97dc9a7d427af0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.207239 15181 tablet_service.cc:1511] Processing CreateTablet for tablet 4a852937ac964a959721a465a5f36ad9 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:03:11.207474 15309 leader_election.cc:343] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.208493 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a852937ac964a959721a465a5f36ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.208160 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.209285 15399 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.199738 15386 tablet_bootstrap.cc:492] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:11.216504 15332 tablet_service.cc:1511] Processing CreateTablet for tablet be59fc6c54f44b09ae8f08b1dcb46a62 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:03:11.217911 15332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be59fc6c54f44b09ae8f08b1dcb46a62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.224051 15259 tablet_service.cc:1511] Processing CreateTablet for tablet 4a852937ac964a959721a465a5f36ad9 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:11.226459 15329 tablet_service.cc:1511] Processing CreateTablet for tablet 4a852937ac964a959721a465a5f36ad9 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:03:11.227730 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a852937ac964a959721a465a5f36ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.232300 15387 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:11.232231 15393 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.232908 15387 ts_tablet_manager.cc:1403] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.258s	user 0.017s	sys 0.001s
I20260709 13:03:11.232873 15393 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.235395 15179 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb9452f725f479a9fcc08d785cfecbc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:11.236903 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb9452f725f479a9fcc08d785cfecbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.237586 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:11.239128 15162 leader_election.cc:343] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.234964 15393 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.240975 15388 tablet_bootstrap.cc:492] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.241648 15388 ts_tablet_manager.cc:1403] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.254s	user 0.016s	sys 0.023s
I20260709 13:03:11.244272 15259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a852937ac964a959721a465a5f36ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.198755 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 929e7bd9064e489d8c24157abdd7499c (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:03:11.246742 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 929e7bd9064e489d8c24157abdd7499c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.246099 15387 raft_consensus.cc:359] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.260309 15333 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb9452f725f479a9fcc08d785cfecbc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:11.260739 15187 tablet_service.cc:1511] Processing CreateTablet for tablet 061ef1ddcd60472fbf7e0c7c536414d4 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:11.261631 15333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb9452f725f479a9fcc08d785cfecbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.262002 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061ef1ddcd60472fbf7e0c7c536414d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.260334 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.252815 15387 raft_consensus.cc:385] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:11.265249 15160 leader_election.cc:343] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.275298 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.265431 15258 tablet_service.cc:1511] Processing CreateTablet for tablet 061ef1ddcd60472fbf7e0c7c536414d4 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:11.276965 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061ef1ddcd60472fbf7e0c7c536414d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.279110 15387 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.279912 15387 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.286197 15386 tablet_bootstrap.cc:654] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.262953 15388 raft_consensus.cc:359] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.287631 15388 raft_consensus.cc:385] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.287910 15388 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.292026 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb9452f725f479a9fcc08d785cfecbc (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:03:11.292719 15388 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.300079 15387 ts_tablet_manager.cc:1434] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.001s
I20260709 13:03:11.301214 15387 tablet_bootstrap.cc:492] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:11.274189 15328 tablet_service.cc:1511] Processing CreateTablet for tablet 061ef1ddcd60472fbf7e0c7c536414d4 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:03:11.276046 15393 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.293367 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb9452f725f479a9fcc08d785cfecbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.312194 15262 tablet_service.cc:1511] Processing CreateTablet for tablet c39b63dad5d94468b5872c05e2d72e0d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:11.314417 15187 tablet_service.cc:1511] Processing CreateTablet for tablet c39b63dad5d94468b5872c05e2d72e0d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:11.317068 15329 tablet_service.cc:1511] Processing CreateTablet for tablet c39b63dad5d94468b5872c05e2d72e0d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:03:11.322784 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b63dad5d94468b5872c05e2d72e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.324077 15182 tablet_service.cc:1511] Processing CreateTablet for tablet 685539345e364189892668dfd1ff7309 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:11.325300 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685539345e364189892668dfd1ff7309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.327757 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 061ef1ddcd60472fbf7e0c7c536414d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.328356 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b63dad5d94468b5872c05e2d72e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.328584 15388 ts_tablet_manager.cc:1434] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.005s
I20260709 13:03:11.332535 15388 tablet_bootstrap.cc:492] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.339180 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b63dad5d94468b5872c05e2d72e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.350258 15387 tablet_bootstrap.cc:654] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.354530 15260 tablet_service.cc:1511] Processing CreateTablet for tablet 685539345e364189892668dfd1ff7309 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:11.355837 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685539345e364189892668dfd1ff7309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.364660 15386 tablet_bootstrap.cc:492] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.366585 15386 ts_tablet_manager.cc:1403] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.169s	user 0.010s	sys 0.010s
I20260709 13:03:11.369796 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 685539345e364189892668dfd1ff7309 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:03:11.371102 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685539345e364189892668dfd1ff7309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.370944 15181 tablet_service.cc:1511] Processing CreateTablet for tablet fc42a0ccf8934477a1ae58b60a2b2b07 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:11.372443 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc42a0ccf8934477a1ae58b60a2b2b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.374152 15388 tablet_bootstrap.cc:654] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.378163 15386 raft_consensus.cc:359] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.378917 15386 raft_consensus.cc:385] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.379225 15386 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.379944 15386 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.382053 15386 ts_tablet_manager.cc:1434] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:03:11.385774 15258 tablet_service.cc:1511] Processing CreateTablet for tablet fc42a0ccf8934477a1ae58b60a2b2b07 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:11.387072 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc42a0ccf8934477a1ae58b60a2b2b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.389505 15386 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:11.394225 15387 tablet_bootstrap.cc:492] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:11.394734 15387 ts_tablet_manager.cc:1403] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.094s	user 0.006s	sys 0.006s
I20260709 13:03:11.396039 15386 tablet_bootstrap.cc:654] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.392942 15332 tablet_service.cc:1511] Processing CreateTablet for tablet fc42a0ccf8934477a1ae58b60a2b2b07 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:03:11.397128 15332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc42a0ccf8934477a1ae58b60a2b2b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.397787 15387 raft_consensus.cc:359] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.398610 15387 raft_consensus.cc:385] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.398975 15387 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.400115 15387 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.404867 15179 tablet_service.cc:1511] Processing CreateTablet for tablet 05375e9e02424e74a5e9fad3c54cb5fa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:11.410136 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05375e9e02424e74a5e9fad3c54cb5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.406679 15387 ts_tablet_manager.cc:1434] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:11.420020 15387 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:11.426568 15387 tablet_bootstrap.cc:654] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.426735 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 05375e9e02424e74a5e9fad3c54cb5fa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:11.432279 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05375e9e02424e74a5e9fad3c54cb5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.432333 15262 tablet_service.cc:1511] Processing CreateTablet for tablet 05375e9e02424e74a5e9fad3c54cb5fa (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:03:11.433926 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05375e9e02424e74a5e9fad3c54cb5fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.435619 15388 tablet_bootstrap.cc:492] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.436085 15388 ts_tablet_manager.cc:1403] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.014s
I20260709 13:03:11.441654 15386 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.442217 15386 ts_tablet_manager.cc:1403] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.010s
I20260709 13:03:11.444779 15386 raft_consensus.cc:359] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.445322 15386 raft_consensus.cc:385] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.445576 15386 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.446211 15386 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.448148 15386 ts_tablet_manager.cc:1434] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:11.448559 15388 raft_consensus.cc:359] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.449246 15388 raft_consensus.cc:385] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.449520 15388 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.450186 15388 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.450605 15181 tablet_service.cc:1511] Processing CreateTablet for tablet 35e75f905ad042d89b465e6461b29a5d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:11.452019 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e75f905ad042d89b465e6461b29a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.452666 15388 ts_tablet_manager.cc:1434] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:03:11.453488 15398 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.453609 15388 tablet_bootstrap.cc:492] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.454110 15398 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.456321 15398 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.458022 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:11.458707 15346 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:11.460358 15388 tablet_bootstrap.cc:654] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.460616 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.462015 15399 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.462451 15399 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.466506 15399 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:11.464043 15238 leader_election.cc:343] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.470578 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:11.468024 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.474174 15179 tablet_service.cc:1511] Processing CreateTablet for tablet 68dae74f1ecc4da09974ea1562dcd4ea (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:11.474499 15197 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:11.473150 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 35e75f905ad042d89b465e6461b29a5d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:11.475674 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:11.475929 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e75f905ad042d89b465e6461b29a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.476302 15398 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.476642 15398 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.476948 15398 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.478165 15399 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.478507 15399 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.478818 15399 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.483651 15410 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.484308 15410 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.485183 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.485975 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68dae74f1ecc4da09974ea1562dcd4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.485826 15272 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:11.489378 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:11.491139 15160 leader_election.cc:343] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.492172 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:11.494077 15162 leader_election.cc:343] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.494617 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.495795 15393 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.496671 15410 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.500428 15399 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.485421 15386 tablet_bootstrap.cc:492] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:11.507331 15258 tablet_service.cc:1511] Processing CreateTablet for tablet 35e75f905ad042d89b465e6461b29a5d (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:03:11.508610 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e75f905ad042d89b465e6461b29a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.510568 15182 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce7d889544e4fcd9cbbf09d13da02b0 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:11.511811 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce7d889544e4fcd9cbbf09d13da02b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.512284 15262 tablet_service.cc:1511] Processing CreateTablet for tablet 68dae74f1ecc4da09974ea1562dcd4ea (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:11.513543 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68dae74f1ecc4da09974ea1562dcd4ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.519850 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce7d889544e4fcd9cbbf09d13da02b0 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:11.521121 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce7d889544e4fcd9cbbf09d13da02b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.522547 15327 tablet_service.cc:1511] Processing CreateTablet for tablet 68dae74f1ecc4da09974ea1562dcd4ea (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:03:11.523837 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68dae74f1ecc4da09974ea1562dcd4ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:11.520993 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:11.532197 15399 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:11.532033 15332 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce7d889544e4fcd9cbbf09d13da02b0 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:03:11.533416 15332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce7d889544e4fcd9cbbf09d13da02b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.535224 15387 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:11.535846 15387 ts_tablet_manager.cc:1403] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.031s
I20260709 13:03:11.536933 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:11.537526 15197 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.539769 15387 raft_consensus.cc:359] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.540733 15387 raft_consensus.cc:385] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.541121 15387 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.543788 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:11.544371 15272 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.548996 15260 tablet_service.cc:1511] Processing CreateTablet for tablet b1d89f71244148538087b141a709ec50 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:11.550417 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d89f71244148538087b141a709ec50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.553215 15386 tablet_bootstrap.cc:654] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.553558 15328 tablet_service.cc:1511] Processing CreateTablet for tablet b1d89f71244148538087b141a709ec50 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:11.555203 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d89f71244148538087b141a709ec50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.555509 15197 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:11.557488 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:11.558748 15399 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.566393 15272 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:11.567378 15387 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.578255 15180 tablet_service.cc:1511] Processing CreateTablet for tablet d2e635b488cd4db6bce175bf8230091e (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:11.579581 15180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e635b488cd4db6bce175bf8230091e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.583752 15398 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.584216 15259 tablet_service.cc:1511] Processing CreateTablet for tablet d2e635b488cd4db6bce175bf8230091e (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:11.585498 15259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e635b488cd4db6bce175bf8230091e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.587579 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:11.589294 15238 leader_election.cc:343] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.593144 15399 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:11.532933 15179 tablet_service.cc:1511] Processing CreateTablet for tablet b1d89f71244148538087b141a709ec50 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:03:11.596560 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d89f71244148538087b141a709ec50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.597393 15388 tablet_bootstrap.cc:492] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.597815 15388 ts_tablet_manager.cc:1403] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.144s	user 0.053s	sys 0.043s
I20260709 13:03:11.598270 15255 tablet_service.cc:1511] Processing CreateTablet for tablet be765c8e55da41e98042904983ca70dd (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:11.599501 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be765c8e55da41e98042904983ca70dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.601835 15399 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.602128 15187 tablet_service.cc:1511] Processing CreateTablet for tablet fddd7d735c9e4195aee24df42bc25619 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:11.602785 15388 raft_consensus.cc:359] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.603279 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddd7d735c9e4195aee24df42bc25619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.604993 15333 tablet_service.cc:1511] Processing CreateTablet for tablet be765c8e55da41e98042904983ca70dd (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:11.605366 15388 raft_consensus.cc:385] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.605440 15398 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.605892 15388 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.606220 15398 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.606694 15398 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.606383 15333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be765c8e55da41e98042904983ca70dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.607780 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:11.608291 15346 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.608742 15398 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.606807 15388 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.610365 15327 tablet_service.cc:1511] Processing CreateTablet for tablet d2e635b488cd4db6bce175bf8230091e (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:03:11.612416 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e635b488cd4db6bce175bf8230091e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.618296 15388 ts_tablet_manager.cc:1434] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:03:11.618666 15329 tablet_service.cc:1511] Processing CreateTablet for tablet fddd7d735c9e4195aee24df42bc25619 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:11.619338 15388 tablet_bootstrap.cc:492] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.619911 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddd7d735c9e4195aee24df42bc25619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.623533 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:11.624195 15345 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:11.625259 15410 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.625690 15410 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.627665 15410 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.628469 15182 tablet_service.cc:1511] Processing CreateTablet for tablet be765c8e55da41e98042904983ca70dd (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:03:11.628782 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.629397 15272 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:11.633792 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:11.639694 15388 tablet_bootstrap.cc:654] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.641387 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:11.640558 15181 tablet_service.cc:1511] Processing CreateTablet for tablet 2331edb5531f4ed8a202724323d28569 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:11.643483 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be765c8e55da41e98042904983ca70dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.644021 15410 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.644405 15387 ts_tablet_manager.cc:1434] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.108s	user 0.018s	sys 0.014s
I20260709 13:03:11.644421 15410 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.644958 15410 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.648111 15387 tablet_bootstrap.cc:492] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:11.648197 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2331edb5531f4ed8a202724323d28569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.626906 15346 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:11.637735 15398 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.653841 15418 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.654306 15418 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.656453 15418 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:11.656891 15418 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.657289 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.657287 15418 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.657980 15272 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:11.653016 15398 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.657879 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.667086 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:11.668723 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:11.670038 15417 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.670390 15417 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.670706 15417 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.673202 15187 tablet_service.cc:1511] Processing CreateTablet for tablet 1082dceab99748b0a8dac27ba897e888 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:11.677919 15410 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.680797 15187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1082dceab99748b0a8dac27ba897e888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.693322 15387 tablet_bootstrap.cc:654] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.696593 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.696841 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:11.698077 15312 leader_election.cc:343] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.698491 15418 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:11.698657 15309 leader_election.cc:343] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.699123 15309 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.700152 15418 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.701732 15417 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.683547 15398 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.706529 15197 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:11.707353 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.711261 15393 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.711499 15260 tablet_service.cc:1511] Processing CreateTablet for tablet 2331edb5531f4ed8a202724323d28569 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:11.711721 15393 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:11.712023 15238 leader_election.cc:343] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.711982 15258 tablet_service.cc:1511] Processing CreateTablet for tablet fddd7d735c9e4195aee24df42bc25619 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:03:11.712779 15260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2331edb5531f4ed8a202724323d28569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.713447 15258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddd7d735c9e4195aee24df42bc25619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.713713 15393 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.715005 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:11.716403 15160 leader_election.cc:343] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.711728 15262 tablet_service.cc:1511] Processing CreateTablet for tablet 1082dceab99748b0a8dac27ba897e888 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:11.720563 15262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1082dceab99748b0a8dac27ba897e888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.721390 15410 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.723656 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:11.724216 15272 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.734164 15388 tablet_bootstrap.cc:492] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.734378 15272 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:11.734678 15388 ts_tablet_manager.cc:1403] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.009s
I20260709 13:03:11.735702 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:11.735136 15093 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.736486 15410 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.736960 15410 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:11.737711 15410 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:11.743829 15419 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.745045 15386 tablet_bootstrap.cc:492] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.747210 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:11.750978 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:11.751166 15333 tablet_service.cc:1511] Processing CreateTablet for tablet 2331edb5531f4ed8a202724323d28569 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:03:11.752646 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:11.752945 15328 tablet_service.cc:1511] Processing CreateTablet for tablet 1082dceab99748b0a8dac27ba897e888 (DEFAULT_TABLE table=test-workload [id=01a285412a1641ef98de75fdd13d5f7f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:03:11.755174 15386 ts_tablet_manager.cc:1403] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.270s	user 0.015s	sys 0.001s
I20260709 13:03:11.753183 15388 raft_consensus.cc:359] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.753799 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:11.763998 15388 raft_consensus.cc:385] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.764700 15388 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.758945 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:11.759502 15346 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:11.765861 15388 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.759404 15417 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:11.762292 15386 raft_consensus.cc:359] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.768582 15386 raft_consensus.cc:385] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.768921 15386 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.758934 15271 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:11.770681 15388 ts_tablet_manager.cc:1434] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:03:11.770619 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.771504 15386 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.758436 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1082dceab99748b0a8dac27ba897e888. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:11.773885 15162 leader_election.cc:343] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.774312 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.775673 15333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2331edb5531f4ed8a202724323d28569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.779419 15393 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.779517 15417 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.786643 15398 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.793423 15398 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.794346 15387 tablet_bootstrap.cc:492] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:11.794847 15387 ts_tablet_manager.cc:1403] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.147s	user 0.028s	sys 0.018s
I20260709 13:03:11.797979 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:11.800401 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:11.800661 15346 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:11.801911 15238 leader_election.cc:343] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:11.806192 15388 tablet_bootstrap.cc:492] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.812763 15387 raft_consensus.cc:359] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.813544 15387 raft_consensus.cc:385] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.813838 15387 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.814546 15387 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.820542 15386 ts_tablet_manager.cc:1434] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.016s
I20260709 13:03:11.821554 15386 tablet_bootstrap.cc:492] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:11.823277 15346 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:11.824326 15387 ts_tablet_manager.cc:1434] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:03:11.825042 15388 tablet_bootstrap.cc:654] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.824844 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:11.829128 15429 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.830016 15429 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:11.825336 15387 tablet_bootstrap.cc:492] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:11.831336 15419 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:11.830971 15429 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.832181 15419 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.840811 15094 catalog_manager.cc:5697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.840852 15388 tablet_bootstrap.cc:492] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.847868 15387 tablet_bootstrap.cc:654] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.848340 15388 ts_tablet_manager.cc:1403] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:03:11.852017 15388 raft_consensus.cc:359] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.852927 15388 raft_consensus.cc:385] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.853286 15388 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.854900 15386 tablet_bootstrap.cc:654] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.858182 15388 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.861536 15388 ts_tablet_manager.cc:1434] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:03:11.862514 15388 tablet_bootstrap.cc:492] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.866747 15386 tablet_bootstrap.cc:492] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.867432 15386 ts_tablet_manager.cc:1403] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.001s
I20260709 13:03:11.867749 15417 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.868204 15417 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.870177 15417 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:11.871161 15386 raft_consensus.cc:359] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.871731 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.872210 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:11.872253 15386 raft_consensus.cc:385] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.872442 15271 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:11.872874 15386 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.872931 15197 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:11.873730 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:11.874565 15417 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:11.873973 15386 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.874914 15417 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.875316 15417 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.875130 15095 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.877344 15386 ts_tablet_manager.cc:1434] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:11.878685 15386 tablet_bootstrap.cc:492] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:11.882133 15417 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.884984 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:11.885526 15197 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.887458 15386 tablet_bootstrap.cc:654] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.892478 15197 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:11.893765 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:11.894728 15422 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:11.895220 15422 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:11.896011 15422 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.901063 15386 tablet_bootstrap.cc:492] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.901708 15386 ts_tablet_manager.cc:1403] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.011s
I20260709 13:03:11.905279 15386 raft_consensus.cc:359] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.906100 15386 raft_consensus.cc:385] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.906404 15386 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.907354 15386 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.907647 15093 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.910763 15386 ts_tablet_manager.cc:1434] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.001s
I20260709 13:03:11.911715 15417 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:11.912117 15386 tablet_bootstrap.cc:492] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:11.912799 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:11.923300 15271 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.929157 15386 tablet_bootstrap.cc:654] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.929160 15388 tablet_bootstrap.cc:654] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.929860 15095 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.931705 15271 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:11.936721 15387 tablet_bootstrap.cc:492] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:11.937266 15387 ts_tablet_manager.cc:1403] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.112s	user 0.052s	sys 0.028s
I20260709 13:03:11.940313 15387 raft_consensus.cc:359] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.940893 15387 raft_consensus.cc:385] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.941115 15387 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.941762 15387 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.943729 15387 ts_tablet_manager.cc:1434] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:03:11.944836 15387 tablet_bootstrap.cc:492] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:11.945437 15388 tablet_bootstrap.cc:492] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.946007 15388 ts_tablet_manager.cc:1403] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.008s
I20260709 13:03:11.948622 15410 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.949082 15410 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.949381 15388 raft_consensus.cc:359] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.950343 15387 tablet_bootstrap.cc:654] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.950275 15388 raft_consensus.cc:385] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.951130 15410 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.951400 15388 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.952158 15388 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.953212 15386 tablet_bootstrap.cc:492] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.953652 15386 ts_tablet_manager.cc:1403] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.011s
I20260709 13:03:11.953357 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:11.954036 15388 ts_tablet_manager.cc:1434] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:11.954401 15346 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:11.954896 15388 tablet_bootstrap.cc:492] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.956175 15386 raft_consensus.cc:359] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.956456 15393 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.956840 15386 raft_consensus.cc:385] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.957145 15393 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.959841 15387 tablet_bootstrap.cc:492] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:11.960289 15387 ts_tablet_manager.cc:1403] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:03:11.960567 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.957151 15386 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.961170 15388 tablet_bootstrap.cc:654] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.961804 15386 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.963840 15386 ts_tablet_manager.cc:1434] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:03:11.964790 15386 tablet_bootstrap.cc:492] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:11.965138 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:11.965891 15346 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:11.967705 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.968679 15410 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.963959 15393 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:11.972065 15386 tablet_bootstrap.cc:654] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.972374 15388 tablet_bootstrap.cc:492] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.972828 15388 ts_tablet_manager.cc:1403] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:03:11.968561 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:11.975586 15387 raft_consensus.cc:359] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.976251 15387 raft_consensus.cc:385] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.976555 15387 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.976392 15388 raft_consensus.cc:359] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.977070 15388 raft_consensus.cc:385] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.977353 15388 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.977306 15387 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.978317 15388 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.979439 15387 ts_tablet_manager.cc:1434] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:03:11.980284 15388 ts_tablet_manager.cc:1434] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:11.981225 15388 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:11.980908 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:11.982597 15410 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.983269 15410 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:11.987506 15388 tablet_bootstrap.cc:654] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:11.990715 15410 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:11.993976 15386 tablet_bootstrap.cc:492] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:11.994441 15386 ts_tablet_manager.cc:1403] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.003s
I20260709 13:03:11.995088 15387 tablet_bootstrap.cc:492] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:11.996290 15388 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:11.996776 15388 ts_tablet_manager.cc:1403] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:03:11.997144 15386 raft_consensus.cc:359] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.997956 15386 raft_consensus.cc:385] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:11.998261 15386 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:11.998907 15386 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:11.999715 15388 raft_consensus.cc:359] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.000442 15388 raft_consensus.cc:385] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.000744 15388 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.000854 15386 ts_tablet_manager.cc:1434] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:03:12.001523 15388 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.002034 15386 tablet_bootstrap.cc:492] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.003975 15388 ts_tablet_manager.cc:1434] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:03:12.005332 15387 tablet_bootstrap.cc:654] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.007280 15388 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.008284 15386 tablet_bootstrap.cc:654] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.015422 15388 tablet_bootstrap.cc:654] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.016759 15387 tablet_bootstrap.cc:492] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:12.017243 15387 ts_tablet_manager.cc:1403] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:03:12.020004 15387 raft_consensus.cc:359] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.020666 15387 raft_consensus.cc:385] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.020955 15387 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.025164 15417 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.026996 15388 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.027505 15388 ts_tablet_manager.cc:1403] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.010s
I20260709 13:03:12.030542 15388 raft_consensus.cc:359] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.031251 15388 raft_consensus.cc:385] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.031531 15388 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.032255 15388 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.033314 15386 tablet_bootstrap.cc:492] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:12.033948 15386 ts_tablet_manager.cc:1403] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 13:03:12.034747 15388 ts_tablet_manager.cc:1434] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:12.035710 15388 tablet_bootstrap.cc:492] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.036372 15410 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.036813 15410 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.022513 15387 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.037547 15419 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.038007 15419 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.038769 15410 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.039492 15387 ts_tablet_manager.cc:1434] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:03:12.040005 15419 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.040446 15417 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.040666 15387 tablet_bootstrap.cc:492] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:12.040879 15417 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.044045 15386 raft_consensus.cc:359] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.044972 15386 raft_consensus.cc:385] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.045158 15388 tablet_bootstrap.cc:654] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.046025 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.046654 15346 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.046984 15386 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.047861 15386 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.048667 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.049288 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.050132 15386 ts_tablet_manager.cc:1434] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:03:12.050475 15387 tablet_bootstrap.cc:654] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.051086 15386 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.059096 15386 tablet_bootstrap.cc:654] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.061517 15429 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.062006 15429 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.062016 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.062589 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.063169 15197 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:12.063728 15410 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.064092 15410 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.064465 15410 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.064814 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.065096 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.065750 15346 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:12.066165 15428 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.066716 15428 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.067169 15428 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.072250 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.072932 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:12.073019 15410 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.074249 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.075227 15421 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.075613 15421 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.075956 15421 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.076193 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.076887 15410 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.080067 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.081166 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.083379 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:12.085111 15237 leader_election.cc:343] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.086774 15417 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.072269 15429 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.081192 15197 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:12.093955 15238 leader_election.cc:343] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.094677 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:12.096181 15429 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.088555 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.103570 15271 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.125349 15410 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.127456 15428 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.131134 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:12.131901 15197 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.135941 15410 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.136605 15410 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.139897 15410 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.139977 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.141749 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.142974 15386 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:12.143621 15386 ts_tablet_manager.cc:1403] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.000s
W20260709 13:03:12.143539 15162 leader_election.cc:343] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:12.144788 15160 leader_election.cc:343] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.145339 15160 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.146275 15410 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.138789 15421 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.153626 15346 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:12.157866 15197 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:12.159307 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.161903 15429 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.162093 15417 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.162592 15429 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:12.164223 15429 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.168563 15410 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.169150 15410 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.169853 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.170627 15346 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.172530 15410 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.173643 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.174074 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.174274 15344 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.174733 15269 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.175397 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:12.176513 15410 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.177062 15410 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.177589 15410 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.180325 15428 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.181135 15346 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:12.191005 15386 raft_consensus.cc:359] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.192041 15386 raft_consensus.cc:385] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.192389 15386 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.196844 15386 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.207758 15386 ts_tablet_manager.cc:1434] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260709 13:03:12.207580 15393 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.215931 15386 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.230432 15386 tablet_bootstrap.cc:654] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.245647 15429 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.256498 15386 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:12.257149 15386 ts_tablet_manager.cc:1403] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.010s
I20260709 13:03:12.260741 15386 raft_consensus.cc:359] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.261720 15386 raft_consensus.cc:385] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.262074 15386 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.264518 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:12.265682 15197 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:12.268697 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.270522 15386 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.276414 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.277581 15386 ts_tablet_manager.cc:1434] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:03:12.284560 15417 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.286896 15398 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.291363 15421 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.251773 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:12.294922 15461 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.295603 15461 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.296175 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:12.297197 15459 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.297298 15410 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.297753 15459 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:12.298597 15459 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.299538 15461 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.300043 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.300624 15346 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.301581 15410 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.302238 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:12.303455 15387 tablet_bootstrap.cc:492] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:12.303455 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.303843 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.304705 15346 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.303923 15387 ts_tablet_manager.cc:1403] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.264s	user 0.095s	sys 0.152s
I20260709 13:03:12.279263 15386 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.306253 15388 tablet_bootstrap.cc:492] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.306703 15388 ts_tablet_manager.cc:1403] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.271s	user 0.093s	sys 0.115s
I20260709 13:03:12.307514 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.308099 15271 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.309330 15388 raft_consensus.cc:359] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.309990 15388 raft_consensus.cc:385] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.310305 15388 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.311007 15388 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:12.308882 15160 leader_election.cc:343] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.313023 15388 ts_tablet_manager.cc:1434] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:12.310581 15410 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.313483 15410 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.313827 15410 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.314154 15388 tablet_bootstrap.cc:492] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.314697 15387 raft_consensus.cc:359] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.319782 15387 raft_consensus.cc:385] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.320540 15387 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.320729 15388 tablet_bootstrap.cc:654] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.312930 15346 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:12.323465 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:12.322249 15387 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.326321 15271 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:12.326552 15398 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.327598 15461 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.328256 15461 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:12.329093 15461 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.333379 15410 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.326570 15387 ts_tablet_manager.cc:1434] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:03:12.337502 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.338841 15387 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:12.341440 15386 tablet_bootstrap.cc:654] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:12.339659 15160 leader_election.cc:343] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.346833 15388 tablet_bootstrap.cc:492] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.346966 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.347520 15388 ts_tablet_manager.cc:1403] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.009s
I20260709 13:03:12.347675 15346 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.349458 15387 tablet_bootstrap.cc:654] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.350283 15410 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.351684 15388 raft_consensus.cc:359] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.352331 15388 raft_consensus.cc:385] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.352604 15388 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.353272 15388 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.358194 15388 ts_tablet_manager.cc:1434] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:03:12.359910 15346 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:12.361644 15388 tablet_bootstrap.cc:492] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.362375 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.368007 15388 tablet_bootstrap.cc:654] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.368060 15421 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.370402 15421 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.370774 15429 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.372483 15421 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.372987 15386 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:12.368024 15461 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.373859 15387 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:12.373872 15461 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:12.373978 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.374492 15387 ts_tablet_manager.cc:1403] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.002s
I20260709 13:03:12.374935 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:12.374887 15461 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.376760 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.377812 15463 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.378199 15463 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.378512 15463 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.380048 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.380211 15421 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.380414 15387 raft_consensus.cc:359] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.380663 15196 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:12.381084 15387 raft_consensus.cc:385] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.381376 15387 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.382082 15387 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.386045 15387 ts_tablet_manager.cc:1434] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 13:03:12.373467 15386 ts_tablet_manager.cc:1403] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.000s
I20260709 13:03:12.389230 15388 tablet_bootstrap.cc:492] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.389693 15388 ts_tablet_manager.cc:1403] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.010s
I20260709 13:03:12.388875 15095 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.391357 15386 raft_consensus.cc:359] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.392369 15386 raft_consensus.cc:385] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.392128 15388 raft_consensus.cc:359] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.388120 15463 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.392791 15388 raft_consensus.cc:385] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.393088 15388 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.395730 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.396420 15271 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.396736 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:12.397529 15197 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.400127 15388 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.402705 15388 ts_tablet_manager.cc:1434] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:03:12.403605 15388 tablet_bootstrap.cc:492] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.404294 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:12.388375 15387 tablet_bootstrap.cc:492] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:12.409561 15386 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.410566 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.412930 15417 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.413390 15417 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:12.414244 15388 tablet_bootstrap.cc:654] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.414188 15417 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.416247 15386 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.418478 15386 ts_tablet_manager.cc:1434] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:03:12.419464 15386 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.411583 15463 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.423269 15422 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.422560 15387 tablet_bootstrap.cc:654] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.433233 15386 tablet_bootstrap.cc:654] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.433758 15197 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:12.445976 15094 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.448629 15094 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.456029 15386 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:12.456624 15386 ts_tablet_manager.cc:1403] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.007s
I20260709 13:03:12.457453 15388 tablet_bootstrap.cc:492] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.457875 15387 tablet_bootstrap.cc:492] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:12.457892 15388 ts_tablet_manager.cc:1403] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.036s
I20260709 13:03:12.458454 15387 ts_tablet_manager.cc:1403] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.006s
I20260709 13:03:12.460093 15386 raft_consensus.cc:359] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.460870 15386 raft_consensus.cc:385] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.460736 15388 raft_consensus.cc:359] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.461027 15387 raft_consensus.cc:359] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.461473 15388 raft_consensus.cc:385] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.461721 15387 raft_consensus.cc:385] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.461813 15388 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.462073 15387 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.462607 15388 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.462957 15387 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.464898 15388 ts_tablet_manager.cc:1434] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:12.465464 15387 ts_tablet_manager.cc:1434] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:12.465817 15388 tablet_bootstrap.cc:492] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.466401 15387 tablet_bootstrap.cc:492] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:12.472223 15388 tablet_bootstrap.cc:654] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.472927 15387 tablet_bootstrap.cc:654] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.476707 15092 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.461278 15386 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.480880 15386 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.484319 15386 ts_tablet_manager.cc:1434] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:03:12.488193 15386 tablet_bootstrap.cc:492] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.491390 15388 tablet_bootstrap.cc:492] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.491848 15388 ts_tablet_manager.cc:1403] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.013s
I20260709 13:03:12.491959 15387 tablet_bootstrap.cc:492] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:12.492367 15387 ts_tablet_manager.cc:1403] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260709 13:03:12.496098 15388 raft_consensus.cc:359] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.497167 15388 raft_consensus.cc:385] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.497550 15388 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.498232 15387 raft_consensus.cc:359] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.498966 15387 raft_consensus.cc:385] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.498626 15388 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.499322 15387 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.500311 15387 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.501417 15388 ts_tablet_manager.cc:1434] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:12.500684 15095 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.502298 15388 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.502471 15387 ts_tablet_manager.cc:1434] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:12.503371 15387 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:12.510756 15387 tablet_bootstrap.cc:654] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.513492 15422 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.513927 15422 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.515703 15422 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.516865 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.517553 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.517580 15272 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:12.518227 15197 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:12.519567 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.520423 15422 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.520843 15422 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.521203 15422 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.520550 15388 tablet_bootstrap.cc:654] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.528889 15422 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.530030 15386 tablet_bootstrap.cc:654] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.530995 15422 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.531816 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:12.532529 15197 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.536581 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.537233 15272 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.542405 15197 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:12.551681 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:12.552961 15422 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.553615 15422 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:12.554646 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:12.554774 15272 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:12.554730 15422 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.567370 15387 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:12.568099 15387 ts_tablet_manager.cc:1403] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.065s	user 0.026s	sys 0.018s
I20260709 13:03:12.571557 15386 tablet_bootstrap.cc:492] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:12.572219 15386 ts_tablet_manager.cc:1403] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.002s
I20260709 13:03:12.572616 15387 raft_consensus.cc:359] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.573395 15387 raft_consensus.cc:385] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.573669 15387 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.574561 15387 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.576583 15386 raft_consensus.cc:359] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.577237 15461 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.577452 15386 raft_consensus.cc:385] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.577747 15386 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.578907 15386 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.577777 15461 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.580116 15095 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.580971 15386 ts_tablet_manager.cc:1434] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:12.582903 15388 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.583129 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.583396 15388 ts_tablet_manager.cc:1403] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.022s
W20260709 13:03:12.584559 15160 leader_election.cc:343] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.585177 15461 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.583396 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.585886 15346 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.585995 15410 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.586328 15387 ts_tablet_manager.cc:1434] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:03:12.586476 15410 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.587324 15387 tablet_bootstrap.cc:492] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:12.587170 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.588295 15461 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.588462 15410 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.588655 15461 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.589062 15461 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.590041 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.591441 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:12.591492 15160 leader_election.cc:343] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.592141 15346 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.593272 15387 tablet_bootstrap.cc:654] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.593339 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.594091 15386 tablet_bootstrap.cc:492] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.594187 15410 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.594775 15410 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.586367 15388 raft_consensus.cc:359] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.595525 15410 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.595813 15388 raft_consensus.cc:385] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.596104 15388 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.596823 15388 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.598625 15388 ts_tablet_manager.cc:1434] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.000s
I20260709 13:03:12.599862 15388 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.605240 15386 tablet_bootstrap.cc:654] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.606142 15388 tablet_bootstrap.cc:654] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.629169 15461 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.629588 15429 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.633076 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.612800 15410 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:12.635967 15160 leader_election.cc:343] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.639431 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:12.641619 15160 leader_election.cc:343] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.642714 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.643829 15461 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.644383 15344 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.647066 15461 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.647528 15461 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.653370 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.651899 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.653424 15429 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.655193 15272 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:12.655328 15429 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.656606 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:12.657158 15162 leader_election.cc:343] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.657482 15459 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.657831 15459 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.654543 15387 tablet_bootstrap.cc:492] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:12.659198 15428 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.659762 15428 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.661458 15459 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.665030 15461 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.667639 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.668501 15197 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:12.671519 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.672304 15429 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:12.673313 15238 leader_election.cc:343] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.673867 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.674752 15428 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.674715 15345 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:12.676759 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.678601 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.679488 15428 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:12.679647 15237 leader_election.cc:343] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.679920 15428 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.680131 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:12.680423 15428 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.681375 15422 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.681830 15422 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.683923 15422 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.683600 15344 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:12.685237 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:12.685619 15410 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.685863 15271 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:12.686081 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.686442 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.686640 15343 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.691159 15387 ts_tablet_manager.cc:1403] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.104s	user 0.022s	sys 0.012s
I20260709 13:03:12.691268 15429 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.694118 15309 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:12.695323 15422 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:12.695573 15419 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.695694 15422 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.695955 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.696135 15422 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.696084 15419 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:12.700096 15312 leader_election.cc:343] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.704780 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:12.706070 15388 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:12.707218 15393 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.708782 15419 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.710305 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.697543 15410 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.711107 15388 ts_tablet_manager.cc:1403] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.111s	user 0.020s	sys 0.010s
I20260709 13:03:12.710347 15422 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.712299 15345 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:12.716934 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:12.712200 15410 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:12.718135 15312 leader_election.cc:343] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.718204 15237 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:12.719571 15419 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.719357 15459 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.722100 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.722693 15270 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.725062 15387 raft_consensus.cc:359] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.730779 15387 raft_consensus.cc:385] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.731375 15387 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.734333 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.719491 15410 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:12.736905 15162 leader_election.cc:343] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.736229 15387 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.732332 15459 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.739406 15422 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:12.740731 15388 raft_consensus.cc:359] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.743800 15419 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.741729 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:12.742128 15270 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:12.742161 15343 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:12.751067 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.751619 15386 tablet_bootstrap.cc:492] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:12.752074 15386 ts_tablet_manager.cc:1403] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.158s	user 0.031s	sys 0.072s
I20260709 13:03:12.751909 15429 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.752498 15410 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.753013 15410 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:12.752638 15095 catalog_manager.cc:5697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.753767 15410 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.754597 15386 raft_consensus.cc:359] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.755239 15386 raft_consensus.cc:385] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.755504 15386 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.756129 15386 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.758553 15386 ts_tablet_manager.cc:1434] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:12.759455 15386 tablet_bootstrap.cc:492] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:12.763931 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:12.765256 15386 tablet_bootstrap.cc:654] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:12.765530 15461 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:12.766058 15461 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:12.766885 15461 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.768657 15393 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.742781 15387 ts_tablet_manager.cc:1434] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.002s
I20260709 13:03:12.774569 15387 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:12.745579 15388 raft_consensus.cc:385] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:12.746119 15271 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.745144 15428 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.784379 15428 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.782618 15388 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:12.785821 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:12.786633 15345 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.786023 15388 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.793157 15461 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:12.797271 15388 ts_tablet_manager.cc:1434] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.002s
I20260709 13:03:12.804857 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:12.805606 15197 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:12.808998 15461 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.821322 15388 tablet_bootstrap.cc:492] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:12.809547 15461 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.830526 15461 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:12.832094 15459 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:12.844199 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:12.856523 15160 leader_election.cc:343] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.858613 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:12.859800 15387 tablet_bootstrap.cc:654] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:12.864806 15162 leader_election.cc:343] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:12.865393 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:12.885581 15393 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:12.890614 15459 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.949949 15345 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:12.989964 15410 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.988773 15421 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.963547 15459 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:12.996250 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 168185us
I20260709 13:03:13.000226 15271 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:12.998274 15410 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:12.999334 15421 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.020597 15386 tablet_bootstrap.cc:492] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:13.021023 15386 ts_tablet_manager.cc:1403] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.262s	user 0.031s	sys 0.047s
I20260709 13:03:13.023813 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.024286 15386 raft_consensus.cc:359] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.024986 15197 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
W20260709 13:03:13.025281 15162 leader_election.cc:343] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.025825 15410 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.024986 15386 raft_consensus.cc:385] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.026489 15386 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.028390 15461 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.028317 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:13.029531 15419 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.029981 15419 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:13.030189 15461 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.030819 15419 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.032989 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.033712 15270 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:13.034698 15386 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.034991 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:13.036446 15461 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.036856 15461 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.037217 15461 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.039259 15386 ts_tablet_manager.cc:1434] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:03:13.040294 15386 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
W20260709 13:03:13.040441 15494 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:13.043188 15388 tablet_bootstrap.cc:654] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.042418 15501 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.045768 15501 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.060320 15504 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:13.061383 15417 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.110881 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.120680 15501 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.111371 15092 catalog_manager.cc:5697] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.136238 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:13.138435 15160 leader_election.cc:343] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.138705 15386 tablet_bootstrap.cc:654] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.142747 15421 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.145516 15092 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:13.124195 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82812.5us
W20260709 13:03:13.141466 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 102940us
I20260709 13:03:13.150550 15309 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:13.156790 15459 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.169741 15421 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.201195 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.203382 15271 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:13.206202 15162 leader_election.cc:343] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.206666 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.206990 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.202999 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.201929 15421 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:13.209635 15461 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.212451 15393 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.214069 15461 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.215975 15388 tablet_bootstrap.cc:492] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:13.216493 15388 ts_tablet_manager.cc:1403] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.416s	user 0.011s	sys 0.011s
W20260709 13:03:13.217967 15309 leader_election.cc:343] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.218878 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:13.219491 15268 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.221830 15387 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.222214 15387 ts_tablet_manager.cc:1403] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.448s	user 0.048s	sys 0.028s
I20260709 13:03:13.223013 15502 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.223065 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.223987 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:13.238803 15093 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.219183 15421 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.242211 15509 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.248977 15268 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:13.251587 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:13.252357 15162 leader_election.cc:343] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.253023 15387 raft_consensus.cc:359] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:13.253444 15162 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 -> Peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Couldn't send request to peer 9d785ccef0634edd9f0fbb52fa1c8d27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.253816 15387 raft_consensus.cc:385] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.254582 15459 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.254299 15387 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.255919 15459 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.251622 15342 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:13.256268 15387 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.257786 15459 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:13.259055 15387 ts_tablet_manager.cc:1434] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.036s	user 0.003s	sys 0.003s
I20260709 13:03:13.258662 15459 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.260179 15387 tablet_bootstrap.cc:492] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.249428 15388 raft_consensus.cc:359] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.263388 15388 raft_consensus.cc:385] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.263890 15388 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
W20260709 13:03:13.266688 15312 leader_election.cc:343] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.282591 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.276266 15268 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.277819 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:13.283984 15419 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.278620 15502 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.286679 15509 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.293882 15388 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.291462 15509 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:13.294935 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43607us
I20260709 13:03:13.316183 15388 ts_tablet_manager.cc:1434] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.003s
I20260709 13:03:13.331602 15459 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.338150 15388 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:13.332291 15092 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.360467 15386 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:13.360944 15386 ts_tablet_manager.cc:1403] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.321s	user 0.032s	sys 0.038s
I20260709 13:03:13.361538 15387 tablet_bootstrap.cc:654] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.369125 15093 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.375597 15388 tablet_bootstrap.cc:654] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.374729 15461 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:13.376346 15386 raft_consensus.cc:359] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.395125 15386 raft_consensus.cc:385] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.395515 15386 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.411629 15387 tablet_bootstrap.cc:492] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.412328 15387 ts_tablet_manager.cc:1403] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.152s	user 0.025s	sys 0.012s
I20260709 13:03:13.396626 15386 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.415649 15387 raft_consensus.cc:359] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.416491 15387 raft_consensus.cc:385] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.416790 15387 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.417701 15386 ts_tablet_manager.cc:1434] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.007s
I20260709 13:03:13.417586 15387 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.418622 15386 tablet_bootstrap.cc:492] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:13.420251 15387 ts_tablet_manager.cc:1434] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:13.421456 15387 tablet_bootstrap.cc:492] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.433884 15387 tablet_bootstrap.cc:654] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.439993 15388 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:13.440475 15388 ts_tablet_manager.cc:1403] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.009s
I20260709 13:03:13.443315 15504 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.443147 15388 raft_consensus.cc:359] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.443804 15388 raft_consensus.cc:385] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.443791 15504 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.444232 15388 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.444638 15386 tablet_bootstrap.cc:654] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.445077 15388 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.445928 15504 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.446734 15461 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.447218 15461 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.448177 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.449047 15461 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.450448 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.450584 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.451184 15268 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:13.451678 15388 ts_tablet_manager.cc:1434] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:13.451951 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.452555 15388 tablet_bootstrap.cc:492] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:13.453127 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.454181 15422 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.454631 15422 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.456679 15422 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.457127 15422 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:13.459556 15162 leader_election.cc:343] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:13.460947 15160 leader_election.cc:343] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.461383 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.462126 15461 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.463415 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.464056 15196 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:13.466355 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:13.467150 15509 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.467520 15509 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.467861 15509 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.468114 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:13.469450 15309 leader_election.cc:343] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.472348 15422 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.475888 15419 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.485272 15501 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.485801 15429 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.486259 15429 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.488349 15429 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.490450 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.490756 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.491428 15196 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
W20260709 13:03:13.491679 15237 leader_election.cc:343] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.492655 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:13.493847 15429 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.494302 15429 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.494697 15429 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.495702 15386 tablet_bootstrap.cc:492] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:13.496107 15386 ts_tablet_manager.cc:1403] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.006s
I20260709 13:03:13.500254 15429 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.502197 15509 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.502540 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:13.498587 15386 raft_consensus.cc:359] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.503127 15196 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.503314 15386 raft_consensus.cc:385] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.503636 15387 tablet_bootstrap.cc:492] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.504109 15387 ts_tablet_manager.cc:1403] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.000s
I20260709 13:03:13.503665 15386 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.505389 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:13.505966 15197 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.505733 15386 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.506675 15387 raft_consensus.cc:359] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.507496 15387 raft_consensus.cc:385] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.507752 15387 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.508495 15387 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.510115 15388 tablet_bootstrap.cc:654] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.510720 15387 ts_tablet_manager.cc:1434] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:13.511683 15387 tablet_bootstrap.cc:492] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.515661 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:13.517309 15237 leader_election.cc:343] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.517544 15196 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:13.517369 15386 ts_tablet_manager.cc:1434] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:03:13.518743 15386 tablet_bootstrap.cc:492] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:13.519310 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:13.519896 15271 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.520527 15197 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:13.517349 15387 tablet_bootstrap.cc:654] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.521637 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:13.523856 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:13.524190 15429 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.525262 15429 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.525255 15422 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.527415 15422 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:13.528234 15422 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.535064 15429 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:13.535626 15271 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:13.535336 15386 tablet_bootstrap.cc:654] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.537431 15388 tablet_bootstrap.cc:492] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:13.537914 15388 ts_tablet_manager.cc:1403] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.008s
I20260709 13:03:13.536211 15429 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.540575 15388 raft_consensus.cc:359] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.536823 15387 tablet_bootstrap.cc:492] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.541527 15388 raft_consensus.cc:385] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.541957 15388 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.542930 15388 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.537439 15509 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.541971 15387 ts_tablet_manager.cc:1403] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.005s
I20260709 13:03:13.546747 15387 raft_consensus.cc:359] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.547454 15387 raft_consensus.cc:385] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.547796 15387 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.548523 15387 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.552873 15387 ts_tablet_manager.cc:1434] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:03:13.553778 15387 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.550693 15388 ts_tablet_manager.cc:1434] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:03:13.555496 15093 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.557866 15388 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:13.570254 15388 tablet_bootstrap.cc:654] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.569527 15095 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.570564 15387 tablet_bootstrap.cc:654] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.579648 15386 tablet_bootstrap.cc:492] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:13.580281 15386 ts_tablet_manager.cc:1403] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.000s
W20260709 13:03:13.583179 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:13.585772 15386 raft_consensus.cc:359] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.586442 15386 raft_consensus.cc:385] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.586715 15386 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.587191 15387 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.587194 15388 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:13.587633 15387 ts_tablet_manager.cc:1403] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.001s
I20260709 13:03:13.588073 15388 ts_tablet_manager.cc:1403] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.001s
I20260709 13:03:13.587433 15386 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.590265 15387 raft_consensus.cc:359] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.590363 15388 raft_consensus.cc:359] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.590957 15387 raft_consensus.cc:385] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.591106 15388 raft_consensus.cc:385] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.591327 15387 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.592092 15387 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.592692 15386 ts_tablet_manager.cc:1434] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:03:13.593991 15387 ts_tablet_manager.cc:1434] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:13.591418 15388 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.594918 15386 tablet_bootstrap.cc:492] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:13.594666 15388 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.596663 15388 ts_tablet_manager.cc:1434] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:13.597805 15388 tablet_bootstrap.cc:492] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:13.598083 15387 tablet_bootstrap.cc:492] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.603850 15387 tablet_bootstrap.cc:654] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.608731 15461 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.609174 15461 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.611534 15388 tablet_bootstrap.cc:654] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.613092 15387 tablet_bootstrap.cc:492] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.613554 15387 ts_tablet_manager.cc:1403] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 13:03:13.615718 15386 tablet_bootstrap.cc:654] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.615455 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.616158 15387 raft_consensus.cc:359] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.616845 15387 raft_consensus.cc:385] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.617147 15387 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.617859 15387 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:13.619311 15160 leader_election.cc:343] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.620649 15387 ts_tablet_manager.cc:1434] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:03:13.621815 15387 tablet_bootstrap.cc:492] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.624162 15461 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.629530 15387 tablet_bootstrap.cc:654] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.633649 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.634259 15344 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:13.636071 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.637043 15388 tablet_bootstrap.cc:492] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:13.637558 15388 ts_tablet_manager.cc:1403] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 13:03:13.637909 15461 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.638392 15461 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.638792 15461 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.640264 15388 raft_consensus.cc:359] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.643821 15387 tablet_bootstrap.cc:492] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.644397 15387 ts_tablet_manager.cc:1403] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 13:03:13.644873 15388 raft_consensus.cc:385] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.645203 15388 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.645859 15388 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.647157 15461 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.647990 15387 raft_consensus.cc:359] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.648887 15387 raft_consensus.cc:385] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.649215 15387 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.650010 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:13.651335 15388 ts_tablet_manager.cc:1434] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
W20260709 13:03:13.651290 15160 leader_election.cc:343] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.652299 15388 tablet_bootstrap.cc:492] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:13.653152 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:13.653712 15344 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.658562 15388 tablet_bootstrap.cc:654] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.650213 15387 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.660691 15387 ts_tablet_manager.cc:1434] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:03:13.660961 15386 tablet_bootstrap.cc:492] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:13.661370 15386 ts_tablet_manager.cc:1403] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.067s	user 0.025s	sys 0.016s
I20260709 13:03:13.661558 15387 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.663731 15344 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:13.668165 15387 tablet_bootstrap.cc:654] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.663772 15386 raft_consensus.cc:359] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.668768 15386 raft_consensus.cc:385] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.669106 15386 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.669932 15386 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.672641 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.675076 15386 ts_tablet_manager.cc:1434] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:03:13.676518 15386 tablet_bootstrap.cc:492] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:13.675410 15461 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.680619 15387 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.681203 15387 ts_tablet_manager.cc:1403] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:03:13.681664 15459 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.682134 15459 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.682576 15386 tablet_bootstrap.cc:654] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.683194 15410 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.683733 15410 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:13.684587 15410 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.685369 15387 raft_consensus.cc:359] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.686230 15387 raft_consensus.cc:385] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.686556 15387 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.687386 15387 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.695669 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.695915 15387 ts_tablet_manager.cc:1434] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.006s
I20260709 13:03:13.697026 15387 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
W20260709 13:03:13.697096 15162 leader_election.cc:343] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.692783 15459 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.700819 15461 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.703245 15461 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.703821 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:13.705408 15160 leader_election.cc:343] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.705827 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.707291 15459 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.709983 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:13.711804 15162 leader_election.cc:343] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.712561 15461 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.717245 15386 tablet_bootstrap.cc:492] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:13.717705 15386 ts_tablet_manager.cc:1403] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.011s
I20260709 13:03:13.722802 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.721047 15386 raft_consensus.cc:359] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:13.726554 15160 leader_election.cc:343] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.726030 15387 tablet_bootstrap.cc:654] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.728859 15160 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.729550 15459 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.730777 15459 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.727350 15388 tablet_bootstrap.cc:492] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:13.735255 15196 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.735896 15388 ts_tablet_manager.cc:1403] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.084s	user 0.026s	sys 0.016s
I20260709 13:03:13.738487 15388 raft_consensus.cc:359] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.738987 15388 raft_consensus.cc:385] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.739279 15388 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.744504 15461 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.728440 15386 raft_consensus.cc:385] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.745821 15386 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.746575 15386 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.749235 15386 ts_tablet_manager.cc:1434] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:03:13.751092 15386 tablet_bootstrap.cc:492] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:13.739894 15388 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.757380 15386 tablet_bootstrap.cc:654] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.757977 15388 ts_tablet_manager.cc:1434] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:03:13.758947 15388 tablet_bootstrap.cc:492] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:13.770004 15092 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.784183 15429 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.784732 15429 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.786844 15429 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.791244 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.796108 15501 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.803670 15501 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.806739 15501 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.809171 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.810252 15343 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:13.812515 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:13.813622 15238 leader_election.cc:343] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.794680 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:13.816179 15237 leader_election.cc:343] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.816624 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:13.817138 15422 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.818096 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:13.818873 15429 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.819482 15429 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.822885 15422 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.823434 15422 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.825846 15422 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.827206 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.827960 15271 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:13.828861 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.830210 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:13.831573 15312 leader_election.cc:343] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.834327 15509 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.834743 15509 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.834764 15429 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.835222 15509 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.836023 15387 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.836442 15387 ts_tablet_manager.cc:1403] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.140s	user 0.047s	sys 0.049s
I20260709 13:03:13.839936 15421 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:13.840407 15387 raft_consensus.cc:359] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.841068 15387 raft_consensus.cc:385] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.841943 15509 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.844354 15388 tablet_bootstrap.cc:654] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.841332 15387 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.845095 15387 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.847158 15387 ts_tablet_manager.cc:1434] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:03:13.848073 15387 tablet_bootstrap.cc:492] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.849746 15509 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.850970 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:13.852912 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:13.853484 15268 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.853935 15386 tablet_bootstrap.cc:492] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:13.854306 15386 ts_tablet_manager.cc:1403] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.103s	user 0.028s	sys 0.029s
I20260709 13:03:13.854700 15387 tablet_bootstrap.cc:654] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.856431 15386 raft_consensus.cc:359] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.856937 15386 raft_consensus.cc:385] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.857162 15386 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.857887 15386 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.859169 15421 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.859710 15421 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.861171 15388 tablet_bootstrap.cc:492] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:13.861639 15388 ts_tablet_manager.cc:1403] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.001s
I20260709 13:03:13.861774 15421 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.862042 15386 ts_tablet_manager.cc:1434] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:13.862969 15386 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:13.865461 15387 tablet_bootstrap.cc:492] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:13.868063 15387 ts_tablet_manager.cc:1403] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:03:13.868525 15386 tablet_bootstrap.cc:654] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.867213 15388 raft_consensus.cc:359] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.868921 15388 raft_consensus.cc:385] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.870875 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.871163 15388 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.872195 15388 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.874004 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.876111 15388 ts_tablet_manager.cc:1434] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:03:13.877811 15388 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
W20260709 13:03:13.873304 15312 leader_election.cc:343] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.873286 15387 raft_consensus.cc:359] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.879120 15387 raft_consensus.cc:385] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.879523 15387 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.880434 15387 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.883466 15387 ts_tablet_manager.cc:1434] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:03:13.884614 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.888187 15387 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:13.888240 15504 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.892556 15268 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:13.895435 15388 tablet_bootstrap.cc:654] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.895668 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:13.900629 15387 tablet_bootstrap.cc:654] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.901430 15509 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:13.901944 15509 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:13.902786 15509 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.905728 15551 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.906337 15551 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.908962 15551 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:13.910503 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.911955 15386 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
W20260709 13:03:13.911906 15309 leader_election.cc:343] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.912519 15386 ts_tablet_manager.cc:1403] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.018s
I20260709 13:03:13.913703 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:13.915153 15312 leader_election.cc:343] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.915601 15312 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.916344 15551 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:13.915161 15386 raft_consensus.cc:359] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.917435 15386 raft_consensus.cc:385] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:13.917695 15386 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:13.918453 15386 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.920717 15386 ts_tablet_manager.cc:1434] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:13.921586 15386 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:13.924283 15551 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.927263 15386 tablet_bootstrap.cc:654] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:13.945405 15429 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.946125 15429 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.947372 15461 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.948011 15461 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.949957 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:13.951293 15502 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.951740 15502 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:13.946038 15093 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.953630 15502 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.950680 15461 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.956701 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.957556 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:13.958858 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:13.959860 15271 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:13.964278 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.965158 15343 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
W20260709 13:03:13.967182 15238 leader_election.cc:343] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.968362 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:13.970402 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:13.971601 15393 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:13.972083 15393 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.972512 15393 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.988046 15509 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:13.989408 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:13.990499 15502 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:13.992820 15429 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:13.995352 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:13.997047 15237 leader_election.cc:343] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:13.997673 15237 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:13.999636 15398 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.004509 15502 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.010003 15393 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.019543 15388 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.020102 15388 ts_tablet_manager.cc:1403] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.143s	user 0.009s	sys 0.026s
I20260709 13:03:14.020175 15386 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.021145 15386 ts_tablet_manager.cc:1403] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.100s	user 0.022s	sys 0.009s
I20260709 13:03:14.022625 15501 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:14.024430 15388 raft_consensus.cc:359] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.025251 15388 raft_consensus.cc:385] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.025583 15388 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.026635 15387 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:14.030650 15387 ts_tablet_manager.cc:1403] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.143s	user 0.023s	sys 0.012s
I20260709 13:03:14.030019 15342 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.029309 15386 raft_consensus.cc:359] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.032084 15386 raft_consensus.cc:385] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.032358 15386 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.032969 15386 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.033671 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:14.033962 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:14.034719 15343 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.034003 15393 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.034217 15268 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.026244 15388 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.040011 15386 ts_tablet_manager.cc:1434] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.014s	user 0.000s	sys 0.003s
I20260709 13:03:14.041206 15388 ts_tablet_manager.cc:1434] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 13:03:14.044422 15388 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.046939 15386 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:14.050683 15387 raft_consensus.cc:359] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.051389 15387 raft_consensus.cc:385] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.051641 15387 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.055392 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:14.058638 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:14.058804 15421 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.055392 15343 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:14.060128 15502 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.059306 15421 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.060609 15502 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:14.061414 15502 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.061909 15421 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.062830 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.063475 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.063552 15197 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:14.064117 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:14.064873 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:14.052275 15387 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.065771 15551 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.066118 15551 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.066522 15551 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.069227 15387 ts_tablet_manager.cc:1434] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:03:14.069227 15421 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.069819 15421 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.072485 15387 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:14.074182 15421 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.078578 15504 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.079092 15504 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.082777 15501 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.089999 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.093659 15551 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.100677 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:14.089583 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.101866 15196 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:14.101948 15309 leader_election.cc:343] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.102552 15197 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:14.103302 15343 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.105396 15504 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.109112 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.110035 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.110929 15093 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.111513 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.112855 15509 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.113206 15509 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.113519 15386 tablet_bootstrap.cc:654] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.113517 15509 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.111358 15393 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.117995 15421 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.118490 15421 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.119489 15551 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.120568 15421 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.122123 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.111420 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:14.126590 15312 leader_election.cc:343] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.132583 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.134553 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:14.135372 15268 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:14.136209 15309 leader_election.cc:343] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.136643 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.114867 15196 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:14.138545 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:14.140232 15509 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.142208 15509 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.142926 15421 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.145093 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:14.145495 15504 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.124980 15388 tablet_bootstrap.cc:654] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.125452 15387 tablet_bootstrap.cc:654] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.146163 15504 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:14.147275 15504 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.152051 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:14.152812 15196 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.157924 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:14.160331 15309 leader_election.cc:343] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.177263 15551 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:14.177479 15393 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:14.224395 15196 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:14.227622 15386 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.230697 15388 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.230901 15386 ts_tablet_manager.cc:1403] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.184s	user 0.008s	sys 0.014s
I20260709 13:03:14.231235 15388 ts_tablet_manager.cc:1403] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.187s	user 0.014s	sys 0.007s
I20260709 13:03:14.233474 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.234293 15504 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.234959 15504 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:14.235870 15388 raft_consensus.cc:359] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.236810 15388 raft_consensus.cc:385] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.235847 15504 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.237125 15388 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.238013 15388 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.240300 15388 ts_tablet_manager.cc:1434] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:14.241087 15387 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:14.241163 15388 tablet_bootstrap.cc:492] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.241689 15387 ts_tablet_manager.cc:1403] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.008s
I20260709 13:03:14.245312 15387 raft_consensus.cc:359] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.247932 15387 raft_consensus.cc:385] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.248410 15388 tablet_bootstrap.cc:654] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.242388 15386 raft_consensus.cc:359] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.248808 15386 raft_consensus.cc:385] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.249167 15386 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.250012 15386 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.248593 15387 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.253173 15429 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.256102 15429 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.258368 15429 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.259289 15388 tablet_bootstrap.cc:492] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.259802 15388 ts_tablet_manager.cc:1403] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:03:14.260564 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:14.260818 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.261319 15343 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
W20260709 13:03:14.262128 15238 leader_election.cc:343] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.252794 15386 ts_tablet_manager.cc:1434] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 13:03:14.262786 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:14.267625 15388 raft_consensus.cc:359] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.273869 15388 raft_consensus.cc:385] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.264218 15429 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.274291 15388 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.274413 15429 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.274899 15429 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.275151 15388 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.283360 15388 ts_tablet_manager.cc:1434] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:03:14.284289 15388 tablet_bootstrap.cc:492] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.284312 15386 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:14.255422 15387 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.287346 15509 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.287837 15509 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.290237 15388 tablet_bootstrap.cc:654] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.291383 15509 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.291517 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:14.292881 15309 leader_election.cc:343] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.293691 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.294294 15197 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:14.295567 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.296442 15387 ts_tablet_manager.cc:1434] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.001s
I20260709 13:03:14.296626 15509 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.297776 15509 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.298204 15509 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.299786 15387 tablet_bootstrap.cc:492] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:14.300926 15388 tablet_bootstrap.cc:492] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.301369 15388 ts_tablet_manager.cc:1403] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.004s
I20260709 13:03:14.305934 15388 raft_consensus.cc:359] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.306645 15388 raft_consensus.cc:385] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.306942 15388 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.312276 15388 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.314009 15388 ts_tablet_manager.cc:1434] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:03:14.315177 15388 tablet_bootstrap.cc:492] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.315500 15094 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.316252 15429 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.317282 15094 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.318905 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:14.319092 15429 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.322142 15387 tablet_bootstrap.cc:654] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:14.323238 15238 leader_election.cc:343] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.324090 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:14.324646 15343 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.334448 15509 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.339717 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:14.340932 15386 tablet_bootstrap.cc:654] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.345327 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:14.346662 15309 leader_election.cc:343] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.340315 15197 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.348491 15343 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:14.355311 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:14.343375 15509 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.357028 15398 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.357512 15398 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:14.358349 15398 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.360116 15388 tablet_bootstrap.cc:654] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.373204 15197 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:14.381405 15388 tablet_bootstrap.cc:492] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.381989 15388 ts_tablet_manager.cc:1403] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 13:03:14.428128 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.432431 15388 raft_consensus.cc:359] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.434564 15388 raft_consensus.cc:385] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.435019 15388 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.434823 15093 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.435890 15388 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.438359 15388 ts_tablet_manager.cc:1434] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:03:14.446659 15509 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.455358 15387 tablet_bootstrap.cc:492] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:14.456449 15387 ts_tablet_manager.cc:1403] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.002s
I20260709 13:03:14.472874 15388 tablet_bootstrap.cc:492] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.473531 15504 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:14.484844 15393 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.485589 15393 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.463198 15509 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:14.490928 15387 raft_consensus.cc:359] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.491747 15387 raft_consensus.cc:385] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.492089 15387 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.490932 15386 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.492247 15504 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:14.493534 15386 ts_tablet_manager.cc:1403] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.220s	user 0.016s	sys 0.003s
I20260709 13:03:14.491184 15509 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.495998 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.498023 15393 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.498473 15387 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.505209 15272 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:14.505656 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:14.506901 15504 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.507865 15551 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.507639 15386 raft_consensus.cc:359] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.507555 15504 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:14.508224 15162 leader_election.cc:343] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.508567 15551 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.509968 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:14.510931 15580 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.511385 15580 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.511471 15504 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.511839 15580 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.512904 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.506400 15388 tablet_bootstrap.cc:654] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.513810 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:14.514510 15309 leader_election.cc:343] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.508556 15386 raft_consensus.cc:385] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.515460 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.516923 15386 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.518610 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.522078 15386 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.524086 15387 ts_tablet_manager.cc:1434] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.005s
I20260709 13:03:14.519084 15551 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.521049 15195 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
W20260709 13:03:14.522369 15312 leader_election.cc:343] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:14.532192 15309 leader_election.cc:343] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.532696 15309 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.533802 15504 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.540103 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.563874 15386 ts_tablet_manager.cc:1434] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.003s
I20260709 13:03:14.565845 15386 tablet_bootstrap.cc:492] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:14.558889 15421 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.567806 15421 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.568284 15421 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.569037 15580 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.576915 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:14.577922 15268 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.580286 15387 tablet_bootstrap.cc:492] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:14.584343 15580 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.587309 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:14.589094 15162 leader_election.cc:343] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.593842 15093 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.597199 15268 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:14.599967 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:14.597815 15421 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.602149 15580 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.603305 15580 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:14.604264 15580 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.606755 15387 tablet_bootstrap.cc:654] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.607542 15388 tablet_bootstrap.cc:492] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.608075 15388 ts_tablet_manager.cc:1403] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.136s	user 0.031s	sys 0.014s
I20260709 13:03:14.608749 15581 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:14.609395 15421 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:14.612571 15386 tablet_bootstrap.cc:654] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.615113 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:14.615715 15196 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.617202 15461 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.619055 15388 raft_consensus.cc:359] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.619953 15388 raft_consensus.cc:385] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.624987 15386 tablet_bootstrap.cc:492] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.628261 15388 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.630184 15388 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.636902 15388 ts_tablet_manager.cc:1434] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:03:14.638253 15388 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.626075 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:14.630946 15387 tablet_bootstrap.cc:492] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:14.639866 15387 ts_tablet_manager.cc:1403] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.009s
I20260709 13:03:14.628433 15386 ts_tablet_manager.cc:1403] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.000s
I20260709 13:03:14.624745 15196 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
W20260709 13:03:14.642580 15309 leader_election.cc:343] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.644143 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.645061 15581 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.645542 15581 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:14.645462 15386 raft_consensus.cc:359] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.646170 15386 raft_consensus.cc:385] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.646440 15386 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.646401 15581 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.659262 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.642694 15387 raft_consensus.cc:359] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.662793 15387 raft_consensus.cc:385] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.663147 15387 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.665136 15387 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:14.667860 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:14.668395 15387 ts_tablet_manager.cc:1434] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.002s
I20260709 13:03:14.669212 15387 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:14.669288 15502 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.669850 15502 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.659879 15386 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.672667 15386 ts_tablet_manager.cc:1434] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:03:14.673606 15386 tablet_bootstrap.cc:492] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:14.678694 15386 tablet_bootstrap.cc:654] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.683840 15387 tablet_bootstrap.cc:654] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.683615 15504 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.686802 15393 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.686460 15388 tablet_bootstrap.cc:654] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.692809 15581 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.694550 15502 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.695760 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:14.696411 15343 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:14.696653 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.700011 15271 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:14.705896 15386 tablet_bootstrap.cc:492] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.706527 15386 ts_tablet_manager.cc:1403] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.006s
I20260709 13:03:14.707857 15398 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.707602 15095 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.708338 15398 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.710557 15398 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.711124 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:14.711793 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:14.712903 15393 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:14.713317 15393 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.713721 15393 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.722187 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.723415 15196 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:14.725538 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:14.726552 15429 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.751641 15268 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.759869 15429 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.763110 15386 raft_consensus.cc:359] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.763839 15386 raft_consensus.cc:385] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.764109 15386 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.764780 15386 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.766889 15393 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.769697 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:14.770045 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:14.770259 15271 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.770576 15343 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.777778 15343 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:14.779227 15162 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:14.780174 15459 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.780467 15502 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:14.780683 15459 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.781708 15502 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:14.783711 15502 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.784817 15459 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.785363 15393 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.786203 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:14.780529 15271 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
W20260709 13:03:14.790203 15162 leader_election.cc:343] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.787226 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:14.792128 15160 leader_election.cc:343] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.792563 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.792991 15429 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.793434 15429 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.797097 15459 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.808239 15581 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:14.809500 15386 ts_tablet_manager.cc:1434] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.000s
I20260709 13:03:14.813834 15387 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:14.814508 15387 ts_tablet_manager.cc:1403] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.145s	user 0.019s	sys 0.016s
I20260709 13:03:14.816574 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:14.817410 15195 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:14.820155 15387 raft_consensus.cc:359] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.820873 15387 raft_consensus.cc:385] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.821169 15387 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.821883 15387 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.815580 15502 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.823274 15502 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.824186 15387 ts_tablet_manager.cc:1434] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:03:14.825285 15387 tablet_bootstrap.cc:492] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:14.825963 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:14.826660 15388 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.827113 15388 ts_tablet_manager.cc:1403] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.189s	user 0.034s	sys 0.032s
W20260709 13:03:14.827322 15160 leader_election.cc:343] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.822777 15429 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.830775 15386 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:14.832320 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:14.833915 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:14.833206 15388 raft_consensus.cc:359] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.834685 15388 raft_consensus.cc:385] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.835155 15429 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:14.834065 15502 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:14.836179 15388 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.840216 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:14.847054 15162 leader_election.cc:343] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:14.847500 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:14.843461 15388 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.848871 15387 tablet_bootstrap.cc:654] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:14.853744 15238 consensus_peers.cc:597] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.849344 15459 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.856233 15388 ts_tablet_manager.cc:1434] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:03:14.857329 15388 tablet_bootstrap.cc:492] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.859558 15398 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:03:14.870148 15094 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:14.880244 15386 tablet_bootstrap.cc:654] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.885138 15429 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:14.893790 15387 tablet_bootstrap.cc:492] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:14.893980 15388 tablet_bootstrap.cc:654] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.894310 15387 ts_tablet_manager.cc:1403] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.069s	user 0.006s	sys 0.006s
I20260709 13:03:14.904587 15387 raft_consensus.cc:359] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.905359 15387 raft_consensus.cc:385] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.905717 15387 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.906836 15387 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.912217 15386 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.912693 15386 ts_tablet_manager.cc:1403] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.082s	user 0.016s	sys 0.008s
I20260709 13:03:14.915254 15386 raft_consensus.cc:359] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.915908 15386 raft_consensus.cc:385] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.916165 15386 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.917074 15386 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.918537 15386 ts_tablet_manager.cc:1434] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:14.919500 15386 tablet_bootstrap.cc:492] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:14.926120 15388 tablet_bootstrap.cc:492] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.926631 15388 ts_tablet_manager.cc:1403] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.006s
I20260709 13:03:14.929040 15386 tablet_bootstrap.cc:654] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.933267 15387 ts_tablet_manager.cc:1434] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.002s
I20260709 13:03:14.933269 15388 raft_consensus.cc:359] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.934381 15388 raft_consensus.cc:385] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.934715 15388 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.934859 15387 tablet_bootstrap.cc:492] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:14.935855 15388 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.938107 15388 ts_tablet_manager.cc:1434] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:14.939344 15388 tablet_bootstrap.cc:492] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:14.941430 15422 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:14.945996 15388 tablet_bootstrap.cc:654] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.946704 15387 tablet_bootstrap.cc:654] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.953999 15386 tablet_bootstrap.cc:492] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.954420 15386 ts_tablet_manager.cc:1403] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.004s
I20260709 13:03:14.956929 15386 raft_consensus.cc:359] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.957590 15386 raft_consensus.cc:385] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.957856 15386 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.958527 15386 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.966123 15386 ts_tablet_manager.cc:1434] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:14.967486 15386 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:14.975965 15386 tablet_bootstrap.cc:654] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:14.987964 15386 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:14.988467 15386 ts_tablet_manager.cc:1403] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.013s
I20260709 13:03:14.991165 15388 tablet_bootstrap.cc:492] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:14.991809 15388 ts_tablet_manager.cc:1403] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.030s
I20260709 13:03:14.991581 15386 raft_consensus.cc:359] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.996315 15386 raft_consensus.cc:385] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:14.996544 15386 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:14.997339 15386 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:14.999372 15386 ts_tablet_manager.cc:1434] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:03:15.000193 15386 tablet_bootstrap.cc:492] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.000075 15388 raft_consensus.cc:359] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.000767 15388 raft_consensus.cc:385] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.001032 15388 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.001675 15388 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.003671 15388 ts_tablet_manager.cc:1434] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:03:15.004673 15388 tablet_bootstrap.cc:492] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:15.005726 15386 tablet_bootstrap.cc:654] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.011735 15388 tablet_bootstrap.cc:654] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.012471 15581 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.020541 15502 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.021250 15502 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.023988 15502 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.028021 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.028947 15344 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:15.031602 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:15.033252 15459 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.033648 15459 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.033972 15459 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.036751 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.040233 15387 tablet_bootstrap.cc:492] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.040712 15387 ts_tablet_manager.cc:1403] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.106s	user 0.028s	sys 0.011s
I20260709 13:03:15.041697 15386 tablet_bootstrap.cc:492] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
W20260709 13:03:15.041831 15160 leader_election.cc:343] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.042132 15386 ts_tablet_manager.cc:1403] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.024s
I20260709 13:03:15.043217 15387 raft_consensus.cc:359] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.043905 15387 raft_consensus.cc:385] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.044143 15387 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.044843 15581 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.044641 15386 raft_consensus.cc:359] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.045334 15386 raft_consensus.cc:385] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.045626 15386 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.045099 15387 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.045320 15581 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.046360 15386 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.047936 15581 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.048707 15386 ts_tablet_manager.cc:1434] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:15.049732 15386 tablet_bootstrap.cc:492] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.050443 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.051800 15501 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.052246 15501 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.050267 15459 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.054183 15501 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.054282 15459 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.054872 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.055639 15271 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:15.056034 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.056406 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.056568 15344 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:15.057708 15238 leader_election.cc:343] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.060387 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.061007 15309 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:15.062283 15237 leader_election.cc:343] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.062775 15387 ts_tablet_manager.cc:1434] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:03:15.062691 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:15.063542 15501 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.064106 15421 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.064762 15387 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.065596 15344 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:15.069849 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:15.070533 15421 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.066401 15388 tablet_bootstrap.cc:492] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.068359 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:15.071544 15388 ts_tablet_manager.cc:1403] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.003s
I20260709 13:03:15.071206 15459 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.076792 15459 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:15.077526 15388 raft_consensus.cc:359] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.078214 15388 raft_consensus.cc:385] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.078481 15388 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.072259 15386 tablet_bootstrap.cc:654] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.078418 15459 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:15.082026 15160 leader_election.cc:343] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.084189 15388 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.085759 15388 ts_tablet_manager.cc:1434] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.004s
I20260709 13:03:15.086742 15388 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:15.088338 15387 tablet_bootstrap.cc:654] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.092151 15386 tablet_bootstrap.cc:492] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.092662 15386 ts_tablet_manager.cc:1403] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.003s
I20260709 13:03:15.095288 15387 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.095237 15386 raft_consensus.cc:359] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.096375 15386 raft_consensus.cc:385] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.096712 15386 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.097604 15501 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.098101 15501 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.099083 15388 tablet_bootstrap.cc:654] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.095785 15387 ts_tablet_manager.cc:1403] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.002s
I20260709 13:03:15.100289 15501 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.100960 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:15.102384 15238 leader_election.cc:343] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.102770 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.103614 15344 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:15.105996 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:15.106218 15387 raft_consensus.cc:359] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.106894 15387 raft_consensus.cc:385] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.107445 15387 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.108178 15387 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.110532 15387 ts_tablet_manager.cc:1434] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:03:15.111955 15387 tablet_bootstrap.cc:492] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.113132 15501 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.113502 15501 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.113837 15501 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.106937 15094 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.121430 15386 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.123207 15387 tablet_bootstrap.cc:654] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.125569 15501 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.128166 15386 ts_tablet_manager.cc:1434] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:03:15.129245 15386 tablet_bootstrap.cc:492] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.132293 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.133112 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.133872 15344 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:15.136641 15238 leader_election.cc:343] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.142645 15501 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.147147 15344 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:15.148340 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:15.149435 15501 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.150192 15501 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:15.150975 15501 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.153990 15386 tablet_bootstrap.cc:654] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.158757 15388 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.159250 15388 ts_tablet_manager.cc:1403] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.073s	user 0.026s	sys 0.014s
I20260709 13:03:15.161646 15388 raft_consensus.cc:359] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.162284 15388 raft_consensus.cc:385] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.162542 15388 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.163187 15388 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.165446 15388 ts_tablet_manager.cc:1434] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:15.166441 15388 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:15.166595 15095 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.172942 15388 tablet_bootstrap.cc:654] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.184469 15387 tablet_bootstrap.cc:492] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.184926 15387 ts_tablet_manager.cc:1403] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.030s
I20260709 13:03:15.187129 15388 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.187561 15388 ts_tablet_manager.cc:1403] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 13:03:15.187474 15387 raft_consensus.cc:359] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.188205 15387 raft_consensus.cc:385] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.188467 15387 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.189113 15387 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.190205 15388 raft_consensus.cc:359] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.191373 15388 raft_consensus.cc:385] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.191633 15388 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.192979 15387 ts_tablet_manager.cc:1434] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:15.193096 15388 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.195979 15388 ts_tablet_manager.cc:1434] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:15.196331 15386 tablet_bootstrap.cc:492] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.196754 15386 ts_tablet_manager.cc:1403] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.000s
I20260709 13:03:15.197376 15388 tablet_bootstrap.cc:492] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:15.200973 15386 raft_consensus.cc:359] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.201612 15386 raft_consensus.cc:385] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.201859 15386 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.202586 15386 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.205222 15388 tablet_bootstrap.cc:654] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.205447 15502 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.197856 15387 tablet_bootstrap.cc:492] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.198187 15393 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.208042 15393 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.208365 15459 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.209159 15459 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.209522 15386 ts_tablet_manager.cc:1434] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:03:15.210095 15393 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.210603 15386 tablet_bootstrap.cc:492] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.210651 15393 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:15.211326 15459 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.218036 15387 tablet_bootstrap.cc:654] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.220186 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.220866 15344 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:15.221923 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.222484 15388 tablet_bootstrap.cc:492] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.222903 15388 ts_tablet_manager.cc:1403] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:03:15.222990 15393 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.223449 15393 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.225353 15393 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.225449 15388 raft_consensus.cc:359] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.226130 15388 raft_consensus.cc:385] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.226342 15386 tablet_bootstrap.cc:654] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.226416 15388 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.227306 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:15.228814 15160 leader_election.cc:343] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.229396 15387 tablet_bootstrap.cc:492] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.229820 15387 ts_tablet_manager.cc:1403] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 13:03:15.230536 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.232542 15387 raft_consensus.cc:359] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.233194 15387 raft_consensus.cc:385] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.233485 15387 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.239639 15387 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:15.233421 15160 leader_election.cc:343] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.239702 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.233978 15388 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.243158 15387 ts_tablet_manager.cc:1434] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.006s
I20260709 13:03:15.244233 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.244720 15387 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.246819 15388 ts_tablet_manager.cc:1434] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:03:15.248206 15388 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:15.250722 15387 tablet_bootstrap.cc:654] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.250988 15421 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.251487 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:15.255263 15162 leader_election.cc:343] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.255681 15162 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.256692 15388 tablet_bootstrap.cc:654] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.259384 15580 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.259845 15580 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:15.259904 15160 leader_election.cc:343] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.260357 15580 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.261207 15393 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.264221 15386 tablet_bootstrap.cc:492] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.264792 15386 ts_tablet_manager.cc:1403] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.012s
I20260709 13:03:15.269868 15421 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.275185 15502 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:03:15.284166 15162 leader_election.cc:343] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.284502 15387 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.284811 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.285036 15387 ts_tablet_manager.cc:1403] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.008s
I20260709 13:03:15.286487 15393 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.287729 15387 raft_consensus.cc:359] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.288422 15387 raft_consensus.cc:385] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.288698 15387 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.289628 15387 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.290274 15386 raft_consensus.cc:359] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.291193 15386 raft_consensus.cc:385] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.291525 15386 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.295970 15387 ts_tablet_manager.cc:1434] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:15.292358 15386 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.296988 15387 tablet_bootstrap.cc:492] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.298997 15386 ts_tablet_manager.cc:1434] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:03:15.300330 15386 tablet_bootstrap.cc:492] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.312191 15386 tablet_bootstrap.cc:654] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.314841 15387 tablet_bootstrap.cc:654] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.324355 15386 tablet_bootstrap.cc:492] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.324805 15386 ts_tablet_manager.cc:1403] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 13:03:15.327623 15386 raft_consensus.cc:359] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.328399 15386 raft_consensus.cc:385] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.328689 15386 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.329303 15386 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.332742 15387 tablet_bootstrap.cc:492] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.336896 15386 ts_tablet_manager.cc:1434] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:03:15.338222 15386 tablet_bootstrap.cc:492] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.333276 15387 ts_tablet_manager.cc:1403] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.000s
I20260709 13:03:15.342146 15459 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.342685 15387 raft_consensus.cc:359] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.343525 15387 raft_consensus.cc:385] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.343823 15387 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.342631 15459 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.344487 15387 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.345607 15459 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.346534 15387 ts_tablet_manager.cc:1434] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:03:15.347594 15387 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.354313 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.356352 15386 tablet_bootstrap.cc:654] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:15.357578 15160 leader_election.cc:343] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.302889 15580 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.359510 15580 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.362579 15387 tablet_bootstrap.cc:654] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.362725 15388 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.363227 15388 ts_tablet_manager.cc:1403] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.115s	user 0.042s	sys 0.037s
I20260709 13:03:15.369302 15386 tablet_bootstrap.cc:492] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.369628 15387 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.369752 15386 ts_tablet_manager.cc:1403] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.007s
I20260709 13:03:15.370046 15387 ts_tablet_manager.cc:1403] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:03:15.372638 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:15.375294 15386 raft_consensus.cc:359] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.376006 15386 raft_consensus.cc:385] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.376269 15386 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.376479 15388 raft_consensus.cc:359] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.377126 15388 raft_consensus.cc:385] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.376999 15386 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.378683 15502 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.378988 15386 ts_tablet_manager.cc:1434] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:03:15.379923 15386 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.377403 15388 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.381014 15388 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.383082 15388 ts_tablet_manager.cc:1434] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:03:15.383960 15388 tablet_bootstrap.cc:492] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
W20260709 13:03:15.383834 15160 leader_election.cc:343] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.384601 15387 raft_consensus.cc:359] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.385243 15387 raft_consensus.cc:385] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.385512 15387 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.386171 15387 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.388283 15387 ts_tablet_manager.cc:1434] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:03:15.389201 15387 tablet_bootstrap.cc:492] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.390499 15388 tablet_bootstrap.cc:654] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.391307 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.391947 15343 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:15.394825 15387 tablet_bootstrap.cc:654] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.395359 15580 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.395843 15580 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.397775 15580 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.395481 15386 tablet_bootstrap.cc:654] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.398591 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.400362 15501 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.400857 15501 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.402413 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.402953 15344 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.402812 15501 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.412689 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.413343 15195 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:15.414489 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.415792 15501 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.416133 15501 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.416462 15501 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.420161 15398 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.420840 15398 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.425129 15344 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:15.426951 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.427100 15398 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.426991 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.433548 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.425705 15386 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.445644 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.452136 15342 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:15.459995 15386 ts_tablet_manager.cc:1403] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.080s	user 0.003s	sys 0.008s
I20260709 13:03:15.461076 15195 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:15.464792 15345 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:15.460913 15398 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.465742 15398 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.466044 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.467051 15386 raft_consensus.cc:359] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.467702 15386 raft_consensus.cc:385] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.467777 15398 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.467983 15386 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.468629 15386 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.469164 15398 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.469162 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.469686 15398 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.470033 15398 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.470067 15386 ts_tablet_manager.cc:1434] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 13:03:15.471673 15501 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.473551 15501 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:15.473760 15238 leader_election.cc:343] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.475343 15386 tablet_bootstrap.cc:492] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.475171 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.475880 15196 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.479477 15398 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.482087 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.482640 15197 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.464409 15459 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.464519 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.484407 15343 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:15.487373 15388 tablet_bootstrap.cc:492] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.487867 15388 ts_tablet_manager.cc:1403] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.104s	user 0.025s	sys 0.031s
I20260709 13:03:15.491518 15196 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:15.491448 15197 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:15.495368 15388 raft_consensus.cc:359] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.496199 15388 raft_consensus.cc:385] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.496433 15387 tablet_bootstrap.cc:492] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.496539 15388 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.496910 15387 ts_tablet_manager.cc:1403] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.108s	user 0.022s	sys 0.017s
I20260709 13:03:15.483680 15459 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.500478 15459 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.501963 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.502346 15398 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.502733 15638 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.497766 15388 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.503232 15638 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:15.505770 15638 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.506373 15388 ts_tablet_manager.cc:1434] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:03:15.507663 15388 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:15.509053 15422 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.508845 15459 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.509505 15422 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.511204 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.511457 15459 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.511850 15343 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
W20260709 13:03:15.496302 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 50835.7us
I20260709 13:03:15.513098 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.516166 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:15.519873 15422 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.519999 15504 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.520538 15160 leader_election.cc:343] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.520462 15504 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.521517 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.522174 15197 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:15.522465 15504 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.524097 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.524673 15195 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:15.525012 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.525585 15268 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:15.526420 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:15.524636 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:15.527817 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:15.528378 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.528669 15386 tablet_bootstrap.cc:654] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.528924 15581 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.529345 15581 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.529675 15581 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.529999 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.530578 15268 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:15.528939 15343 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.532593 15421 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.532972 15421 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.533293 15421 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.534341 15501 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.534708 15501 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.535049 15501 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.537462 15092 catalog_manager.cc:5697] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.539063 15640 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.539503 15640 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.541481 15640 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.530733 15388 tablet_bootstrap.cc:654] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.543280 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.543906 15195 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:15.548189 15501 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.549125 15421 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.519672 15398 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.551142 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.552367 15640 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.553419 15640 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.556701 15581 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.557433 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.557787 15386 tablet_bootstrap.cc:492] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.558243 15386 ts_tablet_manager.cc:1403] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.004s
I20260709 13:03:15.559602 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.560182 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.560340 15194 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.561025 15421 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.563796 15269 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.563586 15386 raft_consensus.cc:359] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.564242 15386 raft_consensus.cc:385] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.564536 15386 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.565173 15386 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.565919 15398 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:15.566836 15398 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.567211 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.567947 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:15.568265 15196 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.568653 15268 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.570434 15194 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:15.525579 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.577873 15580 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.578357 15580 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:15.577301 15196 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:15.579159 15580 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.586285 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:15.587296 15421 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.587769 15421 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:15.588618 15421 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.587687 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:15.595341 15387 raft_consensus.cc:359] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.596210 15387 raft_consensus.cc:385] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.596542 15387 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.582175 15640 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.590969 15422 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.567963 15644 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.604936 15502 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:03:15.598181 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 72683.8us
I20260709 13:03:15.610678 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.612284 15387 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.614969 15502 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.616041 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:15.616634 15272 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.594997 15343 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
W20260709 13:03:15.598233 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73720.6us
I20260709 13:03:15.604260 15644 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.620218 15581 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.623740 15387 ts_tablet_manager.cc:1434] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.127s	user 0.013s	sys 0.000s
I20260709 13:03:15.613878 15422 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:15.626633 15422 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.631289 15272 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:15.632946 15386 ts_tablet_manager.cc:1434] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.072s	user 0.029s	sys 0.023s
I20260709 13:03:15.634045 15386 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.634114 15388 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.637059 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.637657 15346 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.637264 15388 ts_tablet_manager.cc:1403] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.130s	user 0.020s	sys 0.010s
I20260709 13:03:15.636716 15387 tablet_bootstrap.cc:492] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.644627 15388 raft_consensus.cc:359] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.645315 15388 raft_consensus.cc:385] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.645653 15388 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.646222 15388 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.649600 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.650856 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.651906 15344 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:15.654033 15502 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.621573 15501 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.625741 15644 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:15.628813 15238 leader_election.cc:343] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.650740 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.658905 15388 ts_tablet_manager.cc:1434] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:03:15.664999 15504 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.668241 15504 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.670171 15504 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.663306 15341 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.671975 15459 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.672454 15459 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.674388 15459 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.673280 15092 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.679620 15094 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.665462 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.683375 15388 tablet_bootstrap.cc:492] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:15.665961 15346 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:15.694985 15095 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.689937 15343 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.694489 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.698210 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.702251 15645 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.702375 15502 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:03:15.713487 15398 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:15.716619 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.717247 15267 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:15.717957 15645 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:15.703868 15237 leader_election.cc:343] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.709461 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.724431 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:15.725584 15160 leader_election.cc:343] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.724992 15502 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.719741 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.714442 15194 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:15.731526 15502 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:15.734194 15502 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.748479 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.749380 15504 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:15.749758 15504 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:15.750108 15504 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.755832 15645 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.756796 15387 tablet_bootstrap.cc:654] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:15.759953 15649 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:03:15.763616 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:15.766490 15268 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:15.769079 15094 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.772927 15386 tablet_bootstrap.cc:654] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.759415 15398 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:03:15.769893 15501 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.781597 15653 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.782123 15653 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.800839 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.803066 15345 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:15.806955 15343 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:15.808221 15504 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.810753 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:15.811849 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.812739 15504 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.812963 15195 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.813520 15644 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.812148 15388 tablet_bootstrap.cc:654] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.812397 15501 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.788148 15341 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:15.824083 15640 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.830974 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:15.817669 15501 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.839787 15196 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.842547 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:15.843346 15095 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.838512 15268 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:15.852599 15387 tablet_bootstrap.cc:492] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:15.852730 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:15.853118 15387 ts_tablet_manager.cc:1403] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.217s	user 0.018s	sys 0.003s
I20260709 13:03:15.853283 15194 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:15.854653 15162 leader_election.cc:343] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.854967 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.839799 15653 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.866338 15501 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:15.887569 15648 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:03:15.886029 15644 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:15.888861 15268 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:15.894121 15652 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.891701 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:15.910398 15386 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.911356 15386 ts_tablet_manager.cc:1403] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.278s	user 0.017s	sys 0.018s
I20260709 13:03:15.904614 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.926194 15644 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.926745 15644 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:15.927556 15644 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.929075 15640 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:15.931174 15387 raft_consensus.cc:359] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.932080 15387 raft_consensus.cc:385] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.932399 15387 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.933099 15387 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.933758 15386 raft_consensus.cc:359] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.934388 15386 raft_consensus.cc:385] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:15.934638 15386 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:15.935177 15195 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:15.935117 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.938578 15386 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.941373 15387 ts_tablet_manager.cc:1434] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.002s
I20260709 13:03:15.937372 15586 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:15.942410 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55048.1us
I20260709 13:03:15.944743 15386 ts_tablet_manager.cc:1434] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:03:15.942691 15586 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:15.949043 15238 leader_election.cc:343] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.949194 15586 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:15.946630 15421 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.950950 15421 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:15.953023 15421 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.956686 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:15.958081 15309 leader_election.cc:343] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.935822 15194 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:15.962319 15386 tablet_bootstrap.cc:492] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:15.964159 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:15.966244 15640 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:15.967808 15640 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:15.969161 15388 tablet_bootstrap.cc:492] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:15.968643 15640 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.970906 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:15.975050 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.977571 15386 tablet_bootstrap.cc:654] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:15.978000 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:15.984377 15387 tablet_bootstrap.cc:492] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:15.969619 15388 ts_tablet_manager.cc:1403] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.291s	user 0.026s	sys 0.008s
I20260709 13:03:15.987155 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:15.987536 15386 tablet_bootstrap.cc:492] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:15.988416 15386 ts_tablet_manager.cc:1403] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.000s
I20260709 13:03:15.991333 15388 raft_consensus.cc:359] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.992002 15388 raft_consensus.cc:385] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:15.992305 15312 leader_election.cc:343] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.992730 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:15.992257 15388 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
W20260709 13:03:15.978451 15237 leader_election.cc:343] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:15.999181 15388 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:15.997076 15581 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.004099 15386 raft_consensus.cc:359] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.004915 15386 raft_consensus.cc:385] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.005206 15386 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.005838 15162 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:16.005867 15386 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.006937 15653 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.007649 15386 ts_tablet_manager.cc:1434] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:03:16.008596 15386 tablet_bootstrap.cc:492] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:16.008488 15653 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.010490 15461 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:16.015462 15388 ts_tablet_manager.cc:1434] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:03:16.024272 15388 tablet_bootstrap.cc:492] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:16.026774 15387 tablet_bootstrap.cc:654] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:16.047113 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:16.049758 15386 tablet_bootstrap.cc:654] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.050032 15421 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.050318 15092 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:16.039824 15237 leader_election.cc:343] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.053112 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:16.054869 15644 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.055536 15644 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.082499 15388 tablet_bootstrap.cc:654] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.098687 15644 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.109366 15094 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.114090 15094 catalog_manager.cc:5697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.123716 15645 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.125007 15645 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.104655 15422 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:03:16.127133 15645 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.137107 15645 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.151758 15644 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.152277 15644 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:16.195441 15664 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:03:16.208951 15386 tablet_bootstrap.cc:492] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:16.209580 15386 ts_tablet_manager.cc:1403] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.201s	user 0.014s	sys 0.013s
I20260709 13:03:16.213294 15386 raft_consensus.cc:359] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.214232 15386 raft_consensus.cc:385] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.217306 15386 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.219624 15386 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.221374 15386 ts_tablet_manager.cc:1434] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:03:16.222338 15386 tablet_bootstrap.cc:492] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:16.214534 15644 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.208950 15387 tablet_bootstrap.cc:492] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:16.223711 15387 ts_tablet_manager.cc:1403] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.240s	user 0.017s	sys 0.029s
I20260709 13:03:16.226550 15586 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.226986 15586 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.228977 15586 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:16.226999 15398 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:03:16.232692 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:16.232717 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:16.240968 15193 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:16.218683 15388 tablet_bootstrap.cc:492] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:16.241585 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:16.242197 15388 ts_tablet_manager.cc:1403] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.218s	user 0.018s	sys 0.029s
I20260709 13:03:16.244644 15386 tablet_bootstrap.cc:654] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.238622 15387 raft_consensus.cc:359] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.245564 15387 raft_consensus.cc:385] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.245929 15387 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.242165 15197 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:16.246272 15388 raft_consensus.cc:359] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.247681 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:16.247750 15387 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.248776 15388 raft_consensus.cc:385] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.249440 15388 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.251871 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:16.252605 15342 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:16.253202 15388 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.257164 15388 ts_tablet_manager.cc:1434] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:03:16.256867 15678 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:16.257992 15388 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:16.258004 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:16.258738 15343 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:16.259564 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:16.249228 15268 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.252451 15586 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.262171 15422 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.262529 15422 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.250505 15644 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.249809 15421 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:03:16.290194 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:16.271656 15644 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.313007 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 65386.7us
I20260709 13:03:16.272101 15422 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.313782 15644 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.329252 15387 ts_tablet_manager.cc:1434] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.105s	user 0.013s	sys 0.002s
W20260709 13:03:16.329288 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 78414us
I20260709 13:03:16.326504 15459 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.337634 15459 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.340345 15459 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.346426 15646 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:16.348939 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 100297us
I20260709 13:03:16.347139 15646 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.352151 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:16.353992 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:16.355193 15645 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.368641 15646 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:16.371609 15162 leader_election.cc:343] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.378932 15422 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.383100 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:16.385193 15387 tablet_bootstrap.cc:492] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:16.380075 15644 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:16.386157 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55422.4us
W20260709 13:03:16.389034 15237 leader_election.cc:343] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.390123 15270 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:16.391567 15386 tablet_bootstrap.cc:492] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:16.404860 15422 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:16.409516 15344 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.416016 15386 ts_tablet_manager.cc:1403] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.004s
I20260709 13:03:16.421543 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:16.422147 15194 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.430109 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:16.430896 15272 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:16.432284 15388 tablet_bootstrap.cc:654] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.417217 15644 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.460224 15640 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:16.473973 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:16.474651 15197 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:16.480430 15386 raft_consensus.cc:359] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.481087 15386 raft_consensus.cc:385] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.481321 15386 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.487510 15386 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.489231 15386 ts_tablet_manager.cc:1434] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.002s
I20260709 13:03:16.490132 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:16.495666 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:16.501252 15344 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:16.499369 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:16.496364 15194 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:16.504251 15645 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:03:16.504276 15238 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:16.505864 15681 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:16.505208 15459 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:16.504667 15645 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.507294 15160 leader_election.cc:343] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.515811 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:16.513266 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:16.507833 15638 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:03:16.518481 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:16.522432 15192 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:16.523415 15386 tablet_bootstrap.cc:492] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:16.510965 15387 tablet_bootstrap.cc:654] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.519979 15501 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:16.520926 15504 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.525404 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:16.525585 15504 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:16.526461 15504 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.533476 15638 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.524950 15689 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:16.513607 15645 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.574201 15388 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:16.574729 15388 ts_tablet_manager.cc:1403] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.317s	user 0.020s	sys 0.026s
I20260709 13:03:16.554629 15422 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:03:16.629588 15388 raft_consensus.cc:359] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.630548 15388 raft_consensus.cc:385] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.630887 15388 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.635004 15387 tablet_bootstrap.cc:492] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:16.634903 15388 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.635529 15387 ts_tablet_manager.cc:1403] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.253s	user 0.020s	sys 0.024s
I20260709 13:03:16.645201 15388 ts_tablet_manager.cc:1434] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:03:16.640734 15645 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.652153 15388 tablet_bootstrap.cc:492] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
W20260709 13:03:16.652657 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 74574.9us
I20260709 13:03:16.670843 15644 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.674819 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:16.675544 15196 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.674279 15689 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.676746 15644 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.691794 15196 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:16.693606 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:16.693997 15700 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:16.695993 15398 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.693596 15689 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.705252 15387 raft_consensus.cc:359] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.706187 15387 raft_consensus.cc:385] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.706524 15387 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.707388 15387 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.721817 15387 ts_tablet_manager.cc:1434] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:03:16.700464 15645 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.691457 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:16.723721 15387 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:16.732414 15386 tablet_bootstrap.cc:654] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.726050 15398 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:16.735882 15398 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.744441 15689 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:16.751482 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51952.7us
I20260709 13:03:16.753141 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:16.754431 15160 leader_election.cc:343] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.746841 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:16.759238 15388 tablet_bootstrap.cc:654] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:16.763547 15162 leader_election.cc:343] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.763978 15162 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:16.765065 15689 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:16.777761 15238 leader_election.cc:343] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.773128 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:16.780982 15345 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:16.781895 15644 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.772909 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:16.783397 15094 catalog_manager.cc:5697] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.783543 15092 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.786664 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:16.789881 15644 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.790382 15644 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.790647 15237 leader_election.cc:343] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.790828 15644 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.800357 15387 tablet_bootstrap.cc:654] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.807189 15393 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.807734 15393 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.809903 15393 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.812341 15386 tablet_bootstrap.cc:492] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:16.812646 15387 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:16.812810 15386 ts_tablet_manager.cc:1403] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.290s	user 0.008s	sys 0.009s
I20260709 13:03:16.813055 15387 ts_tablet_manager.cc:1403] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.090s	user 0.003s	sys 0.013s
I20260709 13:03:16.815763 15387 raft_consensus.cc:359] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.816468 15387 raft_consensus.cc:385] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.817467 15387 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.815816 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:16.818112 15387 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.820087 15270 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:16.821511 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:16.821975 15387 ts_tablet_manager.cc:1434] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:03:16.822278 15393 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:16.822686 15393 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.823086 15393 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.823143 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:16.823901 15342 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:16.823730 15644 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.822966 15387 tablet_bootstrap.cc:492] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:16.826014 15644 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.828536 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:16.829061 15386 raft_consensus.cc:359] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.829743 15386 raft_consensus.cc:385] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.830035 15386 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
W20260709 13:03:16.830084 15238 leader_election.cc:343] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:16.830787 15386 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.832113 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:16.832679 15345 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.833802 15386 ts_tablet_manager.cc:1434] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:03:16.834841 15386 tablet_bootstrap.cc:492] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:16.834815 15393 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.849009 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:16.849392 15393 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.849602 15270 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.850479 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:16.851122 15341 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:16.841461 15386 tablet_bootstrap.cc:654] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.863054 15345 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:16.863629 15341 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:16.864758 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:16.864894 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:16.865509 15393 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.865640 15640 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:16.866035 15393 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:16.866112 15640 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:16.866906 15393 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.866905 15640 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.870033 15270 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:16.873118 15387 tablet_bootstrap.cc:654] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.876490 15388 tablet_bootstrap.cc:492] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:16.876991 15388 ts_tablet_manager.cc:1403] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.227s	user 0.018s	sys 0.002s
I20260709 13:03:16.888856 15388 raft_consensus.cc:359] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.889840 15388 raft_consensus.cc:385] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.890187 15388 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.890789 15388 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.906286 15094 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.910586 15387 tablet_bootstrap.cc:492] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:16.911154 15387 ts_tablet_manager.cc:1403] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.001s
I20260709 13:03:16.914023 15387 raft_consensus.cc:359] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.914741 15387 raft_consensus.cc:385] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.915060 15387 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.915757 15387 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.917907 15387 ts_tablet_manager.cc:1434] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:03:16.921012 15387 tablet_bootstrap.cc:492] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:16.922005 15388 ts_tablet_manager.cc:1434] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 13:03:16.927050 15387 tablet_bootstrap.cc:654] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.927392 15092 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.929414 15386 tablet_bootstrap.cc:492] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:16.933004 15386 ts_tablet_manager.cc:1403] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.098s	user 0.024s	sys 0.033s
I20260709 13:03:16.935604 15386 raft_consensus.cc:359] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.936317 15386 raft_consensus.cc:385] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.936672 15386 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.937312 15386 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.943431 15386 ts_tablet_manager.cc:1434] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:03:16.944398 15387 tablet_bootstrap.cc:492] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:16.944444 15386 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:16.944999 15387 ts_tablet_manager.cc:1403] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:03:16.931820 15388 tablet_bootstrap.cc:492] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:16.948305 15387 raft_consensus.cc:359] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.948987 15387 raft_consensus.cc:385] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.949297 15387 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.949930 15387 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.952023 15387 ts_tablet_manager.cc:1434] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:03:16.952911 15387 tablet_bootstrap.cc:492] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:16.954126 15386 tablet_bootstrap.cc:654] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.954677 15388 tablet_bootstrap.cc:654] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.959373 15387 tablet_bootstrap.cc:654] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:16.974912 15386 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:16.975682 15386 ts_tablet_manager.cc:1403] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.004s
I20260709 13:03:16.979363 15386 raft_consensus.cc:359] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.980401 15386 raft_consensus.cc:385] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:16.980821 15386 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:16.981829 15386 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.985201 15386 ts_tablet_manager.cc:1434] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:16.986914 15640 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.987597 15640 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:16.990206 15640 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:16.994601 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:16.995355 15194 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:17.000429 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:17.001940 15644 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.002199 15388 tablet_bootstrap.cc:492] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:17.002477 15644 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.003337 15386 tablet_bootstrap.cc:492] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:17.002767 15388 ts_tablet_manager.cc:1403] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.004s
I20260709 13:03:17.002944 15644 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.005358 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:17.005997 15345 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:17.011327 15386 tablet_bootstrap.cc:654] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.011793 15644 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.014657 15644 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.018200 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:17.019047 15194 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.049256 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:17.050117 15345 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.041455 15388 raft_consensus.cc:359] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.053956 15388 raft_consensus.cc:385] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.054279 15388 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.063931 15388 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.082069 15387 tablet_bootstrap.cc:492] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:17.082738 15387 ts_tablet_manager.cc:1403] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.130s	user 0.024s	sys 0.054s
W20260709 13:03:17.095083 15372 tablet.cc:2406] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:17.123494 15388 ts_tablet_manager.cc:1434] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.119s	user 0.005s	sys 0.005s
I20260709 13:03:17.126168 15387 raft_consensus.cc:359] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.127117 15387 raft_consensus.cc:385] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.127517 15387 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.128352 15387 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.130764 15387 ts_tablet_manager.cc:1434] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.048s	user 0.013s	sys 0.013s
I20260709 13:03:17.131968 15387 tablet_bootstrap.cc:492] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
W20260709 13:03:17.152915 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:17.150705 15386 tablet_bootstrap.cc:492] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.156177 15386 ts_tablet_manager.cc:1403] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.047s
I20260709 13:03:17.136905 15194 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:17.147514 15387 tablet_bootstrap.cc:654] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.158757 15386 raft_consensus.cc:359] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.159376 15386 raft_consensus.cc:385] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.159657 15386 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.160279 15386 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.162949 15386 ts_tablet_manager.cc:1434] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:03:17.164170 15386 tablet_bootstrap.cc:492] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:17.164804 15387 tablet_bootstrap.cc:492] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:17.165279 15387 ts_tablet_manager.cc:1403] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 13:03:17.168289 15387 raft_consensus.cc:359] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.169826 15387 raft_consensus.cc:385] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.170073 15387 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.170600 15387 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.172118 15387 ts_tablet_manager.cc:1434] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:17.172889 15387 tablet_bootstrap.cc:492] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:17.174932 15386 tablet_bootstrap.cc:654] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.181037 15387 tablet_bootstrap.cc:654] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.181414 15386 tablet_bootstrap.cc:492] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.182307 15386 ts_tablet_manager.cc:1403] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260709 13:03:17.131184 15345 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:17.250865 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:17.254936 15703 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.255492 15703 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:17.256310 15703 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.261703 15194 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.265249 15725 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.265779 15725 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.268085 15725 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.269347 15640 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.288424 15386 raft_consensus.cc:359] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.289096 15386 raft_consensus.cc:385] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.289369 15386 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.290136 15386 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.292209 15386 ts_tablet_manager.cc:1434] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.110s	user 0.012s	sys 0.000s
I20260709 13:03:17.293340 15386 tablet_bootstrap.cc:492] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:17.295750 15689 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.296223 15689 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.298234 15689 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.303045 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:17.303696 15195 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:17.307929 15312 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:17.308223 15725 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:17.308966 15581 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.309332 15581 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.309700 15581 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.314121 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:17.315482 15703 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.315958 15703 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.318086 15703 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.319451 15388 tablet_bootstrap.cc:492] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:17.320883 15581 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.323278 15192 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.323781 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:17.324362 15195 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.328141 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:17.328970 15345 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:17.329564 15644 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.330042 15644 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.330986 15195 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:17.332123 15644 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.332823 15312 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:17.333583 15504 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.334074 15504 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:17.334864 15504 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.335425 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:17.336261 15193 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:17.338266 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:17.339314 15586 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.339818 15586 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.341351 15645 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.341830 15586 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.346657 15388 tablet_bootstrap.cc:654] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.349606 15387 tablet_bootstrap.cc:492] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:17.392833 15387 ts_tablet_manager.cc:1403] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.220s	user 0.017s	sys 0.000s
I20260709 13:03:17.394076 15393 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.395694 15387 raft_consensus.cc:359] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.396380 15387 raft_consensus.cc:385] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.396682 15387 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.397316 15387 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.398792 15387 ts_tablet_manager.cc:1434] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:03:17.349299 15586 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.350574 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:17.402539 15682 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.402972 15268 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:17.351310 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:17.403023 15682 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.403944 15270 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:17.351637 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:17.353730 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:17.354458 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:17.355302 15238 leader_election.cc:343] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:17.405553 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51968.9us
I20260709 13:03:17.368716 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:17.406415 15267 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:17.406638 15312 leader_election.cc:343] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.409267 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:17.410897 15312 leader_election.cc:343] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:17.405814 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50547.9us
I20260709 13:03:17.412762 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:17.413589 15586 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.413985 15586 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.415470 15586 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.418339 15682 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.420548 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:17.421173 15271 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:17.422829 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:17.423662 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:17.372674 15386 tablet_bootstrap.cc:654] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.356663 15644 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:03:17.424718 15504 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.425066 15504 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.359313 15581 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.425429 15504 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.428189 15393 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:17.452139 15386 tablet_bootstrap.cc:492] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.452735 15386 ts_tablet_manager.cc:1403] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.160s	user 0.009s	sys 0.006s
I20260709 13:03:17.457211 15093 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.459014 15386 raft_consensus.cc:359] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.459875 15386 raft_consensus.cc:385] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.460213 15386 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.464008 15386 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.468106 15581 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.468802 15386 ts_tablet_manager.cc:1434] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:03:17.469332 15581 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.473973 15386 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:17.474674 15581 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.476853 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:17.485242 15680 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.485792 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:17.486465 15338 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:17.494702 15339 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.517288 15387 tablet_bootstrap.cc:492] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:17.550143 15386 tablet_bootstrap.cc:654] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.572729 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:17.573859 15644 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.574223 15644 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.574515 15644 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.576198 15386 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.576821 15386 ts_tablet_manager.cc:1403] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.002s
I20260709 13:03:17.580278 15386 raft_consensus.cc:359] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.581099 15386 raft_consensus.cc:385] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.581451 15386 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.583388 15267 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:17.583948 15398 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:17.588733 15386 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.589982 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:17.594470 15386 ts_tablet_manager.cc:1434] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:03:17.597395 15386 tablet_bootstrap.cc:492] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:17.603729 15398 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:17.582692 15644 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.594198 15504 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.613963 15504 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.614872 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:17.616691 15312 leader_election.cc:343] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.619415 15386 tablet_bootstrap.cc:654] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.626309 15386 tablet_bootstrap.cc:492] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.626309 15388 tablet_bootstrap.cc:492] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:17.626884 15386 ts_tablet_manager.cc:1403] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 13:03:17.626892 15388 ts_tablet_manager.cc:1403] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.308s	user 0.057s	sys 0.129s
I20260709 13:03:17.627391 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:17.628034 15270 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.629120 15388 raft_consensus.cc:359] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.629639 15388 raft_consensus.cc:385] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.629855 15388 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.630439 15388 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.632332 15388 ts_tablet_manager.cc:1434] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:03:17.633970 15586 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.635730 15388 tablet_bootstrap.cc:492] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:17.636087 15644 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.636758 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:17.637301 15193 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.639415 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:17.642015 15388 tablet_bootstrap.cc:654] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.634886 15386 raft_consensus.cc:359] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.643718 15386 raft_consensus.cc:385] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.644047 15386 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.644542 15193 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:17.645730 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:17.645841 15270 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:17.645431 15386 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.647234 15387 tablet_bootstrap.cc:654] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.649010 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:17.649670 15343 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.650482 15386 ts_tablet_manager.cc:1434] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:03:17.651952 15386 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:17.652602 15586 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.657912 15682 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.658597 15682 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:17.659736 15682 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.659715 15386 tablet_bootstrap.cc:654] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.668745 15702 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:17.669597 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:17.670324 15702 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.670943 15702 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:17.672140 15702 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.674060 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:17.674626 15266 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.677333 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:17.677999 15093 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:17.684247 15238 leader_election.cc:343] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.684789 15266 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:17.687589 15387 tablet_bootstrap.cc:492] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:17.688059 15387 ts_tablet_manager.cc:1403] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.000s
I20260709 13:03:17.701052 15386 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.701548 15386 ts_tablet_manager.cc:1403] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.003s
I20260709 13:03:17.707703 15343 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:17.712145 15387 raft_consensus.cc:359] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.719628 15387 raft_consensus.cc:385] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.719920 15387 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.720544 15387 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.722572 15387 ts_tablet_manager.cc:1434] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:03:17.723513 15387 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:17.714694 15386 raft_consensus.cc:359] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.723416 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:17.724488 15398 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.724923 15398 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:17.725675 15398 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.729879 15387 tablet_bootstrap.cc:654] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.723934 15386 raft_consensus.cc:385] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.717538 15388 tablet_bootstrap.cc:492] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:17.731637 15388 ts_tablet_manager.cc:1403] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.096s	user 0.027s	sys 0.024s
I20260709 13:03:17.734661 15388 raft_consensus.cc:359] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.736126 15388 raft_consensus.cc:385] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.736529 15388 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.737435 15388 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.740056 15386 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.745261 15386 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.746248 15388 ts_tablet_manager.cc:1434] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:03:17.748189 15388 tablet_bootstrap.cc:492] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:17.756500 15387 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:17.756920 15388 tablet_bootstrap.cc:654] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.756981 15387 ts_tablet_manager.cc:1403] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.020s
I20260709 13:03:17.759701 15387 raft_consensus.cc:359] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.760353 15387 raft_consensus.cc:385] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.760673 15387 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.761289 15387 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.763214 15387 ts_tablet_manager.cc:1434] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:03:17.764132 15387 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:17.750168 15386 ts_tablet_manager.cc:1434] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:03:17.767393 15386 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:17.768525 15388 tablet_bootstrap.cc:492] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:17.769021 15388 ts_tablet_manager.cc:1403] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:03:17.769865 15387 tablet_bootstrap.cc:654] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.771708 15388 raft_consensus.cc:359] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.772431 15388 raft_consensus.cc:385] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.772683 15388 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.773819 15386 tablet_bootstrap.cc:654] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.773447 15388 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.775767 15388 ts_tablet_manager.cc:1434] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:03:17.776835 15388 tablet_bootstrap.cc:492] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:17.779331 15093 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.780969 15093 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.785444 15387 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:17.785758 15388 tablet_bootstrap.cc:654] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.785907 15387 ts_tablet_manager.cc:1403] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.015s
I20260709 13:03:17.788530 15387 raft_consensus.cc:359] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.789146 15387 raft_consensus.cc:385] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.789418 15387 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.790019 15387 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.792074 15387 ts_tablet_manager.cc:1434] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:03:17.792996 15387 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:17.796774 15388 tablet_bootstrap.cc:492] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:17.797235 15388 ts_tablet_manager.cc:1403] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:03:17.798801 15387 tablet_bootstrap.cc:654] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.800191 15388 raft_consensus.cc:359] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.801211 15388 raft_consensus.cc:385] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.800305 15095 catalog_manager.cc:5697] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.801515 15388 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.802353 15388 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.805332 15388 ts_tablet_manager.cc:1434] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:03:17.806654 15388 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:17.810503 15386 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.810346 15398 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.810999 15386 ts_tablet_manager.cc:1403] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.003s
I20260709 13:03:17.814155 15386 raft_consensus.cc:359] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.814848 15386 raft_consensus.cc:385] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.815160 15386 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.815936 15386 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.821314 15398 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.821851 15398 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.832795 15388 tablet_bootstrap.cc:654] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.833662 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:17.835568 15238 leader_election.cc:343] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.837495 15387 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:17.837988 15387 ts_tablet_manager.cc:1403] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.004s
I20260709 13:03:17.840653 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:17.841632 15343 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:17.840612 15387 raft_consensus.cc:359] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.844298 15387 raft_consensus.cc:385] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.844619 15387 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.845021 15501 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.845574 15682 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.845739 15501 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.846269 15682 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.846535 15387 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.848711 15682 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.849979 15501 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.852725 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:17.853065 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:17.853636 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:17.854269 15345 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:17.855329 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:17.856173 15266 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:17.857273 15640 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.857640 15640 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.857981 15640 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.858474 15398 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.862270 15387 ts_tablet_manager.cc:1434] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:03:17.863360 15387 tablet_bootstrap.cc:492] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:17.863679 15386 ts_tablet_manager.cc:1434] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 13:03:17.863700 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:17.866729 15312 leader_election.cc:343] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.870594 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:17.871605 15387 tablet_bootstrap.cc:654] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.871310 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:17.871687 15682 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.865477 15386 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
W20260709 13:03:17.873077 15238 leader_election.cc:343] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:17.874867 15702 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.875345 15702 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.872331 15682 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.877645 15682 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.879086 15501 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.879778 15501 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.877733 15398 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.881819 15398 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.882378 15398 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.885643 15586 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:17.899557 15393 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.900171 15393 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.914492 15706 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:17.922010 15706 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.922518 15706 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.949857 15706 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.954037 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:17.954665 15194 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:17.955904 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:17.956873 15504 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:17.957234 15504 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.957566 15504 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.958040 15388 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:17.958523 15388 ts_tablet_manager.cc:1403] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.152s	user 0.024s	sys 0.060s
I20260709 13:03:17.961496 15388 raft_consensus.cc:359] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.962370 15388 raft_consensus.cc:385] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.962682 15388 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.964591 15504 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.964879 15677 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:17.966696 15501 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.967581 15504 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.967909 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:17.971961 15192 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:17.973927 15398 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.975639 15640 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.976743 15386 tablet_bootstrap.cc:654] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:17.979243 15192 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:17.986378 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:17.980715 15702 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:17.987383 15702 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:17.987609 15386 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:17.988117 15386 ts_tablet_manager.cc:1403] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.011s
I20260709 13:03:17.990739 15386 raft_consensus.cc:359] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.991415 15386 raft_consensus.cc:385] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:17.991245 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:17.991746 15386 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:17.992022 15398 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.992403 15386 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.988132 15702 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:17.995389 15702 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:17.996085 15393 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:17.996508 15386 ts_tablet_manager.cc:1434] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:03:17.997633 15386 tablet_bootstrap.cc:492] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:18.000134 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:18.006695 15388 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.009151 15388 ts_tablet_manager.cc:1434] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.003s
I20260709 13:03:18.011200 15388 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:18.014390 15386 tablet_bootstrap.cc:654] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.016024 15387 tablet_bootstrap.cc:492] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:18.016513 15387 ts_tablet_manager.cc:1403] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.153s	user 0.021s	sys 0.006s
I20260709 13:03:18.020133 15682 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.022178 15386 tablet_bootstrap.cc:492] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:18.022662 15386 ts_tablet_manager.cc:1403] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.006s
I20260709 13:03:18.023610 15682 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:18.024293 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:18.024894 15194 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.025184 15386 raft_consensus.cc:359] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.025810 15386 raft_consensus.cc:385] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.026073 15386 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.025396 15387 raft_consensus.cc:359] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.026693 15386 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.028424 15388 tablet_bootstrap.cc:654] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.028712 15387 raft_consensus.cc:385] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.033090 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.031435 15194 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:18.034860 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:18.035532 15640 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.035658 15682 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.036187 15682 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:18.036327 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:18.037288 15682 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.033203 15387 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.038760 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:18.040439 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:18.043660 15266 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:18.043216 15387 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.044478 15386 ts_tablet_manager.cc:1434] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.004s
I20260709 13:03:18.032094 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.007661 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:18.047086 15192 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:18.047544 15387 ts_tablet_manager.cc:1434] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:03:18.048774 15387 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
W20260709 13:03:18.049685 15238 leader_election.cc:343] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.050505 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:18.051097 15343 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.054991 15386 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:18.058455 15387 tablet_bootstrap.cc:654] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.060217 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:18.061115 15345 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.061224 15386 tablet_bootstrap.cc:654] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.075872 15706 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.076391 15706 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.078249 15094 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.079016 15706 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.079874 15094 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.082086 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.082676 15344 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:18.091058 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:18.091610 15266 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:18.103334 15238 leader_election.cc:343] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.117762 15387 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:18.118400 15387 ts_tablet_manager.cc:1403] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.003s
I20260709 13:03:18.126941 15343 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:18.136655 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:18.129556 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:18.139394 15393 raft_consensus.cc:2764] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:03:18.142202 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:18.143127 15238 leader_election.cc:343] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.145272 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:18.143779 15271 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.070598 15345 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
W20260709 13:03:18.149019 15237 leader_election.cc:343] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.152107 15683 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.156045 15683 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.157981 15683 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.157687 15387 raft_consensus.cc:359] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.159382 15387 raft_consensus.cc:385] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.159636 15387 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.158007 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:18.160346 15387 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.162590 15387 ts_tablet_manager.cc:1434] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.003s
I20260709 13:03:18.167225 15683 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.167975 15683 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.168633 15387 tablet_bootstrap.cc:492] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:18.169879 15683 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.153756 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:18.176692 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.177794 15339 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:18.184044 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.185364 15192 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.179929 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:18.187680 15238 leader_election.cc:343] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.193193 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:18.194078 15367 debug-util.cc:398] Leaking SignalData structure 0x7b0800056f80 after lost signal to thread 14039
W20260709 13:03:18.195075 15367 debug-util.cc:398] Leaking SignalData structure 0x7b08001358a0 after lost signal to thread 15129
I20260709 13:03:18.195272 15644 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.195622 15644 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.195961 15644 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:18.196159 15367 debug-util.cc:398] Leaking SignalData structure 0x7b0800294bc0 after lost signal to thread 15221
I20260709 13:03:18.196509 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:18.197129 15367 debug-util.cc:398] Leaking SignalData structure 0x7b08002b5440 after lost signal to thread 15296
W20260709 13:03:18.198086 15367 debug-util.cc:398] Leaking SignalData structure 0x7b08002aaee0 after lost signal to thread 15370
I20260709 13:03:18.198516 15271 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:18.186446 15703 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.202488 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:18.203270 15267 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:18.205250 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:18.206307 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:18.207291 15501 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.207748 15501 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:18.207872 15703 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.208621 15501 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.223809 15388 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:18.224577 15388 ts_tablet_manager.cc:1403] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.215s	user 0.055s	sys 0.060s
I20260709 13:03:18.235158 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:18.237474 15773 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.236414 15393 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.240839 15703 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:18.245203 15386 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:18.236637 15677 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:03:18.249505 15143 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:18.245926 15388 raft_consensus.cc:359] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.249945 15388 raft_consensus.cc:385] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.249858 15266 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:18.250386 15388 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.250573 15398 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.245718 15386 ts_tablet_manager.cc:1403] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.191s	user 0.060s	sys 0.050s
I20260709 13:03:18.251873 15388 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.261838 15388 ts_tablet_manager.cc:1434] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
I20260709 13:03:18.262823 15393 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.267621 15386 raft_consensus.cc:359] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.268462 15386 raft_consensus.cc:385] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.268731 15386 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.277801 15388 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:18.284303 15387 tablet_bootstrap.cc:654] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.272255 15683 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.256619 15644 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.279014 15703 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.303679 15386 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.305516 15386 ts_tablet_manager.cc:1434] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:03:18.306429 15386 tablet_bootstrap.cc:492] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:18.318499 15677 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.339370 15387 tablet_bootstrap.cc:492] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:18.339895 15387 ts_tablet_manager.cc:1403] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.003s
I20260709 13:03:18.312256 15774 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:03:18.345680 15774 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.346151 15774 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.352698 15702 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:03:18.360482 15386 tablet_bootstrap.cc:654] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.376726 15644 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.357996 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:18.392405 15238 leader_election.cc:343] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.395718 15094 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.397943 15094 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.399441 15387 raft_consensus.cc:359] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.400130 15387 raft_consensus.cc:385] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.400434 15387 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.401074 15387 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.408753 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:18.409384 15345 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.412969 15774 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.416549 15387 ts_tablet_manager.cc:1434] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.076s	user 0.004s	sys 0.003s
I20260709 13:03:18.419117 15504 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.420641 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.421267 15344 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:18.423118 15387 tablet_bootstrap.cc:492] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:18.450259 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:18.453337 15238 leader_election.cc:343] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.456166 15388 tablet_bootstrap.cc:654] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.460616 15237 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:18.462939 15774 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.463369 15774 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.463734 15774 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.472903 15386 tablet_bootstrap.cc:492] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:18.473390 15386 ts_tablet_manager.cc:1403] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.167s	user 0.012s	sys 0.007s
I20260709 13:03:18.476167 15345 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:18.476666 15386 raft_consensus.cc:359] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.477329 15386 raft_consensus.cc:385] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.477694 15386 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.487624 15774 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.489673 15774 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.486920 15386 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.490823 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:18.499756 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:18.501144 15386 ts_tablet_manager.cc:1434] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:18.500334 15345 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.500869 15706 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.502743 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:18.505980 15238 leader_election.cc:343] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.506742 15706 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:18.516367 15386 tablet_bootstrap.cc:492] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Bootstrap starting.
I20260709 13:03:18.518663 15706 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.529750 15345 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:18.531667 15237 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:18.533291 15677 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:18.541663 15388 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:18.542368 15388 ts_tablet_manager.cc:1403] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.265s	user 0.016s	sys 0.015s
I20260709 13:03:18.540479 15703 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.545526 15703 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:18.547076 15703 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.571564 15680 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.572172 15680 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.574474 15680 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.577548 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.576120 15093 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.578464 15338 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:18.582463 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:18.584822 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:18.587051 15706 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.587121 15689 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.578470 15778 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:03:18.614399 15706 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.645742 15706 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.655586 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:18.657747 15237 leader_election.cc:343] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.661137 15387 tablet_bootstrap.cc:654] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.665058 15771 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:03:18.672377 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:18.664382 15778 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:03:18.691322 15689 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.683370 15702 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:03:18.692744 15388 raft_consensus.cc:359] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.693656 15388 raft_consensus.cc:385] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.693991 15388 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.696738 15386 tablet_bootstrap.cc:654] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.694752 15388 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:18.698697 15238 leader_election.cc:343] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.699321 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:18.712833 15388 ts_tablet_manager.cc:1434] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.170s	user 0.023s	sys 0.027s
I20260709 13:03:18.716027 15797 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.710935 15706 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.738802 15388 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:18.715497 15640 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.763715 15388 tablet_bootstrap.cc:654] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.716547 15797 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.747092 15706 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.780233 15706 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.788424 15797 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:18.791296 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.795315 15387 tablet_bootstrap.cc:492] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:18.796020 15387 ts_tablet_manager.cc:1403] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.376s	user 0.017s	sys 0.004s
W20260709 13:03:18.796487 15237 leader_election.cc:343] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.804621 15387 raft_consensus.cc:359] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.805388 15387 raft_consensus.cc:385] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.805670 15387 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.809970 15191 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.816205 15387 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.817269 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:18.819281 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:18.829097 15504 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.829547 15504 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.836269 15386 tablet_bootstrap.cc:492] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: No bootstrap required, opened a new log
I20260709 13:03:18.836737 15386 ts_tablet_manager.cc:1403] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Time spent bootstrapping tablet: real 0.324s	user 0.017s	sys 0.021s
I20260709 13:03:18.838269 15094 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:18.840485 15387 ts_tablet_manager.cc:1434] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.004s
I20260709 13:03:18.841974 15504 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:18.843304 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:18.843914 15266 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:18.844338 15386 raft_consensus.cc:359] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.844976 15386 raft_consensus.cc:385] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.845221 15386 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.845806 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:18.847939 15387 tablet_bootstrap.cc:492] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:18.847855 15386 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.848858 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:18.850101 15386 ts_tablet_manager.cc:1434] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:03:18.850071 15677 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:18.855638 15677 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.856051 15677 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:18.865644 15312 leader_election.cc:343] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.882593 15677 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.886248 15773 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.888586 15677 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:18.889168 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:18.890488 15312 leader_election.cc:343] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.890512 15388 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:18.891433 15388 ts_tablet_manager.cc:1403] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.173s	user 0.017s	sys 0.003s
I20260709 13:03:18.891301 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:18.891991 15266 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:18.893999 15388 raft_consensus.cc:359] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:18.894647 15388 raft_consensus.cc:385] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:18.894927 15388 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:18.895768 15388 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:18.906797 15238 leader_election.cc:343] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:18.909868 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:18.911875 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:18.913240 15703 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.917779 15644 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.920253 15501 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:18.927450 15388 ts_tablet_manager.cc:1434] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:03:18.929469 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:18.939350 15387 tablet_bootstrap.cc:654] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:18.943593 15388 tablet_bootstrap.cc:492] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:18.962931 15266 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:18.966284 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:18.971714 15798 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:18.974845 15682 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:18.975590 15682 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:18.978668 15682 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:18.991652 15238 consensus_peers.cc:597] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.993876 15387 tablet_bootstrap.cc:492] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:18.996433 15387 ts_tablet_manager.cc:1403] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.017s
I20260709 13:03:19.011744 15388 tablet_bootstrap.cc:654] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.013589 15191 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.013666 15387 raft_consensus.cc:359] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.014492 15387 raft_consensus.cc:385] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.014770 15387 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.015902 15387 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.022624 15644 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.023253 15387 ts_tablet_manager.cc:1434] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:03:19.023150 15644 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.024727 15387 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Bootstrap starting.
I20260709 13:03:19.027871 15644 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:19.028133 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:19.028909 15338 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 0.
I20260709 13:03:19.030128 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:19.030850 15703 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.031278 15774 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:19.030822 15388 tablet_bootstrap.cc:492] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:19.031764 15774 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.032128 15388 ts_tablet_manager.cc:1403] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.005s
I20260709 13:03:19.032188 15774 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.035070 15387 tablet_bootstrap.cc:654] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.034782 15388 raft_consensus.cc:359] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.035596 15388 raft_consensus.cc:385] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.035909 15388 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.036689 15388 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.039184 15388 ts_tablet_manager.cc:1434] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:03:19.041158 15388 tablet_bootstrap.cc:492] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:19.046836 15388 tablet_bootstrap.cc:654] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.051131 15387 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: No bootstrap required, opened a new log
I20260709 13:03:19.051064 15774 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.052104 15387 ts_tablet_manager.cc:1403] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.002s
I20260709 13:03:19.053148 15774 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:19.054111 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:19.054333 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:19.054548 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:19.054677 15338 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:19.055968 15238 leader_election.cc:343] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:19.056679 15238 leader_election.cc:343] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:19.061568 15338 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:19.062657 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:19.064474 15644 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:19.064952 15644 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:19.065728 15644 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.071321 15387 raft_consensus.cc:359] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.072057 15387 raft_consensus.cc:385] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.072321 15387 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.079762 15388 tablet_bootstrap.cc:492] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:19.080242 15388 ts_tablet_manager.cc:1403] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:03:19.080257 15501 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.083321 15387 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.085800 15387 ts_tablet_manager.cc:1434] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 13:03:19.093186 15093 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.100303 15683 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.100826 15683 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.102757 15683 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:19.082823 15388 raft_consensus.cc:359] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.103775 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:19.104172 15388 raft_consensus.cc:385] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.104282 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:19.104526 15388 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.104601 15339 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:19.105283 15388 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.106479 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:19.106775 15388 ts_tablet_manager.cc:1434] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:03:19.107529 15393 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.107720 15388 tablet_bootstrap.cc:492] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:19.113636 15388 tablet_bootstrap.cc:654] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.114614 15094 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.121971 15393 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:19.125998 15388 tablet_bootstrap.cc:492] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:19.126506 15388 ts_tablet_manager.cc:1403] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:03:19.135257 15388 raft_consensus.cc:359] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.135950 15388 raft_consensus.cc:385] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.136202 15388 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.145005 15644 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:19.138899 15388 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.149446 15388 ts_tablet_manager.cc:1434] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:03:19.150357 15388 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:19.158284 15388 tablet_bootstrap.cc:654] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.176332 15388 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:19.176766 15388 ts_tablet_manager.cc:1403] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 13:03:19.178736 15388 raft_consensus.cc:359] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.179337 15388 raft_consensus.cc:385] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.179611 15388 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.179531 15586 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.180616 15586 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.180480 15388 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.184116 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:19.182580 15586 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:19.184895 15266 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:19.184206 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:19.185855 15194 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 0.
I20260709 13:03:19.187269 15312 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:19.188472 15677 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:19.188868 15677 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.189219 15677 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.189651 15388 ts_tablet_manager.cc:1434] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:03:19.195688 15388 tablet_bootstrap.cc:492] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Bootstrap starting.
I20260709 13:03:19.204378 15388 tablet_bootstrap.cc:654] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:19.207353 15677 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.218297 15683 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.218880 15683 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.221081 15683 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:19.226987 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:19.227638 15343 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:19.231253 15162 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:19.232044 15799 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:19.232427 15799 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.232774 15799 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.238821 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:19.239470 15268 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.239941 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:19.240478 15194 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.243309 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:19.243083 15799 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.243842 15266 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 0.
I20260709 13:03:19.246143 15268 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:19.247318 15194 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:19.247375 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:19.248158 15682 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:19.248476 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:19.248754 15682 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:19.249078 15266 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.249573 15682 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.255803 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:19.256397 15339 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.259774 15799 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:19.262543 15388 tablet_bootstrap.cc:492] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: No bootstrap required, opened a new log
I20260709 13:03:19.263059 15388 ts_tablet_manager.cc:1403] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.023s
I20260709 13:03:19.264918 15677 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 1 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:19.266820 15266 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:19.267915 15388 raft_consensus.cc:359] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.268996 15388 raft_consensus.cc:385] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:19.269272 15388 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Initialized, Role: FOLLOWER
I20260709 13:03:19.269631 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:19.270475 15393 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:19.271992 15393 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:19.273198 15393 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.274897 15095 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.269902 15388 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.279436 15388 ts_tablet_manager.cc:1434] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:03:19.283167 15339 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:19.307699 15095 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.439981 15393 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.440376 15393 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:19.441713 15393 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:19.442932 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:19.443343 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:19.443857 15339 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 1: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:19.446038 15677 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.446125 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:19.448088 15393 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.456455 15393 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:19.461675 15191 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:19.474117 15586 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.555508 15703 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.568418 15774 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.784175 15799 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.795218 15799 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.818746 15682 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:19.851085 15586 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:20.120301 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:20.152365 15830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:20.153434 15831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:20.159621 14036 server_base.cc:1061] running on GCE node
W20260709 13:03:20.159585 15833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:20.161669 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:20.161939 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:20.162176 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602200162144 us; error 0 us; skew 500 ppm
I20260709 13:03:20.163010 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:20.167316 14036 webserver.cc:533] Webserver started at http://127.13.181.4:39795/ using document root <none> and password file <none>
I20260709 13:03:20.168021 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:20.168347 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:20.168701 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:20.169943 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-3-root/instance:
uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-28ks"
I20260709 13:03:20.175568 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:03:20.183897 15838 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.184844 14036 fs_manager.cc:730] Time spent opening block manager: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:03:20.185247 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-3-root
uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
format_stamp: "Formatted at 2026-07-09 13:03:20 on dist-test-slave-28ks"
I20260709 13:03:20.185541 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:20.222096 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:20.223788 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:20.225816 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:20.232396 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:20.232661 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.232975 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:20.233201 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:20.335327 15900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.4:42201 every 8 connection(s)
I20260709 13:03:20.336654 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.4:42201
I20260709 13:03:20.430572 14036 auto_leader_rebalancer-test.cc:384] add a tserver: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:20.448798 15901 heartbeater.cc:344] Connected to a master server at 127.13.181.62:42621
I20260709 13:03:20.449295 15901 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:20.450181 15901 heartbeater.cc:507] Master 127.13.181.62:42621 requested a full tablet report, sending...
I20260709 13:03:20.453308 15093 ts_manager.cc:194] Registered new tserver with Master: 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:20.455359 15093 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43458
I20260709 13:03:21.458526 15901 heartbeater.cc:499] Master 127.13.181.62:42621 was elected leader, sending a full tablet report...
I20260709 13:03:21.572229 15267 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:21.580199 15191 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.585896 15501 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.612706 15339 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.627837 15501 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:21.636552 15237 consensus_peers.cc:597] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0faaa04570d144c9bd5a7d514ee23dc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:21.638186 15912 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.640511 15191 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.642041 15339 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.665098 15267 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:21.669683 15093 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.683638 15339 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.685155 15501 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.686550 15191 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.687953 15501 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:21.688328 15237 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fddd7d735c9e4195aee24df42bc25619. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:21.702365 15917 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.706029 15339 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.735133 15094 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.748567 15194 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.768383 15192 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:21.798344 15268 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.801440 15799 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.813673 15339 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.816910 15928 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:21.840509 15162 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e8a0429d4024b20b2a1dbe68f14d55e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:21.843856 15928 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.845441 15268 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.867790 15344 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.861976 15094 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:21.900588 15344 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:21.908488 15268 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.909960 15586 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.919536 15194 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:21.921129 15907 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.938560 15907 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.940564 15268 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
W20260709 13:03:21.958556 15311 consensus_peers.cc:597] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c39b63dad5d94468b5872c05e2d72e0d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:21.964478 15194 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:21.970315 15094 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:22.036250 15943 ts_tablet_manager.cc:933] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:22.045415 15943 tablet_copy_client.cc:323] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:03:22.064337 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 0faaa04570d144c9bd5a7d514ee23dc4 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:03:22.064951 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 0faaa04570d144c9bd5a7d514ee23dc4 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-0faaa04570d144c9bd5a7d514ee23dc4
I20260709 13:03:22.073217 15282 tablet_copy_source_session.cc:215] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:22.078744 15943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0faaa04570d144c9bd5a7d514ee23dc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.095808 15943 tablet_copy_client.cc:806] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:22.096869 15943 tablet_copy_client.cc:670] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:22.101814 15943 tablet_copy_client.cc:538] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:22.117899 15943 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:22.156790 15943 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.157812 15943 tablet_bootstrap.cc:492] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:22.158991 15943 ts_tablet_manager.cc:1403] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.041s	user 0.030s	sys 0.000s
I20260709 13:03:22.161962 15943 raft_consensus.cc:359] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.162848 15943 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:22.163566 15943 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.171290 15943 ts_tablet_manager.cc:1434] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:03:22.173117 15282 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-0faaa04570d144c9bd5a7d514ee23dc4 received from {username='slave'} at 127.0.0.1:44984
I20260709 13:03:22.173586 15282 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-0faaa04570d144c9bd5a7d514ee23dc4 on tablet 0faaa04570d144c9bd5a7d514ee23dc4 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:22.193425 15943 ts_tablet_manager.cc:933] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:22.218729 15943 tablet_copy_client.cc:323] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.1:39515
I20260709 13:03:22.236109 15207 tablet_copy_service.cc:140] P 5e6eed5c7a6b4571b5f898002fc990d2: Received BeginTabletCopySession request for tablet 0e8a0429d4024b20b2a1dbe68f14d55e from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:40392)
I20260709 13:03:22.236822 15207 tablet_copy_service.cc:161] P 5e6eed5c7a6b4571b5f898002fc990d2: Beginning new tablet copy session on tablet 0e8a0429d4024b20b2a1dbe68f14d55e from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:40392: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-0e8a0429d4024b20b2a1dbe68f14d55e
I20260709 13:03:22.252264 15207 tablet_copy_source_session.cc:215] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:22.257061 15943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e8a0429d4024b20b2a1dbe68f14d55e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.276078 15943 tablet_copy_client.cc:806] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:22.276795 15943 tablet_copy_client.cc:670] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:22.286717 15943 tablet_copy_client.cc:538] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:22.296684 15943 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:22.323294 15949 ts_tablet_manager.cc:933] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:22.332360 15949 tablet_copy_client.cc:323] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:03:22.335095 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet fddd7d735c9e4195aee24df42bc25619 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:03:22.335645 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet fddd7d735c9e4195aee24df42bc25619 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-fddd7d735c9e4195aee24df42bc25619
I20260709 13:03:22.340847 15943 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.343999 15943 tablet_bootstrap.cc:492] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:22.344158 15282 tablet_copy_source_session.cc:215] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:22.344717 15943 ts_tablet_manager.cc:1403] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.014s
I20260709 13:03:22.347358 15949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fddd7d735c9e4195aee24df42bc25619. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.347239 15943 raft_consensus.cc:359] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.348129 15943 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:22.349007 15943 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.352393 15943 ts_tablet_manager.cc:1434] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:03:22.355403 15207 tablet_copy_service.cc:342] P 5e6eed5c7a6b4571b5f898002fc990d2: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-0e8a0429d4024b20b2a1dbe68f14d55e received from {username='slave'} at 127.0.0.1:40392
I20260709 13:03:22.355871 15207 tablet_copy_service.cc:434] P 5e6eed5c7a6b4571b5f898002fc990d2: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-0e8a0429d4024b20b2a1dbe68f14d55e on tablet 0e8a0429d4024b20b2a1dbe68f14d55e with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:22.370862 15949 tablet_copy_client.cc:806] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:22.371587 15949 tablet_copy_client.cc:670] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:22.376749 15949 tablet_copy_client.cc:538] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:22.393576 15949 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:22.422458 15949 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.423568 15949 tablet_bootstrap.cc:492] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:22.424306 15949 ts_tablet_manager.cc:1403] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.011s
I20260709 13:03:22.427461 15949 raft_consensus.cc:359] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.428272 15949 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:22.428900 15949 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.434870 15949 ts_tablet_manager.cc:1434] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:03:22.436305 15943 ts_tablet_manager.cc:933] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:22.436679 15282 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-fddd7d735c9e4195aee24df42bc25619 received from {username='slave'} at 127.0.0.1:44984
I20260709 13:03:22.437116 15282 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-fddd7d735c9e4195aee24df42bc25619 on tablet fddd7d735c9e4195aee24df42bc25619 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:22.455945 15943 tablet_copy_client.cc:323] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.3:46145
I20260709 13:03:22.470189 15356 tablet_copy_service.cc:140] P 9d785ccef0634edd9f0fbb52fa1c8d27: Received BeginTabletCopySession request for tablet c39b63dad5d94468b5872c05e2d72e0d from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:48112)
I20260709 13:03:22.470772 15356 tablet_copy_service.cc:161] P 9d785ccef0634edd9f0fbb52fa1c8d27: Beginning new tablet copy session on tablet c39b63dad5d94468b5872c05e2d72e0d from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:48112: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-c39b63dad5d94468b5872c05e2d72e0d
I20260709 13:03:22.479753 15356 tablet_copy_source_session.cc:215] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:22.490314 15943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c39b63dad5d94468b5872c05e2d72e0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:22.507634 15943 tablet_copy_client.cc:806] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:22.508249 15943 tablet_copy_client.cc:670] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:22.525557 15943 tablet_copy_client.cc:538] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:22.537895 15943 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:22.560954 15943 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:22.561905 15943 tablet_bootstrap.cc:492] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:22.562572 15943 ts_tablet_manager.cc:1403] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:03:22.565555 15943 raft_consensus.cc:359] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.566388 15943 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:22.566999 15943 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:22.572573 15943 ts_tablet_manager.cc:1434] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.003s
I20260709 13:03:22.578092 15356 tablet_copy_service.cc:342] P 9d785ccef0634edd9f0fbb52fa1c8d27: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-c39b63dad5d94468b5872c05e2d72e0d received from {username='slave'} at 127.0.0.1:48112
I20260709 13:03:22.578567 15356 tablet_copy_service.cc:434] P 9d785ccef0634edd9f0fbb52fa1c8d27: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-c39b63dad5d94468b5872c05e2d72e0d on tablet c39b63dad5d94468b5872c05e2d72e0d with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:22.607015 15876 raft_consensus.cc:1217] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:22.771697 15876 raft_consensus.cc:1217] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:22.835075 15876 raft_consensus.cc:1217] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:23.004333 15876 raft_consensus.cc:1217] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:23.026648 15501 raft_consensus.cc:1064] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:23.029757 15501 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:23.035418 15344 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.036649 15912 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.051795 15876 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.055006 15703 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.066052 15191 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.067575 15912 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.087625 15962 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.093436 15876 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.113220 15344 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.123998 15094 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.150523 15194 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.210167 15956 raft_consensus.cc:1064] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:23.231801 15956 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:23.237725 15272 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:23.256158 15876 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.267167 15703 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.274780 15344 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.288220 15958 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.300302 15962 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.326440 15876 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.369463 15339 raft_consensus.cc:2955] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.385102 15939 raft_consensus.cc:1064] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:23.387701 15939 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:23.417003 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 49978.2us
I20260709 13:03:23.418081 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0faaa04570d144c9bd5a7d514ee23dc4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:23.421301 15095 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.443429 15179 tablet_service.cc:1558] Processing DeleteTablet for tablet 0faaa04570d144c9bd5a7d514ee23dc4 with delete_type TABLET_DATA_TOMBSTONED (TS 5e6eed5c7a6b4571b5f898002fc990d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46344
I20260709 13:03:23.449626 15875 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.459494 15970 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.463505 15977 raft_consensus.cc:1064] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:23.464463 15268 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.466181 15970 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:23.468602 15339 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.481230 15928 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:23.465968 15977 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:23.499001 15874 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.500463 15266 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.501480 15191 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.501391 15971 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:23.502768 15942 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.513494 15978 tablet_replica.cc:333] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:03:23.514611 15978 raft_consensus.cc:2243] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:23.518853 15978 raft_consensus.cc:2272] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:23.527845 15939 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.529708 15978 ts_tablet_manager.cc:1916] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:23.536262 15344 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.536818 15875 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.539155 15912 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.541870 15191 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:23.542021 15912 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.543488 15977 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:23.550851 15942 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.571758 15267 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.584021 15978 ts_tablet_manager.cc:1929] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:23.587781 15978 log.cc:1199] T 0faaa04570d144c9bd5a7d514ee23dc4 P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/wals/0faaa04570d144c9bd5a7d514ee23dc4
I20260709 13:03:23.589501 15082 catalog_manager.cc:5028] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): tablet 0faaa04570d144c9bd5a7d514ee23dc4 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:23.590325 15875 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.584611 15912 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.596195 15094 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:23.583079 15194 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.607767 15973 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.592530 15344 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.609683 15192 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.624873 15339 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.637943 15094 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.660271 15093 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.668890 15875 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:03:23.670477 15985 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:23.683748 15876 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.692716 15272 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.699255 15267 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:23.706432 15874 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.708410 15912 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.716989 15192 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.722506 15501 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:23.732997 15192 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:23.735610 15962 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.741422 15194 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.759496 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fddd7d735c9e4195aee24df42bc25619 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:23.758272 15874 raft_consensus.cc:2955] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.762728 15339 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:23.769866 15873 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.788014 15339 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.793167 15937 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:03:23.793924 15973 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.793551 15268 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.803141 15873 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:23.805938 15973 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:23.812520 15095 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.814270 15937 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:03:23.826581 15939 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.826903 15956 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.844058 15333 tablet_service.cc:1558] Processing DeleteTablet for tablet fddd7d735c9e4195aee24df42bc25619 with delete_type TABLET_DATA_TOMBSTONED (TS 9d785ccef0634edd9f0fbb52fa1c8d27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34528
I20260709 13:03:23.851229 15873 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.856405 15874 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.860544 15082 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e8a0429d4024b20b2a1dbe68f14d55e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:23.909973 15990 tablet_replica.cc:333] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:03:23.917989 15091 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.919123 15990 raft_consensus.cc:2243] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:23.935101 15339 raft_consensus.cc:2955] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.937366 15990 raft_consensus.cc:2272] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:23.940593 15081 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c39b63dad5d94468b5872c05e2d72e0d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:23.944818 15990 ts_tablet_manager.cc:1916] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:03:23.946084 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86716.1us
I20260709 13:03:23.951236 15094 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.956121 15272 raft_consensus.cc:2955] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:23.978006 15179 tablet_service.cc:1558] Processing DeleteTablet for tablet c39b63dad5d94468b5872c05e2d72e0d with delete_type TABLET_DATA_TOMBSTONED (TS 5e6eed5c7a6b4571b5f898002fc990d2 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46344
I20260709 13:03:23.979351 15978 tablet_replica.cc:333] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:03:23.980315 15978 raft_consensus.cc:2243] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:23.981052 15978 raft_consensus.cc:2272] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:23.983889 15255 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e8a0429d4024b20b2a1dbe68f14d55e with delete_type TABLET_DATA_TOMBSTONED (TS f4ca86ee1d194023b1414bbe226f4798 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45850
I20260709 13:03:23.993945 15978 ts_tablet_manager.cc:1916] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:24.018200 15990 ts_tablet_manager.cc:1929] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:24.018538 15991 tablet_replica.cc:333] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:03:24.018934 15990 log.cc:1199] T fddd7d735c9e4195aee24df42bc25619 P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/wals/fddd7d735c9e4195aee24df42bc25619
I20260709 13:03:24.019989 15991 raft_consensus.cc:2243] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:24.020805 15991 raft_consensus.cc:2272] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:24.020829 15081 catalog_manager.cc:5028] TS 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): tablet fddd7d735c9e4195aee24df42bc25619 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:24.025840 15991 ts_tablet_manager.cc:1916] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:24.037679 15978 ts_tablet_manager.cc:1929] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:24.038159 15978 log.cc:1199] T c39b63dad5d94468b5872c05e2d72e0d P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/wals/c39b63dad5d94468b5872c05e2d72e0d
I20260709 13:03:24.039774 15082 catalog_manager.cc:5028] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): tablet c39b63dad5d94468b5872c05e2d72e0d (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:24.047459 15991 ts_tablet_manager.cc:1929] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:24.047858 15991 log.cc:1199] T 0e8a0429d4024b20b2a1dbe68f14d55e P f4ca86ee1d194023b1414bbe226f4798: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/wals/0e8a0429d4024b20b2a1dbe68f14d55e
I20260709 13:03:24.049446 15079 catalog_manager.cc:5028] TS f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): tablet 0e8a0429d4024b20b2a1dbe68f14d55e (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:25.115684 15196 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:03:25.123677 15162 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca0c163c2e66421488cfcf267f5215be. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.124042 15339 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.126585 15271 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.126885 15973 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:25.128458 15956 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:25.136574 15956 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.139756 15339 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.159102 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.161470 15339 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:25.164194 15271 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.180717 15267 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.182287 15967 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:25.183238 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.185092 15999 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:25.186676 15311 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9c0b675005cd4e229d4415a2bcdf807c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.216872 15967 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.255770 15267 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.260092 15344 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:25.272724 15196 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.281121 15271 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.283540 16005 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:25.288254 15194 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.297533 15999 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:25.311573 15093 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:25.324849 15311 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 45855d6a21ab45bf98e978ef6a3fd439. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.334513 16005 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.338234 15191 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.343770 15267 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.352622 15271 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:25.368083 15093 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.375864 15344 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.378194 15976 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:25.379230 15237 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ddce72028fce49eb8627f523baef9ad0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:25.380239 15196 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:25.391662 15977 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:25.396080 15962 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.404884 15339 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.463445 15093 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
W20260709 13:03:25.485139 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 83778.7us
I20260709 13:03:25.502482 15191 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:25.749150 16020 ts_tablet_manager.cc:933] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:25.751904 16020 tablet_copy_client.cc:323] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.1:39515
I20260709 13:03:25.754026 15207 tablet_copy_service.cc:140] P 5e6eed5c7a6b4571b5f898002fc990d2: Received BeginTabletCopySession request for tablet ca0c163c2e66421488cfcf267f5215be from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:40392)
I20260709 13:03:25.754581 15207 tablet_copy_service.cc:161] P 5e6eed5c7a6b4571b5f898002fc990d2: Beginning new tablet copy session on tablet ca0c163c2e66421488cfcf267f5215be from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:40392: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-ca0c163c2e66421488cfcf267f5215be
I20260709 13:03:25.762729 15207 tablet_copy_source_session.cc:215] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:25.771430 16020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca0c163c2e66421488cfcf267f5215be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.780604 16022 ts_tablet_manager.cc:933] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:25.798696 16022 tablet_copy_client.cc:323] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.3:46145
I20260709 13:03:25.801990 15356 tablet_copy_service.cc:140] P 9d785ccef0634edd9f0fbb52fa1c8d27: Received BeginTabletCopySession request for tablet 9c0b675005cd4e229d4415a2bcdf807c from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:48112)
I20260709 13:03:25.802563 15356 tablet_copy_service.cc:161] P 9d785ccef0634edd9f0fbb52fa1c8d27: Beginning new tablet copy session on tablet 9c0b675005cd4e229d4415a2bcdf807c from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:48112: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-9c0b675005cd4e229d4415a2bcdf807c
I20260709 13:03:25.815696 15356 tablet_copy_source_session.cc:215] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:25.818475 16024 ts_tablet_manager.cc:933] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:25.819242 16022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c0b675005cd4e229d4415a2bcdf807c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.826398 16020 tablet_copy_client.cc:806] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:25.827075 16020 tablet_copy_client.cc:670] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:25.832378 16020 tablet_copy_client.cc:538] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:25.844729 16020 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:25.846699 16024 tablet_copy_client.cc:323] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.3:46145
I20260709 13:03:25.849195 16026 ts_tablet_manager.cc:933] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:25.849524 15356 tablet_copy_service.cc:140] P 9d785ccef0634edd9f0fbb52fa1c8d27: Received BeginTabletCopySession request for tablet 45855d6a21ab45bf98e978ef6a3fd439 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:48112)
I20260709 13:03:25.850157 15356 tablet_copy_service.cc:161] P 9d785ccef0634edd9f0fbb52fa1c8d27: Beginning new tablet copy session on tablet 45855d6a21ab45bf98e978ef6a3fd439 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:48112: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-45855d6a21ab45bf98e978ef6a3fd439
I20260709 13:03:25.858279 15356 tablet_copy_source_session.cc:215] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:25.862234 16024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45855d6a21ab45bf98e978ef6a3fd439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.930260 16020 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:25.931416 16020 tablet_bootstrap.cc:492] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:25.932114 16020 ts_tablet_manager.cc:1403] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.088s	user 0.033s	sys 0.034s
I20260709 13:03:25.936101 16020 raft_consensus.cc:359] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:25.937009 16020 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:25.937953 16020 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:25.932097 16022 tablet_copy_client.cc:806] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:25.944842 16022 tablet_copy_client.cc:670] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:25.951454 16026 tablet_copy_client.cc:323] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:03:25.954216 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet ddce72028fce49eb8627f523baef9ad0 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:03:25.954782 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet ddce72028fce49eb8627f523baef9ad0 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-ddce72028fce49eb8627f523baef9ad0
I20260709 13:03:25.963732 16024 tablet_copy_client.cc:806] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:25.965253 16024 tablet_copy_client.cc:670] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:25.965641 15282 tablet_copy_source_session.cc:215] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:25.967350 16022 tablet_copy_client.cc:538] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:25.972360 16026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddce72028fce49eb8627f523baef9ad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:25.983165 16024 tablet_copy_client.cc:538] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:26.000780 16020 ts_tablet_manager.cc:1434] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.068s	user 0.021s	sys 0.013s
I20260709 13:03:25.998251 16024 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:26.003391 16022 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:26.013864 15207 tablet_copy_service.cc:342] P 5e6eed5c7a6b4571b5f898002fc990d2: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-ca0c163c2e66421488cfcf267f5215be received from {username='slave'} at 127.0.0.1:40392
I20260709 13:03:26.014499 15207 tablet_copy_service.cc:434] P 5e6eed5c7a6b4571b5f898002fc990d2: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-ca0c163c2e66421488cfcf267f5215be on tablet ca0c163c2e66421488cfcf267f5215be with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:26.021224 16026 tablet_copy_client.cc:806] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:26.022207 16026 tablet_copy_client.cc:670] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:26.029321 16024 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:26.031801 16024 tablet_bootstrap.cc:492] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:26.032476 16024 ts_tablet_manager.cc:1403] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.006s
I20260709 13:03:26.044237 16026 tablet_copy_client.cc:538] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:26.036319 16024 raft_consensus.cc:359] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:26.047912 16024 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:26.048605 16024 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:26.057914 16024 ts_tablet_manager.cc:1434] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:03:26.059576 15356 tablet_copy_service.cc:342] P 9d785ccef0634edd9f0fbb52fa1c8d27: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-45855d6a21ab45bf98e978ef6a3fd439 received from {username='slave'} at 127.0.0.1:48112
I20260709 13:03:26.059995 15356 tablet_copy_service.cc:434] P 9d785ccef0634edd9f0fbb52fa1c8d27: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-45855d6a21ab45bf98e978ef6a3fd439 on tablet 45855d6a21ab45bf98e978ef6a3fd439 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:26.081724 16022 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:26.082855 16022 tablet_bootstrap.cc:492] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:26.083603 16022 ts_tablet_manager.cc:1403] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.084s	user 0.022s	sys 0.006s
I20260709 13:03:26.086730 16026 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:26.086338 16022 raft_consensus.cc:359] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:26.087364 16022 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:26.088074 16022 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:26.090749 16022 ts_tablet_manager.cc:1434] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:03:26.092764 15356 tablet_copy_service.cc:342] P 9d785ccef0634edd9f0fbb52fa1c8d27: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-9c0b675005cd4e229d4415a2bcdf807c received from {username='slave'} at 127.0.0.1:48112
I20260709 13:03:26.093210 15356 tablet_copy_service.cc:434] P 9d785ccef0634edd9f0fbb52fa1c8d27: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-9c0b675005cd4e229d4415a2bcdf807c on tablet 9c0b675005cd4e229d4415a2bcdf807c with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:26.111435 16026 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:26.112315 16026 tablet_bootstrap.cc:492] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:26.112974 16026 ts_tablet_manager.cc:1403] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.026s	user 0.023s	sys 0.003s
I20260709 13:03:26.115865 16026 raft_consensus.cc:359] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:26.116653 16026 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:26.117251 16026 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:26.124467 16026 ts_tablet_manager.cc:1434] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:03:26.126113 15282 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-ddce72028fce49eb8627f523baef9ad0 received from {username='slave'} at 127.0.0.1:44984
I20260709 13:03:26.126543 15282 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-ddce72028fce49eb8627f523baef9ad0 on tablet ddce72028fce49eb8627f523baef9ad0 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:26.261831 15874 raft_consensus.cc:1217] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:26.286238 15874 raft_consensus.cc:1217] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:26.327368 15874 raft_consensus.cc:1217] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:26.382437 15874 raft_consensus.cc:1217] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:26.655692 15956 raft_consensus.cc:1064] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:26.658282 15956 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:26.667583 15343 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.666885 15874 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.668622 15271 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.669073 15928 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.670717 15956 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.673647 16029 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.697492 15956 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.707188 15874 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.712970 16005 raft_consensus.cc:1064] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:26.715869 16005 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:26.724732 15271 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.729447 15343 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.739424 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.748106 15267 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.749735 15191 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.751976 15874 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.752195 16010 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.753568 15999 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.756178 15999 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.763453 15999 raft_consensus.cc:1064] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:26.808518 15999 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:26.810380 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44686.2us
I20260709 13:03:26.822602 16005 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.831328 15196 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.872020 16032 raft_consensus.cc:1064] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:26.874979 16032 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:26.891681 15874 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.891880 15191 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.893509 16052 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.894709 16042 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.895516 15874 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.897346 15962 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:26.928347 15343 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.931366 15271 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.943831 15272 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.944702 15977 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:26.956068 16052 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:26.962167 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43558.8us
I20260709 13:03:26.964669 15191 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:26.972460 15962 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:26.979799 16052 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.982543 15875 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.986196 15977 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.991153 15343 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.991153 15271 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:26.997885 15873 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.006991 15196 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.014745 15874 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.092978 15191 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:27.101641 15092 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.143510 15872 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:27.150977 15956 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:27.155661 15093 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.158669 15956 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.167505 15875 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.170135 15082 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca0c163c2e66421488cfcf267f5215be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:27.184396 15094 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.188037 15192 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.192914 15267 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:03:27.198385 15082 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet ca0c163c2e66421488cfcf267f5215be with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:03:27.199234 15956 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:27.216516 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.213667 15267 raft_consensus.cc:2955] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.241026 15333 tablet_service.cc:1558] Processing DeleteTablet for tablet ca0c163c2e66421488cfcf267f5215be with delete_type TABLET_DATA_TOMBSTONED (TS 9d785ccef0634edd9f0fbb52fa1c8d27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34528
I20260709 13:03:27.245031 15343 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:27.246099 15338 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:27.257391 15191 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:27.260850 15875 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:27.261401 16042 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:27.267141 16050 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:27.273118 15873 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:27.276386 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:27.258445 15267 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:27.284770 15875 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:27.285593 16010 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:27.287531 16010 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:27.290683 16050 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.292337 15977 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:27.284312 15191 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:27.306039 15962 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.302784 16005 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.314625 16061 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:27.314009 15875 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.317703 15873 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.330267 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ddce72028fce49eb8627f523baef9ad0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:27.330452 15081 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 45855d6a21ab45bf98e978ef6a3fd439 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:27.330188 15196 raft_consensus.cc:2955] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.327373 15195 raft_consensus.cc:2955] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.355232 15093 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.359400 15094 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.360324 15874 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.362686 15092 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index 3 to 4, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:27.369510 15081 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9c0b675005cd4e229d4415a2bcdf807c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:27.371095 16062 tablet_replica.cc:333] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:03:27.372332 16062 raft_consensus.cc:2243] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.372964 16062 raft_consensus.cc:2272] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.374332 15255 tablet_service.cc:1558] Processing DeleteTablet for tablet 9c0b675005cd4e229d4415a2bcdf807c with delete_type TABLET_DATA_TOMBSTONED (TS f4ca86ee1d194023b1414bbe226f4798 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45850
I20260709 13:03:27.376870 15191 raft_consensus.cc:2955] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:27.379630 16062 ts_tablet_manager.cc:1916] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:27.397943 15333 tablet_service.cc:1558] Processing DeleteTablet for tablet ddce72028fce49eb8627f523baef9ad0 with delete_type TABLET_DATA_TOMBSTONED (TS 9d785ccef0634edd9f0fbb52fa1c8d27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34528
I20260709 13:03:27.400460 15262 tablet_service.cc:1558] Processing DeleteTablet for tablet 45855d6a21ab45bf98e978ef6a3fd439 with delete_type TABLET_DATA_TOMBSTONED (TS f4ca86ee1d194023b1414bbe226f4798 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45850
I20260709 13:03:27.402338 16062 ts_tablet_manager.cc:1929] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:27.403012 16062 log.cc:1199] T ca0c163c2e66421488cfcf267f5215be P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/wals/ca0c163c2e66421488cfcf267f5215be
I20260709 13:03:27.405143 16062 tablet_replica.cc:333] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:03:27.406064 16063 tablet_replica.cc:333] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:03:27.406241 16062 raft_consensus.cc:2243] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.406440 15081 catalog_manager.cc:5028] TS 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): tablet ca0c163c2e66421488cfcf267f5215be (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:27.407083 16062 raft_consensus.cc:2272] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.410713 16062 ts_tablet_manager.cc:1916] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:27.418761 16063 raft_consensus.cc:2243] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.419663 16063 raft_consensus.cc:2272] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.427523 16063 ts_tablet_manager.cc:1916] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:27.428040 16062 ts_tablet_manager.cc:1929] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:27.428548 16062 log.cc:1199] T ddce72028fce49eb8627f523baef9ad0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/wals/ddce72028fce49eb8627f523baef9ad0
I20260709 13:03:27.430240 15081 catalog_manager.cc:5028] TS 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): tablet ddce72028fce49eb8627f523baef9ad0 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:27.445297 16063 ts_tablet_manager.cc:1929] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:27.445806 16063 log.cc:1199] T 9c0b675005cd4e229d4415a2bcdf807c P f4ca86ee1d194023b1414bbe226f4798: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/wals/9c0b675005cd4e229d4415a2bcdf807c
I20260709 13:03:27.447606 16063 tablet_replica.cc:333] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:03:27.447952 15079 catalog_manager.cc:5028] TS f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): tablet 9c0b675005cd4e229d4415a2bcdf807c (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:27.448679 16063 raft_consensus.cc:2243] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:27.449334 16063 raft_consensus.cc:2272] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:27.452564 16063 ts_tablet_manager.cc:1916] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:27.463752 16063 ts_tablet_manager.cc:1929] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:27.464118 16063 log.cc:1199] T 45855d6a21ab45bf98e978ef6a3fd439 P f4ca86ee1d194023b1414bbe226f4798: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/wals/45855d6a21ab45bf98e978ef6a3fd439
I20260709 13:03:27.465766 15079 catalog_manager.cc:5028] TS f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): tablet 45855d6a21ab45bf98e978ef6a3fd439 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:03:28.495746 15271 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:28.502162 15343 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:28.503067 15237 consensus_peers.cc:597] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a8ef022b8854b68ac36c434a5c64a1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.503671 15191 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:28.504431 16055 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:28.505620 16061 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.513661 16055 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.517409 15191 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.519981 15343 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.529290 15338 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:28.535876 15091 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.545177 15271 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:28.546242 15191 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:28.546360 15311 consensus_peers.cc:597] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1011f7cfdb64b11bff42c90ec444dbe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.547835 16050 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.548795 15999 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.561539 15999 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.563810 15195 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.565068 15271 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.587082 15191 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:28.594009 15271 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:28.595542 15956 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.596247 15338 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:28.595619 15093 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:28.598501 15162 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81d86ef88f7f41238f3a595588effaca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.599263 15956 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:28.607546 15928 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.610072 15271 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.643209 15091 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.648357 15271 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:28.649101 15338 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.739506 15343 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:28.742219 15962 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:28.748821 15237 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35e75f905ad042d89b465e6461b29a5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:28.776451 16061 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.781533 15192 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:28.779779 15338 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.788012 16083 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:28.796854 15192 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:28.803884 15093 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 2, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 1 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.882337 16088 ts_tablet_manager.cc:933] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:28.885696 16088 tablet_copy_client.cc:323] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:03:28.887900 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 1a8ef022b8854b68ac36c434a5c64a1f from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:03:28.888482 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 1a8ef022b8854b68ac36c434a5c64a1f from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-1a8ef022b8854b68ac36c434a5c64a1f
I20260709 13:03:28.895182 15282 tablet_copy_source_session.cc:215] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:28.898885 16088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a8ef022b8854b68ac36c434a5c64a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:28.923434 16088 tablet_copy_client.cc:806] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:28.924084 16088 tablet_copy_client.cc:670] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:28.927639 16088 tablet_copy_client.cc:538] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:28.937664 16088 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:28.960813 16088 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:28.961825 16088 tablet_bootstrap.cc:492] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:28.962575 16088 ts_tablet_manager.cc:1403] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.025s	user 0.025s	sys 0.001s
I20260709 13:03:28.965698 16088 raft_consensus.cc:359] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:28.966609 16088 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:28.967334 16088 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:28.970628 16088 ts_tablet_manager.cc:1434] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:03:28.972312 15282 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-1a8ef022b8854b68ac36c434a5c64a1f received from {username='slave'} at 127.0.0.1:44984
I20260709 13:03:28.972772 15282 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-1a8ef022b8854b68ac36c434a5c64a1f on tablet 1a8ef022b8854b68ac36c434a5c64a1f with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:29.049422 16088 ts_tablet_manager.cc:933] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:29.051367 16088 tablet_copy_client.cc:323] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.3:46145
I20260709 13:03:29.053097 15356 tablet_copy_service.cc:140] P 9d785ccef0634edd9f0fbb52fa1c8d27: Received BeginTabletCopySession request for tablet c1011f7cfdb64b11bff42c90ec444dbe from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:48112)
I20260709 13:03:29.053648 15356 tablet_copy_service.cc:161] P 9d785ccef0634edd9f0fbb52fa1c8d27: Beginning new tablet copy session on tablet c1011f7cfdb64b11bff42c90ec444dbe from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:48112: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-c1011f7cfdb64b11bff42c90ec444dbe
I20260709 13:03:29.059906 15356 tablet_copy_source_session.cc:215] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:29.062826 16088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1011f7cfdb64b11bff42c90ec444dbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:29.080196 16088 tablet_copy_client.cc:806] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:29.080842 16088 tablet_copy_client.cc:670] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:29.084383 16088 tablet_copy_client.cc:538] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:29.093286 16088 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:29.114300 16088 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:29.115407 16088 tablet_bootstrap.cc:492] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:29.116340 16088 ts_tablet_manager.cc:1403] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.003s
I20260709 13:03:29.120121 16088 raft_consensus.cc:359] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:29.121237 16088 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:29.122058 16088 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:29.127377 16094 ts_tablet_manager.cc:933] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:29.128405 16088 ts_tablet_manager.cc:1434] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 13:03:29.130861 16094 tablet_copy_client.cc:323] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.1:39515
I20260709 13:03:29.131882 15356 tablet_copy_service.cc:342] P 9d785ccef0634edd9f0fbb52fa1c8d27: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-c1011f7cfdb64b11bff42c90ec444dbe received from {username='slave'} at 127.0.0.1:48112
I20260709 13:03:29.132316 15356 tablet_copy_service.cc:434] P 9d785ccef0634edd9f0fbb52fa1c8d27: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-c1011f7cfdb64b11bff42c90ec444dbe on tablet c1011f7cfdb64b11bff42c90ec444dbe with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:29.134078 15207 tablet_copy_service.cc:140] P 5e6eed5c7a6b4571b5f898002fc990d2: Received BeginTabletCopySession request for tablet 81d86ef88f7f41238f3a595588effaca from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:40392)
I20260709 13:03:29.134568 15207 tablet_copy_service.cc:161] P 5e6eed5c7a6b4571b5f898002fc990d2: Beginning new tablet copy session on tablet 81d86ef88f7f41238f3a595588effaca from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:40392: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-81d86ef88f7f41238f3a595588effaca
I20260709 13:03:29.141345 15207 tablet_copy_source_session.cc:215] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:29.144207 16094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81d86ef88f7f41238f3a595588effaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:29.169943 16094 tablet_copy_client.cc:806] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:29.170528 16094 tablet_copy_client.cc:670] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:29.187085 16094 tablet_copy_client.cc:538] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:29.208103 16094 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:29.233383 16088 ts_tablet_manager.cc:933] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:29.237010 16088 tablet_copy_client.cc:323] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:03:29.239221 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 35e75f905ad042d89b465e6461b29a5d from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:03:29.239786 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 35e75f905ad042d89b465e6461b29a5d from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-35e75f905ad042d89b465e6461b29a5d
I20260709 13:03:29.268052 15282 tablet_copy_source_session.cc:215] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:29.272519 16088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35e75f905ad042d89b465e6461b29a5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:03:29.345363 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45448.7us
W20260709 13:03:29.977872 16088 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.691s	user 0.006s	sys 0.002s
I20260709 13:03:30.280856 16088 tablet_copy_client.cc:806] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:30.281760 16088 tablet_copy_client.cc:670] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
W20260709 13:03:30.487229 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.011s	sys 0.004s
W20260709 13:03:30.506381 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.011s	sys 0.004s
W20260709 13:03:30.482014 15235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.012s	sys 0.010s
W20260709 13:03:30.519393 15235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.014s	sys 0.011s
I20260709 13:03:30.591563 16102 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.592144 16102 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.594588 16102 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.597054 16075 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.599125 16103 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.544193 16105 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.608853 16105 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.590826 16085 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.611456 16085 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.613698 16085 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.602972 16111 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.615334 16111 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.617753 16111 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.619414 16111 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.621548 16103 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.622116 16106 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.622686 16106 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.623968 16103 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.614374 16075 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.624768 16106 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.625234 16106 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.629362 16105 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.626036 16075 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.605494 16102 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.630861 16102 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:03:30.607000 15160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.882s	user 0.000s	sys 0.030s
W20260709 13:03:30.635427 15160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.000s	sys 0.030s
I20260709 13:03:30.625695 16106 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.642251 16055 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.648170 16055 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:30.650434 16055 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.650766 16108 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.640656 16111 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.651707 16108 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.652375 16106 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.663372 16118 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.663959 16118 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.667309 16055 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.668429 16104 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.668737 16055 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:30.668958 16104 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.669634 16105 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.671742 16105 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.672188 16104 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.666810 16106 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.673048 16106 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.676048 16055 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.677359 16111 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.681035 16110 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.681532 16110 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.674432 16075 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.673708 16105 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.694744 16075 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:30.694979 16116 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.698675 16103 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.681515 16102 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.680572 16104 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.688488 16108 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.707880 16103 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.695777 16116 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.713449 16114 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.715116 16085 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.716794 16085 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.717518 16075 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:30.718766 16085 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.719691 16114 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.729583 16113 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.730189 16113 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.732492 16113 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.727577 16102 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.734701 16102 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.726871 16085 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.746263 16105 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.746079 16085 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.746845 16105 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:30.748512 16094 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 1.525s	user 0.024s	sys 0.041s
W20260709 13:03:30.748893 16094 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 1.525s	user 0.024s	sys 0.041s
I20260709 13:03:30.749087 16105 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.748472 16085 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.712741 16104 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.745263 16115 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.767944 16114 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.750276 16118 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.763461 16113 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.763554 16075 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.769223 16085 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.777806 16128 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.781407 16122 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.771014 16061 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.776221 16117 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.784251 16061 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.784763 16117 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:30.781988 16122 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.776549 16106 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.906747 16125 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.907413 16125 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:30.775540 16105 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.805243 16103 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.913827 16126 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.914407 16126 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:30.917203 16126 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:30.917672 16126 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.918115 16126 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:30.922456 16126 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.922953 16126 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.923477 16126 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:30.925415 16126 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.817152 16055 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.880344 16114 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.784255 16110 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.823426 16102 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.822372 16061 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.881403 16118 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.822199 16124 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.938998 16118 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.845614 16082 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.886922 16123 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.776401 16115 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.817095 16120 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.939173 16124 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.905130 16104 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.886822 16112 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.785518 16113 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.912106 16103 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.805367 16128 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.785351 16075 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.937799 16110 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.934006 16105 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.942206 16082 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.940595 16102 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:30.786285 16085 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:30.822521 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:30.949361 16104 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.946789 16120 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.950368 16110 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.953033 16104 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.946218 16123 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:30.957772 16061 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.958112 16120 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:30.958552 16104 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.958539 16061 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.959283 15873 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:30.957939 16110 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.959581 16075 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.937040 16055 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.961452 16061 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.963025 16055 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.940209 16114 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.965952 16114 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.936735 16127 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:30.969317 16128 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:30.978686 16105 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.976570 16102 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.975283 16127 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.973628 16114 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:30.982404 16114 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:30.989741 16116 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.994768 16094 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:30.995891 16094 tablet_bootstrap.cc:492] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:30.996692 16094 ts_tablet_manager.cc:1403] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 1.789s	user 0.040s	sys 0.052s
I20260709 13:03:30.998947 16118 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.001794 16117 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.004900 16061 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.005620 16061 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:30.975811 16115 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:30.949273 16103 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:30.976329 16112 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.035219 16123 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.036180 16121 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.039354 16061 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.042412 16102 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.052558 16125 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.056937 16094 raft_consensus.cc:359] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:31.040777 16085 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.026405 16127 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.027782 16113 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.025444 16115 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.072762 16115 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.075270 16116 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.076336 16116 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.078732 16116 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:31.079708 16116 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.080408 16116 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.083333 16116 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.091491 16085 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.062494 16094 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:31.043166 16121 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.113237 16118 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.085765 16115 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.117188 16121 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.092653 16102 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.094126 16113 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.091763 16116 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.137773 16138 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.139298 16130 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.182235 16116 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.198432 16112 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.140821 16113 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.203671 16122 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.140022 16130 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.224217 16130 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.230543 16133 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.126513 16118 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.138644 16138 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.155566 16102 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.231413 16133 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.264469 16122 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.265292 16122 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.365721 16103 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:31.374326 16142 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.393508 16144 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.424578 16142 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.350136 16139 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.425815 16139 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.368929 16122 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:31.315114 15237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.017s
I20260709 13:03:31.424979 16144 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.419541 16146 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.427230 16142 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.427676 16146 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:03:31.427290 15237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.011s	sys 0.022s
I20260709 13:03:31.431843 16146 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.432562 16137 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.433167 16137 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.434146 16122 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.434623 16139 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.434687 16122 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.435437 16137 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.435921 16137 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.436326 16137 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.436865 16122 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:31.368014 16113 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:31.438127 16137 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.429929 16144 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.439447 16115 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.445593 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.446195 15192 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:31.446401 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.447222 15196 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:31.448144 16137 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.450376 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.450495 16137 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.450999 15191 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:31.439742 16122 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.455629 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.456405 15196 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:31.439962 16115 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.461300 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.376516 16127 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.258777 16138 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.267810 16133 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:31.443568 16102 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.381887 16134 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.368100 16132 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.382207 16131 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.395532 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:31.460644 16137 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.364182 16129 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.470578 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:31.470764 16110 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.460561 16146 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.471204 16147 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.471714 16127 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.465653 16142 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.472488 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.484673 15268 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.480400 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.473717 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.415896 16141 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.416706 16143 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.474095 16118 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.485853 16110 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.466449 16122 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.487440 16124 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.483950 16146 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.500197 16135 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.488462 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:31.489289 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.490087 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.501545 15271 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.475119 16138 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.500689 16135 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.502549 16135 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.492362 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.492399 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.480300 16137 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.481825 15873 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.492705 16143 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.490939 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:31.498513 16122 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.499679 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.517107 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.501579 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.502480 15875 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.490171 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.488696 16147 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:31.505741 15266 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.506531 16127 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.507607 16146 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.510878 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.491299 16142 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.517254 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.519186 15191 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.500229 16110 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.503804 16144 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.522387 16137 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.580291 15196 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.582791 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:31.584103 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.585060 15195 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.591050 16147 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:31.502041 16141 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.586346 16110 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.485584 16131 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.594609 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.608078 16146 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.512851 16138 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.603305 16145 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.604511 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.605278 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.606498 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.483505 16132 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.520047 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.608655 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:31.522044 15872 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.638041 16115 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.493235 16129 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.618466 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.618489 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.650337 16124 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.659384 15266 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.659524 16124 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.647310 16127 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.659904 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.660265 16127 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:31.602421 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.661305 15191 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.662091 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.662307 16127 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:31.662724 15269 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.596138 16144 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.637069 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.640703 16110 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.645135 15270 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.657454 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.636391 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.660130 16131 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.660665 15190 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.647608 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.490584 16134 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.667985 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:31.646974 16146 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.684011 15264 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.718107 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.796432 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.803992 16146 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.804240 15344 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.804469 16151 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.718257 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.795158 16144 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.657441 16145 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:31.805744 15346 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.793803 16137 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.802379 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.683732 15188 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.663686 16149 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.810601 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.805207 16151 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.805783 15197 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.684505 15189 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.808388 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.815056 15268 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
W20260709 13:03:31.807610 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 139697us
I20260709 13:03:31.805126 16134 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:31.662814 16127 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.815600 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.818827 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.659931 16124 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.718505 16129 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.684921 16110 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.720345 16143 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.820694 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.823397 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.823529 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.824687 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.707232 16147 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.824931 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.825606 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.792273 16142 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:31.886945 15268 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.706735 16115 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.763782 16141 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.819309 15339 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.719499 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.828008 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.811599 16103 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.888445 15344 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.706501 16150 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.880335 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.810504 16149 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.899147 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.899827 15344 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.900600 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.898248 16139 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.880503 15873 raft_consensus.cc:1217] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:31.905939 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.906494 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.902388 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.898406 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.898128 16152 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.903606 16139 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.904417 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.827702 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.894150 15269 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.902222 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.907666 15339 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.890486 16120 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.898903 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.912212 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.908524 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.092089 16085 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.891768 16134 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:31.895577 16103 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:31.893957 16129 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:31.895496 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:31.919971 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.894822 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.923008 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.921567 15337 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.931360 16129 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.826500 16127 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.890254 16147 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.901887 16132 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:31.136101 16094 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:31.895877 16135 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.925948 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:31.919416 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:31.930929 15344 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:31.915062 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:31.940316 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:31.894879 16150 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.901655 16115 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.933357 16103 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.929468 16152 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.923722 16120 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.933158 16134 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:31.953264 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.980908 16127 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.029577 16124 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:31.988396 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.981581 16085 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.980960 16136 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.034063 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.054648 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.055068 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.102058 15344 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:32.102229 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.059262 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.103101 15338 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:32.101598 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.106206 15346 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:32.092954 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.106752 16129 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.107827 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.108001 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.952714 16139 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.027483 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.108907 16116 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.109189 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.109891 16094 ts_tablet_manager.cc:1434] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 1.113s	user 0.017s	sys 0.024s
I20260709 13:03:31.955560 15873 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
W20260709 13:03:32.110285 16094 ts_tablet_manager.cc:1467] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Tablet startup took 1113ms
I20260709 13:03:32.095518 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.112260 15189 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:31.970924 16142 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.112953 16142 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.103837 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.114360 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.118041 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:31.968284 16149 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.050889 16147 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.096439 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.052033 16135 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:32.049718 16151 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.036463 16145 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:31.979641 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65222.7us
I20260709 13:03:32.054706 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.101732 15270 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:32.104532 16136 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.056048 16082 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.012773 16138 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:31.969261 16110 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.094412 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.119822 16128 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.116981 15337 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:32.129755 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.129853 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.130225 16114 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.124287 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.131058 16142 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.241344 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.157827 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.256119 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.291484 16110 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:32.153098 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.142383 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.294996 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.295516 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.295780 15265 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:32.296085 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.296851 15197 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:32.296900 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.314131 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.315506 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.227869 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.150360 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.136330 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.316874 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.132483 16150 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.136106 16152 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:32.110620 16094 ts_tablet_manager.cc:1469] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Trace:
0709 13:03:29.113503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:29.113649 (+   146us) service_pool.cc:224] Handling call
0709 13:03:29.127735 (+ 14086us) ts_tablet_manager.cc:934] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
0709 13:03:29.142995 (+ 15260us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:29.160831 (+ 17836us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:29.160953 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:29.168743 (+  7790us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:29.169063 (+   320us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:29.169362 (+   299us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:29.169428 (+    66us) inbound_call.cc:177] Queueing success response
0709 13:03:29.207731 (+ 38303us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:30.997090 (+1789359us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:31.054064 (+ 56974us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:31.054864 (+   800us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":300,"raft.queue_time_us":1435,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"tablet-copy.queue_time_us":12854,"tablet-download-pool.queue_time_us":188,"tablet-download-pool.run_cpu_time_us":1094,"tablet-download-pool.run_wall_time_us":15826,"thread_start_us":15557,"threads_started":2}
I20260709 13:03:32.318159 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.318557 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.291821 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.292160 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.320785 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.320883 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.292580 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.161361 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.292160 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.322227 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.322664 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.322674 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.323401 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.323787 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.324087 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.324530 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.324771 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.179823 16124 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:32.325377 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.131139 16134 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.134227 16115 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.150837 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.165678 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.328033 15190 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:32.328547 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.181027 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:32.227797 15160 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.565s (SENT) [suppressed 5 similar messages]
I20260709 13:03:32.160650 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.329290 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.329521 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.330315 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.330554 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.153545 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.297683 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.151899 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.331494 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.331872 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.332114 15189 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:32.332309 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.151216 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.333079 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.333280 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.298678 16128 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.333691 15188 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:32.334225 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.334416 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.297801 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.334729 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.335480 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:32.141433 15897 debug-util.cc:398] Leaking SignalData structure 0x7b08001ede80 after lost signal to thread 14039
W20260709 13:03:32.300362 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 176124us
I20260709 13:03:32.335760 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.300061 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.336620 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.336745 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:32.336752 15897 debug-util.cc:398] Leaking SignalData structure 0x7b08001d6e20 after lost signal to thread 15129
I20260709 13:03:32.337744 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.237987 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:32.147466 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.235339 16103 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.302443 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:32.351660 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 49398.6us
I20260709 13:03:32.352461 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.352807 16103 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:32.353742 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.354332 15268 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:32.355109 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:32.355206 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.293139 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:32.356212 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.356578 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.356750 16139 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.357161 16139 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.357400 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.152257 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.356220 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.309959 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.358377 15192 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:32.151549 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.357455 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.359194 15194 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:32.166637 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.319458 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.321170 15191 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:32.360317 15194 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.361147 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:32.362020 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 134280us
I20260709 13:03:32.362218 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.316964 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:32.313222 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 128144us
I20260709 13:03:32.360317 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.363742 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.364094 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.364988 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:32.141701 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.365326 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.365932 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.366348 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.161706 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.153431 15875 raft_consensus.cc:1217] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:32.327454 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.371909 16082 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:32.371795 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 57496.9us
I20260709 13:03:32.372362 16082 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.372761 16082 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.372908 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.373808 16108 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.374265 16108 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.374749 16108 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.375479 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:32.325695 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.301548 16136 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.237474 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:32.295521 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.300859 16121 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.382108 16121 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.382562 16121 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.331521 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.333598 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.338939 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.333101 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:32.338907 15897 debug-util.cc:398] Leaking SignalData structure 0x7b0800102ee0 after lost signal to thread 15221
I20260709 13:03:32.386030 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:32.386731 15897 debug-util.cc:398] Leaking SignalData structure 0x7b0800326180 after lost signal to thread 15296
W20260709 13:03:32.387874 15897 debug-util.cc:398] Leaking SignalData structure 0x7b08001eaaa0 after lost signal to thread 15370
W20260709 13:03:32.388976 15897 debug-util.cc:398] Leaking SignalData structure 0x7b0800176100 after lost signal to thread 15900
I20260709 13:03:32.346125 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.357555 16139 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.390939 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:32.356591 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63545.2us
I20260709 13:03:32.359253 15189 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.393054 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.365044 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:32.132010 16120 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.335573 16128 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.337744 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:32.391384 16124 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.330621 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.397373 16124 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.393251 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.397796 16124 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.392544 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:32.394052 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.400782 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.392409 16134 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.403891 16134 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.404181 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:32.404863 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.405625 16115 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.406026 16115 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.406227 15238 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.406973 16138 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.407370 16138 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.407737 16138 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.408252 16155 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.406407 16115 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.404307 16134 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.326699 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.410633 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.411098 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.409560 16110 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.419413 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:32.420043 16110 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.420621 16110 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.414199 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.415282 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:32.421995 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.418022 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.422290 16152 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.416935 16128 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.423594 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.424855 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.426096 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.422931 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.423245 16128 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.429533 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.429739 16128 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.430191 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.430258 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.431149 16118 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.431532 16118 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.431871 16118 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.430658 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.435734 16145 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.433458 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:32.437440 16085 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.426967 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.434240 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.434474 16114 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.442628 16114 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.443017 16114 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.434666 16103 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.434973 16135 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.416333 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.438375 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:32.408730 16155 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.439829 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:32.439604 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.440732 15309 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.441376 16158 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.442113 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.437800 16085 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.448616 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.446676 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.452505 16061 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.441421 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:32.445815 16159 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.449131 16135 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.444264 16103 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.450168 16155 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.460300 16121 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.460839 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.450546 16147 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.450342 16145 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.459579 16116 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.473186 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.459631 16085 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.459512 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:32.477015 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.449842 16150 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:03:32.454566 16158 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.478818 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.479770 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.480053 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.481105 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.468502 16135 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.491883 16158 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.469163 16120 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.470359 16103 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.482244 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.495628 16106 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.486824 16160 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.474136 16061 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.492435 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.480983 16055 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.492868 16132 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.474300 16145 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.472982 16159 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.517019 16159 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.490748 16114 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:03:32.486766 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47022.8us
I20260709 13:03:32.511070 16055 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.513394 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.521031 16055 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.521533 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.516438 16145 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.484900 16111 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.520398 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.510830 16061 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.522001 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.523379 16152 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.509148 16106 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.518632 16142 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.525817 16111 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.532289 16161 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.534152 16136 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.507829 16160 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.506852 16108 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:32.540387 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 58208us
I20260709 13:03:32.542295 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.529086 16061 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.543320 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.519454 16157 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.551170 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.535579 16106 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.555284 16166 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.555418 16146 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:32.551855 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 53253us
I20260709 13:03:32.557791 16164 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.552492 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.559119 16167 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.562736 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:32.561283 16082 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.564728 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.539176 16111 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.565798 16150 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.566118 16106 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.540660 16161 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.541734 16160 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.550791 16157 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.566617 16166 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.591837 16082 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.573841 15873 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.572620 16143 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.601974 16143 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:32.602700 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.602854 16143 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.582736 15265 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.603047 16055 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.591638 16139 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.583935 16116 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.582324 16165 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.587530 16161 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.599570 16121 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:32.573586 16123 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:03:32.589653 16157 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.628003 16123 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.604001 16143 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.588383 16167 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.628521 16055 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.632289 16123 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:32.600463 16166 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.607195 16116 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.608489 16129 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.629439 16162 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.650892 16162 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:32.651422 16162 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.654810 16108 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.655675 16123 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.657045 16123 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.641348 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:32.640398 16167 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.609992 16110 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.644539 16116 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.629253 16134 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.706010 16159 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.728237 16134 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:32.694142 16114 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.730508 15193 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.718218 16136 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.642185 16111 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.622305 16160 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:32.779975 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 227529us
I20260709 13:03:32.759958 16136 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.752121 16138 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:32.783344 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.634634 16165 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:32.790246 16165 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.790892 16172 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:32.793684 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 313982us
I20260709 13:03:32.774471 16139 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.800755 16110 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.800858 16108 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.805083 16111 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.806905 15875 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.810921 16124 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.812866 15267 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:32.812943 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 231925us
I20260709 13:03:32.793213 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.816287 15160 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.817549 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.791419 16172 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.822105 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.841131 16160 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.851137 16160 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.851609 16160 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.851999 16160 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.852275 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.842914 16103 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.848954 16138 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.849615 16110 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.867338 16110 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.867538 16170 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.867877 16110 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.868115 16170 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.859869 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.820058 16055 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.834339 16115 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.845072 16172 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.878134 16124 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.886081 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.872648 16159 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.887559 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.873162 16170 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.890009 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:32.889675 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:32.878507 16111 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.888025 16055 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.878716 16108 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:32.899010 16108 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.901072 16108 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.898339 16055 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.890530 16138 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.891309 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:32.917230 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.918493 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:32.924443 16147 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.924983 16147 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.925352 16147 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.904983 16121 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.885064 16135 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:32.929268 16108 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.940860 16108 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.915963 16138 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.929791 16164 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.930752 16115 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.958166 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:32.960202 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.942549 16108 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.950145 16138 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.957263 16164 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:32.992194 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.982291 16103 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:32.973628 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:32.959133 16158 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:32.989204 16164 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.004813 16088 tablet_copy_client.cc:538] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:03:33.014793 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 469366us
W20260709 13:03:33.015723 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 411837us
I20260709 13:03:33.016849 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.000283 16121 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:33.021298 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.993175 16161 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.024240 16176 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.024919 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:32.991806 16110 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:33.040686 16152 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.041193 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:33.044461 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 226994us
I20260709 13:03:33.045233 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.045050 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.046864 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.046864 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.050151 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:33.045878 16118 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.001s
I20260709 13:03:33.052124 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.066493 15873 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.066002 16106 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.084715 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:33.085916 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.092331 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.085036 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.094866 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.106407 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.049662 16151 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.068172 16115 raft_consensus.cc:1064] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:33.060402 16163 raft_consensus.cc:1064] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:03:33.113306 15312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.034s	sys 0.058s
I20260709 13:03:33.048218 16152 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.114554 16088 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:03:33.051165 16123 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.077188 16124 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.086781 16159 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:33.120107 15312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.034s	sys 0.058s
I20260709 13:03:33.053301 16127 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.087790 16181 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:03:33.077091 16135 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.119227 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:33.126816 16128 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.003s
I20260709 13:03:33.113059 16142 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.074350 16164 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.042546 16121 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.063525 16157 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:33.083244 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71328.7us
I20260709 13:03:33.134733 16177 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.076033 16160 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.066903 16162 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.120599 16149 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.128253 16179 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.088762 16118 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.074642 16172 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:33.133656 16085 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.000s
I20260709 13:03:33.129364 16114 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.150478 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:33.151425 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.158509 16114 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:33.160440 16114 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.161410 16172 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.161506 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.162364 16176 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.163615 16176 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.164283 16118 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.164728 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.164855 16085 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.165439 16142 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.166486 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.158653 16177 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:03:33.183436 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 136614us
I20260709 13:03:33.184322 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.185509 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.149396 16111 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.168880 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.178275 16134 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:33.152479 16152 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.191004 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.192415 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.197777 15192 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.167124 16114 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.183367 16179 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:33.198634 16179 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.198336 16108 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:33.185122 16145 consensus_meta.cc:287] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.002s
I20260709 13:03:33.199416 16134 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.203387 16145 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.204485 16157 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.168490 16161 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.204816 16162 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.205178 16134 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.201491 15189 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:33.205885 16166 consensus_meta.cc:287] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.000s
I20260709 13:03:33.205583 16145 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.206269 16166 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.201114 16127 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.201654 16114 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:33.183681 16061 consensus_meta.cc:287] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.616s	user 0.005s	sys 0.006s
I20260709 13:03:33.211654 16166 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.212241 16110 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.212904 15190 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.191514 16149 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.197432 16103 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:33.190428 16143 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.001s
I20260709 13:03:33.217489 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.166857 16085 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.198369 16173 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.146240 16128 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.174230 15193 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.202076 15191 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.201678 15188 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.182732 16174 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.178264 16106 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.168627 16160 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.199690 16158 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.189733 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.222036 16061 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.209908 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.210536 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.184840 16177 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.243585 16061 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.187674 16111 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:33.216348 16103 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:33.216353 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.177636 16138 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.203446 16175 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.167164 16142 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.180051 16178 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:03:33.256989 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:33.257107 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.257674 15344 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:33.236009 16110 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.237779 15197 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.241079 16149 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.177280 16147 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.263195 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.248734 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.172855 16165 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.251174 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.229455 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.253129 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.246381 16103 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.253338 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.241781 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.236805 15189 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.273487 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.268603 15192 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:33.260324 16110 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:33.259860 16108 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:33.265432 16155 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.000s
I20260709 13:03:33.207439 16115 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:33.248168 16145 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:03:33.251670 16174 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
W20260709 13:03:33.317015 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46849.6us
I20260709 13:03:33.318941 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.251874 16151 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:03:33.276490 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:33.276490 15190 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.264236 16162 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:03:33.315456 16166 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.313269 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.322674 16121 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.326164 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.326869 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.323263 16160 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.328166 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.329272 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.331300 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.332154 15264 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.334925 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.338176 15272 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.319344 16110 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.327517 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.341638 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.343537 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.346138 15268 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.322630 16128 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.351410 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.313786 16149 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:03:33.364298 15191 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.347718 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.325582 16155 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.371382 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.377863 15339 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:33.378490 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.353402 16142 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:33.379468 16142 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.381451 16142 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.382813 16174 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.383333 16174 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.384663 16147 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.384441 16174 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.386035 16174 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.389940 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:33.391621 16149 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.392621 16149 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.393019 16149 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.393821 16149 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.394251 16143 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.394660 16143 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.394949 16145 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.395368 16145 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.395761 16178 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.396206 16178 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:33.396740 16167 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 13:03:33.397115 16167 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.365123 16134 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:03:33.396217 16145 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.400961 16127 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.401369 16127 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.402287 16127 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.351454 16164 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.405326 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.368016 15266 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.407832 16152 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.408227 16152 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.390923 16154 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:03:33.401178 16145 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.383421 16123 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.408514 16138 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.406672 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:33.411510 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 84909.4us
I20260709 13:03:33.424261 15190 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:33.438807 15192 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:33.439208 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 344422us
I20260709 13:03:33.440989 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.441218 15195 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.443471 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.444211 15195 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.446337 15192 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.447538 15343 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.448518 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.450095 15195 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.447540 15192 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.451133 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.374409 16111 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:33.452984 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.456306 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.342043 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.464268 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.466408 15191 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:33.459285 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:33.467012 15196 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.467415 15267 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:33.461128 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.436888 16123 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.475972 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.476284 16165 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.476032 16179 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.476118 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.477116 16127 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.477241 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.462257 16103 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.470968 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.471220 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:33.472433 16170 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 13:03:33.487317 15162 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.475307 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.478721 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:33.488771 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:33.462131 16108 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.484025 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.484967 15190 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.495822 15192 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.485723 15195 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.496773 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.491688 16165 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.493180 15269 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.493335 15346 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:33.493433 16151 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.494234 16128 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.496824 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.469524 16160 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.500066 15268 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.491961 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.501880 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.547079 15189 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:33.547307 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45616.9us
I20260709 13:03:33.548094 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.495714 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.508735 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.511600 15207 tablet_copy_service.cc:342] P 5e6eed5c7a6b4571b5f898002fc990d2: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-81d86ef88f7f41238f3a595588effaca received from {username='slave'} at 127.0.0.1:40392
W20260709 13:03:33.512027 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 178267us
I20260709 13:03:33.512496 15337 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:33.512737 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.557480 15190 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.557302 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.559017 15207 tablet_copy_service.cc:434] P 5e6eed5c7a6b4571b5f898002fc990d2: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-81d86ef88f7f41238f3a595588effaca on tablet 81d86ef88f7f41238f3a595588effaca with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:33.513248 16111 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.559836 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.561031 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.562052 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.513522 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:33.552240 16173 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.478106 16152 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.564941 16152 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.514981 16103 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.509663 16170 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.513284 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.519109 16162 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.506778 16175 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.521250 16142 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.521719 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.522552 16155 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.522775 15264 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.456077 16167 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.495344 16158 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.458878 16166 raft_consensus.cc:2764] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:33.525202 16123 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.533465 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:33.469342 15263 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.540446 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.397128 16178 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:33.542732 15195 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:33.613229 15197 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.544242 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:33.613747 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 73389.1us
I20260709 13:03:33.546036 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.549295 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.614528 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:33.614900 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 65688.9us
I20260709 13:03:33.615522 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.494743 16176 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.551359 15194 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:33.552969 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.623165 15267 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:03:33.572067 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:33.581121 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91797.1us
I20260709 13:03:33.581416 15192 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:33.590718 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:33.591099 15271 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:33.548210 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:33.575539 16116 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.872s	user 0.006s	sys 0.007s
I20260709 13:03:33.565681 16165 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.630470 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.582840 16179 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.593349 15841 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.538250 16177 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.609310 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:33.609922 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 76526.1us
I20260709 13:03:33.610423 16061 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.577175 16128 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.620523 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.616518 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.624940 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.626721 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.527665 16143 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.581275 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.628610 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.590557 16142 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.665246 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.665684 16061 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:33.666101 16061 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.666339 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.636677 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.635875 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.639740 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.628407 16155 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:33.667950 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51485.5us
I20260709 13:03:33.599272 16162 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.668371 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.637621 16176 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.671070 16176 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.671340 15337 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:03:33.635210 15193 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.633852 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.665895 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.667330 15266 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:33.665066 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.631654 16164 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.606627 15272 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.669080 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.677065 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.678346 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.643906 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.646376 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.671141 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.627969 16181 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.673177 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.681734 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.682011 15266 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:33.635430 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:33.632256 16147 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.682907 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.679548 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:33.683609 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:33.684417 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.684412 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.680233 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:33.683012 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47658.8us
I20260709 13:03:33.670765 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.688946 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.688750 16142 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.689656 15265 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:33.691095 16055 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.692761 16088 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:03:33.670766 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 93838.5us
I20260709 13:03:33.693622 16088 tablet_bootstrap.cc:492] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:03:33.693553 16127 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.693933 15343 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:33.694132 16127 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:33.630342 16116 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.694514 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:33.694797 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.696175 16157 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.696045 16110 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:33.697234 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.694597 16127 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.698693 16106 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.698833 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.699262 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.694417 16088 ts_tablet_manager.cc:1403] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.587s	user 0.026s	sys 0.013s
I20260709 13:03:33.700073 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.687711 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.702644 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.611359 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.704299 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.705487 16165 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.707244 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.706758 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.711552 16162 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.672153 16158 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.713299 16158 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.715090 16177 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.672049 16108 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.715535 16165 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.715308 16088 raft_consensus.cc:359] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:33.716302 16088 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:03:33.717206 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.718959 15162 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.730485 16061 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.733351 15268 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:33.739674 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.741639 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.744586 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.746044 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.748827 15162 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:33.680190 16138 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.758019 16088 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:03:33.758875 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 74591.8us
I20260709 13:03:33.759876 16061 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.705346 15346 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.716555 15190 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.740386 16165 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.779855 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.754179 16082 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.762466 15263 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:33.777879 16147 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:33.783267 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.785313 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.785840 16164 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:33.786085 16123 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.793031 16108 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.747582 16177 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.786845 16061 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.762542 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.754608 16183 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.701531 16176 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:33.751740 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 156688us
I20260709 13:03:33.747593 16166 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.780320 16088 ts_tablet_manager.cc:1434] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260709 13:03:33.761489 16161 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.794713 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:33.799311 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 111499us
I20260709 13:03:33.762934 16157 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:03:33.786502 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.787801 16180 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.786839 16128 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.753909 16181 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:03:33.817072 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.818511 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.786540 16111 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:03:33.762488 16185 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:03:33.807984 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.819872 16187 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:03:33.820212 16161 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:33.822062 16187 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.822413 16187 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:33.810448 16170 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:33.810405 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:33.805704 16155 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:03:33.830243 15188 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.818120 16197 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.839747 15197 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.820029 16145 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.845981 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:33.846434 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.856714 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:33.857483 16157 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:33.827169 16138 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.822638 16161 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.859911 15875 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.868860 16121 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.868532 16111 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.866744 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:33.870224 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.871830 16127 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.886212 16111 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:33.890604 16194 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.890609 16111 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.893819 15339 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:33.895989 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:33.896291 16127 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:33.897519 16194 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:33.851733 16187 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.902230 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:33.917613 15873 raft_consensus.cc:1217] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:33.922343 16061 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.925030 15345 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:33.910277 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:33.931272 15872 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:03:33.908627 16194 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:33.941293 16194 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:33.941790 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:33.945592 15341 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:33.951610 15093 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 1 to 2, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:33.952582 15340 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:33.953188 16135 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.953752 16187 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.953352 16197 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:03:33.963667 16135 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.964071 16135 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:33.964587 16055 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.965000 16055 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:33.964844 16135 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.966112 16135 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.965898 16055 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.967686 16061 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:33.956439 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:33.971341 16055 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.972293 16197 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.972555 16142 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.970047 16180 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.981451 16180 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:33.988303 16180 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:33.990242 16180 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.998296 16197 raft_consensus.cc:1064] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:33.998989 16176 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.949465 15337 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:34.011539 16108 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.012044 16108 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.014091 16108 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:34.018262 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:34.018540 16111 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:34.021528 16163 raft_consensus.cc:1068] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }.
  Pending config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:34.023671 16110 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:34.028779 16178 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.031195 15162 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.034224 16103 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.034772 16103 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.034883 16177 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.035356 16177 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.035727 16103 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.037894 16143 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.038801 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.039235 16116 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:34.040190 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.040892 16114 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.041327 15271 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.041250 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.041510 16114 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.042337 16183 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.043190 15271 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.036214 16177 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:34.053478 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.055850 15344 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:34.057461 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.044955 15160 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.047045 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:34.048492 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:34.060355 15268 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:34.061360 16085 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.061838 16167 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.053519 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:34.055518 16177 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.072033 16082 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.075788 16167 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.076711 16167 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:34.079267 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.074116 16085 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.081254 16085 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.091689 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.094260 16082 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.052819 16197 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:34.114172 15342 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:34.115592 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.116511 16082 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.122097 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.123095 16082 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.123699 16082 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.124785 16082 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.133311 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:34.151676 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 320052us
I20260709 13:03:34.154320 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.159315 15343 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:34.171952 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:34.175241 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:34.176080 15337 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:34.176877 16138 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.177321 16138 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.178213 16138 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.175153 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:34.171536 16166 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.184435 15344 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.188992 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:34.196833 15266 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:34.200278 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.170830 16177 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.203413 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:34.218876 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.220994 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:34.239732 16187 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:34.226950 16146 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:34.249009 16151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.019s	sys 0.046s
W20260709 13:03:34.249528 16151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.019s	sys 0.046s
W20260709 13:03:34.224324 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.210959 15190 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.207294 16178 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:34.257601 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:34.263182 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 402523us
I20260709 13:03:34.264314 15268 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.240586 16187 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:34.273530 15268 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.241150 16146 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:34.277313 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.255954 16177 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.227972 16176 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:03:34.224408 16135 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:03:34.218205 16162 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:03:34.312642 15345 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.286644 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:34.344542 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67416.3us
I20260709 13:03:34.331060 15196 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.332048 15197 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.346711 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.333698 16146 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:34.352015 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65449.8us
I20260709 13:03:34.328620 15268 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.356037 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:34.275388 16178 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.363914 15268 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.363426 15189 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.312851 16151 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:03:34.367713 15238 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:34.349725 16183 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.379508 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:34.310737 16181 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:03:34.312656 16201 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
W20260709 13:03:34.521075 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 153420us
I20260709 13:03:34.360360 16155 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.339385 16165 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.370620 16138 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.525177 16180 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.534996 16202 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:03:34.535705 15872 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:34.368909 16111 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.163s
I20260709 13:03:34.536010 16199 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.209s
I20260709 13:03:34.528756 16198 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.183s
I20260709 13:03:34.518507 16055 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:03:34.560021 16106 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:03:34.561841 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:34.562363 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 191789us
I20260709 13:03:34.536875 16177 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.576303 16187 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:34.586899 16103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.009s	sys 0.078s
I20260709 13:03:34.600054 16178 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:34.597062 15188 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
W20260709 13:03:34.707044 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 63996.3us
I20260709 13:03:34.709568 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:34.715205 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:34.716710 15188 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:34.717695 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:34.720471 15265 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.720628 15263 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:34.605563 15268 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:34.720937 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 108882us
W20260709 13:03:34.641235 16103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.078s
I20260709 13:03:34.659484 16108 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.649319 16111 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.759441 16111 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.760820 16111 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.668013 16121 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.763446 16121 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.764937 16121 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:34.340380 16142 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:03:34.666918 16171 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.767609 16171 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.657900 16146 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.791172 16154 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.792750 16154 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:34.793685 16146 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:34.795457 16151 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.797379 16151 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.797768 16151 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:34.575979 16147 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.675199 16174 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.800179 16174 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:34.801849 16174 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.355999 16164 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.652415 16165 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:34.805186 16165 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:34.672042 16185 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.807399 16185 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.808987 16185 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.669957 16191 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.813040 16191 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:34.656106 16149 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.814306 15871 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:34.814706 16149 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:34.816192 16149 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.817986 16149 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.677330 16204 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.819455 16204 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.769311 16171 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.674147 16207 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.709748 15092 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 2 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:34.730546 16170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:34.822711 16207 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.734809 15271 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.740767 16221 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:03:34.747567 16106 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:34.748526 15343 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:34.754050 16186 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.827440 16186 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:34.756342 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:34.757215 16115 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.736784 16061 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.739393 16180 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.732209 16055 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:03:34.830686 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:34.777845 16142 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.832110 16142 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:34.833007 16115 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:34.833561 16142 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:34.780194 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.780766 16198 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:34.833524 16115 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:34.805781 16202 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:34.677048 16210 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.846241 16210 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.821163 16204 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.827528 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:34.810855 16185 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:34.832067 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 75999.3us
I20260709 13:03:34.767016 16121 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.762969 16111 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.850771 15266 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:34.855123 16151 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.856702 16151 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.857216 15339 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:34.837076 16186 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.840490 16202 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.841228 16115 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.842212 15345 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:34.842782 16142 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.843267 15343 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.824270 16207 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.814365 16191 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.847707 16210 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.874701 16210 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.843891 16198 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.861049 16204 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.863413 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:34.873525 16191 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.885776 16164 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:34.886274 16164 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:34.890678 16154 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.890475 16180 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.891865 16154 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:34.895125 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:34.896445 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.894364 16207 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.903086 16180 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:03:34.913650 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.916970 16180 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.919206 15343 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:34.919988 15282 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-35e75f905ad042d89b465e6461b29a5d received from {username='slave'} at 127.0.0.1:44984
I20260709 13:03:34.920691 15282 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-35e75f905ad042d89b465e6461b29a5d on tablet 35e75f905ad042d89b465e6461b29a5d with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:34.920747 15345 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:34.896584 16198 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:34.899061 16154 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:34.926267 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:34.905463 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:34.922979 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:34.933569 16174 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.934440 15269 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:34.934856 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.939489 16154 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:34.939949 16202 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:34.940162 16154 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:34.941298 16154 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.942517 16171 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.944072 16221 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:34.943794 16164 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.946595 16198 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:34.947335 16198 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:34.947960 16103 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:34.948294 16164 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.968022 16186 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.968539 15269 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:34.968744 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:34.969468 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 178576us
W20260709 13:03:34.967442 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 63550.5us
I20260709 13:03:34.973239 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:34.972458 16221 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:34.974227 15263 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:34.975391 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:34.976147 15268 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:34.977185 15272 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.007139 16142 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.008409 16115 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.006696 16210 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:03:35.017890 16103 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:35.024444 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.043265 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 209916us
I20260709 13:03:35.042821 16198 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.043632 16115 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.050932 15337 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.057134 15343 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.066560 16154 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.067413 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 156) took 1387 ms. Trace:
I20260709 13:03:35.071775 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.072188 15343 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.066429 15091 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.076952 16198 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:35.077386 16198 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.076581 15091 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.077906 16198 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.072954 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.083323 15196 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:35.071816 15093 rpcz_store.cc:276] 0709 13:03:33.712454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.747852 (+ 35398us) service_pool.cc:224] Handling call
0709 13:03:35.067158 (+1319306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:34.380673 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:34.516728 (+136055us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:34.516783 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:03:34.516814 (+    31us) tablet.cc:662] Decoding operations
0709 13:03:34.528305 (+ 11491us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:34.532891 (+  4586us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:34.534665 (+  1774us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:34.543562 (+  8897us) tablet.cc:701] Row locks acquired
0709 13:03:34.555567 (+ 12005us) write_op.cc:260] PREPARE: finished
0709 13:03:34.567232 (+ 11665us) write_op.cc:270] Start()
0709 13:03:34.571602 (+  4370us) write_op.cc:276] Timestamp: P: 1783602214567182 usec, L: 0
0709 13:03:34.571910 (+   308us) op_driver.cc:348] REPLICATION: starting
0709 13:03:34.606081 (+ 34171us) log.cc:844] Serialized 537 byte log entry
0709 13:03:34.678560 (+ 72479us) op_driver.cc:464] REPLICATION: finished
0709 13:03:35.016910 (+338350us) write_op.cc:301] APPLY: starting
0709 13:03:35.017051 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:35.017187 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:35.017706 (+   519us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:35.018225 (+   519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:35.021441 (+  3216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:35.021610 (+   169us) write_op.cc:312] APPLY: finished
0709 13:03:35.022202 (+   592us) log.cc:844] Serialized 22 byte log entry
0709 13:03:35.023461 (+  1259us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:35.023609 (+   148us) write_op.cc:454] Released schema lock
0709 13:03:35.023736 (+   127us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:35.024478 (+   742us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:35.024534 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":338055,"apply.run_cpu_time_us":2840,"apply.run_wall_time_us":7499,"num_ops":1,"prepare.queue_time_us":414515,"prepare.run_cpu_time_us":8468,"prepare.run_wall_time_us":283410,"raft.queue_time_us":7231,"raft.run_cpu_time_us":122386,"raft.run_wall_time_us":348207,"replication_time_us":106533,"thread_start_us":729994,"threads_started":4,"wal-append.queue_time_us":60174}]]}
I20260709 13:03:35.086997 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.090798 16151 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:35.091346 16151 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.091884 16151 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.104521 15345 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:35.104983 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:35.105741 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53622.4us
I20260709 13:03:35.106851 15092 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.110864 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.111115 16191 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:35.112692 16191 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.113062 16191 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.113742 15196 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.116503 15271 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.121464 16198 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.122085 16191 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.126585 16185 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.123198 16227 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:03:35.127409 16185 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:35.128364 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.131958 16185 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:35.132270 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.132819 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.133025 15197 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:35.129372 15196 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.133802 15190 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.133703 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.134828 15193 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.135232 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.135918 16128 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.136454 16128 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:35.138775 16128 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:35.139361 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.126452 16103 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:03:35.143939 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:35.144555 15196 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:35.126446 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.128384 16183 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:03:35.145447 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.146600 16164 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:35.123881 16198 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.140107 15091 catalog_manager.cc:5697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 1 to 2, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.088191 16154 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.142530 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:35.136029 15190 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.157611 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:35.158437 15875 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:35.150002 16174 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:03:35.158811 15092 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 2 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.166213 16171 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:35.168548 15091 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 1 to 2, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.176995 16193 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.176839 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.177704 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.177624 16193 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.177974 15271 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:35.178912 16164 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.179456 16164 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:35.179831 16193 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.180570 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.180456 16164 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.181197 15268 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:35.182416 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:35.182426 16114 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:35.187325 16114 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.188651 16114 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:35.170603 16134 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:03:35.167191 16186 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:35.191188 15237 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.191301 16186 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.191795 16186 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.192107 16115 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:35.192589 16115 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.193025 16115 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.193499 16185 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:35.194056 16185 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.196717 16180 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:35.197463 16180 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.199205 16204 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:35.199764 16204 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:35.202121 16204 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.204557 16082 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:35.205857 15268 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:35.207018 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63232.3us
I20260709 13:03:35.210268 16180 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.212826 16185 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.216151 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:35.219822 15268 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.220075 15271 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.223201 16171 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.223398 15271 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:35.223811 16171 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.224823 16187 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.225369 16187 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.221784 16186 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:35.227166 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:35.228355 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:35.228672 16171 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.229539 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:35.230217 16186 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.230584 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.230756 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:35.232852 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.242174 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:35.247828 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.250103 16187 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.253654 15271 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:35.255923 15091 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 1 to 2, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.263337 15338 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:03:35.263859 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.250993 16186 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.280941 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.255491 16128 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:03:35.293041 15189 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.274362 16193 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:35.302594 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.302822 16115 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:35.304045 15193 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:35.306520 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.308053 15195 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:35.308252 15191 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:35.308985 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.310307 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.310775 16164 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:35.312274 16180 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.312659 16180 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:35.309027 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.278750 16198 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:35.310916 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.322822 16207 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:03:35.326643 16154 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.322921 16191 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.298866 16173 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.333025 15193 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.334046 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.335583 16164 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:35.336966 16207 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.337352 16207 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:35.338510 16207 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.339319 16085 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:35.340049 16207 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.340075 16085 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.320044 16183 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.343524 16183 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.345342 15193 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:35.346153 16183 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.314414 16193 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.346560 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.346980 16193 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.347434 15193 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:35.348785 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.349483 15193 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.318332 16198 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.351523 16198 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.354394 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.355214 15193 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.355902 16115 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:35.356981 16230 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:03:35.357182 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:35.357892 15872 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.358275 16135 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.358984 16135 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.361682 16135 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.362782 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:35.363387 16135 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:35.363575 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52884.2us
I20260709 13:03:35.364861 15191 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:35.367251 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:35.363884 16135 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.382385 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:35.402796 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.342965 16085 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.418897 15197 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:35.422618 16236 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:03:35.423326 16226 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:03:35.424810 16226 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:35.425155 16226 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:35.437352 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:35.403657 16183 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.441043 15192 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:35.445961 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:35.398562 16173 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:35.412217 16114 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:03:35.426991 15263 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:35.425890 16226 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.457753 16108 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.460954 16061 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.462456 15195 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:35.435354 16151 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.438436 16085 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:03:35.447388 16166 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:03:35.480409 16135 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.481078 16103 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:03:35.483738 16232 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.359s	user 0.006s	sys 0.000s
I20260709 13:03:35.455811 16183 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.506294 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.486619 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:35.476836 15872 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:35.492650 16226 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.503469 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.512045 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:35.507700 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:35.464746 16221 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:03:35.520347 15197 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:35.517118 16115 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:35.525609 16221 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.526201 16221 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:35.506043 16103 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:35.525308 16115 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.517284 16154 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:35.538725 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63636.6us
I20260709 13:03:35.538789 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:35.555770 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:35.557216 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.522249 16128 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:35.522423 16187 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:35.567938 16242 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:03:35.530699 16164 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.610128 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:35.613333 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:35.555207 16154 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.568234 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:35.632189 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 170725us
I20260709 13:03:35.521629 16193 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.637436 15237 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:35.569576 16187 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.631527 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.693066 16128 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:35.631804 16154 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.627501 16108 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:35.742970 15272 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:35.635460 15342 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:35.636081 16185 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.643807 16187 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.756501 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.624778 16164 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.777647 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:35.782927 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.764503 16173 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:35.779083 16234 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:03:35.761801 15265 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:35.796684 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 159364us
I20260709 13:03:35.799599 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:35.810433 16251 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:35.812094 16252 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:35.783270 16151 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.785161 16165 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.815338 15272 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:35.787889 16085 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.822121 15271 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:35.804738 16249 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.759145 16103 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.816789 16210 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:35.816300 16186 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.852383 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.854480 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:35.849360 15266 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:35.844225 16151 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.868665 16151 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.871276 16115 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:35.872403 16222 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:35.872468 16221 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:35.871556 16246 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:03:35.840669 16183 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.817068 16198 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.824015 16165 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.875387 16103 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:35.845894 16085 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.892011 16250 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:35.894153 16250 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.896400 16250 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.899232 16193 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:35.899492 16241 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:03:35.902169 16108 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:35.889863 16151 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.902720 16108 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.903611 16164 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.861050 16249 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.908697 16165 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.857990 16128 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.881561 16256 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.909533 16256 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:35.911679 16256 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:35.881824 16210 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:35.877542 16258 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:35.865063 16186 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.919812 16251 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.921728 16251 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.924978 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:35.925747 15271 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.922443 16180 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:35.929512 16251 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.929911 16085 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.929996 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:35.908720 16249 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:35.931851 15341 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:35.925077 16164 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.924606 16207 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.965653 15271 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:35.977962 16256 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.978657 16256 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.979275 16151 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.979810 16151 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:35.980640 16256 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.981704 16151 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:35.924647 16258 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.941618 16187 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:35.965868 16115 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:35.997360 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:35.998848 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:35.940964 16210 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:36.001178 15093 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.983439 16180 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.019897 15339 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:35.965979 16164 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:35.992031 15193 consensus_meta.cc:287] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.002s
I20260709 13:03:35.961906 16207 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:35.985159 16264 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:36.013779 15093 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.022605 16198 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.029484 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.022605 15193 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.030303 15263 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:36.030721 15342 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.019896 16115 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.031885 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.033057 15344 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:36.033484 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.036293 15345 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:03:36.024912 16186 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.057525 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.058559 15345 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:36.056667 15093 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.067901 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.075500 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.043800 16272 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:36.079401 16262 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.078248 15093 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:36.081696 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:36.086071 16128 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.086608 16128 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:36.087508 16128 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.089571 16185 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.073982 15265 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.094590 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.079922 16262 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:36.083385 16186 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.091328 15093 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:36.114006 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.144271 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.145047 15265 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.145095 16210 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:36.145934 16114 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.146148 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.146433 16114 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.144477 16187 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.097777 16256 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:36.147060 16177 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.077781 16154 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:36.098905 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65655.5us
I20260709 13:03:36.165874 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.166311 15344 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.166512 15345 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.160881 16135 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.168031 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.169411 16135 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.169749 16266 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.170267 16266 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.172112 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.172894 15345 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.149366 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.051120 16264 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:36.098423 16226 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.151636 16155 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:36.151772 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:36.155536 16276 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.156042 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:36.158070 16173 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:36.178038 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.165027 15263 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.096885 16272 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:36.183933 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.196523 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:36.183805 16226 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.184000 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:03:36.185081 16280 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:03:36.163190 16256 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:36.185844 16270 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.177448 15342 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.164335 16177 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.148524 16186 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.177310 15872 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Advancing to term 2
I20260709 13:03:36.191516 16151 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:36.185874 16277 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:36.202013 15264 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:36.202651 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.221432 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:36.204610 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:36.207899 15270 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.207705 16256 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.208693 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.233671 15266 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.209929 16177 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.212136 16154 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.197597 16174 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:36.205473 16270 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.191913 16135 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.191500 16258 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.189038 16276 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.178874 16114 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.192576 16155 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.200090 16173 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.238966 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:36.238713 16257 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.241605 16262 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:36.242084 15268 raft_consensus.cc:2410] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:03:36.220749 16164 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.244793 16270 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.246251 16174 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.246933 16266 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.246973 16276 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.235520 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:36.252177 16261 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.252653 16186 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.253270 16264 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.221556 15344 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.239511 16191 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.257347 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 726) took 1028 ms. Trace:
I20260709 13:03:36.261297 15311 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:36.238857 16151 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.257014 16257 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:36.278115 16257 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.266419 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:36.271520 16191 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:36.272044 16272 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.272136 15340 rpcz_store.cc:276] 0709 13:03:35.210735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.210920 (+   185us) service_pool.cc:224] Handling call
0709 13:03:35.954697 (+743777us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:35.975156 (+ 20459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.999332 (+ 24176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.999364 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.999915 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:03:36.027155 (+ 27240us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:36.029334 (+  2179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.044891 (+ 15557us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.213426 (+168535us) raft_consensus.cc:1685] finished
0709 13:03:36.213451 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.239274 (+ 25823us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5941,"raft.queue_time_us":12012,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":13986,"spinlock_wait_cycles":10328960,"thread_start_us":20827,"threads_started":1,"wal-append.queue_time_us":60336}
I20260709 13:03:36.279381 15874 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:36.271006 16108 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.289856 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.292685 16164 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.293104 16164 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.288676 15871 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:36.285144 16173 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.284544 16149 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.286000 16272 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:36.317385 16226 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.314807 16260 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.314800 16155 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.297694 16164 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.316983 16151 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.321996 16260 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.350001 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 722) took 1155 ms. Trace:
I20260709 13:03:36.352883 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.352962 16191 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:36.355196 16151 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:36.355717 16151 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.357728 16151 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.325703 16174 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.350634 15337 rpcz_store.cc:276] 0709 13:03:35.194945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.195846 (+   901us) service_pool.cc:224] Handling call
0709 13:03:35.273815 (+ 77969us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:35.280762 (+  6947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.312153 (+ 31391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.312193 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.312700 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.494431 (+181731us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:35.515866 (+ 21435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.518961 (+  3095us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.324092 (+805131us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b540034f420. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5682dbe 00007f36e568d930 00007f36e568d8d8 00007f36e568d858 00007f36e568d813 00007f36e568ca9c 00007f36eb578626 00007f36eb572dd8 00007f36e56c97cb 00007f36e56cc2c0
0709 13:03:36.332044 (+  7952us) raft_consensus.cc:1685] finished
0709 13:03:36.332063 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.349889 (+ 17826us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1228,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":12648,"spinlock_wait_cycles":63011456,"thread_start_us":139975,"threads_started":1,"wal-append.queue_time_us":171377}
I20260709 13:03:36.364305 16061 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:36.365005 16061 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.376091 15872 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:36.334975 16260 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:36.382812 16239 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.598s	user 0.004s	sys 0.000s
I20260709 13:03:36.383679 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.432195 15271 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.386334 16115 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.389302 15188 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.389993 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.390760 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.389357 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:36.443796 16255 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.604s	user 0.003s	sys 0.005s
I20260709 13:03:36.391396 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:36.392213 16207 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.393108 15194 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:03:36.447547 15193 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.393792 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.394716 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 20) took 1096 ms. Trace:
I20260709 13:03:36.448630 15195 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:36.397336 16165 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.400568 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.462884 16165 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.405294 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:36.405527 16276 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:36.413748 15266 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.419075 16270 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:36.419659 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.425680 16257 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.443859 15196 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:36.447999 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 725) took 1237 ms. Trace:
I20260709 13:03:36.445871 16061 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.448729 15189 rpcz_store.cc:276] 0709 13:03:35.298366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.301831 (+  3465us) service_pool.cc:224] Handling call
0709 13:03:35.302224 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.363545 (+ 61321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.363579 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.364115 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.521537 (+157422us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:35.530754 (+  9217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.554169 (+ 23415us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.392766 (+838597us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5400355820. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5682dbe 00007f36e568d930 00007f36e568d8d8 00007f36e568d858 00007f36e568d813 00007f36e568ca9c 00007f36eb578626 00007f36eb572dd8 00007f36e56c97cb 00007f36e56cc2c0
0709 13:03:36.394317 (+  1551us) raft_consensus.cc:1685] finished
0709 13:03:36.394353 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.394615 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61226,"raft.queue_time_us":64849,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":18024,"spinlock_wait_cycles":4655872,"thread_start_us":151449,"threads_started":1,"wal-append.queue_time_us":171566}
I20260709 13:03:36.455494 15197 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.456578 15341 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.457482 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.487598 15271 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:36.458251 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.467535 16276 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.468082 15265 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.330137 16272 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:36.472978 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67860.7us
I20260709 13:03:36.479358 16269 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.482219 16061 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.484066 15263 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.480413 15346 rpcz_store.cc:276] 0709 13:03:35.210396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.210615 (+   219us) service_pool.cc:224] Handling call
0709 13:03:35.520016 (+309401us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:35.525373 (+  5357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.525682 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.525735 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.526366 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.631346 (+104980us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:35.635384 (+  4038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.643555 (+  8171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.442908 (+799353us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:36.447589 (+  4681us) raft_consensus.cc:1685] finished
0709 13:03:36.447617 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.447797 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41689216,"thread_start_us":87679,"threads_started":1,"wal-append.queue_time_us":253920}
I20260709 13:03:36.492619 16257 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.494493 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.501996 15266 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:36.500670 16061 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:36.503239 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 298671us
I20260709 13:03:36.504439 16061 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.492940 15193 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
W20260709 13:03:36.505330 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:36.527720 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.512418 16269 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:36.506631 16082 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.499177 16207 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:03:36.510174 16166 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:36.587426 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.513268 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.604885 15271 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.599757 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.531616 16155 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.588541 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 710) took 1298 ms. Trace:
I20260709 13:03:36.608481 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.611845 15271 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:36.588073 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.614449 16268 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.614718 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:36.615502 15196 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.615170 16268 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:36.615816 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.616271 16269 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.613209 16173 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.617551 16173 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.614450 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.619500 16173 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.618716 16268 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:36.621918 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:36.604251 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:36.620549 16155 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.631641 15263 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.606070 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.630658 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.638662 15271 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.608832 16270 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.639807 15266 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.641351 15196 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
W20260709 13:03:36.641850 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 410957us
I20260709 13:03:36.644063 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.645192 15271 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.649187 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.632926 15270 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:36.649725 16272 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.650333 15271 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:36.652019 16165 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.652572 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:36.649712 16155 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.610966 16082 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.659793 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:36.662637 15162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.031s	sys 0.049s
I20260709 13:03:36.628906 15265 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
W20260709 13:03:36.663846 15162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.031s	sys 0.049s
W20260709 13:03:36.665603 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 505055us
I20260709 13:03:36.669548 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.670425 15271 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.671509 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.673003 15271 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.678834 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.614111 16166 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.682185 15194 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:36.682696 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.683427 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:36.683809 16061 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:36.684198 16061 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:36.633636 16164 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:36.683312 15267 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.684477 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:36.693298 15194 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:36.663770 16103 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:36.664779 16135 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.692888 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.675771 16249 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.688596 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:36.662768 16180 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:03:36.694847 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.702296 15195 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:36.695740 15191 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.675794 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.699226 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:36.683017 16193 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:36.664860 16268 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:03:36.705991 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:36.688407 16155 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.709736 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:36.710575 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:36.708537 16193 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.712751 16294 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:36.714421 16193 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:36.716867 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.753067 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:36.754535 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.611459 15269 rpcz_store.cc:276] 0709 13:03:35.237470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.237616 (+   146us) service_pool.cc:224] Handling call
0709 13:03:35.237971 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:35.238243 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.238297 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:35.252805 (+ 14508us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.476784 (+223979us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:35.479847 (+  3063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.492894 (+ 13047us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.382002 (+889108us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:36.509138 (+127136us) raft_consensus.cc:1685] finished
0709 13:03:36.510007 (+   869us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.536247 (+ 26240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26724224,"thread_start_us":218348,"threads_started":1,"wal-append.queue_time_us":379189}
I20260709 13:03:36.887955 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.718261 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.795755 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.904104 15339 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:36.797214 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.882958 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.875612 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.874792 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.906381 15345 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:36.781977 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.715628 16155 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:36.756803 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.910687 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:36.761672 15194 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:36.718748 16061 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.714880 16110 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:36.905586 15271 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.945816 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.790467 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:36.908107 15343 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:36.908555 15191 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:36.905695 15195 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:36.923722 15268 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3.
I20260709 13:03:36.906495 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.715961 16135 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.929229 16270 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.707800 16103 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:36.950182 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 239662us
I20260709 13:03:36.715212 16114 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.214s
I20260709 13:03:36.759043 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.757050 15872 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:36.793493 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:36.756577 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.788973 16207 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.751447 16165 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.936896 16061 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.785643 16180 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:36.754334 16177 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.976375 16177 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.976773 16103 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.977087 16177 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.978376 15263 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:03:36.757477 16226 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.180s
I20260709 13:03:36.756302 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.924152 16155 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:36.758050 16166 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:36.938814 15264 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:36.754793 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:36.981477 15839 leader_election.cc:400] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3.
I20260709 13:03:36.939313 16256 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:36.716038 16249 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:03:36.944141 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 228340us
I20260709 13:03:36.708788 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:36.794257 16204 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:36.948439 15267 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:36.781061 16222 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:03:36.949613 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.946509 15194 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.756578 16173 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.867194 16134 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:36.758463 16260 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:36.899611 16262 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:36.973079 15272 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:36.974064 16207 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.975386 16180 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.964066 15341 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:36.964109 16165 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.995549 16204 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:37.038447 16165 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.041080 16204 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.959296 16292 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.981920 15188 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:36.997869 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48354.9us
I20260709 13:03:36.995543 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.056010 15191 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:36.958371 16270 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.001628 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:36.984465 16164 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:36.955569 16110 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:36.984763 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:36.983928 16256 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:37.004070 16149 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:37.007473 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:36.981936 15839 leader_election.cc:403] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:37.007380 16260 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:37.059437 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 57901.2us
I20260709 13:03:37.058156 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:37.001194 15189 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.054052 16292 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.068073 16149 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:37.065562 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 58156.8us
I20260709 13:03:37.004226 16134 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.012122 16173 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:03:37.071931 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:37.065388 16256 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.086810 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:37.062462 16193 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:03:37.062924 16114 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.090694 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:37.099298 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.102154 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:37.104148 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:37.092128 16180 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.091991 16191 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:37.093195 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:37.094015 16310 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.124898 15343 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:37.096942 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:37.152247 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.153506 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:37.154556 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.096966 16249 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.097808 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:37.012698 16262 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.065506 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.098726 16165 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.114832 16270 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:37.106505 16207 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.109158 16134 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:37.213622 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 111553us
I20260709 13:03:37.109234 16114 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.109952 16293 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.099131 16285 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.070953 16226 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.112577 16260 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:37.112084 16149 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.113956 16173 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.114473 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:37.115274 16103 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.118445 16082 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.076083 16298 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:37.120623 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:37.252414 15338 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:37.121383 16174 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:37.087440 16292 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.155128 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:37.219064 16114 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:37.157027 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52959.9us
I20260709 13:03:37.259572 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:37.156617 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.098748 16110 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:37.204327 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46216.5us
W20260709 13:03:37.089361 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 104756us
I20260709 13:03:37.214800 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:37.217049 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.266324 15191 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:37.224028 16226 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.150328 16193 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.220662 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:37.212030 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.212437 16299 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:03:37.166471 16310 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.166941 16257 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.246301 16103 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.213131 15341 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:37.218055 16293 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.214047 15193 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:37.261152 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:37.341620 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 80543.3us
I20260709 13:03:37.279424 15190 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:37.262236 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:37.268405 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:37.269867 16134 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:37.271481 16110 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.283066 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:37.255686 16298 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:03:37.275404 16306 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:03:37.286805 16226 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.285614 16191 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:37.275465 16303 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:03:37.250403 16173 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.352447 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.369493 15192 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:37.275022 15189 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:03:37.357316 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74344.1us
I20260709 13:03:37.330704 16103 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.327420 16257 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.285902 16174 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:37.286335 16260 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:37.362468 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 100332us
I20260709 13:03:37.316605 16193 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.319064 16128 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:03:37.341712 16293 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.277347 16292 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:37.356070 16311 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:03:37.353041 16270 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.352782 16262 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.375797 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:37.351702 16134 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:37.356403 16110 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.399883 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.378950 16257 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.363790 16298 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.364830 16149 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:37.390527 15267 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:03:37.394291 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 179515us
I20260709 13:03:37.406807 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:37.365844 16319 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.367954 16321 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.395989 16270 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.394824 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.405611 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:37.399657 16134 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.402555 16110 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.414827 16309 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.419345 16270 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.427560 16322 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.427116 15872 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:37.447204 16322 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.447641 16322 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.429203 16173 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.431806 16155 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.419128 16165 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.420644 15196 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:37.395828 16260 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.454452 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:37.463598 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 87879.9us
I20260709 13:03:37.396031 16315 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:03:37.446478 16309 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.467455 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:37.412117 16149 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.475729 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:37.476553 16309 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.476938 16187 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:37.484586 16173 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.496589 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.497519 15196 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:37.485453 16329 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.456739 16191 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.462284 16174 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.499454 16173 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.498803 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 727) took 1089 ms. Trace:
I20260709 13:03:37.501838 16276 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:37.518910 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:37.520793 16297 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.575s	user 0.000s	sys 0.004s
I20260709 13:03:37.521327 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.521180 16134 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:37.509279 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.508210 16330 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:37.517133 16173 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.516893 15270 rpcz_store.cc:276] 0709 13:03:36.409800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.650670 (+240870us) service_pool.cc:224] Handling call
0709 13:03:36.651053 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.651423 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.651448 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.967883 (+316435us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:03:36.968359 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.164876 (+196517us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:37.211443 (+ 46567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.216093 (+  4650us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.485317 (+269224us) raft_consensus.cc:1685] finished
0709 13:03:37.485345 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.496918 (+ 11573us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4583,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":13470976,"thread_start_us":155614,"threads_started":1,"wal-append.queue_time_us":286096}
I20260709 13:03:37.534695 16262 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:37.535274 16322 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.546442 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:37.546741 16177 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.001s
I20260709 13:03:37.533722 16332 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:37.551733 16110 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.552877 16103 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.553151 16155 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.550770 16309 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.523187 15188 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:37.525846 16292 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:37.557672 16336 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:37.643718 16285 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3.
I20260709 13:03:37.681871 15192 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:37.524503 16276 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:37.715662 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:37.716307 15339 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:37.715179 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.747735 16292 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:37.748371 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:37.748328 16292 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.561973 16298 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.571596 16262 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.644994 16177 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.574854 16330 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:37.655859 16191 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:37.650822 16332 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.999289 16061 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:38.012043 16061 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.952350 15338 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:37.954478 15196 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
W20260709 13:03:37.994930 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.778960 15189 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:37.693828 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 98250us
I20260709 13:03:37.782943 16333 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:37.948161 16114 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.000s
I20260709 13:03:38.041368 16061 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:37.944851 16334 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.383s	user 0.001s	sys 0.000s
I20260709 13:03:38.057575 16061 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.854514 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:37.874797 16187 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:37.998036 16262 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.997200 16177 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.929965 16149 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:37.999001 16343 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:38.061280 16061 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:37.865434 16276 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:37.990820 16307 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.878337 16335 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.854003 16321 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.029968 16221 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.030321 16155 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:03:38.062287 16293 consensus_meta.cc:287] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.664s	user 0.009s	sys 0.002s
I20260709 13:03:38.078673 16061 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.084226 16061 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.067960 16324 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.084699 16061 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.035243 16191 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.063722 16114 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.075234 16262 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:03:38.085107 16256 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.934s	user 0.010s	sys 0.001s
I20260709 13:03:38.081933 16134 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.078296 16344 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:38.087419 16340 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:03:38.103233 16262 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.105824 16298 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.107331 16332 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:38.108206 15839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.582s (SENT) [suppressed 2 similar messages]
I20260709 13:03:38.109668 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:38.110515 16309 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.111159 16322 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.111223 16187 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:38.112428 16191 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.113233 16061 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.114329 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:38.156975 16061 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.157267 15196 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:38.157683 16351 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.157807 16350 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:03:38.115620 16314 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.727s	user 0.005s	sys 0.018s
I20260709 13:03:38.117313 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 826) took 1114 ms. Trace:
I20260709 13:03:38.088413 16293 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:38.159575 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 58426.2us
W20260709 13:03:38.130293 16257 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.717s	user 0.005s	sys 0.005s
I20260709 13:03:38.160526 16257 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.160916 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:38.161206 16293 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.117682 16330 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:38.161798 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 658769us
I20260709 13:03:38.162110 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:38.162525 16257 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.095459 16110 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.163093 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:38.163422 15342 raft_consensus.cc:2368] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
I20260709 13:03:38.134414 16149 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.163916 16276 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:38.164501 16276 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:38.164233 16149 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:38.165659 16276 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.136467 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 817) took 1445 ms. Trace:
I20260709 13:03:38.167236 15190 rpcz_store.cc:276] 0709 13:03:36.691397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.691509 (+   112us) service_pool.cc:224] Handling call
0709 13:03:38.136160 (+1444651us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b54002369d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:38.136346 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":566770048}
I20260709 13:03:38.169004 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:38.170075 15190 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:38.137777 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.172082 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.173420 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.063934 16333 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.146302 15339 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
W20260709 13:03:38.102102 16226 consensus_meta.cc:287] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.716s	user 0.009s	sys 0.001s
W20260709 13:03:38.155375 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45770.2us
I20260709 13:03:38.153923 16134 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.089516 16335 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.133067 16173 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.157425 16061 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.158651 15194 rpcz_store.cc:276] 0709 13:03:37.003149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.003328 (+   179us) service_pool.cc:224] Handling call
0709 13:03:37.003704 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.515181 (+511477us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:37.520595 (+  5414us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.650944 (+130349us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.650996 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:37.651057 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.117051 (+465994us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54002116d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:38.117104 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.117251 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33926,"prepare.queue_time_us":5659,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":90,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":3389,"spinlock_wait_cycles":1175511296,"thread_start_us":129984,"threads_started":1,"wal-append.queue_time_us":555220}
I20260709 13:03:38.158296 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.163763 15193 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:38.089799 16155 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.133467 16128 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.138096 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:03:38.195858 16304 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.146s	user 0.023s	sys 0.016s
I20260709 13:03:38.087603 16221 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.176524 16348 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.178264 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:38.082041 16307 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.085525 16321 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.166857 16149 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:38.174036 16298 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.147969 16256 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.186606 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.188582 16061 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.192761 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.193111 16309 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:38.199682 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.183166 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:38.218613 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 56569.4us
I20260709 13:03:38.219139 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:38.220683 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.225481 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.230618 15196 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:38.231141 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:38.225716 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.181242 16226 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.184551 16134 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.215761 16191 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.196806 16348 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.153699 16344 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.233129 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.260227 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:38.334853 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72423.5us
I20260709 13:03:38.158381 16350 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.361107 16352 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.216042 16322 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:38.360466 15196 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:38.360852 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 130648us
I20260709 13:03:38.361888 16352 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.158337 16351 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.371979 16359 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:38.372728 16359 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.373461 16351 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.363484 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:38.367364 16061 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:38.374646 16061 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.369949 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:38.099761 16324 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.375061 16061 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.233371 16187 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:38.369470 16270 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.896s	user 0.011s	sys 0.002s
I20260709 13:03:38.233466 16114 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.305505 16332 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.396569 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.396843 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.232002 16298 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:38.216223 16128 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.305339 15340 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
W20260709 13:03:38.305261 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 197074us
I20260709 13:03:38.378669 15344 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:38.303699 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.268509 16110 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:38.355024 16349 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.387095 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.387490 16321 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.387951 16221 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:38.388386 16300 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.458s	user 0.008s	sys 0.011s
I20260709 13:03:38.358145 16355 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:38.477079 16355 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:38.477502 16355 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.477355 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.478727 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.463454 16359 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:38.479336 15191 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:38.480191 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.481194 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:38.482208 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.482726 15191 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:38.391927 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.392119 16260 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.486280 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.392953 16310 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.393649 16173 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.394742 16155 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:38.396028 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.370720 16108 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.411332 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.379006 16149 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:38.415449 16262 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.495338 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:38.495672 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:38.415449 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.417873 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.496837 15264 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:38.497493 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:38.497772 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:38.498073 15263 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.498903 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.419183 16344 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.399264 16270 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.499658 15871 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.501461 16270 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.419709 16350 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.421661 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.270433 16309 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.424630 16128 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:38.425439 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 757) took 1344 ms. Trace:
I20260709 13:03:38.503541 16108 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.503621 15342 rpcz_store.cc:276] 0709 13:03:37.081234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.114163 (+ 32929us) service_pool.cc:224] Handling call
0709 13:03:38.425215 (+1311052us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b54002733d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:38.425349 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105980672}
I20260709 13:03:38.504905 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:38.505666 15342 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:38.505764 16108 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.425568 16256 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.471419 16349 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.370797 16191 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.466126 16335 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.426417 16193 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.427531 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:38.427953 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 834) took 1275 ms. Trace:
I20260709 13:03:38.460722 16103 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.384727 16187 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.462391 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:38.379359 16322 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:38.464402 15346 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:38.408418 16204 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:38.467638 15195 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:38.474246 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 810) took 1797 ms. Trace:
I20260709 13:03:38.464450 16357 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.389072 16226 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.466040 16110 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.484282 16333 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.390466 16307 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.499672 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:38.517221 16357 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.472968 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:38.392730 16348 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:38.513919 15091 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 157) took 3396 ms. Trace:
I20260709 13:03:38.487138 15191 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:38.482357 16061 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.486162 15343 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:38.489897 15266 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:38.524144 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:38.524806 15266 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:38.525350 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.525789 15266 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:38.466234 16347 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:38.491501 15271 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:38.484750 16355 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.492282 16149 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:38.517175 16187 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.493379 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:38.466696 16324 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:38.520197 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47363.3us
I20260709 13:03:38.527335 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:38.530062 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67743.3us
I20260709 13:03:38.530330 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.555817 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:38.556090 15266 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:38.510073 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:38.543856 15311 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:38.560949 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.561666 15266 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:38.545513 15267 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:03:38.562194 15271 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:38.562490 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:38.540160 16061 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.548240 16128 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:38.465795 16352 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.563060 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.511365 16309 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.513783 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:38.559495 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 66200.7us
I20260709 13:03:38.550508 16347 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.569834 16347 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.569600 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:38.571184 16312 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.111s	user 0.014s	sys 0.001s
I20260709 13:03:38.527782 15264 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:38.572888 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 739) took 1697 ms. Trace:
I20260709 13:03:38.521353 16350 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:38.515455 16134 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.518294 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.551515 16149 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.563796 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:38.549430 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.506260 16108 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:38.557040 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:38.560222 16348 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:38.524462 16270 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.569082 16128 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:38.508930 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 751) took 1429 ms (client timeout 1750 ms). Trace:
I20260709 13:03:38.517484 15197 rpcz_store.cc:276] 0709 13:03:36.677292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.677413 (+   121us) service_pool.cc:224] Handling call
0709 13:03:36.686871 (+  9458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.083869 (+396998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.083925 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.083984 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:37.084030 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.473957 (+1389927us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400211bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:38.474018 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.474173 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":912472832}
I20260709 13:03:38.550912 16260 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:38.556809 16332 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:38.584256 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.602839 15195 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:38.587256 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:38.585204 15162 leader_election.cc:400] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
I20260709 13:03:38.586270 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.590372 16061 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:38.604202 15162 leader_election.cc:403] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:38.604492 16061 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.604858 16061 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.573405 15345 rpcz_store.cc:276] 0709 13:03:36.875278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.932096 (+ 56818us) service_pool.cc:224] Handling call
0709 13:03:36.932507 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.946972 (+ 14465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.947006 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.950889 (+  3883us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.124484 (+173595us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:37.124520 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.124585 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.467956 (+1343371us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:38.572508 (+104552us) raft_consensus.cc:1685] finished
0709 13:03:38.572541 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.572810 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9801,"spinlock_wait_cycles":24288000,"thread_start_us":131285,"threads_started":1,"wal-append.queue_time_us":286113}
I20260709 13:03:38.593222 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.568359 16103 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:38.507982 16298 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.576812 16354 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:38.606591 15267 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:38.606154 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.604604 15271 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:38.606189 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:38.582973 16292 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.610437 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 759) took 1481 ms. Trace:
I20260709 13:03:38.610384 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.613175 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.612665 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:38.518868 15189 rpcz_store.cc:276] 0709 13:03:37.152808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.395587 (+242779us) service_pool.cc:224] Handling call
0709 13:03:37.398059 (+  2472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.035473 (+637414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.427734 (+392261us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54000fa5d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:38.427898 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":678914944}
I20260709 13:03:38.615298 15338 rpcz_store.cc:276] 0709 13:03:37.129553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.253264 (+123711us) service_pool.cc:224] Handling call
0709 13:03:38.610261 (+1356997us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54003aacd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:38.610381 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383673216}
I20260709 13:03:38.602166 16359 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.637991 16359 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.640087 16359 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.641050 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.614190 16348 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:38.642277 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.608654 15341 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:38.622443 16307 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.643817 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:38.623879 16355 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.601150 16260 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.624878 16110 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:38.614560 15342 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:38.627315 16262 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:03:38.597790 15340 rpcz_store.cc:269] 0709 13:03:37.079366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.085397 (+  6031us) service_pool.cc:224] Handling call
0709 13:03:38.508694 (+1423297us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400059e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:38.508839 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562586880}
I20260709 13:03:38.627377 16322 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:38.594764 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:38.608309 16103 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:38.597892 16270 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.628801 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.629084 16191 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:38.629484 15197 raft_consensus.cc:2368] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:38.630370 16350 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.522306 15091 rpcz_store.cc:276] 0709 13:03:35.117866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.118033 (+   167us) service_pool.cc:224] Handling call
0709 13:03:38.513794 (+3395761us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:35.382403 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:35.458615 (+ 76212us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:35.458646 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:03:35.458668 (+    22us) tablet.cc:662] Decoding operations
0709 13:03:35.461792 (+  3124us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:35.461841 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:35.461867 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:35.513274 (+ 51407us) tablet.cc:701] Row locks acquired
0709 13:03:35.514768 (+  1494us) write_op.cc:260] PREPARE: finished
0709 13:03:35.529961 (+ 15193us) write_op.cc:270] Start()
0709 13:03:35.539384 (+  9423us) write_op.cc:276] Timestamp: P: 1783602215522737 usec, L: 0
0709 13:03:35.553990 (+ 14606us) op_driver.cc:348] REPLICATION: starting
0709 13:03:35.784646 (+230656us) log.cc:844] Serialized 1307 byte log entry
0709 13:03:36.153620 (+368974us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5708e28 00007f36e9143581 00007f36e9142d58 00007f36e91479f1 00007f36e91479a9 00007f36e9147939 00007f36e9147901 00007f36e9146b2d 000000000038f354 000000000038f199
0709 13:03:36.161050 (+  7430us) op_driver.cc:464] REPLICATION: finished
0709 13:03:36.378060 (+217010us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b1800325300. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:03:36.689870 (+311810us) write_op.cc:301] APPLY: starting
0709 13:03:36.697010 (+  7140us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:36.715753 (+ 18743us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:36.718016 (+  2263us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:36.863357 (+145341us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:36.900103 (+ 36746us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:03:36.924554 (+ 24451us) write_op.cc:312] APPLY: finished
0709 13:03:36.957144 (+ 32590us) log.cc:844] Serialized 34 byte log entry
0709 13:03:36.965630 (+  8486us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:36.982726 (+ 17096us) write_op.cc:454] Released schema lock
0709 13:03:36.983769 (+  1043us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:37.010282 (+ 26513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.012004 (+  1722us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":141346,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":511448,"apply.run_cpu_time_us":3666,"apply.run_wall_time_us":314152,"num_ops":3,"prepare.queue_time_us":1414,"prepare.run_cpu_time_us":19067,"prepare.run_wall_time_us":822770,"replication_time_us":542150,"spinlock_wait_cycles":32594560,"thread_start_us":357428,"threads_started":1}]]}
I20260709 13:03:38.630764 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.632560 16360 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.632270 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:38.619398 16352 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.631848 16149 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.635228 16357 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:38.640309 16187 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.642729 16348 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:38.619453 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:38.601089 16108 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.628346 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.684810 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.646067 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:38.647310 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 243670us
I20260709 13:03:39.332012 15267 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.645078 16226 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:39.337221 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 717830us
W20260709 13:03:38.980561 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.723534 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.341148 16360 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:39.216447 16367 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:03:39.379518 15267 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:39.380589 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.093590 15871 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:03:39.382948 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.935626 16292 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:38.946482 16365 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:38.843498 16354 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:39.391616 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:38.928035 16359 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:39.352576 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:39.353214 16061 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.748s	user 0.008s	sys 0.001s
W20260709 13:03:39.172499 16353 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.011s	sys 0.016s
I20260709 13:03:38.927515 16110 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:38.651546 16260 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.354202 16103 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.365414 16350 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:39.361903 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.361990 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:38.632346 16128 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:39.354439 16114 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:39.362542 16262 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:38.611205 16344 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.752s
I20260709 13:03:38.646219 15842 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:39.368481 15343 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.763s	user 0.009s	sys 0.000s
W20260709 13:03:39.141607 16298 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.026s
W20260709 13:03:39.320545 16347 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.750s	user 0.009s	sys 0.001s
I20260709 13:03:39.381214 15267 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:39.344575 15188 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:39.314218 16183 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.985255 16355 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.386554 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.347505 16352 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.362535 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.348325 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:39.392436 15195 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:39.343924 16270 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:39.395330 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.368153 16108 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.395771 16061 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.383049 15871 pending_rounds.cc:85] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 2
I20260709 13:03:39.400462 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:39.337018 16310 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.380486 16332 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:39.407764 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 359193us
I20260709 13:03:39.425225 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.425930 15267 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:39.412392 15343 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:39.415100 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:39.392339 16354 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.415627 15271 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:39.417204 15268 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:39.393294 16292 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:39.421653 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 756) took 1008 ms. Trace:
I20260709 13:03:39.427291 15194 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:39.424798 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:39.436997 15195 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:03:39.426218 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:39.437265 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.437638 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 29) took 1048 ms. Trace:
I20260709 13:03:39.437915 15343 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:39.429183 16061 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.429791 16310 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.430222 16332 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.404564 16110 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.412895 16114 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.434103 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.438009 15195 rpcz_store.cc:276] 0709 13:03:38.389724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.424534 (+1034810us) service_pool.cc:224] Handling call
0709 13:03:39.437587 (+ 13053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.438784 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.415987 16353 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:39.438915 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:39.435588 15272 rpcz_store.cc:276] 0709 13:03:38.413372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.421221 (+  7849us) service_pool.cc:224] Handling call
0709 13:03:38.421503 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.472294 (+ 50791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.472352 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:38.485510 (+ 13158us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.575643 (+ 90133us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:38.575669 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.575715 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.421455 (+845740us) raft_consensus.cc:1685] finished
0709 13:03:39.421473 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.421594 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65757,"raft.queue_time_us":67834,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":2871,"thread_start_us":63332,"threads_started":1,"wal-append.queue_time_us":348352}
I20260709 13:03:39.451462 15338 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.399595 16359 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:39.420198 16357 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:39.394685 16365 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.440501 16310 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.453441 16226 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.513702 16332 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:39.512857 16149 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:39.441154 16108 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.434227 15871 pending_rounds.cc:107] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
W20260709 13:03:39.543511 16204 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.000s	user 0.006s	sys 0.005s
W20260709 13:03:39.421020 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 805522us
I20260709 13:03:39.485512 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.481900 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:39.480931 16369 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:03:39.547829 15263 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.048s	user 0.013s	sys 0.000s
I20260709 13:03:39.483151 16359 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:39.440515 16187 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:39.422024 16355 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.521311 16061 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.523770 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:39.547696 16350 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:39.432464 16352 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.525861 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.561481 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:39.434654 15189 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:39.421512 16183 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.418394 16347 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:39.576260 15266 raft_consensus.cc:2368] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:39.576756 16347 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.455834 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.577692 15340 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:39.577896 16379 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:39.578265 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 771) took 1160 ms. Trace:
I20260709 13:03:39.578444 16379 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.526679 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:39.576785 16204 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.549813 16357 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.528739 16371 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:39.535799 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 846) took 1075 ms. Trace:
I20260709 13:03:39.536526 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.538048 15190 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:39.570840 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 861) took 1012 ms. Trace:
I20260709 13:03:39.582696 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 841) took 1558 ms. Trace:
I20260709 13:03:39.487597 15195 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:39.583720 16359 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:39.584151 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 731) took 2093 ms. Trace:
I20260709 13:03:39.584285 16359 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.584525 15195 rpcz_store.cc:276] 0709 13:03:37.490614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.465897 (+1975283us) service_pool.cc:224] Handling call
0709 13:03:39.487210 (+ 21313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.583889 (+ 96679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.584096 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.586326 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 842) took 1561 ms. Trace:
I20260709 13:03:39.586084 16103 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.538419 16110 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.484794 15343 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:39.543083 16373 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.541776 16262 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.513283 16360 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.550752 16108 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.521708 16353 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.613094 15338 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:39.613701 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 784) took 1132 ms. Trace:
I20260709 13:03:39.614195 15338 rpcz_store.cc:276] 0709 13:03:38.480992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.431579 (+950587us) service_pool.cc:224] Handling call
0709 13:03:39.613647 (+182068us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:39.557564 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 221951us
I20260709 13:03:39.543972 16226 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.545725 15872 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:39.515051 16374 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:39.563737 16061 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:39.568435 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:39.634200 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65885.8us
I20260709 13:03:39.635241 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:39.636639 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:39.551344 15871 raft_consensus.cc:2917] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:03:39.571087 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 27) took 1357 ms. Trace:
I20260709 13:03:39.571166 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 835) took 2414 ms. Trace:
I20260709 13:03:39.571671 16344 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:39.572276 16355 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.572993 16183 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.578642 15340 rpcz_store.cc:276] 0709 13:03:38.417400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.432391 (+1014991us) service_pool.cc:224] Handling call
0709 13:03:39.578204 (+145813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.530432 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.581856 16357 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.587393 16365 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.586699 15195 rpcz_store.cc:276] 0709 13:03:38.024889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.585530 (+1560641us) service_pool.cc:224] Handling call
0709 13:03:39.585859 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.586028 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.586056 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.586099 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:39.586129 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.586181 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.586274 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.557870 15263 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:39.621671 15339 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:39.590440 16307 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.946s	user 0.011s	sys 0.000s
W20260709 13:03:39.627398 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77587.7us
I20260709 13:03:39.615466 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:39.570012 16370 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:03:39.582592 15189 rpcz_store.cc:276] 0709 13:03:38.557915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.760013 (+202098us) service_pool.cc:224] Handling call
0709 13:03:39.570766 (+810753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.632488 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.627607 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:39.628438 16373 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.653321 15265 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:39.630004 16110 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.642329 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:39.581521 15264 rpcz_store.cc:276] 0709 13:03:38.460291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.498679 (+ 38388us) service_pool.cc:224] Handling call
0709 13:03:39.535620 (+1036941us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b54004155d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.535738 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16353536}
I20260709 13:03:39.639642 15192 rpcz_store.cc:276] 0709 13:03:37.153068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.405147 (+252079us) service_pool.cc:224] Handling call
0709 13:03:37.421269 (+ 16122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.682510 (+261241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.567408 (+1884898us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54001f6dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:39.567556 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598856576}
I20260709 13:03:39.639587 15272 raft_consensus.cc:2376] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3. Re-sending same reply.
I20260709 13:03:39.593154 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:03:39.583467 16368 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:03:39.597282 16114 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.599884 16292 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:39.591523 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 732) took 2100 ms. Trace:
I20260709 13:03:39.583379 15190 rpcz_store.cc:276] 0709 13:03:38.024516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.537385 (+1512869us) service_pool.cc:224] Handling call
0709 13:03:39.537703 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.582383 (+ 44680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.582626 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.628206 16226 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.586858 16359 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:39.705497 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 223678us
I20260709 13:03:39.643311 16360 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:39.706794 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 746) took 1094 ms. Trace:
I20260709 13:03:39.713876 15195 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:39.715488 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 73268.9us
I20260709 13:03:39.715102 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:39.750876 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:39.752439 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:39.721457 15267 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:39.674538 15871 raft_consensus.cc:2889] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:39.744714 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 849) took 1617 ms. Trace:
I20260709 13:03:39.716892 16365 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.746218 16377 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.760205 16377 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.760692 16377 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.758687 16359 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.765440 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.766502 15268 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:39.772207 16318 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.772727 16318 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:39.712694 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 97316.5us
I20260709 13:03:39.767019 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 843) took 1340 ms. Trace:
I20260709 13:03:39.775111 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:39.758839 16285 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEARNER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.595286 16260 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.709321 16103 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.643605 16371 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.665906 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.665151 16378 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:39.748976 15338 rpcz_store.cc:276] 0709 13:03:38.612265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.615794 (+1003529us) service_pool.cc:224] Handling call
0709 13:03:39.706737 (+ 90943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.754127 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:39.713495 16307 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
I20260709 13:03:39.638789 16374 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:39.754467 15192 rpcz_store.cc:276] 0709 13:03:38.127408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.714498 (+1587090us) service_pool.cc:224] Handling call
0709 13:03:39.744049 (+ 29551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.744294 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.744334 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.744389 (+    55us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:39.744432 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.744504 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.744648 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.744480 15188 rpcz_store.cc:276] 0709 13:03:37.490815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.525106 (+2034291us) service_pool.cc:224] Handling call
0709 13:03:39.553378 (+ 28272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.561445 (+  8067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.564243 (+  2798us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.570322 (+  6079us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:39.591277 (+ 20955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.591359 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.591469 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.755811 15238 leader_election.cc:400] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:39.758258 16382 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.746735 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 729) took 2256 ms. Trace:
W20260709 13:03:39.743954 15263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 758) took 1294 ms (client timeout 1507 ms). Trace:
I20260709 13:03:39.784744 16359 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:03:39.643251 15337 rpcz_store.cc:276] 0709 13:03:38.213950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.215625 (+  1675us) service_pool.cc:224] Handling call
0709 13:03:38.359381 (+143756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.383336 (+ 23955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.385508 (+  2172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.399070 (+ 13562us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.407755 (+  8685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.570831 (+1163076us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54003df254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:39.570882 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.571008 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26226944}
I20260709 13:03:39.793907 16353 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.794327 16359 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:39.794860 15345 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:39.795434 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.795845 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 780) took 1316 ms. Trace:
I20260709 13:03:39.759332 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 844) took 1733 ms. Trace:
I20260709 13:03:39.796059 16260 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:39.784237 16371 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.710733 16110 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.796527 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.796875 16371 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.796916 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 772) took 1379 ms. Trace:
I20260709 13:03:39.797142 16110 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.793263 16374 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.798197 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 847) took 1334 ms. Trace:
I20260709 13:03:39.796403 15195 rpcz_store.cc:276] 0709 13:03:38.025437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.713177 (+1687740us) service_pool.cc:224] Handling call
0709 13:03:39.713506 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.750240 (+ 36734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.759279 (+  9039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.709736 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 794) took 1095 ms. Trace:
I20260709 13:03:39.796236 15345 rpcz_store.cc:276] 0709 13:03:38.479898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.605929 (+126031us) service_pool.cc:224] Handling call
0709 13:03:39.795702 (+1189773us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400174dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.795793 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720190848}
I20260709 13:03:39.796151 15267 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:39.800668 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.801226 15345 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:39.801630 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 751) took 1089 ms. Trace:
I20260709 13:03:39.801916 15345 rpcz_store.cc:276] 0709 13:03:38.712011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.800452 (+1088441us) service_pool.cc:224] Handling call
0709 13:03:39.801582 (+  1130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.798548 15266 rpcz_store.cc:276] 0709 13:03:38.463468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.562277 (+ 98809us) service_pool.cc:224] Handling call
0709 13:03:39.798003 (+1235726us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000d7d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.798122 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2329571200}
I20260709 13:03:39.797490 15340 rpcz_store.cc:276] 0709 13:03:38.417649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.665523 (+1247874us) service_pool.cc:224] Handling call
0709 13:03:39.796857 (+131334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.802887 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.803295 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.803475 15266 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:39.794716 16359 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:39.803999 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 760) took 1381 ms. Trace:
I20260709 13:03:39.804128 15340 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:39.802747 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.650352 16204 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:03:39.639627 16262 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:39.819968 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 788) took 1337 ms. Trace:
I20260709 13:03:39.777323 15312 leader_election.cc:400] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:39.773412 16309 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:03:39.774914 15268 rpcz_store.cc:276] 0709 13:03:38.426588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.765079 (+1338491us) service_pool.cc:224] Handling call
0709 13:03:39.766948 (+  1869us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.786396 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:39.828883 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:39.759057 16292 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.748859 16360 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:39.788959 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:39.754307 16108 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.831866 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:39.792248 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:39.791224 16376 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.758965 15871 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 64) took 1266 ms. Trace:
I20260709 13:03:39.794684 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.806007 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.805481 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.804318 15266 rpcz_store.cc:276] 0709 13:03:38.422491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.802687 (+1380196us) service_pool.cc:224] Handling call
0709 13:03:39.803948 (+  1261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.773797 16114 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:39.793241 15193 rpcz_store.cc:276] 0709 13:03:37.490318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.778780 (+288462us) service_pool.cc:224] Handling call
0709 13:03:39.746469 (+1967689us) spinlock_profiling.cc:243] Waited 93 ms on lock 0x7b54001e69d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.746660 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213797632}
I20260709 13:03:39.804613 16359 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.792045 16378 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:39.793267 16382 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:39.799764 16322 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.814355 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.843513 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 763) took 1448 ms. Trace:
I20260709 13:03:39.814564 15196 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:39.787655 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.797489 15346 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:39.651806 16379 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.840950 15337 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.841137 16322 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:39.859463 16322 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.859375 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.860196 15346 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:39.860975 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.835192 15871 rpcz_store.cc:276] 0709 13:03:38.494159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.499144 (+  4985us) service_pool.cc:224] Handling call
0709 13:03:38.499526 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.758680 (+1259154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.758891 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.861649 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 781) took 1381 ms. Trace:
I20260709 13:03:39.820426 15345 rpcz_store.cc:276] 0709 13:03:38.482058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.802540 (+1320482us) service_pool.cc:224] Handling call
0709 13:03:39.819906 (+ 17366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.835222 16262 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.863106 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.858707 15264 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:39.863849 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 789) took 1381 ms. Trace:
I20260709 13:03:39.823140 15312 leader_election.cc:403] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:39.823957 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:39.864369 15193 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:39.825589 16310 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.826262 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 870) took 1261 ms. Trace:
I20260709 13:03:39.825117 15269 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:03:39.793422 15263 rpcz_store.cc:269] 0709 13:03:38.421904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.497241 (+ 75337us) service_pool.cc:224] Handling call
0709 13:03:39.714559 (+1217318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.754766 16344 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:39.833148 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44233.2us
I20260709 13:03:39.833881 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:39.804662 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 766) took 1388 ms. Trace:
I20260709 13:03:39.834872 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:39.835768 15338 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:39.880241 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:39.880576 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 748) took 1262 ms. Trace:
W20260709 13:03:39.880635 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45851.1us
I20260709 13:03:39.881083 15338 rpcz_store.cc:276] 0709 13:03:38.618527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.791377 (+1172850us) service_pool.cc:224] Handling call
0709 13:03:39.880502 (+ 89125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.806005 16354 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:39.832433 16360 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:39.886318 16332 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:39.887365 16373 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.887409 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.888396 15263 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:39.889535 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.832772 16317 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:39.891199 16317 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:39.891364 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.891920 15344 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:39.892028 16317 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:39.892725 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.893136 16317 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.893442 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:39.836520 16114 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.896669 16382 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:39.897347 16262 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.897537 16114 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.837419 16359 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.897921 16262 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.898442 16262 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.831151 16292 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:39.899286 16292 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.834250 16187 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:39.908871 15265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 751) took 1501 ms (client timeout 1902 ms). Trace:
I20260709 13:03:39.909896 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 868) took 1350 ms. Trace:
I20260709 13:03:39.836480 16256 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.912953 16256 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:39.913060 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.913442 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.913817 15272 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
W20260709 13:03:39.914021 16385 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:39.914186 15267 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.914602 15872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58398 (request call id 91) took 1778 ms. Trace:
I20260709 13:03:39.833606 16260 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.835590 16309 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:03:39.864768 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 87622.1us
I20260709 13:03:39.864171 15345 rpcz_store.cc:276] 0709 13:03:38.482326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.862875 (+1380549us) service_pool.cc:224] Handling call
0709 13:03:39.863790 (+   915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.869349 15192 rpcz_store.cc:276] 0709 13:03:38.565221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.825492 (+1260271us) service_pool.cc:224] Handling call
0709 13:03:39.825801 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.825968 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.825992 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.826030 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:39.826058 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.826109 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.826208 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.872635 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.862023 15346 rpcz_store.cc:276] 0709 13:03:38.480207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.860726 (+1380519us) service_pool.cc:224] Handling call
0709 13:03:39.861601 (+   875us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.864611 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.881754 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:39.882346 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:39.914052 16187 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:39.939261 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 57578.5us
I20260709 13:03:39.939864 15192 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:39.940003 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:39.881623 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 872) took 1271 ms. Trace:
I20260709 13:03:39.944572 15267 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:39.883589 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 27) took 1504 ms. Trace:
I20260709 13:03:39.885916 15160 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:39.945943 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60091.9us
I20260709 13:03:39.886400 16381 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:39.855465 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 855) took 1229 ms. Trace:
I20260709 13:03:39.908473 16378 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.915020 15872 rpcz_store.cc:276] 0709 13:03:38.135881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.137840 (+  1959us) service_pool.cc:224] Handling call
0709 13:03:39.914402 (+1776562us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54005e1ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.914517 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2768998144}
I20260709 13:03:39.844003 15339 rpcz_store.cc:276] 0709 13:03:38.395219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.407968 (+ 12749us) service_pool.cc:224] Handling call
0709 13:03:38.408235 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.711066 (+1302831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.843197 (+132131us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003ab6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:39.843437 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790093184}
I20260709 13:03:39.890277 15263 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
W20260709 13:03:39.909618 15265 rpcz_store.cc:269] 0709 13:03:38.407308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.415871 (+  8563us) service_pool.cc:224] Handling call
0709 13:03:39.536386 (+1120515us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:03:39.908619 (+372233us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b54003287d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.908779 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146369664}
I20260709 13:03:39.913584 16256 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.914830 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:39.858249 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 871) took 1283 ms. Trace:
I20260709 13:03:39.918727 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 843) took 1893 ms. Trace:
I20260709 13:03:39.946173 16114 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.930035 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:39.932885 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 857) took 1376 ms. Trace:
I20260709 13:03:39.946532 16128 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:39.933383 16061 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:39.935716 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.978616 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 786) took 1497 ms. Trace:
I20260709 13:03:39.936007 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:39.978976 15338 rpcz_store.cc:276] 0709 13:03:38.481550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.882061 (+1400511us) service_pool.cc:224] Handling call
0709 13:03:39.978563 (+ 96502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.975512 16381 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:39.979578 15312 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:39.950517 16382 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:39.940965 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 58724.4us
I20260709 13:03:39.941010 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:39.880232 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46421.4us
I20260709 13:03:39.983871 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:39.976179 15197 rpcz_store.cc:276] 0709 13:03:38.025167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.600867 (+1575700us) service_pool.cc:224] Handling call
0709 13:03:39.601302 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.601686 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.601733 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.627991 (+ 26258us) log.cc:844] Serialized 26 byte log entry
0709 13:03:39.779160 (+151169us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:39.779219 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.779311 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.918450 (+139139us) raft_consensus.cc:1685] finished
0709 13:03:39.918477 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.918653 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51670,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":36362,"thread_start_us":134978,"threads_started":1,"wal-append.queue_time_us":181350}
I20260709 13:03:39.978386 15196 rpcz_store.cc:276] 0709 13:03:38.556804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.631964 (+ 75160us) service_pool.cc:224] Handling call
0709 13:03:39.932732 (+1300768us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54001e82d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.932833 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059226368}
I20260709 13:03:39.942698 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.800094 15341 rpcz_store.cc:276] 0709 13:03:38.614661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.524997 (+910336us) service_pool.cc:224] Handling call
0709 13:03:39.709672 (+184675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.943571 16149 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:39.909160 15337 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:39.863849 16377 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.949785 15192 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:39.880899 15340 rpcz_store.cc:276] 0709 13:03:38.416036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.802995 (+1386959us) service_pool.cc:224] Handling call
0709 13:03:39.804608 (+  1613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.949290 15271 rpcz_store.cc:276] 0709 13:03:38.625707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.684447 (+ 58740us) service_pool.cc:224] Handling call
0709 13:03:39.841841 (+1157394us) spinlock_profiling.cc:243] Waited 83.8 ms on lock 0x7b54001d83d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.855409 (+ 13568us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192815872}
I20260709 13:03:39.951429 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.993780 15345 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:39.994225 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 747) took 1380 ms. Trace:
I20260709 13:03:39.994606 15345 rpcz_store.cc:276] 0709 13:03:38.614088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.931637 (+1317549us) service_pool.cc:224] Handling call
0709 13:03:39.994166 (+ 62529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.948752 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:39.995703 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47052.2us
I20260709 13:03:39.952845 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.996711 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 753) took 1270 ms. Trace:
I20260709 13:03:39.997022 15339 rpcz_store.cc:276] 0709 13:03:38.726716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.952607 (+1225891us) service_pool.cc:224] Handling call
0709 13:03:39.996652 (+ 44045us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.953131 16378 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:39.953400 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.998106 15267 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:39.953824 16318 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:39.956943 16322 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.959741 16262 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.961848 16360 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:39.962728 15342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 790) took 1480 ms (client timeout 1549 ms). Trace:
I20260709 13:03:39.945524 16187 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:39.910447 15188 rpcz_store.cc:276] 0709 13:03:38.559916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.820618 (+1260702us) service_pool.cc:224] Handling call
0709 13:03:39.868293 (+ 47675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.880868 (+ 12575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.902278 (+ 21410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.909607 (+  7329us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:39.909648 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.909715 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.909832 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.946005 15264 raft_consensus.cc:2376] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3. Re-sending same reply.
I20260709 13:03:39.944737 15193 rpcz_store.cc:276] 0709 13:03:38.608648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.863758 (+1255110us) service_pool.cc:224] Handling call
0709 13:03:39.864129 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.864842 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.879765 (+ 14923us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.967422 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:40.027756 16349 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:40.028044 15270 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.027768 15872 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEARNER]: Advancing to term 3
I20260709 13:03:40.029603 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.030202 15271 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:39.874389 16376 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:03:40.003171 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 785) took 1522 ms. Trace:
I20260709 13:03:39.945604 15190 rpcz_store.cc:276] 0709 13:03:38.379223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.771127 (+1391904us) service_pool.cc:224] Handling call
0709 13:03:39.771619 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.771903 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:39.823571 (+ 51668us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.879840 (+ 56269us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.883264 (+  3424us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.883311 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.883408 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.883529 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143693,"raft.queue_time_us":98,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":31960,"spinlock_wait_cycles":42321152,"thread_start_us":95053,"threads_started":2,"wal-append.queue_time_us":59778}
I20260709 13:03:40.014990 16373 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:40.008632 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 1.43999e+06us
I20260709 13:03:40.004429 16381 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.009966 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:39.940069 16309 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:39.927747 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 792) took 1444 ms. Trace:
I20260709 13:03:39.976125 15194 rpcz_store.cc:276] 0709 13:03:38.575188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.856654 (+1281466us) service_pool.cc:224] Handling call
0709 13:03:39.857768 (+  1114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.857937 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.857960 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.857998 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:39.858033 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.858081 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.858197 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.937139 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 869) took 1377 ms. Trace:
I20260709 13:03:39.981896 15266 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:40.000243 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.001636 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.002516 16061 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:40.002933 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:39.980366 16114 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.006045 16395 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:39.982177 16382 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.984632 16260 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.985090 16375 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.999214 16191 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:39.992906 16149 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:40.023473 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 169) took 4901 ms. Trace:
I20260709 13:03:40.002104 16387 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.016937 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46344
I20260709 13:03:40.026616 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.002247 16378 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.021962 15345 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:40.036700 15270 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.032893 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.004472 16332 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:40.036830 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:40.045164 15092 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.114395 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.003928 16361 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.036525 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:40.141695 15272 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:40.142789 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:40.142822 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 146544us
W20260709 13:03:40.143239 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 143085us
I20260709 13:03:40.123679 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:40.141995 15092 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.143915 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.031006 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.144663 15270 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.145010 15271 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.146082 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.146291 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 764) took 1731 ms. Trace:
I20260709 13:03:40.147373 15192 raft_consensus.cc:606] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:40.147842 15192 raft_consensus.cc:614] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:40.101143 15343 rpcz_store.cc:276] 0709 13:03:38.483174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.438623 (+955449us) service_pool.cc:224] Handling call
0709 13:03:39.927469 (+488846us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b5400173ed4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.927664 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75609984}
I20260709 13:03:40.146682 15338 rpcz_store.cc:276] 0709 13:03:38.415419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.984219 (+1568800us) service_pool.cc:224] Handling call
0709 13:03:40.146234 (+162015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.150275 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.143496 15266 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.151046 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:40.047300 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:40.101904 15093 rpcz_store.cc:276] 0709 13:03:35.122384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.122525 (+   141us) service_pool.cc:224] Handling call
0709 13:03:40.023351 (+4900826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:36.378499 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:36.379211 (+   712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:36.379256 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:03:36.379282 (+    26us) tablet.cc:662] Decoding operations
0709 13:03:36.379946 (+   664us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:36.379994 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:36.380018 (+    24us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:03:36.380528 (+   510us) tablet.cc:701] Row locks acquired
0709 13:03:36.380546 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:36.380676 (+   130us) write_op.cc:270] Start()
0709 13:03:36.380785 (+   109us) write_op.cc:276] Timestamp: P: 1783602216380636 usec, L: 0
0709 13:03:36.380805 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:03:36.657017 (+276212us) log.cc:844] Serialized 2135 byte log entry
0709 13:03:37.004250 (+347233us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5708e28 00007f36e9143581 00007f36e9142d58 00007f36e91479f1 00007f36e91479a9 00007f36e9147939 00007f36e9147901 00007f36e9146b2d 000000000038f354 000000000038f199
0709 13:03:37.085529 (+ 81279us) op_driver.cc:464] REPLICATION: finished
0709 13:03:37.093274 (+  7745us) write_op.cc:301] APPLY: starting
0709 13:03:37.093345 (+    71us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:37.093501 (+   156us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:37.093530 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:37.094266 (+   736us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:37.094452 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:03:37.094514 (+    62us) write_op.cc:312] APPLY: finished
0709 13:03:37.094746 (+   232us) log.cc:844] Serialized 46 byte log entry
0709 13:03:37.094903 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.095002 (+    99us) write_op.cc:454] Released schema lock
0709 13:03:37.095075 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:37.095433 (+   358us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.095463 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1418163,"reported_tablets":5,"spinlock_wait_cycles":1406208,"child_traces":[["op",{"apply.queue_time_us":268,"apply.run_cpu_time_us":2098,"apply.run_wall_time_us":2098,"num_ops":5,"prepare.queue_time_us":230204,"prepare.run_cpu_time_us":7907,"prepare.run_wall_time_us":627633,"replication_time_us":692928,"spinlock_wait_cycles":470339456}]]}
I20260709 13:03:40.146652 15271 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.101887 15191 rpcz_store.cc:276] 0709 13:03:38.560374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.932843 (+1372469us) service_pool.cc:224] Handling call
0709 13:03:39.936674 (+  3831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.936842 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.936867 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.936905 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:39.936933 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.936984 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.937086 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:40.008826 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 184935us
I20260709 13:03:40.155725 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:40.156526 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 131451us
I20260709 13:03:40.157591 15270 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.010115 16226 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.169720 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.044607 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:40.035148 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:40.172755 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:40.175648 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:40.151764 16114 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.142026 16332 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:40.170807 16315 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.170293 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.048365 16128 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:03:40.158946 16379 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:40.173488 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 232526us
I20260709 13:03:40.124301 15872 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:03:40.121412 16260 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.176218 15271 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.148046 16361 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.151829 16149 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:40.010835 15342 rpcz_store.cc:269] 0709 13:03:38.482595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.506225 (+ 23630us) service_pool.cc:224] Handling call
0709 13:03:39.947766 (+1441541us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b5400096ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:39.951442 (+  3676us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78831360}
I20260709 13:03:40.124557 16285 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:40.145910 16183 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.141618 16378 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.154520 16103 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.181490 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.127182 15264 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:40.181957 15266 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.151754 16318 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.037060 15265 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:40.171871 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:40.196784 16260 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.033316 16373 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.122583 16382 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.168744 16354 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.219446 15874 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:40.219667 16354 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:40.220100 16354 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.220220 16262 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.187366 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.222155 15343 raft_consensus.cc:2368] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
I20260709 13:03:40.189715 15309 leader_election.cc:400] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:40.031198 15337 rpcz_store.cc:276] 0709 13:03:38.481251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.794388 (+1313137us) service_pool.cc:224] Handling call
0709 13:03:39.997973 (+203585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.122746 16375 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:40.121686 16395 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:40.197113 15344 raft_consensus.cc:2410] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:40.196259 15195 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.182413 15341 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:40.176141 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 25) took 1983 ms. Trace:
W20260709 13:03:40.169226 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 122845us
I20260709 13:03:40.079380 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:40.199162 16361 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.194794 15872 pending_rounds.cc:85] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 2
I20260709 13:03:40.205595 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:40.219550 16377 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.243984 15267 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.182691 16310 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.184082 16332 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.151882 16110 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.181628 16307 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.155072 16374 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.211268 15271 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.213126 16285 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:40.184654 15876 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:40.243723 15872 pending_rounds.cc:107] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:03:40.215613 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:40.239176 16375 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.227609 15309 leader_election.cc:403] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.208817 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 755) took 1786 ms. Trace:
I20260709 13:03:40.213359 16183 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:40.195910 16398 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:03:40.221678 16360 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.211849 16359 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:40.217374 16103 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.255527 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 833) took 1831 ms. Trace:
I20260709 13:03:40.188350 16379 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:40.309713 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.261178 15272 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:40.310384 15343 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.310787 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 832) took 1887 ms. Trace:
I20260709 13:03:40.311311 15272 rpcz_store.cc:276] 0709 13:03:38.423603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.246248 (+1822645us) service_pool.cc:224] Handling call
0709 13:03:40.260766 (+ 14518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.310438 (+ 49672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.310715 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.262794 16322 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.216020 15270 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.215673 16309 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.269556 15266 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:40.297912 15263 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:40.208364 16344 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.239508 16395 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.234225 16262 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:03:40.294719 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46344 (request call id 64) took 1876 ms. Trace:
I20260709 13:03:40.321144 15192 rpcz_store.cc:276] 0709 13:03:38.389796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.993174 (+1603378us) service_pool.cc:224] Handling call
0709 13:03:40.266460 (+273286us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b540032c154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5707853 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691 00007f36e3c5b60c 00007f36e3c5a8c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:40.266592 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107162368}
I20260709 13:03:40.303987 15271 rpcz_store.cc:276] 0709 13:03:38.423837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.254566 (+1830729us) service_pool.cc:224] Handling call
0709 13:03:40.254864 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.255109 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.255147 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.255203 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.255248 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.255320 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.255459 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:40.305234 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 115691us
I20260709 13:03:40.259649 16307 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:40.289541 15267 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.267006 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.269366 15872 raft_consensus.cc:2889] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.306493 16377 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.296900 16381 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.299453 16183 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.269084 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.269029 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 769) took 1849 ms. Trace:
I20260709 13:03:40.323734 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:40.309762 16379 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.275925 15839 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:40.307699 15871 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:40.333889 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:40.334316 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.335181 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 793) took 1851 ms. Trace:
I20260709 13:03:40.335445 15263 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.336912 15270 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.338261 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.339201 15266 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:03:40.409471 15266 pending_rounds.cc:85] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 2
I20260709 13:03:40.409732 15266 pending_rounds.cc:107] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:03:40.410005 15266 raft_consensus.cc:2917] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:03:40.340453 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 773) took 1922 ms. Trace:
I20260709 13:03:40.341303 15162 leader_election.cc:400] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
I20260709 13:03:40.457796 15162 leader_election.cc:403] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.456192 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 749) took 1806 ms. Trace:
W20260709 13:03:40.458283 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 117126us
I20260709 13:03:40.341650 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 844) took 1910 ms. Trace:
I20260709 13:03:40.341773 16382 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.342478 16191 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:40.322705 16307 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.458614 15346 rpcz_store.cc:276] 0709 13:03:38.649919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.952590 (+1302671us) service_pool.cc:224] Handling call
0709 13:03:40.338100 (+385510us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:03:40.455606 (+117506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3131776}
I20260709 13:03:40.459303 15268 rpcz_store.cc:276] 0709 13:03:38.430944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.937474 (+1506530us) service_pool.cc:224] Handling call
0709 13:03:40.337661 (+400187us) spinlock_profiling.cc:243] Waited 61.7 ms on lock 0x7b54002a85d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:40.341593 (+  3932us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141816704}
I20260709 13:03:40.348042 16374 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.348253 16110 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.351781 15343 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.354080 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 858) took 1797 ms. Trace:
I20260709 13:03:40.463428 15195 rpcz_store.cc:276] 0709 13:03:38.557127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.804953 (+1247826us) service_pool.cc:224] Handling call
0709 13:03:39.805249 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.239638 (+434389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.353907 (+114269us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54003e67d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:40.354035 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":898820992}
I20260709 13:03:40.357878 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 837) took 1933 ms. Trace:
I20260709 13:03:40.294924 16397 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:40.361495 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 834) took 1937 ms. Trace:
I20260709 13:03:40.362470 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 838) took 1937 ms. Trace:
I20260709 13:03:40.468334 15272 rpcz_store.cc:276] 0709 13:03:38.424067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.329626 (+1905559us) service_pool.cc:224] Handling call
0709 13:03:40.361046 (+ 31420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.361194 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.361232 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.361272 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.361301 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.361347 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.361443 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.469149 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 774) took 2051 ms. Trace:
W20260709 13:03:40.371312 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.469688 15343 rpcz_store.cc:276] 0709 13:03:38.418148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.468335 (+2050187us) service_pool.cc:224] Handling call
0709 13:03:40.468663 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.468838 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.468868 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.468909 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.468941 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.468994 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.469096 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.354545 16381 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.346909 16354 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:40.492358 16375 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.407135 15338 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:40.406148 15344 rpcz_store.cc:276] 0709 13:03:38.483483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.892513 (+1409030us) service_pool.cc:224] Handling call
0709 13:03:40.334979 (+442466us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400272ed4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:40.335124 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698247424}
I20260709 13:03:40.494566 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 776) took 2075 ms. Trace:
W20260709 13:03:40.410632 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 151297us
I20260709 13:03:40.494979 15338 rpcz_store.cc:276] 0709 13:03:38.418673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.493753 (+2075080us) service_pool.cc:224] Handling call
0709 13:03:40.494078 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.494248 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.494279 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.494321 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:40.494354 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.494409 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.494512 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.496306 15338 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.456537 15266 raft_consensus.cc:2889] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:40.460276 16392 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:40.496891 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 778) took 2063 ms. Trace:
I20260709 13:03:40.497231 15338 rpcz_store.cc:276] 0709 13:03:38.433903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.495895 (+2061992us) service_pool.cc:224] Handling call
0709 13:03:40.496146 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.496649 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.496829 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.498598 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 782) took 2018 ms. Trace:
I20260709 13:03:40.458822 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:40.344143 16373 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.322854 16344 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.360338 16226 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.464860 15271 rpcz_store.cc:276] 0709 13:03:38.424815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.357240 (+1932425us) service_pool.cc:224] Handling call
0709 13:03:40.357477 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.357678 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.357693 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.357721 (+    28us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.357738 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.357770 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.357839 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.460608 15337 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:40.407608 16402 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.361819 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:40.407624 15093 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 2 to 3, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:40.472157 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.504470 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 845) took 2072 ms. Trace:
I20260709 13:03:40.504758 15346 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:40.504901 15268 rpcz_store.cc:276] 0709 13:03:38.431822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.473878 (+2042056us) service_pool.cc:224] Handling call
0709 13:03:40.503954 (+ 30076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.504143 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.504169 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.504210 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.504240 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.504300 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.504412 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.474172 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 765) took 2058 ms. Trace:
W20260709 13:03:40.506554 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 144833us
I20260709 13:03:40.506455 15345 rpcz_store.cc:276] 0709 13:03:38.415760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.003728 (+1587968us) service_pool.cc:224] Handling call
0709 13:03:40.021589 (+ 17861us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.021847 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:40.197149 (+175302us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.473855 (+276706us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.473916 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.473961 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.474019 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.474123 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2502,"raft.queue_time_us":3531,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":272964,"threads_started":1}
I20260709 13:03:40.507966 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:40.468722 15267 rpcz_store.cc:276] 0709 13:03:38.425068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.361817 (+1936749us) service_pool.cc:224] Handling call
0709 13:03:40.362059 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.362196 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.362220 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.362254 (+    34us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.362280 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.362326 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.362421 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.359961 16103 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.457610 15342 rpcz_store.cc:276] 0709 13:03:38.417903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.339696 (+1921793us) service_pool.cc:224] Handling call
0709 13:03:40.339974 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.340143 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.340168 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.340208 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.340241 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.340294 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.340389 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.480754 16285 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.482069 16262 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.484694 16149 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:40.485973 16292 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.001s
I20260709 13:03:40.303967 15269 rpcz_store.cc:276] 0709 13:03:38.412491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.416365 (+  3874us) service_pool.cc:224] Handling call
0709 13:03:39.824414 (+1408049us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:39.824678 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.824973 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:39.952858 (+127885us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.176559 (+223701us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.180884 (+  4325us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.185169 (+  4285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.194109 (+  8940us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.198724 (+  4615us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4956,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":5895424,"thread_start_us":202918,"threads_started":1,"wal-append.queue_time_us":355628}
I20260709 13:03:40.241410 15189 rpcz_store.cc:276] 0709 13:03:38.192917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.743578 (+1550661us) service_pool.cc:224] Handling call
0709 13:03:39.776140 (+ 32562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.788218 (+ 12078us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:39.912422 (+124204us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.110392 (+197970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.122295 (+ 11903us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:40.147881 (+ 25586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.154788 (+  6907us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.173597 (+ 18809us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4818,"prepare.queue_time_us":130885,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":36630,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":32575,"thread_start_us":130171,"threads_started":2,"wal-append.queue_time_us":93698}
I20260709 13:03:40.488706 16114 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:40.492980 16354 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:40.464264 16315 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.360659 15341 rpcz_store.cc:276] 0709 13:03:38.416831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.004314 (+1587483us) service_pool.cc:224] Handling call
0709 13:03:40.152511 (+148197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.241317 (+ 88806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.266592 (+ 25275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.500711 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:40.553900 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53247.6us
I20260709 13:03:40.554884 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:40.527915 16310 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.502244 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 836) took 2077 ms. Trace:
I20260709 13:03:40.559463 15266 rpcz_store.cc:276] 0709 13:03:38.424563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.338593 (+1914030us) service_pool.cc:224] Handling call
0709 13:03:40.338885 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.502035 (+163150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.502193 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.560206 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 30) took 2045 ms. Trace:
I20260709 13:03:40.560578 15346 rpcz_store.cc:276] 0709 13:03:38.514889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.537442 (+2022553us) service_pool.cc:224] Handling call
0709 13:03:40.559765 (+ 22323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.559929 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.559952 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.559990 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:40.560017 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.560064 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.560161 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.561220 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:40.478014 16260 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.468178 16397 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:40.531970 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 757) took 2118 ms. Trace:
I20260709 13:03:40.532197 16359 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.527626 15093 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 3 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.474759 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 835) took 2048 ms. Trace:
I20260709 13:03:40.535554 15271 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.536859 15267 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:40.563473 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 856) took 1937 ms. Trace:
I20260709 13:03:40.563951 15267 rpcz_store.cc:276] 0709 13:03:38.625986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.509385 (+1883399us) service_pool.cc:224] Handling call
0709 13:03:40.536557 (+ 27172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.563153 (+ 26596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.563403 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.565586 16354 raft_consensus.cc:1064] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:03:40.565987 16354 raft_consensus.cc:1068] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:03:40.566238 16371 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.769s	user 0.009s	sys 0.000s
I20260709 13:03:40.566612 16371 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.567523 16317 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.568928 16387 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.568977 15263 rpcz_store.cc:276] 0709 13:03:38.424308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.334901 (+1910593us) service_pool.cc:224] Handling call
0709 13:03:40.335243 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.429363 (+ 94120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.472506 (+ 43143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.560357 16374 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.571615 16379 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.573737 16379 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:40.549090 16394 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:03:40.574931 16401 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.166s	user 0.014s	sys 0.000s
I20260709 13:03:40.538758 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 857) took 1912 ms. Trace:
I20260709 13:03:40.569440 16387 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.575960 16387 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.575685 15272 rpcz_store.cc:276] 0709 13:03:38.626229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.524691 (+1898462us) service_pool.cc:224] Handling call
0709 13:03:40.538183 (+ 13492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.538345 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.538384 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.538440 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.538483 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.538554 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.538690 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.544787 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:40.550401 16405 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:40.550825 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:40.552265 15339 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:40.552922 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:40.553102 16114 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.498912 15338 rpcz_store.cc:276] 0709 13:03:38.480473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.497898 (+2017425us) service_pool.cc:224] Handling call
0709 13:03:40.498136 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.498311 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.498344 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.498381 (+    37us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.498409 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.498456 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.498554 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:40.557008 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 406771us
I20260709 13:03:40.530071 16377 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:40.526747 16128 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:40.525683 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:40.557581 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 378253us
W20260709 13:03:40.580483 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.689322 16377 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.544154 16373 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:40.690804 16373 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.693086 16373 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.583251 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.588471 16374 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:40.696906 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 113764us
I20260709 13:03:40.697088 16374 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.697603 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.569593 15337 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:40.589231 16317 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:40.536880 16262 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:40.700852 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.592411 16395 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:40.593094 16149 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.593251 16375 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.700286 16317 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.594409 16381 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.596604 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 854) took 1971 ms. Trace:
I20260709 13:03:40.704046 15271 rpcz_store.cc:276] 0709 13:03:38.625409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.501835 (+1876426us) service_pool.cc:224] Handling call
0709 13:03:40.502078 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.562741 (+ 60663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.596380 (+ 33639us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b54003291d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:40.596544 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76033792}
I20260709 13:03:40.600118 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 797) took 1180 ms. Trace:
I20260709 13:03:40.602037 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 767) took 2185 ms. Trace:
I20260709 13:03:40.705503 15346 rpcz_store.cc:276] 0709 13:03:39.419603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.561517 (+1141914us) service_pool.cc:224] Handling call
0709 13:03:40.599447 (+ 37930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.599683 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.599736 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.599794 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.599842 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.599919 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.600046 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.558980 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 761) took 2136 ms. Trace:
I20260709 13:03:40.537020 16292 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.592597 16315 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
W20260709 13:03:40.616936 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91360.6us
I20260709 13:03:40.713200 16262 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.713867 15266 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:03:40.619493 16376 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:40.582733 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 111305us
I20260709 13:03:40.601352 16128 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:40.574352 16397 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.594496 16183 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.619530 16371 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.624080 16360 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:40.647523 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83991.4us
I20260709 13:03:40.650840 16260 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.644771 15269 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:40.644495 16256 consensus_meta.cc:287] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.659s	user 0.003s	sys 0.008s
I20260709 13:03:40.651449 16310 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.577924 15265 rpcz_store.cc:276] 0709 13:03:38.413671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.220889 (+1807218us) service_pool.cc:224] Handling call
0709 13:03:40.221190 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.221390 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:40.313696 (+ 92306us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.469724 (+156028us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.472711 (+  2987us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.479670 (+  6959us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b18002549e0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:03:40.497002 (+ 17332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.502309 (+  5307us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.527520 (+ 25211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":186719,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2262,"raft.queue_time_us":3059,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":88,"spinlock_wait_cycles":11811072,"thread_start_us":212422,"threads_started":2,"wal-append.queue_time_us":217279}
I20260709 13:03:40.657449 16378 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:40.658476 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 840) took 2232 ms. Trace:
I20260709 13:03:40.662019 16307 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:40.756228 16183 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.707311 15264 rpcz_store.cc:276] 0709 13:03:38.422738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.228794 (+1806056us) service_pool.cc:224] Handling call
0709 13:03:40.229194 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.229459 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:40.323846 (+ 94387us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.503798 (+179952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.525038 (+ 21240us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.531670 (+  6632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.540368 (+  8698us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.555259 (+ 14891us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":225433,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":1066,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":22417,"thread_start_us":251879,"threads_started":2,"wal-append.queue_time_us":248846}
I20260709 13:03:40.756556 16307 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:40.731715 16402 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:03:40.629501 16332 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.751940 16420 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:03:40.758539 16332 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.664176 16361 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.759217 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:40.760649 16361 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.658399 16387 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.760879 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.761483 16397 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.762323 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.762701 16387 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.680379 16344 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.718232 16359 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:03:40.685436 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 775) took 2267 ms. Trace:
I20260709 13:03:40.686282 16409 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:40.690325 16191 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:40.781361 16191 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:40.777724 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.782222 16191 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.782774 15341 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.784236 15875 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:40.702229 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.699460 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 745) took 2091 ms. Trace:
I20260709 13:03:40.705559 15339 rpcz_store.cc:276] 0709 13:03:38.416301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.004536 (+1588235us) service_pool.cc:224] Handling call
0709 13:03:40.004828 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.581091 (+576263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.601765 (+ 20674us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b540016d354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:40.601965 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258601344}
W20260709 13:03:40.785567 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83411us
I20260709 13:03:40.785794 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.562678 16110 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.704305 16317 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.699642 16309 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.701589 16318 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:40.699409 16377 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:03:40.707595 16415 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:40.710443 16395 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.721050 15195 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.723361 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.794317 15191 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.728456 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.795377 15196 raft_consensus.cc:2368] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:40.730952 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:40.738936 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.740515 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.748692 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.737061 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:40.717924 16376 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:40.751161 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.735021 16128 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.739483 15340 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.737190 16360 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.754508 16292 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.754623 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:40.763494 15345 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:40.753700 15270 rpcz_store.cc:276] 0709 13:03:38.425599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.428706 (+2003107us) service_pool.cc:224] Handling call
0709 13:03:40.463532 (+ 34826us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.466177 (+  2645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.466212 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.472316 (+  6104us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.559491 (+ 87175us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.581839 (+ 22348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.581900 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.658250 (+ 76350us) raft_consensus.cc:1685] finished
0709 13:03:40.658271 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.658416 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2281,"raft.queue_time_us":2706,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":74,"thread_start_us":57568,"threads_started":1,"wal-append.queue_time_us":136264}
I20260709 13:03:40.779526 15343 rpcz_store.cc:276] 0709 13:03:38.418412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.471123 (+2052711us) service_pool.cc:224] Handling call
0709 13:03:40.471884 (+   761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.472080 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:40.634114 (+162034us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.684822 (+ 50708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.685137 (+   315us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.685183 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.685245 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.685356 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":198993,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":92,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":171,"thread_start_us":193760,"threads_started":2,"wal-append.queue_time_us":75748}
I20260709 13:03:40.785468 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 29) took 1288 ms. Trace:
I20260709 13:03:40.590490 16382 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.786342 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:40.790805 15339 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:40.750439 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:40.758855 16420 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:40.781023 16409 raft_consensus.cc:1068] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:40.813717 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.822083 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.786955 16110 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.803470 16376 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.820779 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:40.827637 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 796) took 1408 ms. Trace:
I20260709 13:03:40.811080 16378 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.829779 15339 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:40.852311 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.852952 15194 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.792905 16318 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:40.753235 16256 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:40.831537 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 117219us
I20260709 13:03:40.831598 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.796023 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.836458 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.787705 15337 rpcz_store.cc:276] 0709 13:03:38.608093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.554887 (+1946794us) service_pool.cc:224] Handling call
0709 13:03:40.569266 (+ 14379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.699187 (+129921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.699403 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.837564 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:40.802367 15870 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:40.823050 16317 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.808144 16310 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.839851 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:40.801102 16191 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.833354 16420 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.862908 16256 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.849633 16110 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.863658 16420 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.864812 15190 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.798473 16309 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.796522 16415 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:40.871773 15196 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:40.842684 15343 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.822834 15269 rpcz_store.cc:276] 0709 13:03:39.489921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.563516 (+1073595us) service_pool.cc:224] Handling call
0709 13:03:40.612137 (+ 48621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.749393 (+137256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.778388 (+ 28995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.791695 16387 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:40.848265 15338 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.828370 16398 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:40.916268 16398 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:40.850543 15345 rpcz_store.cc:276] 0709 13:03:39.419435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.555634 (+1136199us) service_pool.cc:224] Handling call
0709 13:03:40.555994 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.813401 (+257407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.827319 (+ 13918us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000965d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:40.827562 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476760832}
I20260709 13:03:40.829371 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.918228 16410 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:40.918377 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 89077.8us
I20260709 13:03:40.918817 16410 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.919478 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.920562 16226 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.920975 16226 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:40.920905 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.921579 16226 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.922047 16382 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.856562 16318 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.866982 15344 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.849570 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:40.873490 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 120593us
I20260709 13:03:40.901698 15196 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:40.872641 16149 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:03:40.905169 16360 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:40.914064 16422 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.158s	user 0.004s	sys 0.000s
I20260709 13:03:40.919986 16410 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.922456 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.902765 16415 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.935636 15343 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:40.937626 15194 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:03:40.938884 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.864830 16420 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.922415 16382 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:40.843329 16379 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:40.947031 15345 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.922801 16387 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.947902 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.948734 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.949028 15194 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.859944 16377 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:03:40.951022 15196 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:40.906976 15190 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:40.954552 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.955698 16114 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:40.956110 16114 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:40.956492 16114 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.956745 16332 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:40.956426 16128 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.957180 16332 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:40.957962 16332 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:40.958587 16128 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:40.958952 15191 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:40.959372 15346 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:40.960647 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:40.960861 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:40.963456 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.966782 16435 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:40.968559 16435 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.968461 16376 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:40.969290 16435 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.959793 16315 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.950809 16379 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.951596 16382 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.970129 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:40.954273 16381 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.954162 16387 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.945145 16183 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 13:03:40.992311 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.965598 16332 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.979869 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.996729 16183 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:40.997098 15337 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.997150 16183 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:40.999464 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.971562 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:40.952402 16378 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:03:40.978514 16379 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.005651 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.003378 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:41.004271 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.000347 15338 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:41.011571 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:41.011799 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.012972 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:40.975481 16309 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.013841 15345 raft_consensus.cc:2410] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:40.998525 16374 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.017835 15312 leader_election.cc:400] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:40.999897 16359 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.021996 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.022934 15312 leader_election.cc:403] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:41.003244 16381 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:41.007934 16377 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.026815 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.027681 15338 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:41.027871 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.028762 16377 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:41.029040 16381 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.032763 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.034984 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:41.036777 16382 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.037591 16110 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.022313 16191 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.039268 16183 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.040611 16183 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.040177 16379 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:41.042658 16379 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:41.043445 16379 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:41.025318 16410 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.045104 16410 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:41.046288 16410 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.039258 16382 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:40.977949 16435 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.053120 16315 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:41.055815 16315 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.008836 16103 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:03:41.030841 16377 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:41.059509 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:41.066042 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:41.067550 16433 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.124s	user 0.001s	sys 0.001s
I20260709 13:03:41.067682 16387 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.027917 16359 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.069027 15192 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:41.025722 16374 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:41.071367 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:41.073047 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.075765 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.070169 16382 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:41.087774 15339 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:41.090881 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.091482 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.092108 15338 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:41.092756 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 770) took 2675 ms. Trace:
I20260709 13:03:41.093194 15340 rpcz_store.cc:276] 0709 13:03:38.417134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.007261 (+1590127us) service_pool.cc:224] Handling call
0709 13:03:40.025865 (+ 18604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.824887 (+799022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.092526 (+267639us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54000b5754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:41.092702 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583867264}
I20260709 13:03:41.094880 16374 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:41.105396 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.107746 15345 raft_consensus.cc:2410] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:41.076817 16377 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.069835 16397 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:41.120518 16226 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.121436 16361 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.090492 16382 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:41.123453 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.134477 15339 raft_consensus.cc:2368] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:41.090538 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.128012 16359 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:41.109054 16110 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:41.128235 16432 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:03:41.128824 15343 raft_consensus.cc:2410] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:41.131367 15197 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:41.137231 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.138504 16361 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.132367 16128 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:41.122884 16377 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.139165 16387 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:41.157912 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.140044 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.145838 16376 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:41.140092 16415 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.141093 16382 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:41.143306 15337 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:41.170862 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.171517 15337 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.171648 16415 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.145152 15341 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:41.142369 16226 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.174705 16292 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:41.174695 16398 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.146782 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 777) took 2727 ms. Trace:
I20260709 13:03:41.185364 15344 rpcz_store.cc:276] 0709 13:03:38.418943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.494891 (+2075948us) service_pool.cc:224] Handling call
0709 13:03:40.495257 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.941708 (+446451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.146541 (+204833us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54001761d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:41.146719 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854444928}
I20260709 13:03:41.151432 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.186038 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.129222 16114 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.187901 16436 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:41.188344 16436 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:41.189311 16114 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.154953 15345 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:41.156412 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.189249 16436 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.190586 15339 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:41.201066 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:41.201977 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.159967 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.162158 16361 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.160009 15870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58398 (request call id 95) took 1124 ms. Trace:
I20260709 13:03:41.168946 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.176777 16260 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:41.155259 16128 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.178529 15188 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:41.180835 16377 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.204828 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.205190 15092 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 165) took 3072 ms. Trace:
I20260709 13:03:41.201011 16359 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:03:41.207870 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:41.208307 16376 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.210587 15337 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:41.216455 15346 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:41.149148 16318 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.224372 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:41.225407 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 202833us
I20260709 13:03:41.246994 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:41.254849 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47052.1us
I20260709 13:03:41.254168 15191 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:41.255911 15194 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.262130 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:41.259261 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:41.256971 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:41.268000 15196 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:41.270345 15339 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:03:41.257371 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.219286 15870 rpcz_store.cc:276] 0709 13:03:40.035396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.035521 (+   125us) service_pool.cc:224] Handling call
0709 13:03:40.035827 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.872068 (+836241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.159635 (+287567us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b54006301d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:41.159927 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746997504}
I20260709 13:03:41.224850 16398 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.277047 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:41.276758 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.282061 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:41.253749 16260 raft_consensus.cc:1068] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:41.279206 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.283808 15345 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:41.284140 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.281361 16409 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:03:41.253484 15342 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:41.264628 16292 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.253906 15092 rpcz_store.cc:276] 0709 13:03:38.126467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.129278 (+  2811us) service_pool.cc:224] Handling call
0709 13:03:41.198954 (+3069676us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:40.314544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:40.529585 (+215041us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:40.533280 (+  3695us) write_op.cc:435] Acquired schema lock
0709 13:03:40.537640 (+  4360us) tablet.cc:662] Decoding operations
0709 13:03:40.596218 (+ 58578us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:40.596272 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:40.596300 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:40.596605 (+   305us) tablet.cc:701] Row locks acquired
0709 13:03:40.596622 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:03:40.596770 (+   148us) write_op.cc:270] Start()
0709 13:03:40.596913 (+   143us) write_op.cc:276] Timestamp: P: 1783602220596727 usec, L: 0
0709 13:03:40.596956 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 13:03:40.605989 (+  9033us) log.cc:844] Serialized 917 byte log entry
0709 13:03:40.809470 (+203481us) op_driver.cc:464] REPLICATION: finished
0709 13:03:40.871351 (+ 61881us) write_op.cc:301] APPLY: starting
0709 13:03:40.871430 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:40.871536 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:40.944246 (+ 72710us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:40.983225 (+ 38979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:40.983380 (+   155us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:03:40.983422 (+    42us) write_op.cc:312] APPLY: finished
0709 13:03:40.983629 (+   207us) log.cc:844] Serialized 28 byte log entry
0709 13:03:40.983797 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:40.983872 (+    75us) write_op.cc:454] Released schema lock
0709 13:03:40.983910 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:40.984232 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:40.984257 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1939469,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":48699,"apply.run_cpu_time_us":2242,"apply.run_wall_time_us":112858,"num_ops":2,"prepare.queue_time_us":98598,"prepare.run_cpu_time_us":21228,"prepare.run_wall_time_us":375573,"raft.queue_time_us":197257,"raft.run_cpu_time_us":97243,"raft.run_wall_time_us":159988,"replication_time_us":199399,"thread_start_us":137760,"threads_started":4,"wal-append.queue_time_us":78974}]]}
I20260709 13:03:41.294912 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.299383 15346 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:41.296173 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:41.312151 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 292122us
I20260709 13:03:41.316591 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:41.318537 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.292054 16397 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.319762 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.313620 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:41.293116 16332 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.321156 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.325059 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.304215 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.291765 16191 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:03:41.295086 16428 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:03:41.304951 16128 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.325522 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.328228 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.329663 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.702502 15346 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:41.642055 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.724548 15339 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:41.737676 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.738884 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:41.703367 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.328480 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.741375 15338 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:41.741595 15339 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:41.742012 15339 pending_rounds.cc:85] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
W20260709 13:03:41.737897 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 416370us
I20260709 13:03:41.314041 16260 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.322746 16310 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.743121 15339 pending_rounds.cc:107] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:41.743095 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:41.438259 16442 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:03:41.612069 16378 raft_consensus.cc:670] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:41.772392 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.775066 15339 raft_consensus.cc:2889] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:41.436704 16183 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.357605 15190 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:41.772603 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.747308 16332 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.742666 16262 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:41.325939 16434 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.470s
I20260709 13:03:41.397789 16361 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.743593 16446 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:03:41.736054 16344 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:41.516005 16318 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.781675 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:41.808650 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 445062us
W20260709 13:03:41.844309 15238 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.807s (SENT)
I20260709 13:03:41.824826 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.845570 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.782330 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.786592 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.315146 16360 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.433s
I20260709 13:03:41.779281 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.361717 16409 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:41.789093 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.789700 15268 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.849869 15271 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:41.323621 16292 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.424783 16397 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.415164 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.633030 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:41.517155 16149 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.267s
I20260709 13:03:41.789544 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.807658 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.847425 15270 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.773613 16445 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:03:41.852058 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.879225 15346 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:41.879593 15266 raft_consensus.cc:2368] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:41.880597 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.881271 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:41.857652 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.883715 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.883945 15194 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:41.793855 16434 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:03:41.884774 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 141774us
I20260709 13:03:41.885118 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.885445 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:41.883395 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.808049 15340 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:41.859601 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.887053 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.887840 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.890035 15267 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:41.788357 15269 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.506361 16439 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.394s
I20260709 13:03:41.792454 16354 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:41.850646 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.817041 16361 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.909915 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.910064 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:41.911612 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.790560 15263 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.788781 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.787542 16128 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.858395 16409 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.905233 16307 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.906559 16410 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.001276 16410 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.002180 16410 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.003418 16435 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.003931 16435 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.004773 16376 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:42.005177 16376 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:42.005954 16435 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.789435 16183 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.006040 16376 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.007938 16183 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.792001 16262 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.871656 15270 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:03:41.886725 15147 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.007s	sys 0.027s
I20260709 13:03:42.009948 16262 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:42.010253 15147 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.007s	sys 0.028s
I20260709 13:03:42.003425 16410 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:42.013391 16449 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.503s	user 0.004s	sys 0.009s
I20260709 13:03:41.849033 16344 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.887856 16434 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.917501 15339 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:42.014716 15339 pending_rounds.cc:85] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
I20260709 13:03:42.014966 15339 pending_rounds.cc:107] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:42.015226 15339 raft_consensus.cc:2889] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.015880 16344 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:42.015275 16434 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.016764 15339 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.016866 16434 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.919055 15338 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:41.923422 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.018419 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.901621 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:41.899688 16110 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.897755 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.018950 15271 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.020119 16110 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.020635 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.021189 15267 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:42.021131 16110 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.022087 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.970117 15346 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:42.022545 16453 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:41.922243 15342 raft_consensus.cc:2410] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:41.898904 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.023802 15266 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.022594 15267 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.920899 16260 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.906399 16354 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:41.967374 16292 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:41.983387 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:41.983614 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:41.984570 15340 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.034266 16354 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.035441 16354 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.913483 15190 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:41.974037 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 183496us
I20260709 13:03:41.985284 16397 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.039386 16260 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.042527 15196 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:41.987286 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.044144 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.044705 15268 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:42.045475 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.045938 15268 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.988184 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:41.974874 16409 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.025087 16376 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:41.995088 16361 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:41.993705 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:42.061533 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67923.8us
I20260709 13:03:42.062232 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:41.995764 16359 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:41.996945 16459 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:03:41.999204 16398 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.003s
W20260709 13:03:42.000414 16447 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:03:42.000808 16307 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:41.914458 16445 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:03:42.009680 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.066154 15266 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:42.022840 15346 pending_rounds.cc:85] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
I20260709 13:03:41.792989 16332 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.020079 15092 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 2, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:42.027843 15271 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:42.033553 15189 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:41.986630 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.023746 16436 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.052155 15267 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:41.991675 15264 raft_consensus.cc:2368] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:42.063090 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.067142 16410 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:03:42.052734 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 156528us
I20260709 13:03:41.907842 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.110699 15272 raft_consensus.cc:2368] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:42.072448 15343 raft_consensus.cc:2410] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:42.071712 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.072989 15346 pending_rounds.cc:107] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:42.029098 16453 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.077080 15092 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 2 to 3, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:42.063997 16344 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.069070 16428 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:42.072153 16459 raft_consensus.cc:1068] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:42.076313 16457 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:42.068636 16359 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:42.068110 16456 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.104204 15338 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:42.107380 15345 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:42.093019 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.109477 15268 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:42.146307 15339 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:42.146265 15092 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 3, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 3 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:42.168923 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.169502 15339 pending_rounds.cc:85] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
I20260709 13:03:42.169842 15339 pending_rounds.cc:107] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:42.169994 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.170461 15346 raft_consensus.cc:2889] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.171095 15270 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.170138 15339 raft_consensus.cc:2889] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.170565 15268 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.173415 15338 pending_rounds.cc:85] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
I20260709 13:03:42.173689 15338 pending_rounds.cc:107] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:42.173933 15338 raft_consensus.cc:2889] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.103999 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:42.093843 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:42.203992 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 140957us
W20260709 13:03:42.204485 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 111571us
I20260709 13:03:42.205606 15268 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:42.206576 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.207165 15268 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.087922 16360 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:03:42.104979 16398 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.212441 16360 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:42.212903 16360 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.101485 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:42.099818 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 895) took 1353 ms. Trace:
I20260709 13:03:42.215350 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.214790 16360 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:42.215320 15188 rpcz_store.cc:276] 0709 13:03:40.746601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.916662 (+170061us) service_pool.cc:224] Handling call
0709 13:03:40.917007 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.253651 (+336644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.099589 (+845938us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54001a4354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:42.099760 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600788352}
I20260709 13:03:42.092976 15265 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.216782 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.211396 15340 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:42.217942 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:42.196467 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 213933us
I20260709 13:03:42.184053 16318 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:03:42.220993 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:42.221606 15160 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:46346 dropped due to backpressure: service queue is full with 50 items
I20260709 13:03:42.221789 15264 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:42.223120 15268 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:42.224007 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.224716 15268 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:42.225446 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.226544 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.227267 15268 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:42.180039 16410 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.228076 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.229158 16410 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:42.231488 15270 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:42.232350 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.232988 15270 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:42.233964 15270 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:42.222852 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.234957 15268 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:42.235754 15188 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:42.236356 15268 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:42.236515 15270 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.144694 16379 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.221896 15160 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:46346 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 783)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 785)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 755)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 788)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 790)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 756)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 759)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 752)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 741)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 768)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 770)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 774)
Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40376 (request call id 3)
I20260709 13:03:42.240446 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.241185 15272 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:42.240464 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 68562.4us
I20260709 13:03:42.222728 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.254413 15272 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:42.182767 16191 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:42.255297 16191 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:42.255445 16382 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.256218 16191 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.257362 16191 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.169380 16344 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.174621 16183 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:03:42.260593 16344 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:42.260677 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.172598 16128 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.146486 16114 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
I20260709 13:03:42.246421 15269 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:42.262596 15269 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:42.266180 15269 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:42.247910 16307 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.266709 16409 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.269037 15344 raft_consensus.cc:2368] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
I20260709 13:03:42.246377 15270 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:42.243323 16459 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.242928 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.243849 15309 leader_election.cc:400] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:42.286234 15309 leader_election.cc:403] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:42.180574 16374 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:03:42.251392 16464 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:42.272101 15264 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:42.292088 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86918.7us
I20260709 13:03:42.293654 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.295138 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:42.295778 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.296948 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.300230 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.261404 16128 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.304710 15270 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.302444 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.307320 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.274739 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.269330 16387 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:42.269136 16420 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:42.316828 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.285177 16226 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:03:42.298184 16354 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:42.320544 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.324658 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:42.269948 16379 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:42.325551 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.301287 16183 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.298677 16434 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.304210 16260 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.301649 16456 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.339311 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.322880 16409 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:42.326609 16377 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.331221 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.319847 16398 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.313868 16397 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.323472 16459 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:42.335649 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.334684 16435 raft_consensus.cc:2764] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:42.332527 16183 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.329782 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.360445 15309 leader_election.cc:400] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:42.332199 16451 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:42.323060 16256 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:42.304389 16464 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:42.347076 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.380748 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:42.381424 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.336226 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 131538us
I20260709 13:03:42.348320 15875 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 LEARNER]: Advancing to term 3
I20260709 13:03:42.348829 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.349470 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.341373 15265 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:42.356069 16453 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:42.343190 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:42.391505 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48400.5us
I20260709 13:03:42.392575 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.393958 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.361914 15309 leader_election.cc:400] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
W20260709 13:03:42.365078 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.388221 16262 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:42.404377 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.389025 16464 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:42.389919 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.428735 15271 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:42.430312 15271 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.346192 16318 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.394948 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:42.457376 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62490us
W20260709 13:03:42.432796 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.381651 16398 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.458482 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.500092 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.441527 15271 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:42.472401 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.511140 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86095.8us
I20260709 13:03:42.534940 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.420110 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:42.536131 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 116110us
I20260709 13:03:42.537537 15270 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:42.385754 16451 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:42.423478 16307 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:42.422683 16420 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:42.541429 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:42.402966 16262 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:03:42.553611 16467 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:03:42.541919 16292 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:03:42.513975 16435 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.423219 16315 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:42.423017 16226 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:42.669186 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 132142us
I20260709 13:03:42.534940 16437 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:42.424904 16344 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.136s
I20260709 13:03:42.423404 16376 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
W20260709 13:03:42.675230 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 133893us
W20260709 13:03:42.671077 16470 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.336s	user 0.000s	sys 0.009s
I20260709 13:03:42.682720 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:42.513491 16256 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.158s
I20260709 13:03:42.547475 16465 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:42.679670 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.656137 16459 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.656607 16361 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.681952 15237 leader_election.cc:400] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:42.542284 16318 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:42.685894 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.686655 15191 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.689181 16381 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.669405 16410 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:42.692971 16473 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.322s	user 0.003s	sys 0.005s
I20260709 13:03:42.459105 16456 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.211s
W20260709 13:03:42.541602 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 256264us
I20260709 13:03:42.693876 15237 leader_election.cc:403] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:42.720690 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.692041 15270 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.721729 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.706758 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.690534 16437 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.685240 16445 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:42.691207 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.715624 15191 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:03:42.727620 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:42.727373 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.777313 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 834) took 1458 ms. Trace:
I20260709 13:03:42.777417 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.778898 15196 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:42.779513 15344 rpcz_store.cc:276] 0709 13:03:41.318516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.723881 (+405365us) service_pool.cc:224] Handling call
0709 13:03:42.772805 (+1048924us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400424854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:42.777230 (+  4425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216785152}
I20260709 13:03:42.780551 15271 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:42.782894 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.783346 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.783751 15195 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:42.785159 15270 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.682271 16315 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:42.716655 16377 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.716936 16429 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:42.705281 16465 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.718683 16256 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.790738 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.792938 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.813283 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.725399 16110 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:42.696295 16459 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.763494 16409 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.805294 16495 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:42.805382 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 77878.8us
I20260709 13:03:42.805850 16226 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.769778 16318 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:03:42.716842 16410 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:42.752254 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45658.8us
I20260709 13:03:42.819188 15195 raft_consensus.cc:2368] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:03:42.776525 16379 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:42.826522 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.716992 16476 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:03:42.820272 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:42.834369 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.796029 16445 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.801983 16489 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:42.717518 16262 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:42.836011 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.838289 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.838814 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:42.800325 16429 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:42.841152 16486 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:03:42.841440 16359 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:42.842017 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:42.843406 16382 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.002s
I20260709 13:03:42.843843 16491 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:42.856850 16488 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:03:42.840719 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 877510us
I20260709 13:03:42.824687 16110 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.802894 16377 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.779656 16451 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.846189 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.818478 16256 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.863480 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.864199 15196 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:42.849694 15237 leader_election.cc:400] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:42.821350 16409 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:42.870213 16191 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.004s
I20260709 13:03:42.877820 16110 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.847908 16410 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:42.851854 16226 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.852682 16459 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:42.855199 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.855641 16465 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.894603 15266 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:42.858037 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.833316 16420 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:42.864926 15237 leader_election.cc:403] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:03:42.858040 15264 consensus_meta.cc:287] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260709 13:03:42.851794 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.898011 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:42.898181 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48708.7us
I20260709 13:03:42.870805 16315 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:42.871261 16409 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:42.872408 16256 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:42.872747 16468 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:42.863438 16489 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:42.863204 16491 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:03:42.883718 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.884454 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:42.858114 16262 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.898420 15195 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:42.913776 15266 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.914479 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:42.885305 16487 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:03:42.916208 15270 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:42.917016 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:42.897949 15264 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:42.919711 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 885) took 1126 ms. Trace:
I20260709 13:03:42.920064 15264 rpcz_store.cc:276] 0709 13:03:41.793300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.222489 (+429189us) service_pool.cc:224] Handling call
0709 13:03:42.919647 (+697158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:42.915858 16410 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:03:42.921296 15264 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.921658 15264 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:42.921725 15271 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.921979 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.923205 15265 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.924729 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:42.924980 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.925508 15875 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:03:42.925983 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.926678 15195 raft_consensus.cc:2368] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:42.926251 16429 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.927381 16429 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.929708 16468 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:42.930624 16468 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:42.889722 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47809.7us
I20260709 13:03:42.932137 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.931371 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:42.933101 16420 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.933296 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.934214 16359 raft_consensus.cc:1064] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:42.934625 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.934743 15272 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:42.923142 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.924750 16361 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:42.936239 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.936419 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.936908 16315 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:42.917234 16482 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:03:42.937654 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.937777 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.911746 16476 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:42.938970 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.932281 16377 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:42.936463 15162 leader_election.cc:400] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3.
I20260709 13:03:42.944062 15195 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:42.939193 16318 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:42.944773 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 55074.3us
I20260709 13:03:42.945047 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.948324 15195 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:42.949720 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.949985 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.938868 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.834093 16437 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.922416 15264 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.945158 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:42.946367 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62064.5us
I20260709 13:03:42.957432 15266 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:42.889955 16191 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.952365 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.916271 16489 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.956914 15191 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:42.959430 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.960255 16191 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:42.949091 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.976996 15196 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:42.980150 15195 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:42.981230 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:42.981662 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.982108 15346 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:42.978729 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.985040 15196 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:03:42.983978 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.985949 15195 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:42.988229 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.988862 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.989463 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:42.991739 15338 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:42.993284 15195 raft_consensus.cc:2410] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:42.996847 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.994648 16497 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:42.999583 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.002589 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.990839 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:42.983131 15264 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.976999 16489 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.007863 15195 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:42.992826 16500 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.009238 15195 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:03:43.009657 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.010808 15195 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:43.013727 15196 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:43.018671 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:43.020319 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.012362 16436 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.901s	user 0.012s	sys 0.000s
I20260709 13:03:43.026904 16490 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:43.027494 16490 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.027856 16490 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.885001 16445 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.004583 16307 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:43.048430 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.015483 16262 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.015802 16500 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.057359 16191 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:43.050319 16510 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.073854 16377 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.058636 16262 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.009246 16491 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:43.103703 16499 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:43.104545 16262 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:43.019927 16497 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.107671 16344 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:43.109334 16377 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.122646 15264 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:43.123143 15264 pending_rounds.cc:85] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 1
I20260709 13:03:43.123370 15264 pending_rounds.cc:107] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:43.123612 15264 raft_consensus.cc:2889] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:43.130673 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82730.3us
I20260709 13:03:43.131965 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.133584 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.124105 16377 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:43.197095 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.198105 16344 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:43.198873 16510 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:43.199828 16191 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:03:43.200325 16191 raft_consensus.cc:1068] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:43.071858 16307 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:43.199791 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 56044.5us
W20260709 13:03:43.198354 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 61650.2us
W20260709 13:03:43.205361 15312 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.177s (SENT) [suppressed 59 similar messages]
I20260709 13:03:43.205379 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.210498 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.203890 16262 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.212550 16344 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.213866 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:43.220165 16506 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.106s	user 0.001s	sys 0.001s
I20260709 13:03:43.224081 16517 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.226130 16497 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:43.235321 16452 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:43.235947 16452 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:43.237690 16452 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.248550 16452 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.241684 16510 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:43.247785 16128 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:43.249949 16490 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.273274 16128 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:43.273859 16128 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:43.277280 16128 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:43.277890 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72564.2us
I20260709 13:03:43.253957 16489 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:43.278127 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:43.282228 15270 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:42.957772 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.299130 16114 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:43.299475 16489 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:43.299566 16114 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:43.300185 16114 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:43.301256 16481 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.623s	user 0.004s	sys 0.000s
W20260709 13:03:43.315311 16518 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:03:43.325284 16519 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:03:43.329494 16490 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:43.334959 16500 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:43.335973 16461 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.160s	user 0.004s	sys 0.000s
W20260709 13:03:43.358882 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.379985 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.374198 15238 leader_election.cc:336] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.583s (SENT)
W20260709 13:03:43.441385 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.436944 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:43.456408 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.508348 16128 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.509163 16128 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:43.512852 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 138701us
W20260709 13:03:43.514022 15238 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.608s (SENT)
I20260709 13:03:43.514523 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.556023 16510 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:43.517831 16489 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:43.610433 16500 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:03:43.611063 16500 raft_consensus.cc:1068] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:03:43.729291 16491 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.035s
W20260709 13:03:43.729923 16491 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.009s	sys 0.035s
W20260709 13:03:43.739298 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 225305us
W20260709 13:03:43.739976 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.740553 15238 leader_election.cc:336] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.652s (SENT)
I20260709 13:03:43.741034 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:43.741430 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 783695us
W20260709 13:03:43.742304 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.773950 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.774487 15238 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.774s (SENT)
I20260709 13:03:43.774963 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:43.744921 16489 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.773819 16307 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.065s
I20260709 13:03:43.792389 16452 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.834928 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 898) took 1932 ms. Trace:
I20260709 13:03:43.847505 16491 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:43.864959 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.852208 16128 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:43.922827 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.934850 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.069475 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.854686 16452 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:44.076823 16524 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 13:03:44.077958 16114 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.777s	user 0.006s	sys 0.005s
I20260709 13:03:44.078395 16114 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.069200 16260 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:44.079593 16260 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.070907 16500 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.080567 16114 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.081091 16114 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.081200 16307 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.081543 16260 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:44.081609 16114 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.081760 16307 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.070012 16332 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:44.082943 16332 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.084010 16307 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.084959 16332 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:44.080890 16500 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:44.086148 16452 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:44.082163 16260 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.067674 16491 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.087419 16500 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:44.067538 16128 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:44.070050 16377 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:44.096742 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 322275us
I20260709 13:03:44.089154 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:03:44.098399 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 324250us
I20260709 13:03:44.099131 16377 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.101926 16377 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:44.090824 16128 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:44.089224 16491 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:44.104462 16452 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:03:44.111290 16452 raft_consensus.cc:1068] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:44.112980 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:03:44.108500 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 168621us
I20260709 13:03:44.104161 16527 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:43.855341 15263 rpcz_store.cc:276] 0709 13:03:41.902925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.261708 (+358783us) service_pool.cc:224] Handling call
0709 13:03:42.262084 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.262469 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.262503 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.262977 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.345622 (+ 82645us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:42.365877 (+ 20255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.380400 (+ 14523us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.252422 (+872022us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:43.302070 (+ 49648us) raft_consensus.cc:1685] finished
0709 13:03:43.302096 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.833398 (+531302us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7558,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":3748,"spinlock_wait_cycles":7401728,"thread_start_us":41439,"threads_started":1,"wal-append.queue_time_us":182233}
I20260709 13:03:44.090147 16260 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.117120 16260 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:44.107734 16307 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.109619 16128 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:44.117724 16491 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:44.110484 16453 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.118285 16453 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:44.118753 15264 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:03:44.119284 15264 pending_rounds.cc:85] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 4
I20260709 13:03:44.119109 16453 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.119642 15264 pending_rounds.cc:107] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:03:44.120116 16453 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.120217 15264 raft_consensus.cc:2889] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:44.121834 15197 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:44.126199 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.127454 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.128509 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.129492 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.130270 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.128374 16114 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.131007 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.132862 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.133899 16448 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.136579 15196 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:44.137167 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 920) took 1441 ms. Trace:
I20260709 13:03:44.137241 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:44.137558 15196 rpcz_store.cc:276] 0709 13:03:42.696209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.133826 (+1437617us) service_pool.cc:224] Handling call
0709 13:03:44.134103 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.136959 (+  2856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.137119 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.138237 16448 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:44.139181 16448 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:44.140686 16448 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.143265 16527 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.143764 16527 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.145759 16527 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.147292 15196 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:44.147985 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 921) took 1423 ms. Trace:
I20260709 13:03:44.148329 15196 rpcz_store.cc:276] 0709 13:03:42.724676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.138436 (+1413760us) service_pool.cc:224] Handling call
0709 13:03:44.138756 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.147726 (+  8970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.147932 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.149951 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 925) took 1196 ms. Trace:
I20260709 13:03:44.152508 16476 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:44.153985 16476 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.154277 16531 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.155458 16533 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.156224 15160 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:44.156688 16476 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.163508 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.164202 15344 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.164492 16533 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.164907 16533 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.165261 16533 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.165154 16531 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:44.166317 15345 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:44.153656 15196 rpcz_store.cc:276] 0709 13:03:42.953698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.149135 (+1195437us) service_pool.cc:224] Handling call
0709 13:03:44.149462 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.149623 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.149656 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.149695 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:44.149727 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.149787 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.149900 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.167336 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.167994 15345 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.169005 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:44.170202 16532 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:44.171563 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.171808 16532 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.172243 16532 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.172566 16532 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.173203 16533 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:44.175592 16533 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.176319 16533 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.177222 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40376 (request call id 3) took 2095 ms. Trace:
I20260709 13:03:44.159641 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:44.161921 15339 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:44.177718 15196 rpcz_store.cc:276] 0709 13:03:42.081509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.167791 (+2086282us) service_pool.cc:224] Handling call
0709 13:03:44.176937 (+  9146us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b540032c154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5713735 00007f36ea6d3d29 00007f36e3c521d4 00007f36e3c52162 00007f36e3c52091 00007f36e3c5200c 00007f36e3c512c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:44.177128 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14339328}
I20260709 13:03:44.157563 15338 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:44.161780 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:44.182183 16533 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:44.182600 16533 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:44.167796 16531 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.165197 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.184821 16531 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:03:44.182994 16533 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:44.196599 16444 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 2.758s	user 0.031s	sys 0.027s
I20260709 13:03:44.185940 15344 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:44.199083 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.198881 16510 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:44.200603 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.201731 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.203547 15268 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:44.204242 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.204866 15263 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.209796 15875 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:44.212088 16534 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.213464 15263 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.217789 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.218531 15269 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.218994 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.219655 15266 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.213682 16534 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.197889 16476 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:03:44.190208 16532 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.229473 16532 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.228253 16534 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:44.237914 16533 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.239243 16114 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.239473 16534 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.239867 16114 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:44.242524 16114 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:44.243093 16114 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:44.230737 15197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 900) took 2984 ms (client timeout 2220 ms). Trace:
I20260709 13:03:44.243551 16114 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:44.245883 15197 rpcz_store.cc:269] 0709 13:03:41.246577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.246723 (+   146us) service_pool.cc:224] Handling call
0709 13:03:44.230469 (+2983746us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54003e53d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:44.230622 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6564206976}
I20260709 13:03:44.247890 16114 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.249954 16533 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:44.250690 16485 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.576s	user 0.000s	sys 0.017s
W20260709 13:03:44.255482 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 75420.1us
I20260709 13:03:44.256455 16415 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.256883 16415 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.257678 16415 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.258968 16415 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.259624 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:44.260697 15188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 742) took 2178 ms (client timeout 1652 ms). Trace:
W20260709 13:03:44.266525 15188 rpcz_store.cc:269] 0709 13:03:42.082267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.242107 (+159840us) service_pool.cc:224] Handling call
0709 13:03:44.259468 (+2017361us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:03:44.260610 (+  1142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7299840}
I20260709 13:03:44.267084 16532 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.267738 16114 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:44.275760 16532 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.278151 16534 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:44.278786 16534 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:44.279547 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:44.280390 15190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 785) took 2063 ms (client timeout 1608 ms). Trace:
I20260709 13:03:44.280792 16448 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:44.280754 15190 rpcz_store.cc:269] 0709 13:03:42.217013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.677536 (+460523us) service_pool.cc:224] Handling call
0709 13:03:44.279409 (+1601873us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:03:44.280322 (+   913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3725696}
I20260709 13:03:44.281744 16534 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.282023 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.282321 16534 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.282897 16534 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.283411 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.283601 15197 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:44.284425 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.284590 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.281414 16448 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.285372 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.285872 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.286183 15196 raft_consensus.cc:2368] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:03:44.287266 16537 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.287846 16448 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:44.288482 16460 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 2.194s	user 0.008s	sys 0.016s
I20260709 13:03:44.288527 16534 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.294301 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 858) took 1288 ms. Trace:
I20260709 13:03:44.294723 15340 rpcz_store.cc:276] 0709 13:03:43.006243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.007430 (+  1187us) service_pool.cc:224] Handling call
0709 13:03:43.030129 (+ 22699us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.070355 (+ 40226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.073025 (+  2670us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.078687 (+  5662us) log.cc:844] Serialized 26 byte log entry
0709 13:03:43.270357 (+191670us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:43.270415 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.270502 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.290496 (+1019994us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5400184820. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5682dbe 00007f36e568d930 00007f36e568d8d8 00007f36e568d858 00007f36e568d813 00007f36e568ca9c 00007f36eb578626 00007f36eb572dd8 00007f36e56c97cb 00007f36e56cc2c0
0709 13:03:44.293971 (+  3475us) raft_consensus.cc:1685] finished
0709 13:03:44.293997 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.294234 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2612,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4896,"spinlock_wait_cycles":7634304,"thread_start_us":181900,"threads_started":1,"wal-append.queue_time_us":186343}
I20260709 13:03:44.287001 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.313812 16537 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:44.315826 15197 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:44.318238 16533 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.319100 16533 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.321372 16533 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.322628 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.322912 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.327963 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.324275 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.328383 15195 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:44.328953 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 774) took 2114 ms. Trace:
I20260709 13:03:44.329196 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.329241 15195 rpcz_store.cc:276] 0709 13:03:42.214181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.012720 (+798539us) service_pool.cc:224] Handling call
0709 13:03:44.328203 (+1315483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.328751 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.328904 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.330317 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.330535 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.326859 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 854) took 1342 ms. Trace:
I20260709 13:03:44.331542 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.332875 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.331272 15346 rpcz_store.cc:276] 0709 13:03:42.984844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.985481 (+   637us) service_pool.cc:224] Handling call
0709 13:03:42.985874 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.000218 (+ 14344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.000260 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.000739 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:03:43.058595 (+ 57856us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:43.058638 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.326510 (+1267872us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54000b6654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:44.326555 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.326601 (+    46us) raft_consensus.cc:1685] finished
0709 13:03:44.326616 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.326807 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5837,"spinlock_wait_cycles":31972096,"thread_start_us":57608,"threads_started":1,"wal-append.queue_time_us":119670,"wal-append.run_cpu_time_us":1452,"wal-append.run_wall_time_us":1001489}
I20260709 13:03:44.333968 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.334460 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.336287 15346 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:44.337251 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.337451 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.338398 16532 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:44.338660 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.340003 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.341205 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.341794 15346 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:44.342590 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.335575 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.343501 15195 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:44.344085 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.344604 15195 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:44.345378 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.346151 15195 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:44.346665 15238 leader_election.cc:400] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:03:44.338822 16532 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.334625 15194 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:44.323765 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.347011 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.342670 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.335258 15197 raft_consensus.cc:2368] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:44.347379 16532 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.347543 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:44.353665 16542 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:44.335274 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 906) took 1419 ms. Trace:
I20260709 13:03:44.347184 16527 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:03:44.354981 16542 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.354794 15270 rpcz_store.cc:276] 0709 13:03:42.916314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.931112 (+ 14798us) service_pool.cc:224] Handling call
0709 13:03:44.335100 (+1403988us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540034a154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:44.335222 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800772992}
I20260709 13:03:44.349275 16534 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.348116 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.356137 16542 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.357182 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.362047 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:44.362876 16415 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.363411 16415 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.363862 16415 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.365015 16462 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.365470 16462 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:44.367635 16462 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.368959 16462 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.372308 16415 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.351181 15346 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.356016 16534 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.347118 15238 leader_election.cc:403] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:03:44.375963 16534 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.376708 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.377511 16491 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:03:44.378206 16491 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:44.358004 15189 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 775) took 2143 ms (client timeout 1566 ms). Trace:
W20260709 13:03:44.379199 15189 rpcz_store.cc:269] 0709 13:03:42.214438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.672086 (+457648us) service_pool.cc:224] Handling call
0709 13:03:44.357779 (+1685693us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003e67d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:44.357925 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3656702336}
I20260709 13:03:44.380026 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.380493 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.381186 15189 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:44.381299 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.382282 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.383782 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.382382 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.390142 15189 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:44.390726 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.391652 16376 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.392246 16376 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.392616 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.393777 15197 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:44.394285 16376 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:44.350587 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.390807 16256 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:44.395998 16256 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.396488 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.397744 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.398257 16256 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:44.372815 15143 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:44.398777 15346 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
W20260709 13:03:44.399128 15143 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:03:44.399529 15143 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:44.398694 15195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:44.399859 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.400282 15195 raft_consensus.cc:606] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:44.400651 15195 raft_consensus.cc:614] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:44.400975 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.401561 15346 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.391207 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.403177 16415 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.403806 15189 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:44.383625 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.405427 16491 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:44.405999 16491 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.407105 16495 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.407513 16495 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:44.408250 16495 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.409093 15346 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.409646 16495 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.410241 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.410892 15346 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.412683 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.417871 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:44.419688 16472 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.420073 16472 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:44.420288 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:44.420818 16472 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.421460 16476 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:44.421989 16472 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.422318 16476 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:44.424832 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.425443 16256 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.425915 16256 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.428180 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.429248 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.430038 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.430127 16476 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:44.347934 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.430809 16533 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.387475 16532 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.431309 16533 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.431423 16114 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:44.431921 15196 raft_consensus.cc:2368] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:44.431955 16114 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.432196 16533 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.432886 16114 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.435213 16527 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.435599 16527 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.435921 16527 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.436164 16532 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.428215 16256 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:44.394747 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.441593 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.441967 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.442075 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.445010 15346 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.449605 15092 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 54) took 3134 ms. Trace:
I20260709 13:03:44.450760 15092 rpcz_store.cc:276] 0709 13:03:41.327722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.398262 (+ 70540us) service_pool.cc:224] Handling call
0709 13:03:44.449548 (+3051286us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:42.536078 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:42.791401 (+255323us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:42.792265 (+   864us) write_op.cc:435] Acquired schema lock
0709 13:03:42.798499 (+  6234us) tablet.cc:662] Decoding operations
0709 13:03:42.877599 (+ 79100us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:42.877654 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:42.877681 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:42.878035 (+   354us) tablet.cc:701] Row locks acquired
0709 13:03:42.878052 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:03:42.878209 (+   157us) write_op.cc:270] Start()
0709 13:03:42.878311 (+   102us) write_op.cc:276] Timestamp: P: 1783602222878164 usec, L: 0
0709 13:03:42.878331 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:03:42.891942 (+ 13611us) log.cc:844] Serialized 1416 byte log entry
0709 13:03:43.197159 (+305217us) op_driver.cc:464] REPLICATION: finished
0709 13:03:43.281584 (+ 84425us) write_op.cc:301] APPLY: starting
0709 13:03:43.281669 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:43.281802 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:43.282911 (+  1109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:43.838229 (+555318us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:43.848080 (+  9851us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:03:43.854899 (+  6819us) write_op.cc:312] APPLY: finished
0709 13:03:43.867632 (+ 12733us) log.cc:844] Serialized 34 byte log entry
0709 13:03:43.880752 (+ 13120us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:44.067128 (+186376us) write_op.cc:454] Released schema lock
0709 13:03:44.068906 (+  1778us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:44.084527 (+ 15621us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:44.084558 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":83398,"apply.run_cpu_time_us":10877,"apply.run_wall_time_us":802913,"num_ops":3,"prepare.queue_time_us":154637,"prepare.run_cpu_time_us":26014,"prepare.run_wall_time_us":528819,"raft.queue_time_us":181770,"raft.run_cpu_time_us":23305,"raft.run_wall_time_us":119442,"replication_time_us":266082,"thread_start_us":270799,"threads_started":4,"wal-append.queue_time_us":68361}]]}
I20260709 13:03:44.394642 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:44.442276 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.463474 16549 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.471426 16549 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.473181 15197 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:44.445344 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:44.475714 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.477921 15346 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.478559 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.482371 16495 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:44.482872 16495 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.483289 16495 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.481431 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.480592 15195 raft_consensus.cc:2376] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2. Re-sending same reply.
I20260709 13:03:44.485110 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.485684 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.389016 16534 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:44.488281 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.494612 15194 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:44.496212 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:44.497350 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.498348 16537 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.499589 16537 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.500411 16549 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.474308 16376 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:44.501121 16527 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.501549 16376 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.504904 16537 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.487665 16542 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:44.531515 16542 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.531888 15189 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:44.533059 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.532536 16542 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.533679 15189 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:44.488132 16501 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.534632 16501 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.536755 16501 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:44.538023 15194 raft_consensus.cc:2368] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4.
W20260709 13:03:44.546284 15193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 784) took 2329 ms (client timeout 1583 ms). Trace:
W20260709 13:03:44.546712 15193 rpcz_store.cc:269] 0709 13:03:42.216767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.546061 (+2329294us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:44.546200 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:03:44.547688 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.561573 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.553864 15269 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.567997 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.569017 16376 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:44.570570 16376 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.573931 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.574597 15338 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:44.575166 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:44.575508 15345 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.575913 15340 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.577581 15193 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:44.581089 15345 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:44.585968 16527 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.566890 16495 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:44.592231 16495 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:44.594081 16495 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:44.590220 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:44.597396 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 111783us
I20260709 13:03:44.599121 16376 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:44.600847 16376 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.601320 16376 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:44.599623 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.602349 16376 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.603766 16398 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.603849 16495 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:44.604225 16376 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.606042 15238 leader_election.cc:400] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:44.606814 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:44.612982 16495 raft_consensus.cc:2764] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:44.613528 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:44.613900 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.614143 15192 raft_consensus.cc:2376] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2. Re-sending same reply.
W20260709 13:03:44.614627 15192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 33) took 2533 ms (client timeout 1900 ms). Trace:
I20260709 13:03:44.617223 15162 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.618589 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.619203 16549 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:44.619618 16549 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.619971 16549 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.604367 16398 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:44.623859 16398 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.625116 16398 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.625847 16310 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.626248 16310 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.626561 16310 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:44.629060 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.630002 16415 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:44.631953 15191 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:44.633031 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 741) took 2550 ms. Trace:
I20260709 13:03:44.636780 16359 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:44.641551 15192 rpcz_store.cc:269] 0709 13:03:42.080936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.081045 (+   109us) service_pool.cc:224] Handling call
0709 13:03:44.314077 (+2233032us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:03:44.613386 (+299309us) spinlock_profiling.cc:243] Waited 8.44 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8e9c 00007f36e25e8a5b 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:03:44.614551 (+  1165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37136000}
W20260709 13:03:44.647300 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.636310 15191 rpcz_store.cc:276] 0709 13:03:42.082086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.005755 (+923669us) service_pool.cc:224] Handling call
0709 13:03:44.631691 (+1625936us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.632624 (+   933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.632930 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:44.650300 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.651103 15190 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:44.634302 16310 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.656920 16183 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.659487 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.660307 16183 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.656250 16549 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.665834 16549 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.667553 16292 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:44.667919 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 846) took 2568 ms. Trace:
W20260709 13:03:44.668080 16292 raft_consensus.cc:1068] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:44.668355 15341 rpcz_store.cc:276] 0709 13:03:42.099885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.101555 (+  1670us) service_pool.cc:224] Handling call
0709 13:03:42.101851 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.246879 (+145028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.246935 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:42.247002 (+    67us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:42.249367 (+  2365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.667587 (+2418220us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003ab1d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:44.667643 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.667790 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310168960}
I20260709 13:03:44.669428 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.670001 15346 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.670353 15341 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:44.670740 15341 pending_rounds.cc:85] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
I20260709 13:03:44.671005 15341 pending_rounds.cc:107] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:44.675469 15341 raft_consensus.cc:2889] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:44.660418 15337 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.680637 15346 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.685675 16310 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.687489 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:44.687546 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62074.8us
I20260709 13:03:44.688333 15269 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:44.689286 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.689889 15269 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.693490 16510 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:44.694195 16510 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.695364 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.695955 15266 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.696681 16510 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:44.702143 15337 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
W20260709 13:03:44.682741 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68919us
I20260709 13:03:44.708068 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.717525 15188 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:44.717677 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.726243 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:44.727197 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.727982 15267 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:44.726717 16495 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:44.728961 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.730162 15267 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.726686 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.726230 16510 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.731489 16307 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:44.731990 16307 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.732264 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.745549 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.732841 16307 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.745908 15267 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
W20260709 13:03:44.737434 15268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.009s	sys 0.001s
W20260709 13:03:44.748914 15268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.010s	sys 0.001s
I20260709 13:03:44.750200 15875 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:44.750566 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.751329 15268 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 1.
I20260709 13:03:44.751449 15238 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.752281 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.752844 15268 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.753931 16361 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:44.755291 16567 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:44.757485 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.758054 15267 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.763300 15268 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.764377 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.764827 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.765436 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:44.769587 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 176507us
I20260709 13:03:44.752763 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.740928 15269 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.775435 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:44.772253 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.781811 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.784284 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.784874 15346 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.785274 15238 leader_election.cc:400] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:44.785688 15238 leader_election.cc:403] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:44.791677 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.792618 15191 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:44.792752 15346 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.794811 15339 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:44.797034 15339 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:44.798265 15338 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:44.799823 15346 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:44.801648 15267 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.802493 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.803020 15267 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.803653 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:44.805994 15268 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:44.807184 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.807920 15268 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.805045 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:44.766100 16567 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.791355 16114 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:44.780479 16476 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:44.742375 16531 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:03:44.791352 16495 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:44.800115 16530 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:44.763187 16359 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:03:44.819209 15268 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.829274 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.829986 15268 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.825497 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:44.834319 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.804461 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:44.835274 15269 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.841972 15267 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.833792 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:44.846040 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:44.848852 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.849732 15267 raft_consensus.cc:2376] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4. Re-sending same reply.
I20260709 13:03:44.850857 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.852228 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:44.853232 15267 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:44.853854 15268 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:44.858068 15269 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:44.818210 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:44.818419 16292 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:44.823606 15188 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:44.817790 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:44.871183 15337 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.873889 16377 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:44.874277 16377 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.874625 16377 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.876699 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.877823 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.879383 16435 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.879666 16453 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:44.880154 16435 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.880475 16453 consensus_queue.cc:1243] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:44.880525 16510 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:44.880654 16435 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.827513 16530 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:44.861835 16376 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:44.881712 16530 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.881897 16376 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:44.882257 16397 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:44.882680 16397 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:44.883201 16415 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.882858 16376 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.883565 16397 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:44.863580 15190 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:44.863968 16398 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:44.867611 16501 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:44.868541 16571 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:03:44.869024 16567 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:44.828547 16428 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:03:44.827781 16256 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:03:44.886660 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:44.879438 16292 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:44.859501 16462 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:03:44.890513 15343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.007s	sys 0.000s
W20260709 13:03:44.915093 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 64688.2us
W20260709 13:03:44.891327 15342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.003s	sys 0.003s
I20260709 13:03:44.891857 15270 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:44.883579 16415 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.892036 16435 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:44.886969 16573 raft_consensus.cc:2764] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:44.862207 16495 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:44.860355 16114 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:44.901222 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 847) took 1985 ms. Trace:
I20260709 13:03:44.202860 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:44.915498 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.000893 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.984133 15337 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:44.980264 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.005106 16435 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:44.915602 15343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.008s	sys 0.001s
I20260709 13:03:44.995257 15272 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.000240 15271 rpcz_store.cc:276] 0709 13:03:42.915415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.922454 (+  7039us) service_pool.cc:224] Handling call
0709 13:03:42.922788 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.942344 (+ 19556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.942390 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.948661 (+  6271us) log.cc:844] Serialized 26 byte log entry
0709 13:03:43.110779 (+162118us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:43.110820 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.900873 (+1790053us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54001b4254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:44.900919 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.900960 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:44.900970 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.901166 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26914,"raft.queue_time_us":2719,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4280,"spinlock_wait_cycles":43825152,"thread_start_us":134160,"threads_started":1,"wal-append.queue_time_us":255469,"wal-append.run_cpu_time_us":1791,"wal-append.run_wall_time_us":1003238}
I20260709 13:03:45.008015 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.008075 15272 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.008678 15346 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:45.008967 15271 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:45.009737 15272 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:45.010138 15271 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:45.000046 15342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.009s	sys 0.009s
I20260709 13:03:45.006256 15312 leader_election.cc:400] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4.
I20260709 13:03:45.007345 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.014110 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.014793 15344 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 4. Ops: []
W20260709 13:03:45.015407 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.003387 16114 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.005808 16415 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.011826 15312 leader_election.cc:403] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:45.015700 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.016914 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.030560 15338 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:45.021456 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.027945 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.033056 15344 raft_consensus.cc:2368] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
W20260709 13:03:45.034042 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.034037 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:45.034669 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.036031 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:45.031790 15309 connection.cc:256] RPC call timeout handler was delayed by -1.2806904359999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 13:03:45.038255 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.038486 15309 connection.cc:256] RPC call timeout handler was delayed by -1.0254702649999672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 13:03:45.058156 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:44.909792 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 104788us
I20260709 13:03:45.239768 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:45.241358 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.242038 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.241371 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.242913 15270 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.008101 15337 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:45.255450 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 368684us
I20260709 13:03:45.043376 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.266147 15342 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:45.267856 15339 raft_consensus.cc:1217] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:03:45.039367 16256 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4.
I20260709 13:03:45.292112 16307 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:45.294056 16361 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.030910 16332 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.030761 16428 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.480885 15342 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:45.481365 16332 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.482551 16579 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.483347 16462 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.484006 16462 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.484618 15346 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:45.485761 15218 debug-util.cc:398] Leaking SignalData structure 0x7b08001be300 after lost signal to thread 14039
I20260709 13:03:45.029276 16501 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.298656 16377 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:45.039367 16582 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:45.499713 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.500573 16582 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:45.419446 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.419770 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 380772us
I20260709 13:03:45.420578 16398 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:45.429214 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.429708 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.431782 15339 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:45.431380 15160 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:45.478768 15341 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:45.481493 16428 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:45.342182 15272 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:03:45.504806 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.476642 16307 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.505132 16361 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.506376 15344 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:45.507222 16579 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.507738 16354 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.508108 15270 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:45.487857 16501 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.488857 15841 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:45.490101 16377 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
W20260709 13:03:45.512686 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.486974 16462 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.565397 16310 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:45.565577 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 134473us
I20260709 13:03:45.566077 16310 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:45.566659 16310 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:45.585457 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.526613 16307 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.552130 16428 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:45.608217 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:45.532281 16398 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:45.603012 16332 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:45.647716 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 80348.6us
W20260709 13:03:45.653009 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.654747 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.664683 16501 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:45.664842 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:45.666255 15876 raft_consensus.cc:2410] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:03:45.664950 16415 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.628s	user 0.019s	sys 0.060s
W20260709 13:03:45.683109 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75092.4us
W20260709 13:03:45.697003 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.673697 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46638.1us
I20260709 13:03:45.704843 16361 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.705181 16579 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.698992 16332 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:45.707387 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:45.707545 16332 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.710602 16332 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:45.713815 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:45.714881 16332 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:45.717540 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:45.718582 16332 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:45.705214 15160 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:45.706964 16398 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.706197 16434 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:45.699096 16354 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:45.733623 16530 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.851s	user 0.021s	sys 0.016s
I20260709 13:03:45.734287 16354 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:45.734130 16530 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:45.691133 16428 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:03:45.736665 16428 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:45.737089 16428 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:45.747170 16592 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:45.754822 15270 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.724949 16434 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.776772 15272 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:45.779349 16549 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:45.779902 15263 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:45.738432 16428 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.691555 16415 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.781631 16434 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.787655 16579 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:45.755911 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 190475us
I20260709 13:03:45.798753 15269 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:45.811631 16537 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:45.812531 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 107532us
I20260709 13:03:45.812413 16537 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.813019 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.813509 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:45.814049 15272 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:45.814145 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.815392 16579 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.816462 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.814970 16537 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.818427 16579 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.818559 16537 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:45.819118 16537 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:45.815387 15266 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:45.820295 16537 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:45.821206 16472 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.399s	user 0.021s	sys 0.010s
I20260709 13:03:45.824291 16428 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.826718 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 865) took 1110 ms. Trace:
I20260709 13:03:45.828370 16530 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:45.827275 15268 rpcz_store.cc:276] 0709 13:03:44.716090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.854545 (+138455us) service_pool.cc:224] Handling call
0709 13:03:44.854839 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.902897 (+ 48058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.902930 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.903659 (+   729us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.228091 (+324432us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:45.228226 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.228426 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.826276 (+597850us) raft_consensus.cc:1685] finished
0709 13:03:45.826298 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.826524 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25825,"raft.queue_time_us":26536,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":12605,"thread_start_us":278377,"threads_started":1,"wal-append.queue_time_us":857262}
I20260709 13:03:45.830085 16310 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:45.830900 16415 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.831887 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:45.832481 16310 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.832803 15876 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:03:45.795434 16592 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:45.833957 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.835057 16592 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:45.836798 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.837527 16591 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:45.839664 16534 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:45.839826 15218 debug-util.cc:398] Leaking SignalData structure 0x7b080014e2a0 after lost signal to thread 15129
W20260709 13:03:45.841799 15218 debug-util.cc:398] Leaking SignalData structure 0x7b0800336de0 after lost signal to thread 15221
I20260709 13:03:45.842715 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.843142 15272 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:45.843830 15263 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 4. Ops: []
I20260709 13:03:45.844323 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.844625 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.848460 15270 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.850060 16397 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.851579 16592 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:45.822347 16307 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:45.854056 16307 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:45.854261 15218 debug-util.cc:398] Leaking SignalData structure 0x7b080025fa20 after lost signal to thread 15296
I20260709 13:03:45.832240 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:45.856416 15218 debug-util.cc:398] Leaking SignalData structure 0x7b08002b93a0 after lost signal to thread 15370
I20260709 13:03:45.858270 15343 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:45.862375 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.865597 15345 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:45.867434 15338 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:03:45.867833 15338 pending_rounds.cc:85] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
I20260709 13:03:45.868084 15338 pending_rounds.cc:107] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:03:45.868353 15338 raft_consensus.cc:2889] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.868381 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.802950 16549 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:45.876483 15263 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:45.883597 15270 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.897284 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:45.883956 16591 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:45.903447 16591 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:45.904094 15270 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:45.898862 15218 debug-util.cc:398] Leaking SignalData structure 0x7b080031d600 after lost signal to thread 15900
I20260709 13:03:45.883124 16549 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:03:45.891449 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 184402us
I20260709 13:03:45.903970 16591 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:45.905514 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:45.911945 15272 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:45.918835 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:45.923928 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.960753 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83998.5us
W20260709 13:03:45.928158 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.965211 15270 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:45.964515 16585 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.386s	user 0.004s	sys 0.000s
I20260709 13:03:45.964354 16592 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:03:45.964754 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:45.979015 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:45.976897 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.983294 16596 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:03:45.984267 15191 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:45.986650 15339 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:45.988610 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:45.988704 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:45.990495 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:45.991407 15195 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:45.991778 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:45.995558 15875 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 87) took 1096 ms. Trace:
I20260709 13:03:45.992825 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:45.994187 15188 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 4. Ops: []
I20260709 13:03:45.979099 16310 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.995388 16398 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:45.998234 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.992283 16567 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.001073 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:46.005728 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 517321us
I20260709 13:03:46.006032 16310 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.008736 16310 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:46.011381 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 187492us
I20260709 13:03:46.011070 16567 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.011915 16582 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:46.011901 15237 connection.cc:256] RPC call timeout handler was delayed by -1.2308761880001384s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
W20260709 13:03:46.012939 15237 connection.cc:256] RPC call timeout handler was delayed by -1.1813761880000584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 13:03:46.013232 15237 connection.cc:256] RPC call timeout handler was delayed by -1.1012761880000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:03:46.013450 16567 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:46.014310 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.005803 16398 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.016144 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.016652 16398 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:46.017067 15271 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:46.016543 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:46.013509 15237 connection.cc:256] RPC call timeout handler was delayed by -1.0616761880000922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
I20260709 13:03:46.010617 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.017406 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.023672 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.025184 16472 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.025457 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55865.4us
I20260709 13:03:46.026062 16592 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:46.025802 16472 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.026587 16592 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:46.026522 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.024099 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.028523 15266 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:46.028429 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:46.028009 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.035267 16491 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:46.036365 15268 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:46.036671 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.029965 16600 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:03:46.000823 15875 rpcz_store.cc:276] 0709 13:03:44.899423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.899577 (+   154us) service_pool.cc:224] Handling call
0709 13:03:44.900129 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.900490 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.900520 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.901505 (+   985us) log.cc:844] Serialized 556 byte log entry
0709 13:03:45.039209 (+137704us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:45.039297 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.059131 (+ 19834us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.822334 (+763203us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:45.994907 (+172573us) raft_consensus.cc:1685] finished
0709 13:03:45.994942 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:45.995313 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24039296,"thread_start_us":128117,"threads_started":1,"wal-append.queue_time_us":529744}
I20260709 13:03:46.040522 16592 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.032780 16594 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.043395 16594 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:46.043815 15188 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:46.048202 15193 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:46.051783 15195 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:46.053553 16599 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:46.054513 16599 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:46.055078 16599 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:03:46.057446 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.062103 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.032044 15269 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
W20260709 13:03:46.063084 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.063755 15343 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:46.054423 16434 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.044806 16567 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.078343 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.078820 16600 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:46.056524 16599 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.079386 15195 raft_consensus.cc:2410] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:46.079872 16600 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.080096 16599 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.080340 16600 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:46.081449 16600 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.082685 16600 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.083207 15263 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:46.084448 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.085386 15197 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:46.086390 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:46.087406 15196 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:03:46.087628 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.088584 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.090188 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 860) took 1403 ms. Trace:
I20260709 13:03:46.091280 16398 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.091816 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.092128 16398 consensus_queue.cc:1243] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:46.093405 16398 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:46.094314 16398 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.083137 16593 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:46.100473 15272 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:46.107668 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:46.092139 16472 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:46.121364 15191 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.107453 16398 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:46.107528 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:46.121012 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:46.126430 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 127332us
W20260709 13:03:46.132795 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.109122 16591 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.131502 15193 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.132043 16579 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.147922 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.149400 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:46.151437 15272 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.152278 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.150861 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.152791 15268 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.153177 15269 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:46.152354 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:46.145082 16310 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:03:46.125846 16428 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:03:46.156824 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.156461 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.155211 16582 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
W20260709 13:03:46.154433 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 128092us
I20260709 13:03:46.159891 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.167204 16398 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:46.169318 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.169677 16415 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.170751 16415 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:46.171222 16397 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:46.171626 16397 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.171974 16397 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.172791 16415 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.174024 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.090626 15265 rpcz_store.cc:276] 0709 13:03:44.686228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.698263 (+ 12035us) service_pool.cc:224] Handling call
0709 13:03:44.698586 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.698950 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.698983 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.840809 (+1141826us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:03:45.841467 (+   658us) log.cc:844] Serialized 26 byte log entry
0709 13:03:46.020319 (+178852us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:46.022783 (+  2464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.033692 (+ 10909us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.089672 (+ 55980us) raft_consensus.cc:1685] finished
0709 13:03:46.089691 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.089965 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8028,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":14698368,"thread_start_us":138275,"threads_started":1,"wal-append.queue_time_us":202942}
I20260709 13:03:46.174574 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:46.169013 16398 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.150590 16567 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:46.145149 16453 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:03:46.201943 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 132742us
I20260709 13:03:46.202445 15162 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:46.156354 15188 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.200917 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:46.208886 16601 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:03:46.209863 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.207455 15271 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:46.211315 16537 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:46.218071 15266 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:03:46.221623 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47557.2us
I20260709 13:03:46.222523 15270 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:46.224557 16453 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:46.225546 16453 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:46.225776 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.225948 16453 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:46.226449 15271 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:46.227178 16434 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:46.227918 16434 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.228360 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:46.229141 15193 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.231877 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:46.232758 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:03:46.233003 15237 leader_election.cc:336] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.843s (SENT)
I20260709 13:03:46.233530 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:46.207433 16307 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.202188 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.233649 15872 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:46.234356 16591 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.156824 16579 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.170843 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:03:46.237777 16605 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 13:03:46.234385 16307 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:46.239501 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.240370 16307 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.241592 16307 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.234668 15265 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:46.220762 16530 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.240391 15345 raft_consensus.cc:2410] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:46.244107 16530 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.245230 16491 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:46.246372 16604 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.094s	user 0.005s	sys 0.000s
I20260709 13:03:46.247716 16377 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:46.248137 16377 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:46.248294 16527 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:46.249235 16537 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:46.249614 16501 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:46.250097 16501 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:46.250396 16537 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.251013 16501 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.251507 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 862) took 1564 ms. Trace:
I20260709 13:03:46.252305 16501 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.227939 15271 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 13:03:46.287482 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.293224 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:46.294142 15343 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:46.295754 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 910) took 1514 ms. Trace:
I20260709 13:03:46.296108 15346 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:46.297204 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.296264 15340 rpcz_store.cc:276] 0709 13:03:44.781476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.791421 (+  9945us) service_pool.cc:224] Handling call
0709 13:03:45.880702 (+1089281us) spinlock_profiling.cc:243] Waited 6.26 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:45.905403 (+ 24701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:45.960933 (+ 55530us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:46.113779 (+152846us) log.cc:844] Serialized 14 byte log entry
0709 13:03:46.291110 (+177331us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:46.292489 (+  1379us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:46.295352 (+  2863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.295432 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.295558 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40599,"prepare.queue_time_us":48897,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1839,"raft.queue_time_us":75453,"spinlock_wait_cycles":28905728,"thread_start_us":205004,"threads_started":2,"wal-append.queue_time_us":88114}
I20260709 13:03:46.298151 15345 raft_consensus.cc:2368] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:46.299332 16530 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:46.300972 16377 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.305131 16377 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:46.305692 16610 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:03:46.307402 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 74502.4us
W20260709 13:03:46.310822 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91476.2us
I20260709 13:03:46.227128 16453 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:46.316337 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.316483 16453 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.319603 15345 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:46.321178 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:46.301021 15092 catalog_manager.cc:5697] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.320200 16397 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.251905 15264 rpcz_store.cc:276] 0709 13:03:44.686714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.700812 (+ 14098us) service_pool.cc:224] Handling call
0709 13:03:44.701129 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.701450 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.701482 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.853851 (+1152369us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:03:45.854474 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.968156 (+113682us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:45.972971 (+  4815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.977896 (+  4925us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.251100 (+273204us) raft_consensus.cc:1685] finished
0709 13:03:46.251117 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.251339 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5704,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"spinlock_wait_cycles":9460480,"thread_start_us":109370,"threads_started":1,"wal-append.queue_time_us":259559}
I20260709 13:03:46.344772 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.358573 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:46.374828 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 156113us
I20260709 13:03:46.354601 15092 catalog_manager.cc:5697] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 2, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:46.375579 15272 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:46.338688 16600 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:03:46.386526 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:46.392040 15237 leader_election.cc:336] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.987s (SENT)
I20260709 13:03:46.374933 16567 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:46.396778 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:46.397383 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.402518 16579 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:46.408320 16612 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:03:46.409857 16397 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:46.409644 16594 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.404251 15092 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:03:46.398690 15188 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:46.389153 16491 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.432582 15346 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:46.404379 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:46.444123 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52536.7us
I20260709 13:03:46.424606 16472 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:46.431432 16594 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.433882 16579 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:46.448371 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.450896 15346 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:46.451431 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.452747 16354 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:46.453485 15337 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:46.453904 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 864) took 1663 ms. Trace:
I20260709 13:03:46.458060 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:46.460517 15191 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.454344 15267 rpcz_store.cc:276] 0709 13:03:44.715778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.853885 (+138107us) service_pool.cc:224] Handling call
0709 13:03:44.854306 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.239615 (+385309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.239675 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:46.128596 (+888921us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:03:46.148693 (+ 20097us) log.cc:844] Serialized 26 byte log entry
0709 13:03:46.336138 (+187445us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:46.336186 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.336277 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.366104 (+ 29827us) raft_consensus.cc:1685] finished
0709 13:03:46.366122 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.379550 (+ 13428us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26775,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":62746880,"thread_start_us":485797,"threads_started":2,"wal-append.queue_time_us":173807}
I20260709 13:03:46.427109 16491 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.448895 15340 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
W20260709 13:03:46.465332 16611 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:03:46.474509 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 91844.5us
I20260709 13:03:46.476441 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:46.466342 16606 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.334s	user 0.002s	sys 0.000s
I20260709 13:03:46.460019 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.457360 16579 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.458321 16472 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.459107 16428 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:03:46.483394 16453 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:46.489079 16490 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
W20260709 13:03:46.491505 16409 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.006s	sys 0.003s
I20260709 13:03:46.501780 16615 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:03:46.501734 16453 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:46.512462 16453 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:46.507422 15267 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:03:46.515589 16597 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:46.529116 15191 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:03:46.529548 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.509850 15237 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.031s (SENT)
I20260709 13:03:46.530440 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:46.480125 16567 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:46.509688 16409 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.006s	sys 0.003s
W20260709 13:03:46.532539 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51623.2us
I20260709 13:03:46.533357 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:46.527179 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.526541 16600 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:03:46.536299 16398 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.536974 16592 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:46.537405 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45915.7us
I20260709 13:03:46.538662 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.537426 16592 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:46.539790 16592 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.540470 16597 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.541056 16597 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.541771 16398 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.543241 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.544044 16398 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.544449 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.500558 16626 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:46.545184 15343 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:46.545892 16626 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.546736 16597 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:46.547884 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.549429 16626 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:46.552259 16626 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:46.552838 16626 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.554219 15876 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:46.554952 16621 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:46.555516 16626 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:46.556520 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.541026 16592 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:46.556054 16626 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:46.561932 16398 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:46.564519 16613 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:03:46.565615 16623 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:03:46.566606 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.562373 15190 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:46.572947 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.574483 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.574898 16579 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.575526 16448 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.576241 16448 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.576853 16472 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.578555 15193 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:46.579823 16491 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:46.582036 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 93840.3us
I20260709 13:03:46.582940 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 817) took 1564 ms. Trace:
I20260709 13:03:46.583434 15342 rpcz_store.cc:276] 0709 13:03:45.018675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.481934 (+463259us) service_pool.cc:224] Handling call
0709 13:03:45.482333 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:45.551411 (+ 69078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.551438 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:45.551991 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:03:45.594719 (+ 42728us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:45.788642 (+193923us) log.cc:844] Serialized 14 byte log entry
0709 13:03:45.789144 (+   502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:45.918857 (+129713us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b48001e0258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:03:46.397949 (+479092us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b18002dc7c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419
0709 13:03:46.582568 (+184619us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b5400246654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:46.582627 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.582687 (+    60us) raft_consensus.cc:1685] finished
0709 13:03:46.582703 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.582872 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":368401,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":2500,"raft.run_cpu_time_us":3299,"raft.run_wall_time_us":349135,"spinlock_wait_cycles":214236672,"thread_start_us":156944,"threads_started":2,"wal-append.queue_time_us":227926}
I20260709 13:03:46.604940 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:46.607041 16530 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:46.607090 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.607707 16530 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:46.608634 16530 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.609225 16618 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:46.612393 16582 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:46.613978 16625 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:46.614830 16453 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.615243 16114 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:46.601882 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.621826 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.622750 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.622171 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:46.578950 16448 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.632227 15191 raft_consensus.cc:1217] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-3.2]   Dedup: 3.2->[]
I20260709 13:03:46.628564 16428 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:46.606387 16597 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.633534 16428 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:46.604235 16398 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.634544 15191 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:46.638218 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:46.641920 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67513.5us
W20260709 13:03:46.679168 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.602845 16307 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:03:46.670712 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.707751 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.704341 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 214655us
I20260709 13:03:46.670015 16409 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:46.639778 16627 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
W20260709 13:03:46.726045 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 97925.6us
I20260709 13:03:46.727820 16631 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:46.710974 16409 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:46.732220 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91267us
I20260709 13:03:46.730626 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:46.709321 16625 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:46.708627 16398 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.725178 16491 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.764851 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.704797 16114 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:03:46.769579 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:46.771111 15144 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.008s	sys 0.044s
W20260709 13:03:46.771464 15144 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.009s	sys 0.044s
I20260709 13:03:46.716996 16453 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.2, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:03:46.713881 16615 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:03:46.766016 16472 raft_consensus.cc:2764] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:46.730584 16620 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:03:46.781636 16377 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.781997 16453 consensus_queue.cc:1243] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:46.777539 16354 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.787348 16354 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:46.788194 16630 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:46.788781 16630 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:46.789613 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 59137.9us
I20260709 13:03:46.790702 15237 leader_election.cc:400] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:03:46.790997 15237 leader_election.cc:403] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:46.791822 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 72618.7us
I20260709 13:03:46.797765 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:46.786847 16634 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:46.800292 16582 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.802778 15267 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:46.777017 16549 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:03:46.767822 16491 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.810609 15272 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:46.811299 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:46.811684 16491 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.811867 15271 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.813088 16627 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:46.736300 16631 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.798494 16472 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:03:46.823393 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:46.827907 15270 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.793495 16630 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.824394 16631 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.825083 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:46.832383 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.832975 15343 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:46.778540 16428 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.838099 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:46.837792 15263 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.839736 15345 raft_consensus.cc:2410] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:03:46.840584 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.842584 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:46.843495 15875 raft_consensus.cc:2410] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:46.843667 15876 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEARNER]: Advancing to term 4
I20260709 13:03:46.845957 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:46.846481 15267 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.847949 15265 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:46.836439 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.850237 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:46.851855 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.852979 15271 raft_consensus.cc:2410] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:46.853082 15268 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:46.854663 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.800956 16625 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:46.857241 16625 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:46.844861 16409 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.858451 15272 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:46.859426 16409 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.866146 15270 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:46.859373 15340 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:46.879967 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:46.866847 16434 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:03:46.882943 15264 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:46.855366 15265 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:46.870489 16534 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.868701 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.893215 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:46.897596 15271 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:46.895457 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.909850 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.908075 16398 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:46.931569 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:46.934294 16354 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:46.936193 15345 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:46.902817 16534 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.951119 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:46.940589 16627 raft_consensus.cc:1064] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:46.966599 16354 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:46.971208 16398 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.972327 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:46.971736 16398 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:46.964556 16625 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:46.998898 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 50883us
I20260709 13:03:47.008549 15876 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:47.009433 16627 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:46.996731 16472 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.997277 16625 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:47.045740 15875 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.051278 16625 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:47.070649 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76447.8us
W20260709 13:03:47.068938 16640 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:03:47.082525 16534 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:47.083918 16647 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:03:47.053679 16615 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:03:47.091943 16615 consensus_queue.cc:1243] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:03:47.096868 16648 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:03:47.078640 16579 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.079118 16592 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:47.053740 16472 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:47.078819 16630 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:47.164384 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:47.164500 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:47.112740 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:47.176064 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.109115 16631 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:47.105798 16626 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.239836 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 159143us
W20260709 13:03:47.242673 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.264874 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.239111 16398 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:47.279068 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:47.171144 16579 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:47.206087 16597 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:47.203574 15871 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
W20260709 13:03:47.302268 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.273955 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.276893 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.273788 16646 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.338246 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.206772 16631 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:47.194577 16592 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:47.345425 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.346100 15267 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:47.270349 16549 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.349973 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:47.350950 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 78986.2us
I20260709 13:03:47.204640 16630 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:47.263391 16626 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:47.282799 15263 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:47.346709 16530 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:47.385805 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:47.372393 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.390769 15190 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 4. Ops: []
I20260709 13:03:47.387552 16618 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:47.373462 16639 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:47.388918 16657 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 13:03:47.393666 16654 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 13:03:47.392714 15341 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:47.367714 16646 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:47.419430 16659 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
W20260709 13:03:47.420138 16664 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:03:47.422714 15870 pending_rounds.cc:85] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 2
I20260709 13:03:47.423527 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:47.424671 16428 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:47.402040 16409 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.004s
I20260709 13:03:47.425379 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:47.459333 15338 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:47.462479 15338 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:47.462798 15338 pending_rounds.cc:85] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
W20260709 13:03:47.436883 16662 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
I20260709 13:03:47.437151 16592 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:47.437364 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:47.464808 15345 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:47.465900 15339 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:47.438040 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:47.419332 16656 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:03:47.452515 15870 pending_rounds.cc:107] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:47.388996 16620 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 13:03:47.467841 15870 raft_consensus.cc:2889] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:47.468099 16620 consensus_queue.cc:1243] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:47.407007 16639 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.469324 16639 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.470145 16354 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:47.471676 15338 pending_rounds.cc:107] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:47.455364 15192 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:47.406493 16501 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:47.458204 16428 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:47.472110 15338 raft_consensus.cc:2889] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:47.483471 15875 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:47.485824 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:47.387028 16549 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:47.491894 15194 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:47.492839 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.499660 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.510530 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:47.545833 15191 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:47.546635 16354 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:47.548969 16354 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:47.549500 16354 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.550995 16625 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:47.507817 15188 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:47.548403 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 114842us
I20260709 13:03:47.548836 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.511432 16472 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:47.515909 16409 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.594197 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:47.613072 15270 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:47.599818 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 89371us
I20260709 13:03:47.621977 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.593802 16377 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:47.622864 16377 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:47.624512 16625 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:47.625568 16377 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:47.627477 16631 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:47.629328 16626 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:47.510762 16491 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.511620 16453 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:47.637894 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:47.643505 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:47.643944 16652 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.590s	user 0.000s	sys 0.004s
I20260709 13:03:47.645414 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 975) took 1041 ms. Trace:
I20260709 13:03:47.646204 16687 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:47.646776 16687 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:47.645829 15193 rpcz_store.cc:276] 0709 13:03:46.603709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.604367 (+   658us) service_pool.cc:224] Handling call
0709 13:03:46.628407 (+ 24040us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:46.778603 (+150196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.779641 (+  1038us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:46.836767 (+ 57126us) log.cc:844] Serialized 52 byte log entry
0709 13:03:46.955702 (+118935us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:46.960677 (+  4975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.964242 (+  3565us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:47.636127 (+671885us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:47.645021 (+  8894us) raft_consensus.cc:1685] finished
0709 13:03:47.645043 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.645317 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10439,"raft.queue_time_us":86585,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":8868224,"thread_start_us":135732,"threads_started":2,"wal-append.queue_time_us":124482}
I20260709 13:03:47.649192 16687 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:47.649358 16663 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260709 13:03:47.650007 16630 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:47.651518 16549 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:47.616132 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.652547 16646 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:47.678403 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 119434us
I20260709 13:03:47.740530 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:47.667821 16453 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:47.620806 16409 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:47.745327 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69489.1us
I20260709 13:03:47.650832 16354 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:47.773809 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:47.776814 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 103542us
I20260709 13:03:47.639142 16491 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:47.746562 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.745047 16530 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.749387 16448 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:47.786418 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:47.748239 16592 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:47.749697 16679 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:47.789510 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:47.859449 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.829344 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:47.897953 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.787073 16428 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:47.899714 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 118458us
I20260709 13:03:47.792860 16448 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.820443 16592 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:47.906081 16592 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:47.907451 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.908097 16448 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.820021 16453 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:47.901635 16688 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:03:47.912292 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 83035.3us
I20260709 13:03:47.820756 15193 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:47.896657 16377 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.936975 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.781579 16681 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.121s
I20260709 13:03:47.911232 16453 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:47.895247 16415 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:03:47.938810 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 921) took 1035 ms. Trace:
I20260709 13:03:47.959012 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:47.816711 16530 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:47.938577 16626 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:47.958953 15267 rpcz_store.cc:276] 0709 13:03:46.903705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.383772 (+480067us) service_pool.cc:224] Handling call
0709 13:03:47.384066 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.388109 (+  4043us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:47.402476 (+ 14367us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.938436 (+535960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:47.938491 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:47.938534 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.938601 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.938710 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69046,"prepare.queue_time_us":14158,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":98586,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"thread_start_us":400455,"threads_started":2,"wal-append.queue_time_us":97357}
I20260709 13:03:47.970093 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:47.951020 16453 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.887382 16679 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.015057 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:47.964470 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.020726 16530 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:48.021844 16658 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.820s	user 0.007s	sys 0.005s
I20260709 13:03:48.023487 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.027199 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.027514 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.028120 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.028550 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.028967 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.030469 16579 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:47.972246 16626 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.048659 15195 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:47.952638 16377 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:48.072163 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.035609 16592 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.963199 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 924) took 1011 ms. Trace:
I20260709 13:03:47.994760 16428 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:03:48.097453 16695 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.098187 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.099660 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.099848 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.100574 15194 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:48.101253 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.101548 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.102933 16686 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.103603 16686 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.097457 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.098397 16693 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.052258 16626 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.106769 16693 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:48.052394 16694 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.053186 16530 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.108989 15193 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:48.124256 15267 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:48.126724 15237 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.895s (SENT)
I20260709 13:03:48.094095 16579 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.106796 16686 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.125923 16530 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.150178 16597 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.150792 16597 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.153800 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:48.153971 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:48.154479 15871 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:48.154814 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:48.155441 15870 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.156781 16597 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.160439 16597 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.160856 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 966) took 1108 ms. Trace:
I20260709 13:03:48.160928 16597 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.163393 16686 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.163707 16597 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.163923 16686 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.167891 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:48.168749 16597 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.169356 16597 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.169783 16597 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.175369 16491 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.177801 16686 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.178838 16597 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.180997 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:48.109562 16592 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.098224 16695 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.139601 15189 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:48.187966 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 954) took 1279 ms. Trace:
I20260709 13:03:48.139582 16354 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.199326 15342 rpcz_store.cc:276] 0709 13:03:46.909039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.936598 (+ 27559us) service_pool.cc:224] Handling call
0709 13:03:46.936923 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:46.941244 (+  4321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.941284 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:46.941810 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:03:46.992250 (+ 50440us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:46.992295 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.992360 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:47.974479 (+982119us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:48.146526 (+172047us) raft_consensus.cc:1685] finished
0709 13:03:48.146544 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.187885 (+ 41341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10674,"raft.queue_time_us":19704,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5407,"spinlock_wait_cycles":6107264,"thread_start_us":31972,"threads_started":1,"wal-append.queue_time_us":154561}
W20260709 13:03:48.203815 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 90588.9us
I20260709 13:03:48.184087 16530 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:48.214103 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 194379us
W20260709 13:03:48.200593 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 382248us
I20260709 13:03:48.195871 16501 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:03:48.133525 16694 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:48.210140 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.029s (SENT) [suppressed 23 similar messages]
I20260709 13:03:48.220669 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.161466 15341 rpcz_store.cc:276] 0709 13:03:47.052854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.461646 (+408792us) service_pool.cc:224] Handling call
0709 13:03:47.462064 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.462530 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.462559 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.499232 (+ 36673us) log.cc:844] Serialized 26 byte log entry
0709 13:03:47.792283 (+293051us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:47.819944 (+ 27661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.896941 (+ 76997us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.160567 (+263626us) raft_consensus.cc:1685] finished
0709 13:03:48.160609 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.160792 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":190727,"threads_started":1,"wal-append.queue_time_us":528478}
I20260709 13:03:48.203184 16678 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.226871 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.180184 16549 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:03:48.148044 16579 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.195303 16615 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:03:48.231662 15237 leader_election.cc:336] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.091s (SENT)
I20260709 13:03:48.232450 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:48.241043 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.242374 16679 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:48.233408 16639 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.006s
I20260709 13:03:48.219158 16616 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:03:48.220332 16409 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:48.208268 15876 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:48.110358 15265 rpcz_store.cc:276] 0709 13:03:46.951956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.439097 (+487141us) service_pool.cc:224] Handling call
0709 13:03:47.439534 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.439861 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:47.440310 (+   449us) log.cc:844] Serialized 14 byte log entry
0709 13:03:47.815414 (+375104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:47.885901 (+ 70487us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:47.901178 (+ 15277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.919928 (+ 18750us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.956549 (+ 36621us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65865,"prepare.queue_time_us":2411,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":104662,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":53,"thread_start_us":245606,"threads_started":2,"wal-append.queue_time_us":159782}
I20260709 13:03:48.244464 16695 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.246187 16579 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.247854 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.242404 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.242424 16694 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.244093 16639 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.247470 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 923) took 1317 ms. Trace:
I20260709 13:03:48.230154 16627 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:03:48.257647 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 920) took 1361 ms. Trace:
I20260709 13:03:48.256865 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.244992 16592 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.263840 15194 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:48.257735 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 925) took 1298 ms. Trace:
I20260709 13:03:48.265043 16639 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.243007 16679 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:03:48.264429 15270 rpcz_store.cc:276] 0709 13:03:46.959855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.621059 (+661204us) service_pool.cc:224] Handling call
0709 13:03:47.640664 (+ 19605us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.675464 (+ 34800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.675493 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.747015 (+ 71522us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.122337 (+375322us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:48.122482 (+   145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.122566 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.257515 (+134949us) raft_consensus.cc:1685] finished
0709 13:03:48.257533 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.257681 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45435,"raft.queue_time_us":19345,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":67372,"thread_start_us":329062,"threads_started":1,"wal-append.queue_time_us":450950}
I20260709 13:03:48.266566 16448 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.263648 15190 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:48.260394 16693 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:48.258888 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.266939 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.270603 15270 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:48.262678 15271 rpcz_store.cc:276] 0709 13:03:46.929780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.408369 (+478589us) service_pool.cc:224] Handling call
0709 13:03:47.438752 (+ 30383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.688608 (+249856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.688649 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.745409 (+ 56760us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.044105 (+298696us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:48.044144 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.044229 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.247162 (+202933us) raft_consensus.cc:1685] finished
0709 13:03:48.247186 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.247397 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113781,"raft.queue_time_us":206798,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":393818,"threads_started":2,"wal-append.queue_time_us":458095}
I20260709 13:03:48.263226 15266 rpcz_store.cc:276] 0709 13:03:46.896007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.069283 (+173276us) service_pool.cc:224] Handling call
0709 13:03:47.081756 (+ 12473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:47.665696 (+583940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:47.665735 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:47.678528 (+ 12793us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.048289 (+369761us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:48.048328 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.048394 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.257385 (+208991us) raft_consensus.cc:1685] finished
0709 13:03:48.257417 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.257578 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":404107,"raft.queue_time_us":532305,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":5952,"thread_start_us":397261,"threads_started":2,"wal-append.queue_time_us":446806}
W20260709 13:03:48.228253 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 443299us
I20260709 13:03:48.255741 16377 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.297487 15266 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:48.261377 16453 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:48.316483 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 84834.7us
I20260709 13:03:48.289172 15265 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:03:48.332266 15266 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:48.309695 16693 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.291265 16415 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:03:48.341676 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 936) took 2349 ms. Trace:
I20260709 13:03:48.352196 15339 rpcz_store.cc:276] 0709 13:03:45.985258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.002636 (+ 17378us) service_pool.cc:224] Handling call
0709 13:03:46.026748 (+ 24112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.466284 (+1439536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.328708 (+862424us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002733d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:48.334196 (+  5488us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3309001600}
I20260709 13:03:48.354718 15270 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:48.337944 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:48.359552 15266 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:03:48.392040 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 209463us
I20260709 13:03:48.308451 15271 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:33824
I20260709 13:03:48.354930 16579 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:48.358449 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 388436us
I20260709 13:03:48.439528 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.440389 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:48.449612 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.449997 15192 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
W20260709 13:03:48.430267 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.453205 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:48.435624 16693 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:48.459455 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 237951us
W20260709 13:03:48.459928 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 241013us
I20260709 13:03:48.435359 16695 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.464807 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:48.468608 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:48.358774 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 222690us
W20260709 13:03:48.454746 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.446897 16448 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:48.432628 16678 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:48.487812 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:48.489743 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:48.442948 16579 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.502967 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:48.481398 16686 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.481282 16592 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.512538 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:48.513237 16114 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.516381 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:48.486733 16377 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:48.520172 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:48.486917 16713 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.526980 15271 raft_consensus.cc:606] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:48.538656 15271 raft_consensus.cc:614] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:48.477849 16695 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.532641 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.486824 16527 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.500700 16693 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.543787 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:48.544246 16114 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:48.555267 16707 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:03:48.556819 16706 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:48.560395 16695 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.560663 16579 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.553840 16694 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.563287 16694 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.563678 16114 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.565925 16694 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.569571 16709 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.570101 16709 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.566936 16678 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.570750 16709 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.571445 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 42) took 1203 ms. Trace:
I20260709 13:03:48.571861 15188 rpcz_store.cc:276] 0709 13:03:47.348860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.350472 (+  1612us) service_pool.cc:224] Handling call
0709 13:03:47.387423 (+ 36951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.560929 (+173506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.521298 (+960369us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b54001f72d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:48.552135 (+ 30837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195666688}
I20260709 13:03:48.573542 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:48.574209 15872 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:48.513329 15839 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:48.541800 16642 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:48.575811 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 74007.6us
I20260709 13:03:48.576040 16642 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:48.526132 16537 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.524526 16377 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:48.589643 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.589704 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45987.4us
I20260709 13:03:48.591660 15160 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:48.592314 16377 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.593736 16646 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.594264 16646 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:48.512715 16448 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:03:48.595175 16646 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.544659 16713 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.595844 15871 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:48.596184 16713 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.597278 15237 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:48.603148 16727 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.603797 16727 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.606030 16727 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.606599 16727 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.603255 16694 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:48.558624 16453 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.526724 16686 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.576610 16642 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.576568 16714 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:48.596975 16428 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.534771 16592 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.548933 16626 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.607776 16694 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.577693 16693 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.606962 16727 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:48.666337 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 68548.9us
W20260709 13:03:48.669785 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 149763us
I20260709 13:03:48.670473 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:48.676263 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59724.1us
I20260709 13:03:48.616091 16714 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.680226 15268 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:48.616863 16428 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.682561 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:48.685727 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.685851 15270 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.685809 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:48.662859 16490 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.686940 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.687582 15267 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:48.688800 15267 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:48.690074 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.675827 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 922) took 1760 ms. Trace:
I20260709 13:03:48.691275 16428 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.695097 15263 rpcz_store.cc:276] 0709 13:03:46.915269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.402080 (+486811us) service_pool.cc:224] Handling call
0709 13:03:47.444076 (+ 41996us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.011207 (+567131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.014376 (+  3169us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.015417 (+  1041us) log.cc:844] Serialized 26 byte log entry
0709 13:03:48.311988 (+296571us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:48.312036 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.312112 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:48.661886 (+349774us) raft_consensus.cc:1685] finished
0709 13:03:48.661911 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:48.675733 (+ 13822us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108958,"raft.queue_time_us":201572,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":62,"thread_start_us":699787,"threads_started":2,"wal-append.queue_time_us":431114}
I20260709 13:03:48.697330 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.697961 15263 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.698783 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 829) took 1139 ms. Trace:
I20260709 13:03:48.673959 16453 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.687431 16695 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:03:48.699230 15190 rpcz_store.cc:276] 0709 13:03:47.559612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.562881 (+  3269us) service_pool.cc:224] Handling call
0709 13:03:48.698578 (+1135697us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b54000fb4d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:48.698705 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372152064}
I20260709 13:03:48.671470 16694 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.686251 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:48.690806 15267 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.675194 16727 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.676285 16616 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.712430 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.713405 15268 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.715166 15268 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:48.719187 16377 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.719301 16537 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:48.721585 16377 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.723389 16709 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.725662 16709 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.731236 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.687186 16714 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:48.731978 15268 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:48.706072 16490 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:48.709988 16453 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.680935 16579 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:03:48.737886 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.746585 15268 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.747205 15270 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:48.748303 15267 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:48.754405 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.755851 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.755076 15268 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.773097 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.773722 15270 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.736917 16615 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.774770 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:48.775336 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.777921 15270 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.779778 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:48.757354 16409 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.785526 16409 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.745908 16709 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.787456 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:48.788252 16409 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.789059 16579 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.789567 16579 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.790037 16579 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.791147 16615 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.793334 16615 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.750248 16729 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:48.772358 16527 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:03:48.794087 16729 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:48.796656 16729 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.750927 16679 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.801723 16428 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.802230 16679 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.805215 16679 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.753113 16453 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.808216 16453 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.809060 16428 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:48.811188 16723 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:03:48.801731 16714 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.816915 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.818344 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.819073 16714 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.814209 16579 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.819291 15872 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:48.812548 16490 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:48.823901 16579 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.787398 16709 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.830468 16626 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:48.831359 16709 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.832197 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:48.832692 16691 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:48.833120 16691 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:48.834051 16691 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.835934 16691 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:48.837064 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.839514 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.840088 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:48.840178 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:48.843221 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:48.872414 15875 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:48.872542 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.753777 16501 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.844750 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.845203 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:48.845674 16731 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:03:48.845821 15874 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:48.820000 16597 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:48.818936 15266 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:03:48.853448 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:48.864765 15343 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:48.865757 15346 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:48.728847 16616 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.878577 15270 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:48.749729 16537 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:48.880836 15338 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:48.871603 15871 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:48.883234 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:48.883963 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.884899 16686 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.885862 15340 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:48.829126 16713 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.887210 15340 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:48.886392 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:48.888595 15340 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:48.888192 16694 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.889585 15267 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:48.889925 15340 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:48.891312 16694 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:48.891646 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.893648 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:48.894191 15345 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.896543 16713 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.896931 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.898488 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.899698 16501 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.902251 16501 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.902972 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.908969 16616 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.894004 15311 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:48.913813 16727 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.915218 16730 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.915527 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:48.915759 16730 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.916152 16730 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.916211 15337 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:48.917465 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:48.918053 15337 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:48.919474 16693 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:48.920635 16428 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.921140 16428 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.923247 15870 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.927156 16730 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:48.931274 16730 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:48.846624 16592 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:48.939719 15342 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:48.931418 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:48.936371 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:03:48.906831 16530 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.677s	user 0.006s	sys 0.003s
I20260709 13:03:48.933393 15339 pending_rounds.cc:85] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 2
I20260709 13:03:48.940943 15874 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.947424 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.957150 15339 pending_rounds.cc:107] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:48.957465 15339 raft_consensus.cc:2889] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:48.965065 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:48.990715 15192 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:03:48.940894 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 254708us
I20260709 13:03:48.993265 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:48.963785 16501 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.003504 16501 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.003774 16597 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:49.004426 16597 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:49.009567 15874 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:48.995136 16730 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.010823 16730 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:49.018013 15238 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.644s (SENT)
I20260709 13:03:49.018700 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:49.037808 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 301840us
I20260709 13:03:48.956785 16428 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:49.074009 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80870.4us
I20260709 13:03:48.958125 16530 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:48.985487 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:49.098256 15346 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:49.098026 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.056161 16695 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:49.100852 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 50885.8us
W20260709 13:03:49.101342 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 83397us
I20260709 13:03:49.102973 16453 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.103482 16428 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.103634 16453 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.104575 16377 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.104825 16713 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.105104 16377 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.105811 16453 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.105589 16713 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.107190 16377 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.106725 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:49.107996 16428 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.108528 16713 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.108770 15872 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:03:49.119134 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.119019 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.120215 15338 raft_consensus.cc:2368] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 3. Current term is 4.
I20260709 13:03:49.098917 16735 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.095968 15870 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:49.121207 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:49.117391 16734 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.248160 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.120951 16592 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:49.249447 16592 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.249466 16691 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.242554 16695 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.241756 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.154496 15345 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:49.124099 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.248539 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:49.271960 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 150821us
I20260709 13:03:49.233704 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.295584 15344 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
W20260709 13:03:49.285318 15237 leader_election.cc:336] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.898s (SENT)
I20260709 13:03:49.296767 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:49.114679 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 168258us
W20260709 13:03:49.171532 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49132.9us
I20260709 13:03:49.294049 15338 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:49.132635 16735 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.120359 16693 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.302887 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:49.241989 16738 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.286827 16592 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:49.309787 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.286492 16490 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.308295 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.323992 15345 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:03:49.312429 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:49.312060 16693 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.312877 16709 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:49.312981 16428 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.304590 16409 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.313834 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.313398 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:49.313421 16734 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.314424 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:49.311815 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 210264us
I20260709 13:03:49.318305 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.321587 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.308558 16626 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.306455 16735 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:49.327884 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.123313 16646 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.179s
I20260709 13:03:49.173884 16501 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:49.330824 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45568.1us
I20260709 13:03:49.335150 15195 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:49.335266 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.336997 15344 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.327800 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.308681 16530 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.309175 16727 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:49.338160 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.398607 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61877.6us
I20260709 13:03:49.338141 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.299664 16691 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.301841 16695 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.329917 16409 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:49.400841 15237 leader_election.cc:336] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.122s (SENT)
I20260709 13:03:49.410431 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:49.412144 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:49.412744 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.413369 15344 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:49.339701 16730 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.334833 16709 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:49.353670 16534 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:03:49.355229 16618 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:03:49.322996 16692 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:03:49.322644 16738 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.420183 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.438393 15338 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.422339 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.423094 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:49.421109 15237 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.161s (SENT)
I20260709 13:03:49.440236 15344 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.418708 16626 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.447862 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:03:49.448192 16746 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:03:49.448536 15870 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.452685 16691 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.454034 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 928) took 1413 ms. Trace:
W20260709 13:03:49.455193 16719 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.912s	user 0.005s	sys 0.003s
I20260709 13:03:49.455606 15876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58404 (request call id 91) took 1302 ms. Trace:
I20260709 13:03:49.456089 15876 rpcz_store.cc:276] 0709 13:03:48.153159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.153731 (+   572us) service_pool.cc:224] Handling call
0709 13:03:49.455413 (+1301682us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b540059d154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:49.455519 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116354944}
I20260709 13:03:49.460340 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:49.461978 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 929) took 1420 ms. Trace:
W20260709 13:03:49.442673 16642 consensus_meta.cc:287] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.000s
I20260709 13:03:49.471661 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.471321 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:49.478999 15345 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.473796 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.419732 16617 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:03:49.476843 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.446063 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:49.464139 15269 rpcz_store.cc:276] 0709 13:03:48.041143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.047848 (+  6705us) service_pool.cc:224] Handling call
0709 13:03:48.159500 (+111652us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8eee 0000000000375939 00007f36ea65c1e0 00007f36ea7250c4 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:48.159723 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.160035 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:48.400149 (+240114us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.461127 (+1060978us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b180036e4a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a
0709 13:03:49.461508 (+   381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:49.461587 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:49.461650 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.461742 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.461907 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24942,"prepare.queue_time_us":355934,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":9193,"raft.queue_time_us":3155,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":16180352,"thread_start_us":316024,"threads_started":2,"wal-append.queue_time_us":167794}
I20260709 13:03:49.454509 15264 rpcz_store.cc:276] 0709 13:03:48.040832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.044133 (+  3301us) service_pool.cc:224] Handling call
0709 13:03:48.115057 (+ 70924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.217889 (+102832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.217936 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.218004 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:48.218043 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.453763 (+1235720us) spinlock_profiling.cc:243] Waited 94.2 ms on lock 0x7b54000d7354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:49.453819 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.453969 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216606976}
I20260709 13:03:49.473524 16354 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:49.501446 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80359us
I20260709 13:03:49.504235 15344 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
W20260709 13:03:49.501463 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83151.6us
I20260709 13:03:49.504668 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.505352 15338 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
W20260709 13:03:49.498003 16749 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:03:49.483428 16409 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.473325 16738 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.464843 16616 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:03:49.514107 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.485190 16642 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.530134 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.507699 16354 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.537168 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.539959 15338 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:49.538672 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.540623 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:49.542124 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:49.545183 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.546345 15339 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:49.543699 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:49.521481 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.548574 16754 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.548960 15340 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:03:49.549005 16754 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.549618 16754 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.550933 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:49.511821 16626 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.550601 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.568230 15269 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.554354 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.575064 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.577291 16686 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.577818 16686 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.578285 16686 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.580538 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.581125 15267 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.582068 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:49.551920 16737 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:03:49.551174 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:49.586145 16415 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:49.586740 15876 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:03:49.582897 16691 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.543776 16354 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.587636 16691 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:49.588150 16691 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.588624 16691 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:49.590361 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.591192 15346 raft_consensus.cc:2410] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:49.552763 16756 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:03:49.591908 16756 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:49.593755 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:49.595618 16490 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.595842 16734 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:49.584880 16721 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.030s	user 0.005s	sys 0.005s
I20260709 13:03:49.585037 15870 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:49.596549 16307 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:49.595641 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.596980 16307 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:49.597398 15343 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:49.598241 16737 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:49.598086 16735 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.598626 16737 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:49.598615 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:49.599412 16695 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.599432 16737 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.600855 16737 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.603222 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:49.506806 16709 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:49.606468 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33824 (request call id 0) took 1384 ms. Trace:
I20260709 13:03:49.606844 15271 rpcz_store.cc:276] 0709 13:03:48.228765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.288097 (+ 59332us) service_pool.cc:224] Handling call
0709 13:03:49.606224 (+1318127us) spinlock_profiling.cc:243] Waited 95.9 ms on lock 0x7b54001b3854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5707853 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691 00007f36e3c5b60c 00007f36e3c5a8c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:49.606362 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220577536}
I20260709 13:03:49.607323 16626 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.607997 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.608210 15267 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:49.609165 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.610067 15271 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:49.610965 15272 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.610245 16626 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.611271 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.612354 15271 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:49.612921 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.613193 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.613737 15271 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:49.614743 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.615319 15190 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:49.609161 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.615311 15271 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:49.616322 16642 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.616348 15267 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.585266 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.617357 15266 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:49.617785 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.622334 16592 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:49.624473 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.628523 16354 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:49.629331 16307 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:49.596335 16490 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:49.633023 15268 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:49.669235 15268 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:49.639986 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 943) took 1476 ms. Trace:
I20260709 13:03:49.640810 15270 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:49.641320 16626 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.686291 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.688519 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:49.641640 16735 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.643788 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.644558 16686 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.669113 16490 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:49.691256 16490 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.692341 16686 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.646432 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.693555 15338 raft_consensus.cc:2410] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:49.694434 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.694981 15338 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.695412 16693 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.695815 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.697016 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.647878 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:49.697475 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:49.649606 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.698521 15266 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:49.698995 16501 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:49.650795 15269 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:03:49.655962 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 252335us
I20260709 13:03:49.699401 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.700511 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.700984 15266 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.649406 16691 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.704905 16691 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.705210 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.705360 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.706187 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:03:49.666705 16689 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.706756 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.707414 16689 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.708175 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.710134 16689 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.672855 15268 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.711424 15195 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:49.711894 15268 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.714566 15266 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:49.656800 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.717314 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:49.658214 15272 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:49.667519 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.692229 16754 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.697899 15343 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:49.697507 15338 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.727247 15271 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:49.730854 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:49.730365 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.732120 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.732936 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:49.732950 15192 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:03:49.734122 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.734866 15342 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.737269 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:49.737778 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.739871 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.741926 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:49.742710 15343 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:49.692195 16490 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.743582 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.744412 15338 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:49.744692 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.736064 16727 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:49.747087 16727 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.747550 16727 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.748103 16354 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:49.748775 16354 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.750664 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:49.727769 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.751364 15870 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.751538 15264 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:03:49.752610 16754 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.715937 16626 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:49.753161 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.754969 16626 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:49.743364 16428 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:49.756095 16428 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.756565 16428 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.736740 16409 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:03:49.670881 15265 rpcz_store.cc:276] 0709 13:03:48.168088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.359332 (+191244us) service_pool.cc:224] Handling call
0709 13:03:48.453227 (+ 93895us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.503872 (+ 50645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.512837 (+  8965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:48.516382 (+  3545us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:48.525553 (+  9171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.639712 (+1114159us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b5400328cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:49.639764 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.639913 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71997184}
I20260709 13:03:49.743476 16713 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:49.760277 16713 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.761005 16713 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.743530 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.760188 16597 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:49.762013 15093 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 2, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 2 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:49.764964 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.770571 15270 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:49.745522 15342 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:49.772388 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.734139 16501 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.772475 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.729892 15337 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.774992 15342 raft_consensus.cc:2368] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:49.776294 15343 raft_consensus.cc:2410] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:49.562849 15345 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:49.778961 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.779757 15338 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:49.784686 15265 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:49.788460 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.789176 15266 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:49.775094 16501 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:49.830507 15268 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:49.831188 15268 pending_rounds.cc:85] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 1
I20260709 13:03:49.798136 16501 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.797667 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.666082 15267 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:49.839041 15268 pending_rounds.cc:107] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:49.839440 15268 raft_consensus.cc:2889] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:49.863045 15870 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
W20260709 13:03:49.857569 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 254451us
I20260709 13:03:49.867161 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 968) took 1132 ms. Trace:
I20260709 13:03:49.867751 15268 rpcz_store.cc:276] 0709 13:03:48.734897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.797015 (+ 62118us) service_pool.cc:224] Handling call
0709 13:03:48.797302 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.632906 (+835604us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540032f620. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5684dc0 00007f36e570f1c0 00007f36e5710231 00007f36e570cd8f 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c
0709 13:03:49.866719 (+233813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.867087 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482483968}
W20260709 13:03:49.879295 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 372025us
I20260709 13:03:49.893006 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:49.893050 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:49.896623 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 157777us
I20260709 13:03:49.896870 15195 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:03:49.898501 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:49.868929 16491 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:03:49.925915 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:49.900594 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:49.879992 16592 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:49.900749 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:49.903847 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:49.915385 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.933909 15267 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:49.935700 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:49.922478 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:49.937278 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:49.936365 15271 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:49.931823 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.939558 15343 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
W20260709 13:03:49.944284 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43598.6us
I20260709 13:03:49.944967 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:49.946563 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:49.948377 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 996) took 1092 ms. Trace:
I20260709 13:03:49.948873 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:49.933156 16626 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:49.932780 15341 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:49.950395 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:49.924608 16597 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:49.900455 16618 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:03:49.980950 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.982059 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:49.982622 15272 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.981738 15267 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:49.925575 16763 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.948743 15338 rpcz_store.cc:276] 0709 13:03:48.856203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.933705 (+1077502us) service_pool.cc:224] Handling call
0709 13:03:49.947942 (+ 14237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.948089 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.948112 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:49.948151 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:49.948178 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.948229 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.948323 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:49.960278 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.988745 16642 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:49.991190 16626 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:49.992259 16626 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:49.949949 16759 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.948000 16709 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.994449 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:49.951525 16534 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.999910 16534 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.000388 16534 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.949499 16530 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:49.946422 16767 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:49.951382 16592 raft_consensus.cc:2764] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:49.951177 16409 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:50.004944 16409 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:49.987116 16763 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:50.006268 16763 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.925237 16757 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:03:49.961207 16597 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.960664 16549 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:03:50.017068 15272 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
W20260709 13:03:50.018920 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65228.8us
I20260709 13:03:50.020040 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.024653 15267 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:03:50.031427 15267 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:49.996665 16759 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.001413 16730 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:50.002631 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1005) took 1110 ms. Trace:
I20260709 13:03:50.003995 16530 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.032194 16114 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:03:50.009045 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1013) took 1108 ms. Trace:
I20260709 13:03:50.059845 15193 rpcz_store.cc:276] 0709 13:03:48.895917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.946171 (+ 50254us) service_pool.cc:224] Handling call
0709 13:03:49.092608 (+146437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.100367 (+  7759us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:49.171360 (+ 70993us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.615310 (+443950us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b180008d220. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:03:49.928384 (+313074us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.950080 (+ 21696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:49.960600 (+ 10520us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:49.980418 (+ 19818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.994682 (+ 14264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.003739 (+  9057us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38563,"prepare.queue_time_us":18601,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":8832,"raft.queue_time_us":30742,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":59013,"spinlock_wait_cycles":14307072,"thread_start_us":252373,"threads_started":1,"wal-append.queue_time_us":736691}
I20260709 13:03:50.040726 15340 rpcz_store.cc:276] 0709 13:03:48.892568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.924215 (+1031647us) service_pool.cc:224] Handling call
0709 13:03:49.945607 (+ 21392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.947258 (+  1651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.947286 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:49.950083 (+  2797us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:49.963880 (+ 13797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.986700 (+ 22820us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:49.996243 (+  9543us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:50.032997 16762 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:03:50.037843 16759 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:50.013789 16597 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.013432 16642 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:50.042097 16114 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:50.075812 16114 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:50.075824 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 124080us
I20260709 13:03:50.042649 16530 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.045068 16428 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.013226 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1002) took 1121 ms. Trace:
I20260709 13:03:50.056259 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:50.059190 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 959) took 1370 ms. Trace:
I20260709 13:03:50.059398 16709 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:50.003598 16694 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:50.070907 15346 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:50.071096 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:50.085196 16114 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.037067 15272 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:50.041738 16764 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:03:50.025265 16767 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:50.079666 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:50.091820 15339 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:50.092864 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.097539 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 40) took 1095 ms. Trace:
I20260709 13:03:50.098990 15345 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:50.100932 15346 rpcz_store.cc:276] 0709 13:03:49.001772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.916154 (+914382us) service_pool.cc:224] Handling call
0709 13:03:50.070554 (+154400us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:50.070732 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.097307 (+ 26575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.097485 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6235904}
I20260709 13:03:50.062556 16727 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:50.111537 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.112615 15194 raft_consensus.cc:2410] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:50.125860 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.127871 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.095398 16709 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:50.130877 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.130985 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.079080 16713 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.074934 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:50.132723 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:50.132850 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 112976us
I20260709 13:03:50.107415 16592 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:50.134781 15346 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:50.085937 15341 rpcz_store.cc:276] 0709 13:03:48.891842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.853045 (+961203us) service_pool.cc:224] Handling call
0709 13:03:49.893712 (+ 40667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.989451 (+ 95739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.009108 (+ 19657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:50.108690 16692 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:50.180986 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.182899 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.135700 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.116647 16617 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.184587 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.192215 15194 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:50.193464 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:50.132387 16709 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.219694 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.222895 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.224426 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.225724 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.227289 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.228307 15192 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:50.229197 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:50.229761 15192 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.230521 16727 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:50.231300 16592 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:50.231344 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.231936 16592 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:50.232856 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:50.232815 16592 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.234248 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.236240 16713 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:50.237236 16768 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:03:50.122565 16772 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.129s
I20260709 13:03:50.239125 16307 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.139473 15870 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:50.103943 16694 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.226922 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:50.244699 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.176764 15193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:50.178176 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.293778 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:50.297554 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.304773 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:50.290741 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46305.3us
I20260709 13:03:50.313092 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:50.313427 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.291145 16776 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:50.323073 15272 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:50.290482 15337 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:03:50.321242 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.220023 16617 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:50.317274 15238 leader_election.cc:336] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.560s (SENT)
I20260709 13:03:50.302567 15193 raft_consensus.cc:606] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:50.336444 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:50.337647 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.196519 16692 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.345348 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.348861 16534 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.188491 16642 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:50.323896 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 286296us
I20260709 13:03:50.323434 16776 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:50.314947 16448 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:50.364099 15194 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 2. Current term is 3.
I20260709 13:03:50.366828 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:50.381057 16779 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:03:50.382470 15189 raft_consensus.cc:2410] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:50.386042 15272 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:50.384912 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.356724 16491 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:50.398932 15272 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:50.375825 16776 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.383483 16448 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:50.293949 16767 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.408200 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.396988 16428 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:50.421782 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:50.507085 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 371465us
I20260709 13:03:50.532029 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:50.539311 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 142646us
I20260709 13:03:50.543856 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.547564 15842 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:50.552731 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:50.553507 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:50.540099 16773 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:03:50.461016 16618 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:03:50.508543 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.564714 15272 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:50.569512 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.559115 16491 raft_consensus.cc:2764] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:50.557219 16620 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:03:50.547062 16428 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:50.563475 16792 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:50.555502 16617 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:50.573428 16501 consensus_meta.cc:287] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.718s	user 0.003s	sys 0.008s
I20260709 13:03:50.582185 16727 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:50.570806 16534 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:50.092424 15263 rpcz_store.cc:276] 0709 13:03:48.688562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.698608 (+ 10046us) service_pool.cc:224] Handling call
0709 13:03:48.698973 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.037854 (+338881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.055738 (+ 17884us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.233003 (+177265us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.336065 (+103062us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:49.516354 (+180289us) log.cc:844] Serialized 14 byte log entry
0709 13:03:49.538378 (+ 22024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.538506 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.056612 (+518106us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b180036f280. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:03:50.058848 (+  2236us) raft_consensus.cc:1685] finished
0709 13:03:50.058971 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.059128 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32943,"prepare.queue_time_us":88280,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":106077,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":11703,"spinlock_wait_cycles":10011520,"thread_start_us":434737,"threads_started":3,"wal-append.queue_time_us":155948}
I20260709 13:03:50.557966 16772 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:50.570369 16780 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 13:03:50.552405 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 134670us
I20260709 13:03:50.568140 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.595386 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:50.577632 16775 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:50.592460 15272 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:50.583353 16618 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:50.629854 16618 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:50.631008 16618 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.601167 16796 raft_consensus.cc:2764] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:50.632339 16448 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:50.632658 16788 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:03:50.633766 16775 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:50.634584 16785 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:03:50.634829 16775 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:50.636512 16784 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:03:50.629454 16626 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:50.638127 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:50.638753 15338 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:50.639619 16789 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:03:50.614537 15192 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:50.588351 16792 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:50.600878 16727 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:50.642161 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.632414 16618 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:50.623065 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55018us
W20260709 13:03:50.644300 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49049.5us
I20260709 13:03:50.655444 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:50.658077 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.660655 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.662374 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:50.648113 16781 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
W20260709 13:03:50.647179 16782 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:03:50.643713 16428 raft_consensus.cc:2764] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:50.610487 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.617235 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:50.600718 16501 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.620239 16692 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:50.697432 16805 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:50.698361 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:50.699256 16620 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:50.703387 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.730989 15192 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:50.731895 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:50.731988 16776 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.733033 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.734109 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:50.734266 16798 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
W20260709 13:03:50.706254 16530 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.616s	user 0.002s	sys 0.006s
I20260709 13:03:50.735351 16530 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.737100 15342 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:50.737355 16530 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:50.695266 16780 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:50.709523 15344 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:50.738267 16597 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.002s
I20260709 13:03:50.738667 16597 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.652096 16727 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:50.740813 16597 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:50.664614 16759 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.599s	user 0.015s	sys 0.000s
W20260709 13:03:50.711908 15237 leader_election.cc:336] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.029s (SENT)
I20260709 13:03:50.743011 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:50.657703 16775 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:50.715986 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.716408 15195 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:50.659701 16448 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:50.664458 16793 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:50.749771 16793 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:50.750216 16793 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:50.752233 16501 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:50.753433 16626 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:50.757682 16790 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 13:03:50.666754 16713 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:50.665591 15238 leader_election.cc:336] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.097s (SENT)
W20260709 13:03:50.759449 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93883us
I20260709 13:03:50.726203 15338 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:50.729369 15339 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:50.729871 16694 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:50.737993 16709 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.000s
W20260709 13:03:50.742079 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43829.6us
I20260709 13:03:50.743814 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:50.746003 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.746095 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.723263 16792 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.746750 15263 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:50.748610 16776 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:50.761574 15338 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:50.948833 16709 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.949397 16501 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:50.876945 16763 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.870s	user 0.012s	sys 0.000s
I20260709 13:03:50.950409 16501 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:50.950870 16501 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.916666 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:50.816269 16772 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.951390 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:50.951705 16772 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.952257 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:50.952631 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:50.878679 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:50.953438 15189 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.945312 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1003) took 2053 ms. Trace:
I20260709 13:03:50.882838 16793 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.953989 15337 rpcz_store.cc:276] 0709 13:03:48.892096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.856323 (+964227us) service_pool.cc:224] Handling call
0709 13:03:49.927411 (+ 71088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.340718 (+413307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.945028 (+604310us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003ded54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:50.945248 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673871232}
I20260709 13:03:50.954541 16772 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:50.877264 16814 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:03:50.956162 16793 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:50.956233 15876 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:50.956418 16697 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:50.745918 16805 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:50.956885 16697 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:50.746527 16759 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.950726 16763 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.957912 16697 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:50.908195 15271 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:50.959362 16759 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:50.847424 16618 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:50.759055 16713 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:50.949203 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 203150us
I20260709 13:03:50.960101 16713 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.960862 16114 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:50.960935 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.960098 16618 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.962185 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:50.963268 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.963474 16792 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:50.963770 16618 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:50.964035 16776 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:50.964282 16409 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:50.964555 16776 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:50.965034 16776 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:50.848121 15841 leader_election.cc:336] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.136s (SENT)
I20260709 13:03:50.965735 15841 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:50.966668 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 118580us
I20260709 13:03:50.761516 16428 raft_consensus.cc:2764] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:50.761768 16448 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.969020 15874 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:50.969712 16797 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:50.970080 16797 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:50.970295 16763 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:50.970645 16448 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:50.757709 15188 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
W20260709 13:03:50.864863 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.971341 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:50.972067 15876 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:50.909576 16727 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.974917 16727 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:50.976082 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:50.976652 16694 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:50.977728 15340 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:50.979401 16709 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:50.980815 15190 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:50.981485 15237 leader_election.cc:336] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.720s (SENT)
I20260709 13:03:50.982400 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:50.985495 16735 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:50.984123 16730 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:50.986608 16730 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:50.984163 16737 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:50.987344 16737 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.987752 16737 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.987514 16730 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.988878 16713 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.985569 16703 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:50.990947 16703 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:50.991786 16703 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.991806 16805 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:50.945745 15093 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 3 to 4, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 4 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:50.992868 16703 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.994514 16310 raft_consensus.cc:1064] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:03:50.983749 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.995888 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:50.996927 16310 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:51.005263 16805 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.005611 16697 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.007237 16727 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:51.008267 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.940428 15272 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.009537 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:50.988936 16776 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.011175 15309 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:50.944633 15092 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 166) took 5444 ms. Trace:
I20260709 13:03:51.014935 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.007427 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.010403 16727 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:51.017370 15263 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:51.017982 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.017941 16727 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:50.950888 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:50.872677 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.026065 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.036659 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.037639 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:51.038573 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:51.037642 15271 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.010401 16793 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:50.970925 16797 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.006345 16805 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.044725 16761 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:51.045070 15189 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:03:51.020131 16709 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:51.046018 16709 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.046262 16761 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:51.046422 16709 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.048134 16620 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:51.049161 16758 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:51.049515 16758 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.050287 16758 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.026823 16694 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.051491 16758 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.054237 16692 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:51.054672 16692 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:50.970947 16763 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:51.024322 16775 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.040545 16754 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.065857 16678 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:51.066043 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:51.066288 16678 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.067106 16678 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.068114 16678 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.070276 16692 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.061942 15194 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:51.076504 16692 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.035979 16409 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:51.077397 16409 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:51.036131 16354 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:51.060232 16597 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:51.055387 16307 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:51.046826 16761 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.058774 16713 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.081848 15191 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
W20260709 13:03:51.082304 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.082366 16114 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:51.084892 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.085623 15194 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:51.087387 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.088456 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.097708 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.098078 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.099570 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.100463 15272 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:51.102734 15268 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.107818 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.109601 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.110430 15271 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:51.111303 15272 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:51.101684 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.110425 15268 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:51.121143 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.121929 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.123483 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.124197 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.124560 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.124907 15194 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:51.060920 16730 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:03:51.078684 16409 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:51.126792 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.127326 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.127745 16114 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:51.129096 15270 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.129220 16114 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.129683 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.085965 16597 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:51.082800 16448 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:03:51.134117 15268 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:51.134460 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.131184 16114 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:51.132875 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.142168 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.143814 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.086138 16617 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:03:51.012810 15092 rpcz_store.cc:276] 0709 13:03:45.500219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.511231 (+ 11012us) service_pool.cc:224] Handling call
0709 13:03:50.944540 (+5433309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:46.740005 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:46.740627 (+   622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:46.740676 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:03:46.740711 (+    35us) tablet.cc:662] Decoding operations
0709 13:03:46.793115 (+ 52404us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:46.803022 (+  9907us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:46.803080 (+    58us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:03:46.803562 (+   482us) tablet.cc:701] Row locks acquired
0709 13:03:46.803616 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:03:46.803827 (+   211us) write_op.cc:270] Start()
0709 13:03:46.803995 (+   168us) write_op.cc:276] Timestamp: P: 1783602226803752 usec, L: 0
0709 13:03:46.804033 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:03:46.804716 (+   683us) log.cc:844] Serialized 1364 byte log entry
0709 13:03:47.448531 (+643815us) op_driver.cc:464] REPLICATION: finished
0709 13:03:48.050321 (+601790us) write_op.cc:301] APPLY: starting
0709 13:03:48.088147 (+ 37826us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:48.122495 (+ 34348us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:48.142596 (+ 20101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:48.220515 (+ 77919us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:48.251182 (+ 30667us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:03:48.251240 (+    58us) write_op.cc:312] APPLY: finished
0709 13:03:48.251580 (+   340us) log.cc:844] Serialized 34 byte log entry
0709 13:03:48.452510 (+200930us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:48.460249 (+  7739us) write_op.cc:454] Released schema lock
0709 13:03:48.476919 (+ 16670us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:48.524800 (+ 47881us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:48.534176 (+  9376us) write_op.cc:454] Released schema lock
0709 13:03:49.414996 (+880820us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
Metrics: {"mutex_wait_us":4492,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":503462,"apply.run_cpu_time_us":13413,"apply.run_wall_time_us":493909,"num_ops":3,"prepare.queue_time_us":115748,"prepare.run_cpu_time_us":21626,"prepare.run_wall_time_us":139087,"raft.queue_time_us":286870,"raft.run_cpu_time_us":14361,"raft.run_wall_time_us":443923,"replication_time_us":591131,"spinlock_wait_cycles":16564992,"thread_start_us":680037,"threads_started":5,"wal-append.queue_time_us":314418,"wal-append.run_cpu_time_us":17080,"wal-append.run_wall_time_us":3246786}]]}
I20260709 13:03:51.126921 16713 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.131896 16527 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:51.132489 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.140388 16530 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.126106 16534 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:03:51.147693 16694 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:51.135601 16780 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:03:51.175706 16114 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:51.171249 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:51.175771 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.177695 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.157100 16527 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.140908 16501 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.165234 16735 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:51.184499 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.198612 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.203790 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.204068 16694 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:51.204504 16694 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.204845 16694 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.205159 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.206363 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.158766 16713 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.207463 16693 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:51.208904 16713 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.212386 16802 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:51.213608 16114 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:51.213960 16114 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.214708 16114 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.215876 16114 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:51.216176 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.217237 16813 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:51.217466 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.219808 16642 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:51.220227 16642 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.221000 16642 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.222291 16642 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:51.222417 15841 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.645s (SENT)
I20260709 13:03:51.207093 16597 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.224478 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.217609 16813 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.226918 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.232550 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:51.170109 16354 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.239862 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.241020 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.242766 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.244221 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.244920 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.245932 16626 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:51.246341 16626 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.246718 16626 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.244798 16720 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:03:51.251664 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.255309 15342 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:51.156860 16761 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.203691 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.169178 16530 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.252466 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.259236 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:51.259958 15345 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:51.260324 15338 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:51.253636 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.238039 16754 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.261346 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.210805 16737 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.238212 15263 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:51.261889 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.264261 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.265067 15197 raft_consensus.cc:2376] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4. Re-sending same reply.
I20260709 13:03:51.267774 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:51.275486 15238 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.747s (SENT)
I20260709 13:03:51.277510 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.274962 15195 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:51.279842 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.281781 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.256350 16686 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.287135 15341 raft_consensus.cc:2410] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:51.288049 15340 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:51.289552 16501 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.293725 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.293913 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.298318 15342 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:51.299100 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.299364 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.300886 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:51.302287 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.303011 15346 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:51.303104 15270 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:51.243288 16354 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:51.306522 16783 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.953s	user 0.000s	sys 0.004s
I20260709 13:03:51.265208 16527 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.310113 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 878) took 1008 ms. Trace:
I20260709 13:03:51.317190 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:51.312745 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.313755 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:51.269084 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.320850 16709 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.321413 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.322496 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.317292 15191 rpcz_store.cc:276] 0709 13:03:50.301315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.313248 (+ 11933us) service_pool.cc:224] Handling call
0709 13:03:51.309960 (+996712us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54001a4854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:51.310057 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709082368}
I20260709 13:03:51.323923 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.324100 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.318183 15197 raft_consensus.cc:2376] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5. Re-sending same reply.
W20260709 13:03:51.287261 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47498.5us
I20260709 13:03:51.325789 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.326756 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.291234 16735 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:51.331560 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.332031 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.357975 15191 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:51.359274 15339 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:51.322934 16709 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.361312 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.361716 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.360699 15312 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:51.383782 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:51.364347 16354 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.364463 16737 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:51.364923 15190 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.279763 16813 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.369233 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.369735 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:51.369917 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.331365 16501 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.420369 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.420866 16626 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.421463 15193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:51.422032 15193 raft_consensus.cc:606] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:51.423556 15190 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:03:51.423979 15190 pending_rounds.cc:85] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 5
I20260709 13:03:51.424232 15190 pending_rounds.cc:107] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:03:51.424508 15190 raft_consensus.cc:2889] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:51.424767 16626 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:51.426080 15190 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:51.371366 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:51.427672 15346 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:03:51.428256 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.372068 16776 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:51.430521 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60848.2us
I20260709 13:03:51.430883 16776 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.372900 16527 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.431258 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.431818 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.432353 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.432960 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:51.433791 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.433894 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:51.434049 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.435252 15872 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.435696 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:51.373713 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.436178 15263 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.436496 16354 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.437127 16354 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.408776 16709 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.419852 15192 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:03:51.375097 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.430460 15345 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:51.438946 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:51.443504 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 272878us
I20260709 13:03:51.427331 16767 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:51.487149 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.487735 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.490494 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.495627 15338 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:51.496031 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.495004 15194 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:03:51.502243 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.504359 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:51.506223 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.454370 16501 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.504220 15872 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:51.511811 15196 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:51.512887 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.514118 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:51.516011 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.515719 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:51.522009 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:51.502487 16409 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:03:51.533708 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.534711 16713 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:51.528083 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 201338us
I20260709 13:03:51.540275 15267 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:51.525229 15871 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:51.502961 15870 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.532166 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:51.530323 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.544961 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.544692 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.498704 16822 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:03:51.511819 15873 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:03:51.509881 16767 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:51.557092 16759 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:51.558004 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.558593 16813 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.558481 16767 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.560777 16792 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:51.555693 16757 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:03:51.560822 16530 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.499056 16415 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:03:51.554967 16754 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.555397 15873 pending_rounds.cc:85] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 4
I20260709 13:03:51.556975 16822 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:51.535732 15190 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:51.564421 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:51.552805 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:51.565762 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.567636 15267 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:51.578809 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.575949 15873 pending_rounds.cc:107] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:03:51.583263 15873 raft_consensus.cc:2889] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:51.510637 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:51.541693 16727 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:51.570035 15876 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:51.553192 15188 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:51.600754 15874 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:51.603941 16797 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.576022 16822 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:51.609575 16792 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:51.612766 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 60044.9us
I20260709 13:03:51.616253 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.572356 16693 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.617439 15237 leader_election.cc:400] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
W20260709 13:03:51.575510 16835 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.117s	user 0.000s	sys 0.010s
I20260709 13:03:51.617707 15237 leader_election.cc:403] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:51.622201 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.624579 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:51.609876 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 113472us
I20260709 13:03:51.628152 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.620846 16597 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.618067 16735 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:51.644485 15341 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.635855 15345 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:51.645294 15342 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.595515 16692 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:03:51.647225 15342 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.650347 15342 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.651985 15346 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.623242 16720 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:51.652607 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:51.623327 16834 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:51.629626 16626 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.623018 16693 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:51.629205 16754 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
W20260709 13:03:51.659801 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 100741us
I20260709 13:03:51.648738 16735 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.647432 16713 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:51.645404 16530 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.676618 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:51.677099 16530 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.678107 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.678925 15337 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:51.679276 16530 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.679998 15337 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:51.681803 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.655364 16827 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:51.683456 15196 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:51.657882 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.664794 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.671870 15339 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.674000 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:51.647533 16678 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:03:51.664794 16307 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:51.650096 16597 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.674445 16735 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.671164 16626 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.703687 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.704100 15341 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.686261 16713 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:51.706470 16713 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.692772 16307 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:51.716320 16307 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:51.716859 16836 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.155s	user 0.003s	sys 0.000s
I20260709 13:03:51.718215 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 978) took 1130 ms. Trace:
I20260709 13:03:51.715850 16616 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:51.718931 16616 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:51.719365 16616 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.720391 16597 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:51.718597 15266 rpcz_store.cc:276] 0709 13:03:50.587951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.717335 (+1129384us) service_pool.cc:224] Handling call
0709 13:03:51.717656 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.717857 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.717891 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:51.717939 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:51.717976 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.718032 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.718159 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:51.731422 15842 leader_election.cc:336] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.867s (SENT)
I20260709 13:03:51.733776 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.735173 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.736925 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:51.743685 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.743825 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.744084 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.744442 15196 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:51.746492 15272 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.748488 15341 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.744247 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:51.749922 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.754547 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:51.727717 16534 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:51.728506 16678 consensus_queue.cc:1243] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 2.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:51.656955 16822 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.757429 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:51.747949 16754 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.745173 16813 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:03:51.753765 16792 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:51.783864 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:51.751303 16834 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.784612 16792 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:51.785071 16834 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:51.779044 15263 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:51.695742 16694 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.787850 16694 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:51.787935 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "708015fd563e4389af835f3aca58eb01"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:51.788554 15269 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:51.788776 15196 raft_consensus.cc:606] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.785475 16834 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:51.753533 16626 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:51.789487 16834 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.789727 16626 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:51.780184 16693 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:51.791949 15268 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:51.793349 15338 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:51.794750 15340 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:51.782604 16754 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:51.758603 16534 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.796939 16534 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.797906 16534 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:51.781072 16642 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.000s
I20260709 13:03:51.790633 16626 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.843688 15271 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:03:51.853931 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:51.858551 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 230426us
I20260709 13:03:51.859551 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.807554 16792 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.863278 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.775956 16804 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
W20260709 13:03:51.886788 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.830163 16822 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.890537 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.901180 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.888484 16694 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.905128 16693 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:51.908838 15346 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:03:51.917354 16694 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:51.917783 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.899818 16754 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.923431 15266 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:51.924749 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.925875 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.926558 16850 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.927211 16850 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.895359 16792 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:51.927503 15341 raft_consensus.cc:2410] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:51.928269 16620 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:51.928646 16620 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:51.929345 16792 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:51.929770 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.930856 16754 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:51.930989 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:51.932133 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.937112 15271 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.939589 16754 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.941638 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.941738 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.909261 15346 pending_rounds.cc:85] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 1
I20260709 13:03:51.949836 15346 pending_rounds.cc:107] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:51.950197 15346 raft_consensus.cc:2889] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:51.929421 16620 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.893437 15337 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.967871 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.922901 15197 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:51.975087 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.982720 15345 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.989114 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:51.987583 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:51.904520 16616 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:51.981573 16448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.004s	sys 0.010s
I20260709 13:03:51.977104 16620 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.976655 16850 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.977771 16754 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:52.009263 15271 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:51.989202 16693 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:52.014467 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 257097us
I20260709 13:03:52.007248 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:52.000248 16448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.004s	sys 0.010s
I20260709 13:03:52.017859 15267 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:52.021234 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:51.977653 16813 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:03:51.972149 16735 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:51.983522 16646 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:03:51.989553 16642 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:03:52.032714 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:52.061555 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:52.015789 16859 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.012406 16618 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:03:52.016038 16617 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:03:52.035728 15876 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:52.066133 16858 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:03:52.016379 16307 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:52.068764 16802 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:52.070626 16646 consensus_queue.cc:1243] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:52.061087 16448 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:03:52.016341 16850 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:52.084113 16754 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:52.084574 16824 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:52.092330 16618 consensus_queue.cc:1243] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:52.075623 16834 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.091459 16845 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:52.104504 16797 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.116178 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:52.103952 16527 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:52.103070 16822 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.132568 16527 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:52.131609 16797 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:52.145702 16856 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:03:52.107476 16597 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:03:52.151793 16857 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:03:52.155169 16693 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.141260 16694 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.164611 16797 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:52.139905 16822 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:52.177254 16490 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:52.177742 16490 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:52.149024 16616 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.180637 16692 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:52.181190 16692 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:52.180677 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:52.196136 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:52.172086 16735 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.182216 16692 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:52.199405 16114 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:52.200368 16114 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:52.200902 16114 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:52.207595 16805 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.208333 16805 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.210991 16805 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.216754 16737 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:52.218253 16805 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:52.218843 16805 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:52.220105 16805 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.223897 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:52.178629 16490 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.185679 16822 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:52.226219 16490 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:52.194844 16527 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.227829 16527 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:52.228863 16834 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.231455 16759 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:52.232601 16759 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:52.233493 16759 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.234516 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1048) took 1114 ms. Trace:
I20260709 13:03:52.234925 15197 rpcz_store.cc:276] 0709 13:03:51.120334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.331335 (+211001us) service_pool.cc:224] Handling call
0709 13:03:52.234338 (+903003us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400225bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:52.234454 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1062381952}
I20260709 13:03:52.195071 16694 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:52.238173 16694 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:52.242015 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.258783 16114 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:52.285638 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.323834 16114 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.333729 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 988) took 1234 ms. Trace:
I20260709 13:03:52.334245 15269 rpcz_store.cc:276] 0709 13:03:51.099472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.101508 (+  2036us) service_pool.cc:224] Handling call
0709 13:03:51.488391 (+386883us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:03:51.488577 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.788952 (+300375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.333410 (+544458us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54001d88d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:52.333648 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692694656}
W20260709 13:03:52.350499 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.352389 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:52.388055 15197 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:52.248603 16642 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 13:03:52.324222 16678 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.327723 16856 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:03:52.230955 16802 consensus_queue.cc:1175] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ca86ee1d194023b1414bbe226f4798" responder_term: 4 status { last_received { term: 4 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 4 index: 2 } }
W20260709 13:03:52.406752 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.421343 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.323323 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:52.319792 16757 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:03:52.327814 16616 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:03:52.350152 16618 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:03:52.404683 16850 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:52.411988 16620 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:03:52.435202 16642 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:52.420204 16678 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:52.431171 16761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.019s	sys 0.019s
I20260709 13:03:52.495249 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:52.502780 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:52.503615 15196 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:52.504338 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:52.506317 15195 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:52.463920 16850 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.516153 16850 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.516815 16822 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:52.515254 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:52.518610 16850 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.511458 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:52.501008 16761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.019s	sys 0.020s
I20260709 13:03:52.536480 15189 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:52.537883 16867 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:52.539330 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:52.491117 16642 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:52.650828 15162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.053s	sys 0.085s
I20260709 13:03:52.522732 16822 consensus_queue.cc:1243] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:03:52.666148 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 124399us
W20260709 13:03:52.678098 15162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.053s	sys 0.085s
W20260709 13:03:52.674052 15237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.005s	sys 0.013s
W20260709 13:03:52.679102 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 646436us
W20260709 13:03:52.721210 15237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.006s	sys 0.013s
I20260709 13:03:52.674856 16867 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:52.722013 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 734431us
I20260709 13:03:52.744145 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:52.799798 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 297533us
I20260709 13:03:52.681214 16616 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.807171 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 85579.3us
W20260709 13:03:52.809351 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.675348 16626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.026s
I20260709 13:03:52.809626 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:52.713444 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:52.823983 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 79960.8us
W20260709 13:03:52.825218 15874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.007s	sys 0.033s
I20260709 13:03:52.665619 16850 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:52.716486 16694 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.725486 16693 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:52.856513 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.846787 16686 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:52.859262 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:52.852186 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:52.806876 16597 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.875176 16114 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:52.857462 16616 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:52.729030 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 492010us
I20260709 13:03:52.882318 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:52.847200 16626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.013s	sys 0.026s
I20260709 13:03:52.868629 16415 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:03:52.858402 16448 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.872917 16870 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:03:52.873550 16855 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.917013 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.886664 16869 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:52.894170 16694 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.932439 16686 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:52.915870 16720 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:52.885246 16693 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.920548 16681 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.913494 15188 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:52.910562 16448 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.917984 16855 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:52.991925 16874 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:03:52.887071 16597 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:52.880781 16642 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.986768 16686 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.876071 16850 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:52.914844 16626 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:03:52.990823 16678 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.988202 16880 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:52.992585 16877 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:53.006173 15194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.858s	user 0.010s	sys 0.058s
W20260709 13:03:53.064417 15194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.010s	sys 0.058s
I20260709 13:03:52.989277 16720 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:53.042258 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 232680us
I20260709 13:03:53.067051 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:53.012879 16881 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:03:53.002511 16859 consensus_meta.cc:287] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.925s	user 0.007s	sys 0.006s
I20260709 13:03:53.069397 16797 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.069599 16859 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:53.018364 16713 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:53.069952 16797 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.070719 16713 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:53.070950 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 909) took 1048 ms. Trace:
I20260709 13:03:53.039476 16879 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.071991 16797 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:52.993042 16694 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.073341 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.073622 16694 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.074118 15189 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:53.073365 16797 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.076539 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.073704 16859 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:53.075670 16797 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:53.077375 16859 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.078986 16307 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.077373 15189 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:53.080766 16797 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:53.081833 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.082209 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.071767 16713 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.084220 16597 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:53.085188 16616 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.085678 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:53.072355 16879 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.085479 16881 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.086454 16693 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:52.997745 16681 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.087836 16448 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.089001 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1005) took 1327 ms. Trace:
I20260709 13:03:53.089704 16681 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.089855 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.090231 16881 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:53.090543 15263 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:53.089360 15268 rpcz_store.cc:276] 0709 13:03:51.761196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.761407 (+   211us) service_pool.cc:224] Handling call
0709 13:03:51.783530 (+ 22123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.792333 (+  8803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.088788 (+1296455us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b54001d9cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:53.088951 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18578816}
I20260709 13:03:53.096201 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.106118 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.106952 15266 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:53.108794 15266 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:53.111018 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.111879 15266 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:53.114951 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.116194 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.071408 15194 rpcz_store.cc:276] 0709 13:03:52.022192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.022413 (+   221us) service_pool.cc:224] Handling call
0709 13:03:52.022857 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:52.030376 (+  7519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.030408 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:52.073342 (+ 42934us) log.cc:844] Serialized 52 byte log entry
0709 13:03:52.136490 (+ 63148us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:53.067945 (+931455us) log.cc:844] Serialized 14 byte log entry
0709 13:03:53.069439 (+  1494us) log.cc:844] Serialized 14 byte log entry
0709 13:03:53.070658 (+  1219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.070727 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.070763 (+    36us) raft_consensus.cc:1685] finished
0709 13:03:53.070775 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.070896 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6399,"prepare.queue_time_us":573155,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":10168,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":34476,"spinlock_wait_cycles":4372864,"thread_start_us":957135,"threads_started":2,"wal-append.queue_time_us":136237}
I20260709 13:03:52.952828 16867 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.117486 16693 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:53.119994 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 53077.2us
I20260709 13:03:53.120694 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:53.121351 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.122134 15270 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:53.086320 15265 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.079820 16859 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.126716 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.042246 16761 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:03:53.128463 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.128465 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1062) took 1541 ms. Trace:
I20260709 13:03:53.130916 15266 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:53.157063 15191 rpcz_store.cc:276] 0709 13:03:51.586657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.586777 (+   120us) service_pool.cc:224] Handling call
0709 13:03:51.587129 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.610772 (+ 23643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.610818 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:51.611415 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 13:03:52.194543 (+583128us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b180036f0a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:03:52.667280 (+472737us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:52.667343 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.667429 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.120203 (+452774us) raft_consensus.cc:1685] finished
0709 13:03:53.120221 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.128403 (+  8182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53292,"raft.queue_time_us":31325,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1724,"spinlock_wait_cycles":5192448,"thread_start_us":472525,"threads_started":1,"wal-append.queue_time_us":1294324}
W20260709 13:03:53.129662 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 255357us
I20260709 13:03:53.071023 16686 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.091053 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:03:53.172458 16878 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:03:53.172394 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.173810 16797 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:53.174059 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 53437.7us
I20260709 13:03:53.066604 16877 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:53.191453 15237 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.993s (SENT)
I20260709 13:03:53.167973 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:53.129642 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1072) took 1186 ms. Trace:
I20260709 13:03:53.189164 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.155146 16894 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.209765 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:53.155942 16693 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:03:53.245177 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56170.5us
I20260709 13:03:53.168653 16490 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 13:03:53.245810 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54395.5us
W20260709 13:03:53.208864 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 139115us
I20260709 13:03:53.127095 16626 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:53.190237 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74128.3us
I20260709 13:03:53.202744 16686 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:53.188516 15871 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:53.155710 16694 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.170724 16859 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:53.183308 16873 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:03:53.068410 16880 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.178092 16881 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.178279 16885 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:53.184451 16867 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.211781 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:53.263072 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.263772 15271 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:53.252987 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.249174 16626 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:03:53.255148 16883 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:03:53.224355 15264 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:53.276425 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.274672 16881 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.258737 16833 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:03:53.255815 16616 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:53.250350 16879 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.262477 16694 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.252723 16850 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.291052 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.294227 16307 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:53.278548 16899 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:53.256052 16859 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:53.295436 16887 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:03:53.295609 15271 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:53.263063 16885 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.284315 16626 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.309712 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.290676 16415 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.257561 16686 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.277804 16908 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.313211 16895 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.314442 16892 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:53.316282 16880 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.320904 16881 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.323342 16646 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:53.302938 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.300928 16681 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:53.346130 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.346779 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.347479 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.351250 15271 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:53.308782 16850 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.296152 16616 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.299875 16877 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.375483 15271 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:53.249761 16894 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.310539 16307 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.354103 16899 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.353952 16713 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.359467 16905 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.354717 16742 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:53.349124 16908 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.222363 15340 rpcz_store.cc:276] 0709 13:03:51.939245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.939391 (+   146us) service_pool.cc:224] Handling call
0709 13:03:51.939695 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.939918 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:52.290526 (+350608us) log.cc:844] Serialized 14 byte log entry
0709 13:03:53.016291 (+725765us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:53.041304 (+ 25013us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:53.060434 (+ 19130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.066314 (+  5880us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.125769 (+ 59455us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1541,"prepare.queue_time_us":523924,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":7338,"raft.queue_time_us":244854,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":7950,"thread_start_us":952889,"threads_started":3,"wal-append.queue_time_us":746499}
I20260709 13:03:53.368156 15194 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:53.324820 16885 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:53.327903 16855 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.307461 16694 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:53.372696 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.391979 16877 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.310312 16859 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:53.385510 16901 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:03:53.379462 16850 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.387584 16758 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:53.389335 16869 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:53.326383 16693 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:53.394995 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 213270us
I20260709 13:03:53.357275 16646 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:53.377240 16527 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.149s	user 0.015s	sys 0.000s
I20260709 13:03:53.371266 16681 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.335088 16415 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.379545 16616 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.375103 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:53.411875 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.415235 16897 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.405567 16899 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.415870 16902 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.397222 16761 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.382907 15263 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:53.404518 16742 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.482265 16742 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.483410 15264 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:53.448033 16898 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:03:53.473311 15189 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
W20260709 13:03:53.448400 16891 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:03:53.449399 16908 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:53.407287 16713 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:53.451023 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.450877 16758 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:53.491780 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.491917 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.355501 16895 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.461205 15340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1d89f71244148538087b141a709ec50"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:03:53.459132 16869 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:53.467710 16681 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.467167 16646 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:53.464731 16827 raft_consensus.cc:993] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:03:53.458873 16804 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.486097 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:53.493125 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:53.495496 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.636s (SENT) [suppressed 64 similar messages]
W20260709 13:03:53.499761 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.467809 16757 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:03:53.513597 15343 raft_consensus.cc:1217] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-4.3]   Dedup: 2.2->[4.3-4.3]
I20260709 13:03:53.513744 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:53.514088 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:53.514442 15346 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:53.514711 15338 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:53.514140 15343 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:03:53.414052 16905 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.484898 16825 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:03:53.524693 15342 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:53.496140 16527 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:53.535760 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:53.536656 15875 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:53.486706 16761 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.525774 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:53.510691 16824 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:53.510897 15340 raft_consensus.cc:606] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:53.533921 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:53.540295 15343 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:53.535307 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:53.529788 15345 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:53.549223 16899 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.517975 16911 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:53.552676 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 341649us
I20260709 13:03:53.559677 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.558190 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:53.486254 16897 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.583586 16792 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.543169 15340 raft_consensus.cc:614] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:53.605798 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:53.605734 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.604562 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:53.495350 16902 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.554459 15871 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:03:53.631076 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.517114 16804 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.592299 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:53.600623 16307 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:53.544059 16527 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:53.649538 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43879.9us
I20260709 13:03:53.616466 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:53.542380 16758 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:53.662614 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 104543us
I20260709 13:03:53.676745 16804 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:53.678246 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 182772us
I20260709 13:03:53.649499 16694 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.687853 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.693918 15237 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.584255 16792 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.655529 16914 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:53.662097 15873 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
W20260709 13:03:53.743950 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 50141.1us
I20260709 13:03:53.555919 16720 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.658273 15265 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:53.683701 16899 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.682861 16850 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.743492 16908 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:53.743988 15870 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:03:53.620343 16869 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.678823 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:53.746349 16415 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.748476 16914 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.773828 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:53.775640 15191 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:53.749289 16888 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.755669 16646 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.772891 16908 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.770144 16928 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:53.785290 16919 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.793352 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:53.793960 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.797904 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:53.826665 15345 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:53.799217 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.799510 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.799624 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.784634 16912 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.829277 15195 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:53.800647 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.800872 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.831094 15192 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:53.769240 16713 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:53.829377 16912 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:53.785735 16904 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:03:53.784751 16896 raft_consensus.cc:1081] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:03:53.592581 16911 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.833250 16906 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:53.830636 16845 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:53.797874 15337 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:53.786607 16897 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:53.765458 16899 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:53.839098 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.770866 16879 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.856730 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.816027 16908 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:53.793989 16914 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:53.838119 16713 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.837144 16869 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.834641 16928 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.865106 15345 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:03:53.834939 16527 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.842360 16825 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.873174 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.855273 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.848716 16845 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.842777 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.859827 16929 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.851567 16906 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.852392 16761 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.835300 15839 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:53.860376 16907 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:53.859633 16924 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.860248 16916 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.860070 16910 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:53.874312 16792 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:53.921567 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:53.936160 16920 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:03:53.937071 15189 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:53.938252 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.941372 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:53.879514 16867 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.005s
I20260709 13:03:53.923096 16905 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:53.955364 16918 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:03:53.883582 16928 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.870656 16879 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.941974 16742 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.880936 16713 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.928951 16906 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.945955 16907 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.950171 16792 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:53.945446 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 137267us
I20260709 13:03:53.932545 16825 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.960788 16913 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:53.961094 16902 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:54.000728 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.969094 16905 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:53.856177 16919 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:53.974082 16907 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:53.831533 16888 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:54.010812 16923 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:03:53.974438 16694 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.967207 16910 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:54.029237 16921 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:03:54.013713 16867 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:54.007401 16930 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.033748 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:54.033973 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 240716us
I20260709 13:03:53.991763 16926 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.019132 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:53.957405 16924 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.041780 16919 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.017122 16903 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:54.007730 16895 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.048234 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
W20260709 13:03:54.043638 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.945140 16929 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.034921 16850 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.025081 16646 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.069954 16910 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.018456 16905 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:53.955483 16916 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.042778 16912 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.020505 16913 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:54.064978 16915 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:03:54.053881 16527 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.037317 16694 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.065184 16911 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.071501 16895 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.086841 16693 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.083946 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.089073 16899 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.051261 16867 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:54.104043 16913 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.114012 16742 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:54.117337 16885 consensus_meta.cc:287] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
I20260709 13:03:54.137152 16924 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.085979 16850 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.141577 16879 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.149619 16929 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.068014 15189 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:54.151648 16692 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:54.145049 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.150449 16694 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.100175 16527 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.138311 16885 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.165319 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.179558 15270 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:54.166241 16310 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:54.113024 16911 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.118517 15265 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:03:54.112735 16895 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.064822 16930 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.183542 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:54.186656 16937 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:03:54.194105 16616 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.721s	user 0.004s	sys 0.006s
I20260709 13:03:54.194531 16911 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.117861 16914 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.197368 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1023) took 1057 ms. Trace:
I20260709 13:03:54.230027 15270 rpcz_store.cc:276] 0709 13:03:53.140279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.164933 (+1024654us) service_pool.cc:224] Handling call
0709 13:03:54.197319 (+ 32386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.070897 16926 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.195588 16114 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:54.236617 16114 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:54.181622 16310 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:54.119892 16693 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.237803 16114 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:54.243637 16310 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.246644 16114 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.247170 16926 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:54.255360 16681 consensus_meta.cc:287] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.738s	user 0.005s	sys 0.007s
I20260709 13:03:54.259964 16681 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.261152 16693 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.265774 16681 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.249850 16813 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:54.266472 16813 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:54.267410 16813 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.268365 16813 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.272749 16914 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.231540 16616 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.247720 16845 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:54.278481 16930 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.262017 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.276968 16905 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.253376 16825 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:54.294703 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.284478 16877 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.003s
I20260709 13:03:54.282231 16888 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.300436 15193 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:03:54.301599 16694 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.302110 16694 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:54.293108 16626 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.950s	user 0.013s	sys 0.000s
I20260709 13:03:54.288985 16914 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.288269 16928 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.298910 16693 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.323876 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.328323 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:54.331249 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.323697 16867 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.334904 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.326258 16899 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.327510 16888 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:54.336033 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 292990us
I20260709 13:03:54.325112 16897 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.338858 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.327903 16694 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.340539 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:54.321568 16914 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.318958 16626 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.339362 16919 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:54.334494 16930 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:54.346402 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.335155 16527 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.337466 16929 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:54.355391 16805 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:54.356714 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 917) took 1012 ms. Trace:
I20260709 13:03:54.340142 16911 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.329134 16693 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.347338 16916 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.357285 15191 rpcz_store.cc:276] 0709 13:03:53.344073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.346542 (+  2469us) service_pool.cc:224] Handling call
0709 13:03:54.356462 (+1009920us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001e7dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:54.356637 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928264960}
I20260709 13:03:54.361352 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.361572 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:54.350855 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.362165 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.343194 16897 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.364544 16114 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:54.365486 15268 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:03:54.366309 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.367503 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.342401 16899 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:54.362746 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.369462 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.351150 16935 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:54.354130 16888 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:54.349503 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.368388 15874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 103) took 2112 ms. Trace:
I20260709 13:03:54.357841 15269 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.364995 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:54.370956 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.368031 16697 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.375368 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:54.363864 16945 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:54.379894 16888 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.385758 16686 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.386680 16825 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.387187 16825 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:54.387593 16825 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.360157 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:54.376869 16845 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.377033 16693 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.378026 16928 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.378659 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.403280 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.381328 15874 rpcz_store.cc:276] 0709 13:03:52.321560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.321972 (+   412us) service_pool.cc:224] Handling call
0709 13:03:52.322331 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.859078 (+536747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.859107 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:52.870305 (+ 11198us) log.cc:844] Serialized 26 byte log entry
0709 13:03:54.154317 (+1284012us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b18002ce180. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:03:54.343668 (+189351us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:54.343721 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.343790 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.368122 (+ 24332us) raft_consensus.cc:1685] finished
0709 13:03:54.368140 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.368322 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1856,"raft.queue_time_us":574174,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":16179,"spinlock_wait_cycles":15729408,"thread_start_us":725348,"threads_started":2,"wal-append.queue_time_us":1473483}
I20260709 13:03:54.404050 15192 raft_consensus.cc:2410] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:54.405077 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.369262 16930 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:54.406293 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.381906 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:54.407703 15189 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:54.408545 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.409957 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.385850 16888 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:54.354981 16907 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:54.388566 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.375850 16626 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.388267 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:03:54.420753 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.380003 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.379383 16914 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.395532 16867 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:03:54.388827 16616 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.382195 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:54.400529 16908 consensus_meta.cc:287] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.000s
W20260709 13:03:54.400843 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.382840 15869 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:54.411233 15871 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:54.378924 16899 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.413971 16797 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:54.437359 16797 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:54.439323 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.410302 16713 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.415447 16897 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.414676 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:54.416339 15193 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:54.442781 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.443393 15193 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:54.444229 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:54.444979 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:54.446033 15873 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:03:54.446440 16804 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.446936 16804 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:54.446987 15188 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 914) took 1926 ms (client timeout 2121 ms). Trace:
W20260709 13:03:54.448074 15188 rpcz_store.cc:269] 0709 13:03:52.520546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.523167 (+  2621us) service_pool.cc:224] Handling call
0709 13:03:54.446825 (+1923658us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b5400236ed4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:54.446932 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75228928}
I20260709 13:03:54.449219 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.449822 15188 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:54.447690 16885 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.424158 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:54.429828 16490 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:54.427534 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.458705 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:54.429113 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.461321 15271 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:54.413177 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.430253 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:54.384953 16859 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.943s	user 0.012s	sys 0.006s
I20260709 13:03:54.433408 16895 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.464577 15272 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:54.433624 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51520.6us
I20260709 13:03:54.433866 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.434211 16845 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.440068 15162 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:54.450693 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.406337 16930 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.453568 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:54.430013 16642 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.382575 16697 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:03:54.430405 16693 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.485663 16693 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.455147 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:54.455730 16786 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:54.455595 16797 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:54.430305 16934 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:54.430779 16686 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.454116 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:54.440438 16908 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:54.471462 16907 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.474499 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:54.475685 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:54.500216 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:54.500432 15188 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.476418 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:54.501933 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.477656 16307 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:54.458510 16490 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.502877 16307 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.503435 16307 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:54.503017 16490 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.508261 15188 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:03:54.479622 15311 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:54.509270 16930 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:54.511292 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:54.511581 16934 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.483462 15194 raft_consensus.cc:2410] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:54.483995 16713 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.479183 15263 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:54.474066 16845 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.484549 15196 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:54.470225 16859 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.484967 16897 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:03:54.426297 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46362.1us
I20260709 13:03:54.519515 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:54.521780 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:54.523559 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:54.525313 15272 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:54.527514 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:54.495087 15193 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:54.528715 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.529109 15271 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.462153 16906 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.496794 16824 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:54.512327 16804 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.510232 16930 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.512109 16934 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:54.509413 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.537508 15268 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:54.538040 15842 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:54.541951 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.542661 15195 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:54.542934 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.521850 16678 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.518954 16845 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.514534 16713 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.534060 16681 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:54.540416 16930 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:54.532750 16912 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:54.553617 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.554272 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:54.547309 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.555365 15195 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:54.555469 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.553002 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:54.554888 15344 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.557834 16693 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.558725 15188 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:54.559206 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 62) took 1068 ms. Trace:
I20260709 13:03:54.559615 15194 rpcz_store.cc:276] 0709 13:03:53.490552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.491600 (+  1048us) service_pool.cc:224] Handling call
0709 13:03:54.558958 (+1067358us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54002364d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:54.559130 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277876608}
I20260709 13:03:54.533838 16907 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.533737 16527 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.522503 16786 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:54.544916 16824 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:54.565258 16907 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.550534 16713 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.567508 16907 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.567687 16824 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:54.550647 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:54.569260 15263 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.499940 16686 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.561998 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:54.546365 16881 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.521973 16597 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:03:54.571132 15188 raft_consensus.cc:606] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:54.545776 15342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708015fd563e4389af835f3aca58eb01"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:03:54.572562 15342 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:54.550887 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.572890 15342 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.539882 16941 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:54.520972 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.562882 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.547915 16678 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:54.564606 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.571569 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:54.540616 16825 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.596609 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:54.560150 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:54.562335 16953 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:54.559419 16899 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.611682 16825 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.612129 16899 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.614682 15190 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:03:54.572765 16626 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:54.615451 16626 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.566531 16527 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.561239 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.573433 15341 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:54.574100 15272 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
W20260709 13:03:54.561820 16952 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:03:54.550276 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:54.571134 16912 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:54.571173 16881 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.577978 16908 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.577544 16786 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.578521 15873 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:54.565881 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.551479 16681 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.615882 16626 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.546079 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:54.608754 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:54.592310 16678 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.624680 15338 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:54.633143 15194 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:54.621903 16527 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.633952 15193 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.633952 15267 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.625360 16881 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.621701 15189 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:54.639632 16681 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.645210 15190 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.646889 16912 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.669278 16720 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.643014 16757 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:54.686038 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:54.688227 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:54.688602 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 167699us
I20260709 13:03:54.689661 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:54.696810 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:54.720108 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 76647.7us
I20260709 13:03:54.720736 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:54.707571 15267 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:54.724522 16899 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.725162 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.725988 16934 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.726274 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.727245 16850 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.724439 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:54.723896 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:54.728351 15341 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.728718 15267 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.711294 15311 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:54.712092 15193 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:54.730831 15197 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.731372 15339 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:54.731060 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:54.732627 15193 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:54.740548 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.689302 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.813386 15267 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:03:54.920683 15237 leader_election.cc:336] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.525s (SENT)
I20260709 13:03:54.873036 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.923942 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.877358 15341 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:54.750311 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.924836 15267 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:54.795297 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.925520 15339 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:54.745272 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:54.801488 15344 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:54.819332 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1022) took 1691 ms. Trace:
I20260709 13:03:54.900110 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:54.817715 15266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1031) took 1675 ms (client timeout 1657 ms). Trace:
I20260709 13:03:54.894300 16867 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.926255 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.924247 15272 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:54.944228 15271 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.944696 15267 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:54.945927 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:54.790823 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.690446 16848 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:54.947566 15266 rpcz_store.cc:269] 0709 13:03:53.142446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.817555 (+1675109us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:54.817663 (+   108us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:03:54.693733 16597 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:54.950821 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.788216 16956 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:54.952307 15346 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:54.744194 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:54.937793 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.689517 16908 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.693445 16885 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.251s
I20260709 13:03:54.967092 16908 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.811017 15189 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:54.968364 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1077) took 1103 ms. Trace:
I20260709 13:03:54.968734 15189 rpcz_store.cc:276] 0709 13:03:53.864604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.690983 (+826379us) service_pool.cc:224] Handling call
0709 13:03:54.789468 (+ 98485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.968095 (+178627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.968306 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.691099 16757 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.727905 16693 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.894855 16759 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.951016 15269 rpcz_store.cc:276] 0709 13:03:53.138121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.168465 (+ 30344us) service_pool.cc:224] Handling call
0709 13:03:53.168752 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.382083 (+1213331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.819083 (+437000us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000d6954. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:54.819255 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2734195968}
I20260709 13:03:54.976032 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:54.831954 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:54.863757 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.948132 16894 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.864454 16686 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.989588 15194 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:54.989735 15342 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.963800 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.001170 15339 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.002000 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.765297 16899 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:54.946020 15264 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:03:54.762305 16945 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:54.696503 16822 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.258s
I20260709 13:03:55.006788 15265 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:55.017045 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.010726 16899 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.018297 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.019153 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 56) took 1474 ms. Trace:
I20260709 13:03:54.898842 16678 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.019562 16899 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.783138 16930 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.022293 16930 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:54.989455 16908 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:54.826503 16907 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.883450 16914 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:03:55.025708 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 281602us
I20260709 13:03:55.005640 16786 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:54.811080 16307 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:54.960484 16681 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.947185 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.828850 15870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58400 (request call id 109) took 1313 ms. Trace:
I20260709 13:03:54.922335 16850 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.036398 16850 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.036720 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:54.960297 16310 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.037364 15871 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.037650 15870 rpcz_store.cc:276] 0709 13:03:53.515097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.519251 (+  4154us) service_pool.cc:224] Handling call
0709 13:03:53.659608 (+140357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:53.773728 (+114120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.828614 (+1054886us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540068ea50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:54.828776 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253564160}
I20260709 13:03:55.039454 16908 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:55.040796 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.039966 16908 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.043066 15271 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:55.044214 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.046954 15271 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:55.047876 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.049186 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.049815 15266 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:55.050516 16928 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.048410 15271 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:55.051403 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:03:55.052029 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.052594 15271 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:55.052953 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 55) took 8205 ms. Trace:
I20260709 13:03:55.053717 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.053509 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.055387 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.055573 16907 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.056329 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.056972 15344 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:54.734524 16892 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.265s
I20260709 13:03:55.058552 16713 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:54.787387 16490 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.060724 16713 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:55.019533 15264 rpcz_store.cc:276] 0709 13:03:53.544893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.545836 (+   943us) service_pool.cc:224] Handling call
0709 13:03:54.685467 (+1139631us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8eee 0000000000375939 00007f36ea65c1e0 00007f36ea7250c4 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:03:55.019067 (+333600us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16300416}
I20260709 13:03:55.061400 15343 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:54.803673 16935 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.196s
I20260709 13:03:55.025270 16626 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.063243 16935 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:55.063602 16935 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.063766 16626 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.053356 15093 rpcz_store.cc:276] 0709 13:03:46.847528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.847959 (+   431us) service_pool.cc:224] Handling call
0709 13:03:47.525782 (+677823us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5677090 00007f36e5715f3a 00007f36eb4cc1cc 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc 00007f36e9a8a392 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:55.052885 (+7527103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:51.169717 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:51.222133 (+ 52416us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:51.222167 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:03:51.222200 (+    33us) tablet.cc:662] Decoding operations
0709 13:03:51.222579 (+   379us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:51.222677 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:51.222710 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:51.223020 (+   310us) tablet.cc:701] Row locks acquired
0709 13:03:51.223058 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:03:51.223193 (+   135us) write_op.cc:270] Start()
0709 13:03:51.223299 (+   106us) write_op.cc:276] Timestamp: P: 1783602231223155 usec, L: 0
0709 13:03:51.223319 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:03:51.269058 (+ 45739us) log.cc:844] Serialized 912 byte log entry
0709 13:03:51.561254 (+292196us) op_driver.cc:464] REPLICATION: finished
0709 13:03:51.762632 (+201378us) write_op.cc:301] APPLY: starting
0709 13:03:51.778437 (+ 15805us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:51.778552 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:51.778657 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:51.779019 (+   362us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:51.779199 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:03:51.779259 (+    60us) write_op.cc:312] APPLY: finished
0709 13:03:51.779469 (+   210us) log.cc:844] Serialized 28 byte log entry
0709 13:03:51.779662 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:51.779764 (+   102us) write_op.cc:454] Released schema lock
0709 13:03:51.779816 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:51.780234 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:51.780280 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1289776,"reported_tablets":5,"spinlock_wait_cycles":51445504,"child_traces":[["op",{"apply.queue_time_us":186085,"apply.run_cpu_time_us":2014,"apply.run_wall_time_us":24337,"num_ops":2,"prepare.queue_time_us":153436,"prepare.run_cpu_time_us":57970,"prepare.run_wall_time_us":336567,"raft.queue_time_us":113532,"raft.run_cpu_time_us":16214,"raft.run_wall_time_us":69721,"replication_time_us":337797,"thread_start_us":357876,"threads_started":4,"wal-append.queue_time_us":169529,"wal-append.run_cpu_time_us":14040,"wal-append.run_wall_time_us":1361226}]]}
I20260709 13:03:55.064447 16925 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:55.064950 16925 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.066133 15188 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:55.028743 16914 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.035099 15190 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:55.068539 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:55.069304 16964 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:03:55.069686 16620 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:55.070077 16620 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:55.070443 16620 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.070677 15871 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:55.006552 15263 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:55.085256 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.085965 16620 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.086606 16906 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.086778 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1071) took 1223 ms. Trace:
I20260709 13:03:55.087193 15188 rpcz_store.cc:276] 0709 13:03:53.863578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.597816 (+734238us) service_pool.cc:224] Handling call
0709 13:03:54.608013 (+ 10197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.066556 (+458543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.086532 (+ 19976us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54001e69d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:55.086710 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048468736}
I20260709 13:03:55.088368 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:55.011009 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.088959 15188 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:55.089476 15272 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:54.999022 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:55.090476 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:55.090586 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 91638.8us
I20260709 13:03:55.090951 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 922) took 1290 ms. Trace:
I20260709 13:03:55.091373 15196 rpcz_store.cc:276] 0709 13:03:53.800244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.800377 (+   133us) service_pool.cc:224] Handling call
0709 13:03:55.090762 (+1290385us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54001f77d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:55.090895 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502596352}
I20260709 13:03:55.092527 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.027472 15342 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:54.963162 16848 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:55.093232 15268 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:55.018896 15265 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.094058 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.094198 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:55.093829 16848 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.022524 16845 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.057269 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.097390 15270 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:55.099350 15872 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:03:55.093842 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.100504 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:55.100883 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.101974 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.102538 15342 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:03:55.098209 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.103914 15270 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:55.104728 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.105201 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1076) took 1240 ms. Trace:
I20260709 13:03:55.105798 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.106421 15270 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:55.105562 15194 rpcz_store.cc:276] 0709 13:03:53.864454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.640403 (+775949us) service_pool.cc:224] Handling call
0709 13:03:54.640805 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.000302 (+359497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.104983 (+104681us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b54003e53d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:55.105146 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801484032}
I20260709 13:03:55.107000 16935 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.108219 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:55.108479 16935 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.109035 15194 raft_consensus.cc:2410] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:55.057543 16678 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:55.110176 16678 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:55.110667 16678 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:55.115281 16797 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.092573 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:55.120257 16963 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:03:55.003355 16693 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.050688 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.121299 15266 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:55.122459 15266 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:55.111583 16678 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.123988 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:55.124742 15268 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:03:55.071506 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1079) took 1206 ms. Trace:
I20260709 13:03:55.125033 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.126368 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.127271 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:55.125355 15190 rpcz_store.cc:276] 0709 13:03:53.864879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.789308 (+924429us) service_pool.cc:224] Handling call
0709 13:03:54.818295 (+ 28987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.069269 (+250974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.071233 (+  1964us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54001f72d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:55.071447 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482958592}
I20260709 13:03:55.129077 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:55.129238 15190 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.129671 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.130111 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1081) took 1264 ms. Trace:
I20260709 13:03:55.130285 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:55.071900 16881 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:03:55.075419 15237 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.578s (SENT)
I20260709 13:03:55.131405 16897 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:55.132072 16897 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.132184 16892 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:55.132920 16892 consensus_queue.cc:1243] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:55.133082 16897 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.133908 16892 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:55.134500 16892 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:55.134835 16892 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.135239 16892 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.134492 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.136268 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.136897 15270 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:55.138123 15270 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:55.072144 16908 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.075955 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1072) took 1212 ms. Trace:
I20260709 13:03:55.139019 15197 rpcz_store.cc:276] 0709 13:03:53.863772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.685848 (+822076us) service_pool.cc:224] Handling call
0709 13:03:54.730667 (+ 44819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.731255 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.075778 (+344523us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b54001a5250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:55.075900 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102372608}
I20260709 13:03:55.140182 15342 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.091694 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:54.997335 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.999095 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.076805 15189 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:55.004398 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.053471 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:55.068606 16914 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.079018 16761 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:55.034523 16888 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.002s
I20260709 13:03:55.082638 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:55.086364 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.019690 16686 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:55.088737 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:54.950304 16867 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.131304 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.032058 16786 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:55.130918 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.140694 15197 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.061849 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.140724 15193 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:55.053372 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:55.141752 15269 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:55.073705 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.142884 15343 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.142526 15341 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.144083 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.147753 15196 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:55.149072 15192 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
W20260709 13:03:55.162818 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 87413.5us
I20260709 13:03:55.163936 15272 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:55.164597 15342 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.168565 15192 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:03:55.152633 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70070.7us
I20260709 13:03:55.165928 15271 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 13:03:55.168360 15237 leader_election.cc:336] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.655s (SENT)
I20260709 13:03:55.171262 15192 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:55.171347 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.149752 15346 raft_consensus.cc:2368] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:55.155457 15263 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:54.954042 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:55.073988 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.058569 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.181946 15344 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.182695 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.183353 15344 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.158576 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:55.183601 15237 leader_election.cc:336] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.700s (SENT)
I20260709 13:03:55.180281 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:55.183907 15345 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:55.150262 16893 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:55.164816 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1082) took 1292 ms. Trace:
I20260709 13:03:55.161818 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1080) took 1296 ms. Trace:
I20260709 13:03:55.165321 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.046801 16527 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.151628 15267 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:55.169279 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.152997 16888 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.169447 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.173362 15192 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:55.174502 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.130668 15190 rpcz_store.cc:276] 0709 13:03:53.865667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.128598 (+1262931us) service_pool.cc:224] Handling call
0709 13:03:55.128975 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.129797 (+   822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.130041 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:55.169612 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.162324 16885 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:03:55.156337 16686 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.166750 16928 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:03:55.158931 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 1.39594e+06us
I20260709 13:03:55.184713 15339 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.179394 16713 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:03:55.139583 15270 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:55.184912 16895 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:03:55.211859 15345 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:55.212568 15197 rpcz_store.cc:276] 0709 13:03:53.872017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.140131 (+1268114us) service_pool.cc:224] Handling call
0709 13:03:55.140473 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.162138 (+ 21665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.164763 (+  2625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:55.163803 15269 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.173413 16761 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:55.280719 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:55.281698 16761 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:55.217911 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48718.3us
I20260709 13:03:55.283614 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.218503 16756 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:55.179455 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 244505us
I20260709 13:03:55.212433 16893 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.299356 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.184653 16930 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:55.225430 15192 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:55.026345 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:55.301101 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 274817us
I20260709 13:03:55.230357 16527 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.231123 15195 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:55.232352 16786 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.233824 15190 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:55.234817 16693 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.324113 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.324831 15269 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:55.325927 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62743.5us
I20260709 13:03:55.235968 16888 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:55.236258 16620 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.236545 16307 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:55.215078 15189 rpcz_store.cc:276] 0709 13:03:53.865467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.990416 (+1124949us) service_pool.cc:224] Handling call
0709 13:03:55.033329 (+ 42913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.143857 (+110528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.159488 (+ 15631us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:55.238729 16804 raft_consensus.cc:993] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:03:55.240144 16850 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.235991 16490 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:55.244752 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.222275 16776 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:03:55.227526 16697 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.245765 15337 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.246666 16925 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:55.219271 16597 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:55.335454 16597 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.336733 16597 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.251953 16681 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.253695 16867 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.256800 16859 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.210978 16968 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.184008 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:55.340955 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 157537us
W20260709 13:03:55.341775 15237 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.703s (SENT)
I20260709 13:03:55.090008 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:55.343670 15188 raft_consensus.cc:2368] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:55.344709 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1098) took 1006 ms. Trace:
I20260709 13:03:55.276053 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:55.345103 15195 rpcz_store.cc:276] 0709 13:03:54.338781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.561694 (+222913us) service_pool.cc:224] Handling call
0709 13:03:55.344491 (+782797us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54000c08d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:55.344654 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481306368}
I20260709 13:03:55.345670 15871 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.347223 15194 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.347661 15194 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:55.348519 15194 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.349921 15194 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.249563 16686 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.257840 16912 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.270174 16885 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:55.282462 16962 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.295s	user 0.006s	sys 0.000s
I20260709 13:03:55.169660 16967 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:55.288200 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.289973 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.291666 15311 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:55.184484 16945 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:03:55.304979 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.306013 16930 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.367844 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.368571 15345 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:55.307014 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.369367 15346 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:55.311167 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.370126 15267 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.321388 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.353042 16968 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:55.351469 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.376708 15339 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:03:55.289073 16761 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.360285 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:55.378489 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:55.306043 16931 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:55.304458 16713 consensus_queue.cc:1243] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:03:55.400715 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 109153us
I20260709 13:03:55.308493 16914 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:55.372819 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.373663 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.406383 15270 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:55.309127 16756 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:55.379994 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:55.386675 15269 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:03:55.305784 16928 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:03:55.388685 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.390053 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.390080 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.410053 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.362016 16912 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.399487 15267 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
W20260709 13:03:55.361809 16958 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:55.404389 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.405419 15311 leader_election.cc:400] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:03:55.459371 15311 leader_election.cc:403] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:03:55.459955 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 58195.6us
W20260709 13:03:55.453050 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 126456us
I20260709 13:03:55.461452 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.358142 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.464766 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.466037 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.323189 16757 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.412339 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.467921 15272 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:55.412281 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.469131 15270 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:55.415895 15343 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.391680 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:55.416165 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 126277us
I20260709 13:03:55.471323 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.416796 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.418659 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:55.374476 16930 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.422924 16490 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:55.406646 16893 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.481038 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.481292 16893 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.482187 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.483513 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:55.483712 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:55.484390 16848 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:55.484897 16848 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:55.485397 16941 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:55.485894 16848 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.486800 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.408876 16897 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.388940 16833 raft_consensus.cc:1081] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:03:55.411532 16976 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:55.425206 16914 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:55.487398 16897 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.429647 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:55.428884 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.488266 16897 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.489423 16897 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.432955 16822 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:55.489876 16822 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.430336 16931 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:55.436082 15263 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:55.490700 16822 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.491918 15339 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.491647 16931 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.492295 16822 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:55.435374 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.436642 15265 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:55.400794 16693 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:55.401026 16859 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:55.438185 16912 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.439934 16934 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:55.439990 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.441972 16888 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:55.443173 16881 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.443931 16845 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.462941 16978 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.463461 16850 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:55.477507 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73243.5us
I20260709 13:03:55.534368 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:55.484807 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.423561 16756 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.436535 15871 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:55.495077 16892 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.488279 16914 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.421607 16967 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:55.496191 16976 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.547644 16967 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:55.548242 16976 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.548558 16967 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.496309 16490 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.551232 16490 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.498488 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.493713 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.555401 15345 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
W20260709 13:03:55.556061 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62444.5us
I20260709 13:03:55.556321 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.501784 15266 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.543679 16833 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:55.511065 16934 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.559517 16833 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:55.560078 16934 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.561076 16934 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:55.503270 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.506984 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.562439 16713 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:03:55.503161 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 124048us
I20260709 13:03:55.564883 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.536705 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:55.537712 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.503151 16693 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.560941 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:55.560606 16833 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:55.567910 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.508119 16859 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.574299 15346 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.527202 16888 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.577841 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:55.581655 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.583349 15196 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:03:55.580140 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.585003 15194 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:55.560634 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:55.587355 15870 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.587531 15869 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:55.586939 16415 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:03:55.586747 15345 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.544831 16908 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:55.544476 16912 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.545960 16936 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:55.590276 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.577718 15337 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.575968 16945 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:03:55.580070 16693 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.608628 16945 consensus_queue.cc:1243] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:03:55.576965 16895 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.582947 16859 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.580523 16881 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.608141 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:55.613384 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.585129 16850 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.589188 16968 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.576395 16935 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:03:55.591012 16908 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:55.615502 16759 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.001s
I20260709 13:03:55.645355 16776 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:55.667541 16776 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.668072 16776 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.612601 16895 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.592250 16893 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
W20260709 13:03:55.143654 16948 consensus_queue.cc:1175] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" responder_term: 4 status { last_received { term: 3 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:55.676298 16895 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.677150 16895 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.665802 16935 consensus_queue.cc:1243] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 3.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:55.665910 16908 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.679611 16980 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:55.696486 16978 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
W20260709 13:03:55.537562 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52834.3us
I20260709 13:03:55.538439 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.467478 15091 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 4, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:55.733552 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 195046us
I20260709 13:03:55.740095 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:55.745843 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 137612us
I20260709 13:03:55.745991 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:55.639355 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.647804 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:55.686872 16930 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.776854 15343 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.777240 16931 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:55.575729 16713 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:03:55.762780 16850 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:55.764873 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 201375us
I20260709 13:03:55.734879 15091 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.609419 15340 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.679291 16892 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:55.777560 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.779412 16931 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:55.659587 16761 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.782841 16713 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.771286 16678 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.788288 15344 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:55.789036 15091 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:03:55.669772 16917 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.690300 16980 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.774049 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:55.647598 16888 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:55.808472 16917 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.811481 15191 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:55.814893 15344 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.815886 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1120) took 1117 ms. Trace:
I20260709 13:03:55.818040 16930 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:55.816447 15338 rpcz_store.cc:276] 0709 13:03:54.698449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.727191 (+ 28742us) service_pool.cc:224] Handling call
0709 13:03:54.727519 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:54.732011 (+  4492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.732041 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:54.742790 (+ 10749us) log.cc:844] Serialized 52 byte log entry
0709 13:03:55.327641 (+584851us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b1800187cc0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:03:55.501824 (+174183us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:55.501873 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.501961 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:55.815193 (+313232us) raft_consensus.cc:1685] finished
0709 13:03:55.815247 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.815626 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4121,"raft.queue_time_us":4217,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":45205,"spinlock_wait_cycles":12938496,"thread_start_us":173964,"threads_started":1,"wal-append.queue_time_us":802093}
W20260709 13:03:55.823246 16934 consensus_queue.cc:1175] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:03:55.825572 16980 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.825945 16761 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.785456 16850 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:55.829139 16850 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:55.778661 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 43641.4us
I20260709 13:03:55.800601 16914 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.795817 16931 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.797394 16713 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.842832 16914 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:55.844753 16713 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.846364 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:55.794381 16968 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.850073 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 926) took 1844 ms. Trace:
I20260709 13:03:55.856163 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1032) took 1050 ms. Trace:
I20260709 13:03:55.855338 15091 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:55.856549 15266 rpcz_store.cc:276] 0709 13:03:54.805693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.124025 (+318332us) service_pool.cc:224] Handling call
0709 13:03:55.501592 (+377567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.558484 (+ 56892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.855778 (+297294us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b54003287d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:55.855986 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867674368}
I20260709 13:03:55.850530 15196 rpcz_store.cc:276] 0709 13:03:54.005967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.165805 (+1159838us) service_pool.cc:224] Handling call
0709 13:03:55.173751 (+  7946us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:55.586177 (+412426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.849565 (+263388us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54002116d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:55.849881 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941344512}
I20260709 13:03:55.846812 16713 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.857448 15091 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:55.881145 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 133696us
I20260709 13:03:55.885327 16776 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.887657 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:55.891500 16995 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:03:55.902891 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.905277 16976 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:55.907534 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:55.893780 16914 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:55.909399 16914 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.894713 16968 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.910884 16976 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:55.911339 15271 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:55.912498 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:55.913511 16881 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:55.895958 15346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:03:55.915625 15346 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.915974 15346 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.901365 15344 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:55.901816 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:55.922855 15337 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:03:55.924487 16914 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.925312 16936 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:55.925959 16936 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.925334 16914 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:55.927531 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.929564 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 189886us
I20260709 13:03:55.928303 16968 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.940856 16968 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:55.951596 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.958165 16917 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:55.958051 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 111971us
I20260709 13:03:55.959734 16931 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.972754 16597 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.973644 16597 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:55.978583 16968 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:55.981325 16720 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:55.981895 16720 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.973215 16797 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:55.982425 16597 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:55.982482 16797 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:55.984695 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 934) took 1184 ms. Trace:
I20260709 13:03:55.985229 16893 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:55.982314 16720 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:55.991951 16686 consensus_meta.cc:287] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.627s	user 0.018s	sys 0.001s
I20260709 13:03:55.969271 15091 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:55.979550 16968 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.997785 15342 rpcz_store.cc:276] 0709 13:03:54.799754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.169388 (+369634us) service_pool.cc:224] Handling call
0709 13:03:55.984241 (+814853us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400423e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:55.984439 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662600960}
I20260709 13:03:55.999506 16893 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:55.960170 16913 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:56.007687 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45739.2us
I20260709 13:03:56.004850 15091 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.002848 16893 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.013216 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:56.018607 15191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1075) took 2154 ms (client timeout 2093 ms). Trace:
I20260709 13:03:56.018128 15091 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.021195 16888 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:56.035305 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67164.7us
W20260709 13:03:56.040002 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.041589 15190 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.019s
I20260709 13:03:56.042066 15190 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:56.043131 16968 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.044778 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:56.046576 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:56.047978 16931 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:56.050616 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44786.6us
I20260709 13:03:56.051409 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:56.054199 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.055626 16914 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.056008 16928 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:56.056234 16914 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.056747 16928 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.057117 16928 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.057493 16928 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.057502 16906 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:56.058008 16906 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:56.059152 16906 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.059638 16776 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.060217 16906 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.061530 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.065455 15091 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.067924 16758 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.073266 16913 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.005179 16686 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.078450 16686 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.079450 15264 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:03:56.054888 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.004341 16850 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:56.026213 15191 rpcz_store.cc:269] 0709 13:03:53.864303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.362007 (+497704us) service_pool.cc:224] Handling call
0709 13:03:56.018287 (+1656280us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000fa5d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:56.018505 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3331088768}
W20260709 13:03:56.092106 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 50946.2us
I20260709 13:03:56.084313 16797 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.095674 16759 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.099179 16945 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:56.100425 16678 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.101013 16678 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.101570 16756 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.102174 16756 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.104230 15188 pending_rounds.cc:85] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 2
I20260709 13:03:56.103487 15091 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.104573 15188 pending_rounds.cc:107] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:56.104983 15188 raft_consensus.cc:2889] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.107851 15195 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:56.110827 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:56.111426 15190 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:56.112161 16804 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:56.112712 16804 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:56.112990 16490 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.561s	user 0.018s	sys 0.004s
I20260709 13:03:56.105484 15091 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.112941 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.119807 16597 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.120221 15189 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.120528 16597 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.121682 15091 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.122725 16597 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.123661 15196 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:56.124917 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.034621 16693 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.131703 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.131835 16945 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.132992 15195 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:56.134895 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.135176 16913 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:56.135618 16859 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.135993 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:56.137118 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 90708us
I20260709 13:03:56.138604 15190 pending_rounds.cc:85] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 3
I20260709 13:03:56.139456 16930 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.139197 16931 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.140406 15191 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:56.140316 16936 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.134572 15091 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 3, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:56.142187 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.142877 16756 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:56.143453 16415 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:56.179845 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:56.145675 16114 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.181003 16114 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:56.151115 15339 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.519s	user 0.013s	sys 0.009s
I20260709 13:03:56.182649 15339 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:03:56.151451 16822 consensus_meta.cc:287] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.005s
W20260709 13:03:56.183380 16912 consensus_meta.cc:287] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.007s
I20260709 13:03:56.176287 16930 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.183983 16930 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:56.178375 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.148885 16490 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.168634 15190 pending_rounds.cc:107] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:03:56.176071 15193 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:56.113781 16804 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.191107 15344 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:56.191375 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.192338 15192 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:56.194041 15193 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:56.194639 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:03:56.189831 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.191478 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:56.146327 16797 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.189282 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.224473 15195 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:56.189604 15340 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:56.191691 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:56.192939 16822 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:03:56.232926 15195 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:56.193358 15343 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:56.234601 15189 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:56.199903 16720 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.205941 16114 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.222620 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.190213 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.210265 15194 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:56.189597 15346 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:56.225092 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 75441.6us
I20260709 13:03:56.228747 15269 raft_consensus.cc:2368] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:03:56.192636 15190 raft_consensus.cc:2889] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.229139 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:56.196815 16859 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.201401 16980 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.229384 15091 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.201279 16678 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.219825 16850 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.219852 16693 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.192668 16490 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:56.190354 16908 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.508s	user 0.016s	sys 0.006s
I20260709 13:03:56.236271 16931 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:56.257164 15346 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.166460 16759 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:56.252619 16980 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.253595 15338 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:56.229231 16597 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:56.256996 15342 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:56.187016 16895 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.014s
I20260709 13:03:56.263669 16897 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:56.256989 16931 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:56.267400 15191 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:56.266629 16720 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.258538 16936 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.200112 16945 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.274179 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.275833 16892 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:56.243412 16893 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.276682 16892 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.277076 16892 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.264319 16908 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.277486 16892 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.260861 16804 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.270586 16713 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:56.270313 16931 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.268774 15091 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 3, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:03:56.277956 16822 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.278330 16893 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.278661 16912 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.279079 16980 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:56.280362 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:56.280470 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51405.9us
I20260709 13:03:56.264555 16597 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.205971 16928 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.293605 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:56.302039 15269 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:56.299460 16597 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.307621 15091 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.298337 16980 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.314886 16980 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.315840 16928 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:56.316107 16980 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.319566 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.322636 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:56.324206 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:56.325672 15238 leader_election.cc:400] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:56.325933 15238 leader_election.cc:403] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.326531 16906 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:56.327008 16906 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:56.327694 16859 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:56.328310 16908 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.328466 16859 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.331616 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.332486 15270 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:56.333159 15345 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:56.333717 16968 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.334918 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.335716 15264 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:56.336467 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.328070 16906 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.337682 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.309551 15869 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:56.338426 15264 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:56.308967 16930 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.303318 16713 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.306288 16912 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:56.309698 16720 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.299611 16804 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.349455 15091 catalog_manager.cc:5697] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.358744 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.359642 15162 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:56.360299 16678 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.360867 16678 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.361969 16888 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.362268 16936 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:56.362793 16888 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:56.363186 16888 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.363600 15268 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:56.363691 16678 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:56.363972 16888 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.365136 16888 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.365536 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.366418 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.367215 16897 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.367623 16897 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.367992 16897 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.368583 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:56.370124 16822 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:56.370648 16822 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.362813 16936 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:56.371672 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:56.371547 16822 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.372391 15870 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.355322 16893 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:03:56.348254 16720 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.375736 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:56.376212 15266 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:56.376796 16720 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.377420 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:56.378050 15341 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.378595 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:56.345818 16912 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.379302 15339 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:56.379470 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.380106 15346 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:56.379750 16912 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.378142 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.380999 16912 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.372329 16936 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.384398 16804 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.385370 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.385942 15338 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:56.386088 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.386667 15270 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.387009 16713 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.346537 16945 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:56.356474 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.374692 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.405416 15341 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:56.409619 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:56.409950 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.410801 16930 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.412535 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:56.413172 15869 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:56.412002 15091 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.421061 16931 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.421255 15091 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.424940 16892 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.426311 16895 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:56.422791 15091 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:56.427286 17002 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.136s	user 0.001s	sys 0.002s
I20260709 13:03:56.427611 15091 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.406883 16776 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:03:56.403652 16945 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:56.432243 16945 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.430766 15091 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.436918 15270 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:56.445111 16893 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:56.445550 16893 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.439481 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.453533 15272 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:56.446380 16893 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:56.455641 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 81020.4us
I20260709 13:03:56.457409 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.447499 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.435972 16892 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.469923 15091 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.474861 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.473839 15091 catalog_manager.cc:5697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.475239 16114 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.475330 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.477303 15266 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:56.481287 16114 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.474344 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.486856 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.487833 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:56.489444 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.480962 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.490790 15196 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.465178 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.488595 15272 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:56.492990 15268 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:56.482622 16490 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:56.499132 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.499153 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.502497 16114 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.502995 16114 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.506871 15270 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.507579 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.504904 15091 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 2, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.508111 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.509655 15193 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:56.512050 15271 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:56.484133 16930 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:03:56.498718 15189 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.520360 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.521162 15267 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.498099 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.522861 15264 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:56.527971 16988 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:03:56.528599 16948 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.507886 16761 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:03:56.529093 16948 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.529561 16948 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.476956 16976 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:03:56.520503 15265 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:56.515112 15197 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:56.544821 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.548892 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:56.544595 15091 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.506178 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.528003 15870 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:56.567198 15266 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.567847 15091 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:03:56.569406 15091 catalog_manager.cc:5697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:56.570482 16776 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:56.494990 16897 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.550500 15192 raft_consensus.cc:2368] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:56.577491 16945 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.578519 16893 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.583636 15340 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:56.586987 16897 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.507980 16759 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:03:56.552848 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.558952 16935 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:56.566823 15264 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:56.554445 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.588495 15091 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.542861 15196 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:56.591219 16935 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:56.571797 17008 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.279s	user 0.003s	sys 0.000s
I20260709 13:03:56.562314 15189 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:56.597591 15091 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.595882 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.603534 15312 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.596262 15344 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:03:56.606946 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 78388.3us
I20260709 13:03:56.611449 16888 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:56.612424 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.613260 15189 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:03:56.615307 15266 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:56.616514 15270 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:56.617533 15191 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:56.608964 15091 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.617911 15191 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:56.612411 17015 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:56.621407 15191 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.624060 16906 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:56.624794 16935 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.626102 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.614152 15194 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:56.621605 15091 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:56.614945 16888 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:03:56.635071 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.606106 16490 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:56.617970 16797 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:56.650804 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.643729 16114 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:56.651821 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.652281 16114 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.652660 16114 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.613083 16678 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:03:56.626945 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.657953 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.659983 16597 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:56.670274 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 267079us
I20260709 13:03:56.642603 16895 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:56.666776 16597 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.651254 16906 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.681826 16945 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.682256 16678 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:56.682811 16756 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:56.684343 16797 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:56.700821 16756 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:56.701620 16797 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.686187 16948 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.706894 16948 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.632810 16936 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:03:56.688141 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.709704 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:56.710484 15870 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:56.711750 16759 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:56.712359 16759 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:56.713332 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.713712 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.713858 15338 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:56.713963 15343 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:56.698580 16114 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.700241 16888 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.680796 15190 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.735131 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.735584 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.736197 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.738216 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.738564 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.739686 15195 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:56.739688 16833 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.739948 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.740551 16833 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.742159 16761 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.742543 16833 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.742808 16786 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:56.726687 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.743394 16786 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.743904 16786 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.745060 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:56.747231 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.747967 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.749002 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.749995 15197 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:56.742863 16761 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.751173 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.752174 15196 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:56.752614 16761 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:56.695065 16490 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.757539 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.761616 16906 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.763509 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.764858 16833 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.765277 16948 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.765758 16948 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.766089 16948 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.767127 15190 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:56.767807 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:56.677138 16935 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.769807 16859 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:56.702131 16756 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.775765 16756 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.776476 16114 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:56.785465 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.781064 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.791922 15269 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:03:56.797151 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 114768us
W20260709 13:03:56.797645 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 137288us
W20260709 13:03:56.800568 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:56.801116 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.713343 16759 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.802839 17020 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:03:56.804095 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.804961 15190 raft_consensus.cc:2368] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:03:56.803130 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:56.807281 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.802291 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.809898 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:56.810447 15343 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.820077 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.845196 15337 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:56.848035 15191 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.868700 15345 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:03:56.875320 15345 pending_rounds.cc:85] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 3
I20260709 13:03:56.871793 15309 leader_election.cc:400] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:03:56.854766 15267 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:56.873880 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.855746 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:56.878454 15344 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:56.881016 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.811918 16833 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:56.883769 15189 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.884622 15345 pending_rounds.cc:107] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:03:56.884939 15345 raft_consensus.cc:2889] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.852963 15340 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:56.847067 16678 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:56.890280 16597 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:56.899873 17013 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
I20260709 13:03:56.901784 15870 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:56.903650 17017 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:56.905503 16678 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.910518 15342 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:03:56.912164 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:03:56.913738 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93753.2us
I20260709 13:03:56.910900 15342 pending_rounds.cc:85] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 2
I20260709 13:03:56.914697 15342 pending_rounds.cc:107] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:56.914965 15342 raft_consensus.cc:2889] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.914500 15312 leader_election.cc:400] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:03:56.915849 15312 leader_election.cc:403] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:56.916023 15190 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:56.917251 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:56.920598 15345 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:56.938133 15189 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:56.940248 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:56.939975 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.899863 16597 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.925074 16888 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:56.948328 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.915911 16948 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:56.951205 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:03:56.952606 15237 leader_election.cc:336] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.553s (SENT)
I20260709 13:03:56.949831 16859 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.956339 16859 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:56.961112 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.969123 16804 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.969609 16804 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.965222 17024 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:56.970345 16948 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:56.970410 17024 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.970969 17024 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.971556 16114 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.970439 16936 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:03:56.973646 16936 consensus_queue.cc:1243] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:56.975069 16936 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:56.966827 16912 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:56.949685 16931 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:56.981022 16931 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:56.969946 16804 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.981383 16597 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:56.983644 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.984048 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:56.984246 15196 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:56.984627 15197 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:56.985404 15188 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:56.986200 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:56.981388 16931 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.995812 15342 raft_consensus.cc:1217] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-6.4]   Dedup: 2.2->[4.3-6.4]
I20260709 13:03:56.997978 15342 pending_rounds.cc:85] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 2
I20260709 13:03:56.998240 15342 pending_rounds.cc:107] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:56.998453 15342 raft_consensus.cc:2889] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.996729 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:56.999153 15337 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.000026 16859 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:57.000319 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.005584 15345 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:57.007333 15337 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:57.007862 15343 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:57.012200 16912 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:57.013278 15191 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:57.013043 16934 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:03:57.018078 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.018117 15267 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:57.020781 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:57.021525 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:57.030819 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.056545 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.054438 16786 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:57.037700 16859 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.027137 17020 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:57.020211 16888 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:57.057618 16912 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.063838 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.111073 15345 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:57.064059 17024 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:57.064602 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:57.066406 15237 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.603s (SENT)
I20260709 13:03:57.067014 16906 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:57.067391 16897 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:57.019003 17021 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:57.067740 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46294.1us
I20260709 13:03:57.016727 16804 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:57.071225 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53425.3us
I20260709 13:03:57.072707 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:57.072255 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:57.076365 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.084093 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:57.034195 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:57.086005 15269 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:57.087813 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.076119 16936 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:57.117486 15192 raft_consensus.cc:2368] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:57.125207 15268 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.127712 16936 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:57.128681 16936 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:57.131637 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 97532.4us
I20260709 13:03:57.132380 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:57.134047 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.134878 15341 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:57.135308 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.136308 15345 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:57.139415 15196 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:57.110234 17020 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.143370 15190 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:57.142022 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.145053 15345 raft_consensus.cc:2410] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:57.141747 16948 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:57.150523 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70995.7us
I20260709 13:03:57.150929 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.138366 16756 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:57.151741 15345 raft_consensus.cc:2368] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
W20260709 13:03:57.152187 15841 leader_election.cc:336] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.771s (SENT)
I20260709 13:03:57.153664 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.144024 17020 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.154269 15341 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:57.138859 16897 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:57.156528 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:03:57.161726 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.152312 15188 raft_consensus.cc:2368] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5.
W20260709 13:03:57.164461 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 98082.8us
I20260709 13:03:57.170172 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.170773 15341 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:57.171586 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.172243 15341 raft_consensus.cc:2410] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:57.172986 16948 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:57.173054 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.174027 15345 raft_consensus.cc:2410] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:57.174125 16948 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.174854 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.175915 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.176406 15345 raft_consensus.cc:2368] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:57.176968 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.177474 15345 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:57.177989 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.178726 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.179404 16967 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.150600 16859 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:57.182966 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.183104 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.184784 15341 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:57.187775 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 118772us
I20260709 13:03:57.188446 16786 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:03:57.189023 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.189599 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.190667 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.191475 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.181658 16859 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:57.196950 16897 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.197453 16804 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:57.203579 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.199460 16859 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.205931 17024 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:57.206840 16859 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:57.211190 16967 consensus_queue.cc:1175] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" responder_term: 4 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:57.183915 16992 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:57.206780 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62103.6us
I20260709 13:03:57.180320 16888 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.216100 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.217119 16906 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.217500 15237 leader_election.cc:400] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:57.217816 15237 leader_election.cc:403] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.227129 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:57.227671 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.229574 15268 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:57.236887 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.238090 17044 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.239310 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.240370 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:57.240505 15841 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.240834 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.242072 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.246555 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.243530 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.244501 15238 leader_election.cc:400] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:57.247424 15238 leader_election.cc:403] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.247689 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.248421 15341 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:57.244501 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.248667 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.252079 15869 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:57.252353 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.258271 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.252833 17024 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.255085 16756 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:57.263263 16936 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.266315 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.265901 16931 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.274034 16931 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:57.277611 15160 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.279012 17024 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.280551 17024 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:57.281683 16759 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:57.282019 16759 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:57.260274 16992 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.282829 16759 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.285409 16804 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:57.288594 16804 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:57.289955 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:03:57.292589 17045 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:03:57.292533 16931 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:57.294203 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.295178 16931 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:57.295728 16931 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:57.298565 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.272104 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.307197 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:57.309885 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.311403 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:57.317544 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.321864 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.336998 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.338119 15344 raft_consensus.cc:2410] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:57.340474 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.341466 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.341629 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.340493 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.342705 15270 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:57.349822 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.350664 15266 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.352026 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.349259 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.354336 15263 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.356344 15337 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:57.358304 15337 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:03:57.363154 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69040.1us
W20260709 13:03:57.364895 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.364670 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.365633 15270 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.366386 15344 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:57.367488 15267 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:03:57.367851 15267 pending_rounds.cc:85] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 3
I20260709 13:03:57.368088 15267 pending_rounds.cc:107] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:57.368310 15267 raft_consensus.cc:2889] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:57.368937 15337 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:57.372884 15266 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:03:57.373828 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 129461us
I20260709 13:03:57.375310 15345 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:57.375448 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.380921 15271 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:57.379900 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.381494 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.386883 15270 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:03:57.387974 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.312494 16931 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.388025 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.390300 17020 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:57.391330 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 150996us
I20260709 13:03:57.393443 16786 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.398772 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.389020 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.395882 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.393896 16761 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.399953 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.401852 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.443701 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.442607 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:03:57.445807 17030 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:57.446789 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.395977 16906 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.447391 15270 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:57.449870 15269 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:57.453116 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.453511 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.454243 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.454783 15271 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.457710 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:57.457526 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.463014 15270 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:57.468281 15263 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:57.407339 15264 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:57.388135 17048 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:57.472049 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.454726 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.478096 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.479579 15340 raft_consensus.cc:2368] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:03:57.480310 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:57.456924 16859 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.485213 15264 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:57.486971 15263 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:57.487829 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.496896 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.498925 15869 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:57.499608 17020 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:57.499838 17055 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.478543 16833 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:03:57.500944 17020 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:57.477921 17042 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:57.502293 16720 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:57.468858 16786 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:03:57.502871 16720 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:57.383332 16756 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.503794 16720 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.509500 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.506112 16759 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:57.467577 16906 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.511804 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.518330 15268 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.479151 16888 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:57.514065 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 275557us
I20260709 13:03:57.462622 17039 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.515134 15271 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:57.517009 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:03:57.518612 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116862us
I20260709 13:03:57.522877 15271 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:57.512539 16822 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.529181 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.537292 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.545567 15271 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:57.546677 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.547333 15271 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.514703 17042 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:57.520190 16893 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.554448 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.549019 15270 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:57.557860 16114 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:57.564577 15268 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:57.529582 16888 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:57.545554 17021 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:03:57.556721 15271 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:03:57.519826 16936 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:03:57.545346 16934 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:57.566082 16678 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.568038 16967 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:03:57.569537 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:57.583215 15196 raft_consensus.cc:2368] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:57.578092 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.564087 17053 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:57.567484 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.580768 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.545051 16833 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:03:57.566164 17052 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.589296 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.589896 17055 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.592975 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:57.595890 15271 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.597662 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:57.600274 15192 raft_consensus.cc:2368] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5.
I20260709 13:03:57.602947 16859 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.602942 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:57.605468 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.605774 15196 raft_consensus.cc:606] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.606901 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.607144 16859 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:57.603262 15872 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:57.591322 16934 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:57.591872 17044 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
W20260709 13:03:57.611116 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43700.5us
I20260709 13:03:57.613910 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.621548 15272 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:57.619225 15842 leader_election.cc:400] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5.
I20260709 13:03:57.601732 16804 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.611617 17052 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.601898 17057 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.629057 15842 leader_election.cc:403] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:03:57.651655 17054 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:03:57.620795 16859 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.678776 16978 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.615727 17053 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:03:57.630182 16888 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.685020 17044 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.686515 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:57.686367 16804 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:57.686774 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 79951.9us
W20260709 13:03:57.685451 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 71581.6us
I20260709 13:03:57.687558 15271 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:57.630308 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.602216 17042 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.704274 15196 raft_consensus.cc:606] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.717494 15196 raft_consensus.cc:614] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:57.706779 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:03:57.722675 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 92462.9us
I20260709 13:03:57.704727 16936 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.730372 15271 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:03:57.730813 15271 pending_rounds.cc:85] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 2
I20260709 13:03:57.731138 15271 pending_rounds.cc:107] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:57.731434 15271 raft_consensus.cc:2889] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:57.732714 15271 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:57.735311 16936 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.737506 16936 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:57.735592 17062 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5.
I20260709 13:03:57.744204 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.721848 16859 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:57.749379 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.743268 15271 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:57.691051 17052 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.704733 16978 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.750777 17044 raft_consensus.cc:2764] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:57.719596 16934 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.759559 16967 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:03:57.773653 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.767488 16859 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:03:57.790709 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.790700 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.792510 17063 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.792688 17020 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.790634 16992 consensus_meta.cc:287] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.006s
I20260709 13:03:57.807498 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.803740 16859 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:57.810315 15238 leader_election.cc:400] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:57.810694 15238 leader_election.cc:403] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.815858 17070 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.818490 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.810501 16804 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:57.827364 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.827957 15346 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.829005 16678 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.810283 16859 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:57.829942 15270 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:57.830531 16859 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.831740 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:57.832048 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:03:57.836639 17066 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:03:57.838325 15268 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:57.838723 15268 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:03:57.839229 15264 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:57.839344 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.839797 15266 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:57.839412 15268 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.840080 15338 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.840525 15264 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:57.840615 15268 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.841884 15266 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:57.843021 16804 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:57.843577 15344 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:57.831626 16859 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.847787 16978 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:57.848351 17044 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.849701 17062 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:57.850098 17062 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:03:57.850950 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.851300 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:03:57.851552 15342 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.806716 16992 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.802273 17020 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.854642 15265 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:57.855162 15268 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:57.855517 15268 pending_rounds.cc:85] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 2
I20260709 13:03:57.855741 15268 pending_rounds.cc:107] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:57.855985 15268 raft_consensus.cc:2889] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:57.851830 15196 raft_consensus.cc:606] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:57.853682 17052 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:57.857189 16114 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:57.856012 17020 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:57.852406 15270 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:57.860338 15338 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:03:57.860579 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.862913 15345 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:57.863207 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:57.920423 15341 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.867208 15339 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:03:57.857065 17072 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:03:57.867731 15870 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.871727 15267 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:03:57.872139 17067 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:03:57.872143 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 61978.9us
I20260709 13:03:57.919634 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:57.922084 15238 leader_election.cc:400] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:57.922580 15238 leader_election.cc:403] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.922091 15263 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:57.852245 16967 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:57.924819 16114 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:57.926100 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 63928.2us
W20260709 13:03:57.929237 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.929445 15342 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:57.932279 15192 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:03:57.935848 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 117455us
I20260709 13:03:57.936610 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.872254 17063 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:57.939047 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:57.940456 15341 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:57.941484 15346 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:57.930281 15264 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:57.944828 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.946074 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.947384 17070 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.948192 17074 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.950171 17052 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:57.953500 15189 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:03:57.953603 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.954587 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.957502 15342 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:57.958654 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.960332 15189 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:57.961220 15195 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:57.961220 15197 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:57.961625 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.929028 17039 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.961334 17062 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:57.964208 17039 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:57.964788 17062 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.964932 15197 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:57.966164 17039 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:57.939894 17072 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.962198 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:57.962458 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:57.967443 16978 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.967873 15193 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:57.967973 16978 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:57.968935 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:57.970115 16978 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:57.971285 17020 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:57.925256 17048 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.937259 16936 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:03:57.967471 15194 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.950688 17052 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:57.976684 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:57.980464 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:57.955991 16912 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.993703 15194 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:03:57.978300 16931 raft_consensus.cc:993] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:03:57.957872 17070 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:57.977542 17057 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.979799 17044 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.982559 17055 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.989589 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:57.948210 16859 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.010073 15343 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:57.985783 16678 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:58.017952 17042 raft_consensus.cc:1081] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:03:58.024484 17071 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.025987 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:57.974619 17074 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:03:57.985459 16897 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:03:57.995015 16930 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:03:57.987495 16978 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:03:57.990069 16822 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:03:57.998448 16912 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.026674 15871 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:58.021051 16888 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:57.999550 17070 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:58.047863 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 71275.1us
W20260709 13:03:58.055158 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 43926.3us
I20260709 13:03:58.061909 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.044518 16888 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.027937 16678 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.079241 15342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:03:58.084347 15342 raft_consensus.cc:606] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:58.084867 15342 raft_consensus.cc:614] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:58.077435 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.071666 16888 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:58.091847 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 102327us
I20260709 13:03:58.093698 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 976) took 1021 ms. Trace:
I20260709 13:03:58.094208 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:03:58.119264 15340 rpcz_store.cc:276] 0709 13:03:57.072660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.331376 (+258716us) service_pool.cc:224] Handling call
0709 13:03:58.093469 (+762093us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000b5c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:58.093645 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284696832}
I20260709 13:03:58.153595 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:58.157097 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:58.102698 17075 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:03:58.158429 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 64299.8us
I20260709 13:03:58.159543 16114 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:58.160142 16114 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.160676 16114 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.165931 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:58.083949 17074 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.154345 16978 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:58.180111 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.153021 17044 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.143697 16935 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.221807 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.222529 15269 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:03:58.172236 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 94903.8us
I20260709 13:03:58.203294 15339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:03:58.143368 16893 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.223783 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.224666 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.231114 15269 raft_consensus.cc:2410] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:03:58.173765 16930 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:03:58.225265 17079 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:03:58.225454 17080 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:58.234429 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.236912 16114 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.243906 16114 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:58.161022 16934 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:03:58.260223 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.177160 16897 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:03:58.238345 17074 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.219296 17020 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:03:58.226788 16978 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.232761 16935 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.233139 16893 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.284375 15268 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:58.297143 15269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ecbb94961244797af5928bce195f79f"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:33824
I20260709 13:03:58.297945 15269 raft_consensus.cc:606] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.298374 15269 raft_consensus.cc:614] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:03:58.272617 17078 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:03:58.272410 15870 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:58.243959 17084 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:03:58.274886 16931 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.286028 15188 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:58.316594 15342 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
W20260709 13:03:58.319970 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45880us
I20260709 13:03:58.329161 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.325716 15272 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:58.326372 16931 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.275807 16895 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:03:58.311192 16912 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:58.340986 17085 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:03:58.342501 17070 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:58.343309 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1082) took 1007 ms. Trace:
I20260709 13:03:58.319151 17052 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:58.344326 17055 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.344779 17074 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:58.345088 16931 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:58.347199 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:58.351192 15267 rpcz_store.cc:276] 0709 13:03:57.336003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.457274 (+121271us) service_pool.cc:224] Handling call
0709 13:03:58.343124 (+885850us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400010754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:58.343254 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929995136}
I20260709 13:03:58.347503 17072 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:03:58.357021 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:58.334071 17021 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:03:58.347208 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:03:58.348745 16930 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:58.357779 17070 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:58.404923 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 110974us
I20260709 13:03:58.412058 16114 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:58.386013 15872 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:03:58.435202 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 186732us
W20260709 13:03:58.458655 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 209468us
I20260709 13:03:58.386277 17021 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.430510 17044 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.464329 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:03:58.460270 16756 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:58.470129 16893 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:58.417225 17070 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.472779 15237 leader_election.cc:400] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:03:58.473130 15237 leader_election.cc:403] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:03:58.478114 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:58.481491 17048 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:03:58.482832 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.483736 15264 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:03:58.483958 17111 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:58.484458 17111 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:58.484890 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.485316 17111 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.486351 15191 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:58.489686 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.490753 17062 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:58.491217 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:58.491291 17062 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.493557 17062 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:58.501255 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:58.510636 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:58.520223 16978 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:58.476996 17077 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260709 13:03:58.522524 17089 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:03:58.477325 17098 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:03:58.521238 16931 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:58.527125 15345 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:58.518438 16833 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:58.531913 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:58.529974 16756 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:58.538501 17039 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:58.560333 17039 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:58.560961 16833 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:58.561478 16833 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:58.561178 17039 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.562228 17039 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:58.563148 17114 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.563333 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:58.563645 17114 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.564513 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:58.565721 17114 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:58.566450 17114 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:58.559729 16934 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:58.567411 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:58.567277 16934 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.569219 16934 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:58.566742 16756 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.570290 17117 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:58.570458 16756 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:58.541002 16597 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:58.571305 16597 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.573307 16597 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:58.508833 16895 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:03:58.575572 16935 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:58.565834 15338 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6. Ops: [4.2-5.3]
I20260709 13:03:58.556013 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:58.570804 17117 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:03:58.598151 17097 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.244s	user 0.000s	sys 0.002s
I20260709 13:03:58.602607 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:58.612468 15345 raft_consensus.cc:2368] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:58.471312 16930 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.562374 16833 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.566887 17114 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:58.627197 17102 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:58.627874 17102 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.629623 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:58.630411 17102 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:58.632623 17093 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.123s	user 0.000s	sys 0.009s
I20260709 13:03:58.632828 16893 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:58.633491 16893 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:58.635303 17092 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.154s	user 0.012s	sys 0.000s
I20260709 13:03:58.637969 16893 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:58.639117 17100 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:03:58.639201 15339 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:58.639688 15339 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:58.640760 17108 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.178s	user 0.000s	sys 0.002s
I20260709 13:03:58.642195 16934 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:58.643977 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.644402 17070 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:58.644632 15272 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:03:58.644549 16935 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:58.645792 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.646752 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:58.646942 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.652175 15272 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:58.613026 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:58.623968 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:58.654103 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:58.656049 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:58.658010 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:58.659323 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:58.613978 16678 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:58.664582 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:03:58.600708 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 109857us
I20260709 13:03:58.660955 16934 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.670310 15339 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:58.680522 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:58.683463 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:58.683892 17117 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.685457 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.687225 16597 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:58.687340 17070 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:58.687758 16597 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.688163 16597 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.688102 17070 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:58.689163 15237 leader_election.cc:400] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:03:58.681779 16678 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:58.691017 17107 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:58.691534 16678 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:58.691999 16678 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:58.683460 17124 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:03:58.693636 17020 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:03:58.695132 17118 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.214s	user 0.000s	sys 0.008s
I20260709 13:03:58.601837 16888 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.697607 16888 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:58.625484 16978 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.701612 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:58.701988 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:58.702394 15341 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
W20260709 13:03:58.727875 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44382.2us
I20260709 13:03:58.727923 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1132) took 1113 ms. Trace:
W20260709 13:03:58.728384 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 200511us
I20260709 13:03:58.731169 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:58.730609 15271 rpcz_store.cc:276] 0709 13:03:57.614693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.975883 (+361190us) service_pool.cc:224] Handling call
0709 13:03:57.976141 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:58.070991 (+ 94850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:58.071019 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:58.071081 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:58.071122 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.727673 (+656551us) spinlock_profiling.cc:243] Waited 94.7 ms on lock 0x7b5400327dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:58.727721 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:58.727867 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217706368}
I20260709 13:03:58.679491 16893 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:58.701442 16888 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.749631 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:58.730108 16761 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:58.749951 17114 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.756536 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.757503 15271 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:58.733944 17057 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:03:58.738355 17044 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:58.737004 17020 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:58.730376 16978 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.762135 17020 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.819101 16978 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:58.761664 17044 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:58.823251 17044 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:58.822670 16912 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:03:58.828742 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.831969 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:58.832685 15271 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:58.835656 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 103691us
I20260709 13:03:58.754786 16888 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.853641 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.854388 15264 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:58.855399 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.815864 16759 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:58.861940 15271 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:58.868815 17024 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.777776 17057 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:58.829280 17021 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:58.829828 17020 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:58.897053 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 144034us
I20260709 13:03:58.893657 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.898666 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.899626 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:58.901376 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.902053 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:58.902172 15270 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:58.829468 16678 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.926627 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:58.871869 16759 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.932173 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.926873 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:58.935983 15264 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:58.939505 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:58.969805 15264 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:58.970281 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:58.971257 15264 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:58.979486 15270 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:58.871366 16936 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:03:58.926467 17021 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.986249 15264 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:58.941288 16759 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:59.023066 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 96246.7us
I20260709 13:03:59.017274 15264 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:58.938287 16934 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:58.902817 17024 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.994458 16597 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:58.980918 16893 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.969146 17074 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.987011 17071 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:59.037317 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.062453 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1216) took 1200 ms. Trace:
I20260709 13:03:59.064270 15264 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:59.066255 15193 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:59.063535 15343 rpcz_store.cc:276] 0709 13:03:57.862242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.863592 (+  1350us) service_pool.cc:224] Handling call
0709 13:03:57.863840 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:58.013627 (+149787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.062121 (+1048494us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400096ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:59.062383 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335875328}
W20260709 13:03:59.067600 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.067458 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:59.069150 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.069272 15191 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:03:59.073922 15264 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:59.074915 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.076056 15264 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:59.081820 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.083887 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.084793 15191 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:03:59.043243 17071 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:03:59.089632 17142 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:03:59.090052 17081 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.864s	user 0.000s	sys 0.008s
I20260709 13:03:59.091696 16597 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:03:59.092026 17139 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:03:59.092554 17116 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.612s	user 0.003s	sys 0.009s
I20260709 13:03:59.092860 17048 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:59.061765 16888 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.031244 16934 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:03:59.103854 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:59.083906 17135 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:03:59.042894 16893 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.074362 17074 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:59.096839 17126 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
W20260709 13:03:59.111162 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 257567us
I20260709 13:03:59.111485 15189 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:58.980554 17120 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.350s
I20260709 13:03:59.117372 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.101580 17133 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:59.120239 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.130318 15189 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:03:59.109123 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1129) took 1522 ms. Trace:
W20260709 13:03:59.128218 17039 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.005s
I20260709 13:03:59.125301 17133 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.142133 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:59.145226 17133 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.145421 15191 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:59.145660 17137 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:03:59.146723 17129 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.269s	user 0.001s	sys 0.001s
I20260709 13:03:59.148069 15267 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:59.149123 17125 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 13:03:59.149348 15267 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:03:59.135759 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 236185us
I20260709 13:03:59.150454 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.151091 15193 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:59.150807 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:59.152920 15191 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:03:59.156021 15193 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:59.115221 17074 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.161409 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.162077 15193 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:03:59.164927 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 225603us
I20260709 13:03:59.166043 15267 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:03:59.167665 15193 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:59.168005 15196 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:59.153600 17048 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.160065 16678 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.170673 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:59.172554 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:03:59.173902 15872 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.002s
I20260709 13:03:59.174256 15872 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:03:59.175293 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:59.175513 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:59.176184 17107 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:59.176999 17102 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:59.176891 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:59.178190 16895 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:59.178803 16895 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.179316 16895 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:59.182519 17074 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.157493 17127 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.191381 16893 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.135628 15265 rpcz_store.cc:276] 0709 13:03:57.579527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.855532 (+276005us) service_pool.cc:224] Handling call
0709 13:03:57.855857 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.856204 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.856239 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:57.856730 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:03:58.159566 (+302836us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:58.388293 (+228727us) log.cc:844] Serialized 14 byte log entry
0709 13:03:58.409578 (+ 21285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.431235 (+ 21657us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.089774 (+658539us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b24000f4688. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265f09d 00007f36e529110e 00007f36e52a888c 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221
0709 13:03:59.093047 (+  3273us) raft_consensus.cc:1685] finished
0709 13:03:59.093150 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.101791 (+  8641us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5026,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7672,"spinlock_wait_cycles":8175872,"thread_start_us":379300,"threads_started":2,"wal-append.queue_time_us":303040}
I20260709 13:03:59.169030 17057 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:59.194335 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:59.186924 17048 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.195597 17109 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:59.195744 17084 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.196693 17048 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.197045 17109 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:59.197489 17109 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.197829 17109 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:59.198258 17117 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:59.198338 16931 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:59.199743 16936 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.200095 17117 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:59.200559 16931 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.204010 17024 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.204586 17024 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.205633 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:03:59.185949 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:03:59.132573 17071 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.206162 16934 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.207687 17071 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:59.206912 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:03:59.210732 15267 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:03:59.216747 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:03:59.215251 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:59.219981 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:03:59.221979 17152 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:59.248656 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:59.246037 15194 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:59.239173 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:59.245162 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.259075 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.229573 17084 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:59.232489 17101 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:03:59.235808 17138 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:03:59.262014 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.232862 17107 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:59.273128 16895 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.232172 16893 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:03:59.229229 16888 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:03:59.279666 15342 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:03:59.267424 17110 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.796s	user 0.016s	sys 0.007s
I20260709 13:03:59.283303 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.284078 15346 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:59.286087 15337 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:59.286448 15343 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:59.286880 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.280243 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.232308 17020 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.287935 15341 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:03:59.286087 15342 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:03:59.269972 17107 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.292598 15340 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:03:59.300971 17161 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:03:59.302055 16822 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:59.302457 16822 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:59.303319 16822 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.304288 16822 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.310055 16759 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.315187 15345 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:03:59.316149 17095 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.853s	user 0.006s	sys 0.011s
I20260709 13:03:59.317778 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1133) took 1631 ms. Trace:
I20260709 13:03:59.277328 17084 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:59.318133 15263 rpcz_store.cc:276] 0709 13:03:57.686132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.976367 (+290235us) service_pool.cc:224] Handling call
0709 13:03:57.976633 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.980242 (+  3609us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:58.079505 (+ 99263us) log.cc:844] Serialized 14 byte log entry
0709 13:03:58.106089 (+ 26584us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:58.108488 (+  2399us) log.cc:844] Serialized 26 byte log entry
0709 13:03:58.109011 (+   523us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:58.109215 (+   204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.109502 (+   287us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.315557 (+1206055us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:03:59.317494 (+  1937us) raft_consensus.cc:1685] finished
0709 13:03:59.317597 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.317721 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9146,"prepare.queue_time_us":330798,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":70,"raft.queue_time_us":9017,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":6899,"spinlock_wait_cycles":21949824,"thread_start_us":92936,"threads_started":2,"wal-append.queue_time_us":292259}
I20260709 13:03:59.291806 16934 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:59.294772 17107 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:59.295214 16895 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.331727 17131 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:59.332197 17160 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:03:59.332422 17131 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:59.332785 17020 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.333566 17131 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:59.334012 17151 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.334589 17151 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:59.328536 16934 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:03:59.335907 16934 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.336735 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.336988 16934 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:59.336756 17151 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.339702 15346 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:59.340126 17144 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:59.340703 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.341311 15194 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:03:59.341976 17144 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:59.342566 17144 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:59.306671 17133 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.345175 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:59.341396 15346 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:59.377131 15341 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:59.334283 17084 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.329340 17102 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.287079 17044 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.397886 15343 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:59.401360 15271 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:03:59.385881 17152 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.385984 16888 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.386932 16895 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.424468 16895 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.419772 17153 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.422824 17152 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:03:59.434048 17146 raft_consensus.cc:993] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:03:59.440353 17044 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.424085 16888 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:59.444537 16895 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.445860 16888 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:59.450235 16759 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.451575 17044 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.459450 17048 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.464675 17074 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.464895 17057 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.465333 17074 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.465533 17057 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.467710 17057 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.467710 17074 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:03:59.472018 17158 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:03:59.480561 16895 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.430991 17153 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.513962 16761 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:03:59.489256 17044 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.520923 16895 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:59.483757 17048 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.532218 15270 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:59.535086 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1106) took 1060 ms. Trace:
I20260709 13:03:59.527772 16761 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:59.535524 15272 rpcz_store.cc:276] 0709 13:03:58.474759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.652963 (+178204us) service_pool.cc:224] Handling call
0709 13:03:58.653510 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.654222 (+   712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:58.654251 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:58.654772 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:03:58.782891 (+128119us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:59.534481 (+751590us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.534764 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.534835 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.534879 (+    44us) raft_consensus.cc:1685] finished
0709 13:03:59.534891 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.535007 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":744184,"raft.queue_time_us":1498,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":238,"thread_start_us":127553,"threads_started":1,"wal-append.queue_time_us":195028}
I20260709 13:03:59.552181 17133 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.540335 17109 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.574684 17152 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:59.579641 17109 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.563407 17151 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.589500 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.589824 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.590533 15342 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:59.591172 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.591431 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.592520 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.592782 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:59.593904 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:59.584124 17167 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.093s	user 0.001s	sys 0.001s
I20260709 13:03:59.597568 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:59.600407 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:59.585711 17169 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.604844 17107 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.618064 17102 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:59.619062 16895 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:03:59.619185 16822 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:03:59.621755 17127 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.622404 17127 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:59.625492 15339 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:03:59.626092 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:34532 (request call id 1232) took 1424 ms. Trace:
I20260709 13:03:59.626444 15339 rpcz_store.cc:276] 0709 13:03:58.201884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.203083 (+  1199us) service_pool.cc:224] Handling call
0709 13:03:59.622388 (+1419305us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54001a40d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5704a3d 00007f36ea6d4cd0 00007f36e3c59254 00007f36e3c591e2 00007f36e3c59111 00007f36e3c5908c 00007f36e3c58342 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:03:59.626001 (+  3613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955638144}
I20260709 13:03:59.621790 17020 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:03:59.629931 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 303443us
I20260709 13:03:59.606181 16888 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:59.633838 17169 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.649792 15340 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:03:59.639019 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:59.658963 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:59.598160 16934 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:59.661108 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 313688us
I20260709 13:03:59.595256 17109 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.664743 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:59.618835 17048 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.667308 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.678270 15339 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:03:59.668764 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:03:59.664055 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:03:59.670181 15343 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:03:59.658882 17044 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.596014 17151 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:03:59.658238 17071 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.659301 17127 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.614169 17085 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
W20260709 13:03:59.690536 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.694849 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:03:59.699396 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.708472 15345 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:59.675798 17057 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:59.703105 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 978) took 1089 ms. Trace:
I20260709 13:03:59.720908 15196 rpcz_store.cc:276] 0709 13:03:58.606419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.606568 (+   149us) service_pool.cc:224] Handling call
0709 13:03:58.606875 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.168364 (+561489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.696031 (+527667us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540024ca54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:03:59.696218 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289885568}
I20260709 13:03:59.668015 17152 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:03:59.724776 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 60813.8us
I20260709 13:03:59.725461 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.689062 17133 raft_consensus.cc:1081] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:03:59.726995 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:59.727237 17150 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.727406 17133 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:59.727839 15188 raft_consensus.cc:2368] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:03:59.727967 17150 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:59.728725 17150 consensus_queue.cc:1243] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:59.729094 17133 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:59.729637 17150 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:59.730409 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.681814 16948 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:03:59.729995 17150 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:03:59.732028 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.689366 17143 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:03:59.732611 17150 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.733415 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.733837 17131 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:59.735339 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:59.736666 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.708731 17071 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.738350 15195 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:59.709893 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.739450 15192 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:03:59.711346 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.683360 16895 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.712973 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.713768 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.669792 17084 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.725677 17151 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.737733 17150 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:59.674153 17074 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:59.712180 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.734685 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:59.745738 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:03:59.630923 17144 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.669930 17109 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.682715 17146 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:03:59.690281 17048 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.752899 17169 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:03:59.807464 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:03:59.852226 15345 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.719589 17153 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.813941 17044 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.855567 15190 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:59.823173 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 72224.3us
I20260709 13:03:59.858867 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:59.859723 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:03:59.834561 17071 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:03:59.841005 16761 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.841675 16931 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.752059 16895 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.804060 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:00.093931 15339 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:00.094067 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 234401us
I20260709 13:03:59.745052 17152 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:03:59.699286 17020 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.862061 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.824877 17074 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:03:59.954411 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:03:59.874356 16720 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:03:59.923149 17115 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.441s	user 0.004s	sys 0.036s
I20260709 13:03:59.875291 17044 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.062081 17151 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:59.955399 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:00.117740 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1163) took 1214 ms. Trace:
W20260709 13:04:00.073698 17179 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.438s	user 0.007s	sys 0.002s
W20260709 13:04:00.076459 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.076752 17181 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:04:00.126106 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:00.077682 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:00.080510 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:00.127092 15341 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:04:00.118770 15265 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:00.127945 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47536.1us
I20260709 13:04:00.069921 15190 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:00.128180 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:00.085537 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:00.066200 15345 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:00.090041 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:00.092826 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1155) took 1477 ms. Trace:
I20260709 13:04:00.094810 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:03:59.857471 17048 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.108515 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:00.111397 15338 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:00.133587 15271 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:00.131943 15339 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:04:00.115613 17186 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.233s	user 0.004s	sys 0.006s
I20260709 13:04:00.119786 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:00.118741 15263 rpcz_store.cc:276] 0709 13:03:58.903187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.323110 (+419923us) service_pool.cc:224] Handling call
0709 13:03:59.323361 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.323561 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:59.568686 (+245125us) log.cc:844] Serialized 14 byte log entry
0709 13:04:00.062844 (+494158us) log.cc:844] Serialized 14 byte log entry
0709 13:04:00.101670 (+ 38826us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:00.117336 (+ 15666us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.117412 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:00.117468 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.117550 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.117677 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":305695,"prepare.queue_time_us":253833,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":31900,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":14992,"spinlock_wait_cycles":263922432,"thread_start_us":323499,"threads_started":2,"wal-append.queue_time_us":167650}
I20260709 13:04:00.137576 15195 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:00.130991 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:00.137943 15195 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:00.138348 15191 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:00.129837 15270 rpcz_store.cc:276] 0709 13:03:58.615329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.016650 (+401321us) service_pool.cc:224] Handling call
0709 13:03:59.531944 (+515294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.536607 (+  4663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.092647 (+556040us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b54001b5650. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:00.092774 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1184230656}
I20260709 13:04:00.099661 17127 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:00.107647 17074 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:00.112447 17115 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.630s	user 0.005s	sys 0.037s
I20260709 13:04:00.139663 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:00.159228 15270 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.146449 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:00.147769 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:00.100131 16931 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.121651 17070 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:00.253135 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1145) took 2321 ms. Trace:
I20260709 13:04:00.148639 15195 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:00.126461 17085 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.136586 16992 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:00.107964 17020 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.267364 15191 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:00.117794 17189 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:00.132421 17057 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.312383 15270 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:04:00.275619 17179 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:04:00.322486 17184 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:00.263546 17071 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:00.299901 17181 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:04:00.125000 16720 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.329499 17144 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.156777 17140 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 13:04:00.300858 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:00.163288 17127 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.350106 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:00.351277 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:00.433494 15263 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:00.349624 15269 rpcz_store.cc:276] 0709 13:03:57.931267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.346302 (+415035us) service_pool.cc:224] Handling call
0709 13:03:58.346571 (+   269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:58.352517 (+  5946us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:59.559693 (+1207176us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.802124 (+242431us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:59.803718 (+  1594us) log.cc:844] Serialized 52 byte log entry
0709 13:03:59.803896 (+   178us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:59.803943 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.804042 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.171372 (+367330us) raft_consensus.cc:1685] finished
0709 13:04:00.171396 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.253049 (+ 81653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1178026,"prepare.queue_time_us":1200357,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1490,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":8932,"spinlock_wait_cycles":28416,"thread_start_us":264910,"threads_started":2,"wal-append.queue_time_us":333947}
I20260709 13:04:00.364471 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:00.436208 15270 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:00.437502 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:00.438266 15270 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:00.350847 17182 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.599s	user 0.000s	sys 0.005s
I20260709 13:04:00.359158 16992 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.433112 15271 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:00.440307 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:00.441692 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:00.442344 15271 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:00.425724 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 308301us
I20260709 13:04:00.358260 16895 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:00.412891 17189 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.456326 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:00.466331 15269 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:00.457854 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 320088us
I20260709 13:04:00.464468 15263 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:00.373759 17057 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.359731 17070 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.362149 17085 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.431689 17044 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.452581 16992 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.484378 15271 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:00.486936 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:00.493355 15312 leader_election.cc:400] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:04:00.493743 15312 leader_election.cc:403] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:00.420917 17071 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.455011 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 1.
I20260709 13:04:00.526602 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:00.455958 17140 consensus_queue.cc:1243] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:04:00.496717 17185 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 13:04:00.496531 16822 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:00.474700 17189 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.540772 17189 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:00.541592 17189 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:00.542073 17189 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.542517 17189 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:00.472079 17188 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:00.497920 15269 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:00.499966 16978 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3.
I20260709 13:04:00.502105 15270 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:00.511142 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1142) took 2650 ms. Trace:
I20260709 13:04:00.511799 17148 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:00.519985 16931 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.520556 17152 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.523247 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1170) took 1345 ms. Trace:
I20260709 13:04:00.551973 15266 rpcz_store.cc:276] 0709 13:03:57.860875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.331975 (+471100us) service_pool.cc:224] Handling call
0709 13:03:58.343428 (+ 11453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.347249 (+  3821us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:59.521554 (+1174305us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.585099 (+ 63545us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.587136 (+  2037us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.587268 (+   132us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:59.587302 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.587368 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.007242 (+419874us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b4800061a58. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:00.494994 (+487752us) raft_consensus.cc:1685] finished
0709 13:04:00.510762 (+ 15768us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.510967 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1308043,"prepare.queue_time_us":1179839,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":5589,"raft.run_cpu_time_us":1956,"raft.run_wall_time_us":425299,"spinlock_wait_cycles":3035392,"thread_start_us":40082,"threads_started":1,"wal-append.queue_time_us":98902}
I20260709 13:04:00.556581 17188 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:00.544925 17182 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:00.577428 15272 rpcz_store.cc:276] 0709 13:03:59.184247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.575046 (+390799us) service_pool.cc:224] Handling call
0709 13:03:59.575349 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.576731 (+  1382us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:59.601016 (+ 24285us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.902609 (+301593us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.071648 (+169039us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.071789 (+   141us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:00.071821 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.071884 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.523043 (+451159us) raft_consensus.cc:1685] finished
0709 13:04:00.523069 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.523182 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31399,"prepare.queue_time_us":26052,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":247106,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":7253,"thread_start_us":189194,"threads_started":1,"wal-append.queue_time_us":853034}
I20260709 13:04:00.563591 17189 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.569351 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:00.570274 16678 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:00.573393 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:00.551363 17044 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:00.619467 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 485968us
I20260709 13:04:00.625871 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1178) took 1347 ms. Trace:
I20260709 13:04:00.626425 15272 rpcz_store.cc:276] 0709 13:03:59.278850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.596675 (+1317825us) service_pool.cc:224] Handling call
0709 13:04:00.625265 (+ 28590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.625475 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.625509 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.625566 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:00.625600 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.625667 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.625801 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:00.597375 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.573836 17181 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:04:00.561091 17109 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:00.643687 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1172) took 1430 ms. Trace:
I20260709 13:04:00.597360 17152 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:00.644337 15267 rpcz_store.cc:276] 0709 13:03:59.213132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.582468 (+369336us) service_pool.cc:224] Handling call
0709 13:03:59.582752 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.585070 (+  2318us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:03:59.585100 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.587980 (+  2880us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.668057 (+ 80077us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:59.668094 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.668166 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.643357 (+975191us) raft_consensus.cc:1685] finished
0709 13:04:00.643391 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.643602 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1930,"raft.queue_time_us":2399,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9603,"spinlock_wait_cycles":1990272,"thread_start_us":50850,"threads_started":1,"wal-append.queue_time_us":217053}
I20260709 13:04:00.602880 17048 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.660842 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1179) took 1339 ms. Trace:
W20260709 13:04:00.661665 15265 consensus_meta.cc:287] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 13:04:00.670504 15265 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:00.671437 15270 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:04:00.672798 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1132) took 1085 ms. Trace:
I20260709 13:04:00.673396 15265 rpcz_store.cc:276] 0709 13:03:59.587566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.935936 (+348370us) service_pool.cc:224] Handling call
0709 13:04:00.672718 (+736782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.669461 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 78) took 1349 ms. Trace:
I20260709 13:04:00.675299 15265 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:00.675105 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1140) took 2814 ms. Trace:
I20260709 13:04:00.661549 15267 rpcz_store.cc:276] 0709 13:03:59.321198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.646703 (+1325505us) service_pool.cc:224] Handling call
0709 13:04:00.659700 (+ 12997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.660098 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.660164 (+    66us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.660251 (+    87us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:00.660357 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.660489 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.660713 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.676854 15268 rpcz_store.cc:276] 0709 13:03:57.860405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.308782 (+448377us) service_pool.cc:224] Handling call
0709 13:03:58.309090 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.309470 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:59.462746 (+1153276us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b1800378160. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf 00007f36e5727038
0709 13:03:59.544320 (+ 81574us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.591290 (+ 46970us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.591726 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.591839 (+   113us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:59.604218 (+ 12379us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.604408 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.604485 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.076269 (+471784us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:00.674804 (+598535us) raft_consensus.cc:1685] finished
0709 13:04:00.674840 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.675005 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14437,"prepare.queue_time_us":1226135,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":2709,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":11488,"spinlock_wait_cycles":70564480,"thread_start_us":62369,"threads_started":2,"wal-append.queue_time_us":134817}
I20260709 13:04:00.675736 15272 rpcz_store.cc:276] 0709 13:03:59.319695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.643690 (+1323995us) service_pool.cc:224] Handling call
0709 13:04:00.668926 (+ 25236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.669108 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.669142 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.669184 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:00.669216 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.669269 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.669393 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.676313 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1180) took 1354 ms. Trace:
W20260709 13:04:00.665061 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 570300us
I20260709 13:04:00.699770 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:00.628132 17044 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.658866 16678 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:00.669997 17155 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:00.683018 17048 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.687631 17199 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.699332 15265 rpcz_store.cc:276] 0709 13:03:59.321536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.674468 (+1352932us) service_pool.cc:224] Handling call
0709 13:04:00.674838 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.675960 (+  1122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.676251 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.728235 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1114) took 2039 ms. Trace:
I20260709 13:04:00.692860 17020 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:00.716777 17191 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.335s	user 0.000s	sys 0.002s
I20260709 13:04:00.734019 15266 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:04:00.729949 15264 rpcz_store.cc:276] 0709 13:03:58.688974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.079111 (+390137us) service_pool.cc:224] Handling call
0709 13:03:59.079424 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.079749 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.079770 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.113220 (+ 33450us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.036270 (+923050us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800377aa0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:04:00.422296 (+386026us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:00.422343 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.422414 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.727826 (+305412us) raft_consensus.cc:1685] finished
0709 13:04:00.727856 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.728131 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52406,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4072,"spinlock_wait_cycles":4608768,"thread_start_us":358567,"threads_started":1,"wal-append.queue_time_us":1487739}
W20260709 13:04:00.747892 17206 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:00.752120 17085 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:00.753051 17127 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.753767 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1271) took 1005 ms. Trace:
W20260709 13:04:00.755393 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.012s	sys 0.017s
W20260709 13:04:00.755700 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.012s	sys 0.017s
I20260709 13:04:00.752163 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1181) took 1081 ms. Trace:
W20260709 13:04:00.756664 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.756335 15264 rpcz_store.cc:276] 0709 13:03:59.671514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.751152 (+1079638us) service_pool.cc:224] Handling call
0709 13:04:00.751544 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.751763 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.751801 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.751869 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:00.751911 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.751978 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.752107 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.758661 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1182) took 1083 ms. Trace:
I20260709 13:04:00.759209 15264 rpcz_store.cc:276] 0709 13:03:59.674957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.757531 (+1082574us) service_pool.cc:224] Handling call
0709 13:04:00.757843 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.758239 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.758278 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.758333 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:00.758375 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.758447 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.758588 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.754230 15346 rpcz_store.cc:276] 0709 13:03:59.748415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.008851 (+260436us) service_pool.cc:224] Handling call
0709 13:04:00.009300 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.072473 (+ 63173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.072506 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.072991 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.366118 (+293127us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:00.366174 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.366277 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.753542 (+387265us) raft_consensus.cc:1685] finished
0709 13:04:00.753567 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.753702 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":172,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":84,"thread_start_us":292708,"threads_started":1,"wal-append.queue_time_us":526415}
I20260709 13:04:00.763186 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1185) took 1073 ms. Trace:
I20260709 13:04:00.763058 15265 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:04:00.764397 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1127) took 1180 ms. Trace:
I20260709 13:04:00.664297 17152 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.764789 15265 rpcz_store.cc:276] 0709 13:03:59.584226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.731484 (+1147258us) service_pool.cc:224] Handling call
0709 13:04:00.762631 (+ 31147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.764075 (+  1444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.764346 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.767828 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1186) took 1073 ms. Trace:
I20260709 13:04:00.768445 15265 rpcz_store.cc:276] 0709 13:03:59.694646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.766843 (+1072197us) service_pool.cc:224] Handling call
0709 13:04:00.767226 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.767442 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.767483 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.767542 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:00.767586 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.767648 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.767758 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.770120 15264 rpcz_store.cc:276] 0709 13:03:59.689461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.760446 (+1070985us) service_pool.cc:224] Handling call
0709 13:04:00.760812 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.761021 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.761055 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.762654 (+  1599us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:00.762725 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.762859 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.763084 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:00.746829 16992 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.734109 16948 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:00.761160 17127 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.764195 17070 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:00.731210 17048 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:00.840864 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 341245us
I20260709 13:04:00.776789 17057 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.729990 17155 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.791783 17071 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.856133 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1268) took 1114 ms. Trace:
I20260709 13:04:00.861086 15342 rpcz_store.cc:276] 0709 13:03:59.741878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.742006 (+   128us) service_pool.cc:224] Handling call
0709 13:03:59.742291 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.742614 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.742640 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.749434 (+  6794us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.057845 (+308411us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:00.057901 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.057996 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.563830 (+505834us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:00.849686 (+285856us) raft_consensus.cc:1685] finished
0709 13:04:00.849715 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.856049 (+  6334us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3899,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2976,"spinlock_wait_cycles":59235584,"thread_start_us":236253,"threads_started":1,"wal-append.queue_time_us":514967}
I20260709 13:04:00.836921 16978 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.841907 17202 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.873500 16978 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.849846 16720 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:00.737669 17199 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.827991 16678 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.853214 17204 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.865957 17189 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.842024 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:00.789915 16948 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.866293 17188 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.907510 17048 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:00.903013 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 61119.4us
I20260709 13:04:00.876012 17071 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:00.906677 16978 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:00.907181 17155 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:00.907066 16948 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.909228 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:00.907908 17200 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:00.842209 17127 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.920262 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:00.911391 17071 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.920162 15192 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:00.921650 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:00.925877 15189 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:00.909747 17070 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.928850 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:00.921020 17150 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.084s	user 0.014s	sys 0.000s
I20260709 13:04:00.917860 16978 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:00.935833 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:00.927107 17071 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:00.921679 17189 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:00.926621 17200 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:00.899994 17202 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.959231 17199 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.960544 17152 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:00.936504 17070 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:00.963259 17070 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.963745 17189 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:00.966248 17189 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:00.903541 17204 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:00.943055 17084 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.190s	user 0.009s	sys 0.006s
I20260709 13:04:00.998380 17084 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:00.998267 17144 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:00.999915 16761 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.000016 17200 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.002820 17152 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:01.003391 17152 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:00.980872 17192 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.559s	user 0.004s	sys 0.000s
I20260709 13:04:00.981570 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:01.007733 17152 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.007892 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:01.008720 17207 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:01.009305 17207 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:01.009620 17143 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:01.010008 17143 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:01.005079 17204 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.982275 17150 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:01.010275 17207 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.010850 17143 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.012228 17143 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.983238 17127 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:00.987274 17201 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:00.991642 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1243) took 1712 ms. Trace:
I20260709 13:04:01.017031 15338 rpcz_store.cc:276] 0709 13:03:59.279013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.703495 (+424482us) service_pool.cc:224] Handling call
0709 13:03:59.703819 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.133601 (+429782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.991374 (+857773us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400424d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:00.991576 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936881536}
I20260709 13:04:01.010867 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1270) took 1262 ms. Trace:
I20260709 13:04:00.992789 17070 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.993252 17189 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:00.994397 17074 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.002s
I20260709 13:04:00.943259 16978 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:00.996833 17202 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:01.015916 17044 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.018481 15337 rpcz_store.cc:276] 0709 13:03:59.748064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.748226 (+   162us) service_pool.cc:224] Handling call
0709 13:03:59.748658 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.751829 (+  3171us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:59.820512 (+ 68683us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.840267 (+ 19755us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b48001e0258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:00.083385 (+243118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.084037 (+   652us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.084201 (+   164us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:00.084252 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.084355 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.980217 (+895862us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:01.010630 (+ 30413us) raft_consensus.cc:1685] finished
0709 13:04:01.010665 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.010805 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2793,"prepare.queue_time_us":65706,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":36,"raft.queue_time_us":13545,"raft.run_cpu_time_us":914,"raft.run_wall_time_us":47004,"spinlock_wait_cycles":29883008,"thread_start_us":240856,"threads_started":1,"wal-append.queue_time_us":495431}
W20260709 13:04:01.026882 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 500364us
I20260709 13:04:01.055912 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:01.075766 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:01.084236 17209 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.084051 17202 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.084877 17209 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.085093 17202 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.051723 17070 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.087843 17070 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.088456 17070 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.089511 17202 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:01.090377 17202 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.089972 16978 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.054577 17189 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.091208 17149 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:01.092643 17189 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.027705 17150 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:01.095932 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:01.107213 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:01.116918 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 417250us
I20260709 13:04:01.117920 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:01.088928 17070 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:01.122005 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 106498us
I20260709 13:04:01.123524 17070 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:01.125233 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.086968 17209 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.134431 16934 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.135049 16934 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.136951 15870 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:01.137213 16934 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:01.137492 16992 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.138888 15869 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:01.100805 17220 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:01.140352 15343 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:01.156112 15344 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:01.140971 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:01.152717 15341 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:01.154556 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:01.168274 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:01.169005 15339 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:01.094403 17205 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:04:01.180588 15309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.007s
W20260709 13:04:01.181139 15309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.007s
I20260709 13:04:01.105845 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:01.192406 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.105808 17199 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.057158 17074 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.213757 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:01.217335 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1174) took 2003 ms. Trace:
I20260709 13:04:01.217948 15270 rpcz_store.cc:276] 0709 13:03:59.213778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.580319 (+1366541us) service_pool.cc:224] Handling call
0709 13:04:00.671125 (+ 90806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.671901 (+   776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.217073 (+545172us) spinlock_profiling.cc:243] Waited 90.4 ms on lock 0x7b54002f1cd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:01.217257 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207842560}
I20260709 13:04:01.225862 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.227592 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.026208 17201 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:01.153523 17189 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.153668 17150 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:01.166924 17070 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:01.199337 17152 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:01.201089 17205 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:01.234678 15237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.003s	sys 0.024s
W20260709 13:04:01.239933 15237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.003s	sys 0.024s
I20260709 13:04:01.134918 17071 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.119287 17202 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:01.240578 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 667218us
I20260709 13:04:01.208837 17044 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:01.258024 15346 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:04:01.245069 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:01.216634 17153 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:01.268905 17153 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:01.272953 17153 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:01.268960 17169 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.274010 17169 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:04:01.243853 15268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.013s
I20260709 13:04:01.253367 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:01.228211 17211 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.233502 17198 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:01.279531 15270 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
W20260709 13:04:01.280473 15268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.003s	sys 0.013s
I20260709 13:04:01.241117 17216 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.220173 17199 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:01.303896 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 198149us
I20260709 13:04:01.279469 17146 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:01.240820 17189 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.231688 15839 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:01.301522 15872 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:01.277715 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.342132 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:01.192955 17220 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:01.555019 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 301683us
I20260709 13:04:01.566273 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1124) took 1982 ms. Trace:
I20260709 13:04:01.566846 15268 rpcz_store.cc:276] 0709 13:03:59.583476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.688746 (+1105270us) service_pool.cc:224] Handling call
0709 13:04:00.689037 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.689235 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:00.719288 (+ 30053us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.565838 (+846550us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:01.565908 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:01.565970 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.566054 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.566198 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274574,"prepare.queue_time_us":29793,"prepare.run_cpu_time_us":301,"prepare.run_wall_time_us":299,"thread_start_us":571434,"threads_started":1,"wal-append.queue_time_us":591899}
I20260709 13:04:01.331907 17084 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:01.574343 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:01.587975 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.588904 15268 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:01.275400 17044 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:01.603935 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:01.561147 16759 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.559062 17224 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.562458 17153 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.330878 16833 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.262s
I20260709 13:04:01.614079 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:01.335008 17119 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.268s
I20260709 13:04:01.302186 17211 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.584928 17084 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:01.661214 17218 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.354s	user 0.000s	sys 0.000s
I20260709 13:04:01.671414 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1173) took 2458 ms. Trace:
I20260709 13:04:01.671978 15269 rpcz_store.cc:276] 0709 13:03:59.213471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.575279 (+1361808us) service_pool.cc:224] Handling call
0709 13:04:00.575682 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.576049 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.576085 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.601389 (+ 25304us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.068503 (+467114us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:01.068559 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.068655 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.671118 (+602463us) raft_consensus.cc:1685] finished
0709 13:04:01.671149 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.671327 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":961,"raft.queue_time_us":268372,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":11291,"thread_start_us":405175,"threads_started":1,"wal-append.queue_time_us":597492}
I20260709 13:04:01.674377 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:01.678108 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:01.680696 15269 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.340152 17150 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.629206 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.691639 15872 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:01.697444 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:01.620076 17070 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:01.556326 17146 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.648469 17084 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.634840 17211 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.687806 16833 consensus_queue.cc:1243] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:01.789713 15875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:01.790329 17230 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:04:01.621631 16759 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.610090 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.629935 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.575598 16992 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:01.317482 17216 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:01.621034 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 408164us
I20260709 13:04:01.796341 17220 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:01.797484 16934 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:01.741962 17198 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.742655 16822 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.647625 17153 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.800174 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.789765 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.782742 17209 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.636890 17224 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.807654 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.810700 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1177) took 2588 ms. Trace:
I20260709 13:04:01.811303 17146 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.812296 17199 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:01.812928 17228 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:04:01.813446 17071 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.815379 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.811328 17107 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:01.831312 15266 rpcz_store.cc:276] 0709 13:03:59.222580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.577815 (+1355235us) service_pool.cc:224] Handling call
0709 13:04:00.618781 (+ 40966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.750607 (+131826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.810446 (+1059839us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003291d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:01.810639 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264248192}
I20260709 13:04:01.791553 17074 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:01.884042 17249 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:04:01.858518 15270 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:01.885916 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.887332 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:01.888237 15270 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:01.889127 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:01.890341 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.884030 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.893062 15266 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:01.894263 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.895711 15266 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:01.897644 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.817723 17169 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:01.819885 17202 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:01.822324 16822 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:01.863425 17226 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:04:01.863570 15269 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:01.935134 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:01.878361 17219 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.547s	user 0.001s	sys 0.000s
I20260709 13:04:01.935462 16759 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.908300 17044 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:01.937402 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1176) took 2715 ms. Trace:
I20260709 13:04:01.910212 17153 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:01.905265 17206 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:04:01.859007 17209 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:01.914814 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.906500 15266 raft_consensus.cc:2410] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:01.795004 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.927444 17074 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:01.948107 17074 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:01.949528 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.950755 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.929178 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:01.951347 15266 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:01.933750 16822 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:01.864321 15268 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:04:01.954625 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 79) took 2230 ms. Trace:
I20260709 13:04:01.952591 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:01.938369 15195 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.958144 15266 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:04:01.958797 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1139) took 2234 ms. Trace:
I20260709 13:04:01.937983 15271 rpcz_store.cc:276] 0709 13:03:59.222247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.601550 (+1379303us) service_pool.cc:224] Handling call
0709 13:04:00.602135 (+   585us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.602575 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:00.630005 (+ 27430us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.054785 (+424780us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.055323 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.055681 (+   358us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:01.055727 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.055825 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.631494 (+575669us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4800061a58. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:01.937078 (+305584us) raft_consensus.cc:1685] finished
0709 13:04:01.937186 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.937340 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35838,"prepare.queue_time_us":27028,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":10564,"raft.queue_time_us":312899,"raft.run_cpu_time_us":3461,"raft.run_wall_time_us":770163,"spinlock_wait_cycles":6621440,"thread_start_us":348168,"threads_started":1,"wal-append.queue_time_us":554559}
I20260709 13:04:01.959132 15266 rpcz_store.cc:276] 0709 13:03:59.724308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.957594 (+2233286us) service_pool.cc:224] Handling call
0709 13:04:01.957921 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.958557 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.958749 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:01.960302 15271 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:01.960587 15266 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:04:01.942668 15269 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:02.025636 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:02.026413 15269 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:04:02.027880 15269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:04:02.028951 15269 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:02.029830 15269 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:01.828158 17235 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:04:01.948835 17209 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:01.961051 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1140) took 2236 ms. Trace:
I20260709 13:04:02.034888 15271 rpcz_store.cc:276] 0709 13:03:59.724638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.959566 (+2234928us) service_pool.cc:224] Handling call
0709 13:04:01.959900 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.960762 (+   862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.960988 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:02.036624 15266 pending_rounds.cc:85] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 2
I20260709 13:04:02.037096 15266 pending_rounds.cc:107] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:04:02.036777 17205 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:02.037461 15266 raft_consensus.cc:2889] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:01.893611 17143 consensus_meta.cc:287] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.881s	user 0.012s	sys 0.000s
I20260709 13:04:01.937321 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:02.038340 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1187) took 2164 ms. Trace:
I20260709 13:04:01.967655 15873 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:01.955075 15268 rpcz_store.cc:276] 0709 13:03:59.724069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.953644 (+2229575us) service_pool.cc:224] Handling call
0709 13:04:01.954004 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.954219 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.954256 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:01.954311 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:01.954351 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.954432 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.954560 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:01.828361 17229 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:01.975471 15195 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:04:01.981266 17221 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 13:04:01.986527 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1126) took 2402 ms. Trace:
I20260709 13:04:02.002138 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:01.819000 17198 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:02.011754 17216 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:02.037312 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1189) took 1119 ms. Trace:
I20260709 13:04:01.962972 17074 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:02.010437 17224 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:02.038708 15266 rpcz_store.cc:276] 0709 13:03:59.874115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.959964 (+2085849us) service_pool.cc:224] Handling call
0709 13:04:01.960251 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.038080 (+ 77829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.038287 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:02.099913 15271 rpcz_store.cc:276] 0709 13:04:00.918732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.036195 (+1117463us) service_pool.cc:224] Handling call
0709 13:04:02.036617 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.036829 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.036868 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.036933 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:02.036984 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.037067 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.037242 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:02.101212 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:02.101421 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1123) took 2518 ms. Trace:
I20260709 13:04:02.069846 17204 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:02.105458 15195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1207) took 1986 ms (client timeout 1577 ms). Trace:
I20260709 13:04:02.109161 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:02.038661 15270 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:02.112823 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:02.113886 15272 rpcz_store.cc:276] 0709 13:03:59.583990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.684958 (+1100968us) service_pool.cc:224] Handling call
0709 13:04:00.685373 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.789505 (+104132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.789541 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.789590 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:00.789629 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.986191 (+1196562us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002a80d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:01.986249 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.986444 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238984064}
W20260709 13:04:02.106141 15195 rpcz_store.cc:269] 0709 13:04:00.119180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.119534 (+   354us) service_pool.cc:224] Handling call
0709 13:04:00.998078 (+878544us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b18001ce3c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5748646 00007f36e568258e 00007f36e5703f9e 00007f36e57057de 00007f36e571127c 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c
0709 13:04:01.937937 (+939859us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b58006e03d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e56690aa 00007f36e56eb447 00007f36e5703fe7 00007f36e57057de 00007f36e571127c 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c
0709 13:04:02.105350 (+167413us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1799004416}
I20260709 13:04:02.109437 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1191) took 1183 ms. Trace:
I20260709 13:04:02.102232 15267 rpcz_store.cc:276] 0709 13:03:59.583154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.687153 (+1103999us) service_pool.cc:224] Handling call
0709 13:04:00.687510 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.688367 (+   857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.688396 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.688863 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.164206 (+475343us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:01.208457 (+ 44251us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.231359 (+ 22902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.231491 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.980417 (+748926us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:01.985740 (+  5323us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b1800378460. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:02.101075 (+115335us) raft_consensus.cc:1685] finished
0709 13:04:02.101114 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.101326 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22619,"prepare.queue_time_us":52184,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":3794,"raft.queue_time_us":208600,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":14202,"spinlock_wait_cycles":29535744,"thread_start_us":474284,"threads_started":1,"wal-append.queue_time_us":658376}
I20260709 13:04:02.125466 15268 rpcz_store.cc:276] 0709 13:04:00.925728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.108340 (+1182612us) service_pool.cc:224] Handling call
0709 13:04:02.108762 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.108995 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.109036 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.109102 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:02.109148 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.109222 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.109367 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:02.085582 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:02.130429 17220 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:02.130905 17220 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:02.131348 17220 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:02.132234 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 130199us
W20260709 13:04:02.135273 15873 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58404 (request call id 133) took 1642 ms (client timeout 2023 ms). Trace:
I20260709 13:04:02.136420 15197 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:02.062180 17209 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:02.103122 17205 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.144972 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:02.063060 17189 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:02.062438 17201 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:02.187453 15341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.020s	sys 0.065s
I20260709 13:04:02.047606 17143 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:02.102285 15266 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:02.198961 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:02.209240 15270 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:04:02.211630 15270 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:02.212590 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1197) took 1252 ms. Trace:
I20260709 13:04:02.145502 17084 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:02.167865 17200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.035s	sys 0.089s
W20260709 13:04:02.148087 17117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.033s	sys 0.091s
I20260709 13:04:02.205426 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1194) took 1247 ms. Trace:
W20260709 13:04:02.212774 15338 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.008s	sys 0.025s
W20260709 13:04:02.135845 15873 rpcz_store.cc:269] 0709 13:04:00.512726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.512950 (+   224us) service_pool.cc:224] Handling call
0709 13:04:01.741842 (+1228892us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b58001d6498. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:04:02.135173 (+393331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10325760}
W20260709 13:04:02.217641 15191 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.059s	sys 0.123s
I20260709 13:04:02.229774 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1198) took 1269 ms. Trace:
W20260709 13:04:02.200393 15341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.020s	sys 0.066s
I20260709 13:04:02.211248 15269 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:02.264214 15270 rpcz_store.cc:276] 0709 13:04:00.959916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.210905 (+1250989us) service_pool.cc:224] Handling call
0709 13:04:02.211386 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.212253 (+   867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.212528 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:02.285878 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 141020us
W20260709 13:04:02.148159 17111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.009s	user 0.031s	sys 0.090s
I20260709 13:04:02.129522 17204 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:02.291356 15338 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.009s	sys 0.026s
W20260709 13:04:02.539356 15263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.322s	user 0.035s	sys 0.038s
I20260709 13:04:02.844700 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1291) took 1651 ms. Trace:
W20260709 13:04:02.844828 15263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.642s	user 0.035s	sys 0.048s
W20260709 13:04:02.386765 15192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.179s	user 0.008s	sys 0.023s
I20260709 13:04:02.845160 15338 rpcz_store.cc:276] 0709 13:04:01.193695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.193869 (+   174us) service_pool.cc:224] Handling call
0709 13:04:01.194273 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.194547 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:01.220083 (+ 25536us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.844243 (+1624160us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.844388 (+   145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.844429 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:02.844467 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.844533 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.844645 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1549,"prepare.queue_time_us":25689,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4149,"thread_start_us":1623618,"threads_started":1}
W20260709 13:04:02.846233 15192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.643s	user 0.009s	sys 0.036s
I20260709 13:04:02.290879 15267 rpcz_store.cc:276] 0709 13:04:00.957686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.203862 (+1246176us) service_pool.cc:224] Handling call
0709 13:04:02.204669 (+   807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.204931 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.204971 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.205039 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:02.205073 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.205150 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.205340 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:02.847544 15268 rpcz_store.cc:276] 0709 13:04:00.960229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.228570 (+1268341us) service_pool.cc:224] Handling call
0709 13:04:02.229073 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.229325 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.229368 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.229425 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:02.229456 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.229513 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.229681 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:02.850075 15191 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.063s	sys 0.146s
I20260709 13:04:02.856767 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:02.197428 16992 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:02.674996 15238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.515s (SENT) [suppressed 33 similar messages]
I20260709 13:04:02.912168 15269 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:02.916301 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.619s	user 0.012s	sys 0.040s
W20260709 13:04:02.916976 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.619s	user 0.012s	sys 0.040s
W20260709 13:04:02.822197 17243 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:04:02.838068 17238 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260709 13:04:02.831424 17232 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.615s	user 0.002s	sys 0.000s
I20260709 13:04:02.353070 17211 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:02.290418 17200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.274s	user 0.035s	sys 0.090s
I20260709 13:04:02.388278 15093 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 2 to 4, now has a pending config: VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1), VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2), VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3), VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 4 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:02.969677 17237 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.494s	user 0.001s	sys 0.001s
I20260709 13:04:02.285234 17140 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:02.911995 16992 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:02.969141 17239 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.308s	user 0.000s	sys 0.000s
I20260709 13:04:02.285804 17143 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:02.284278 17189 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:02.540868 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:02.968904 17198 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:02.510830 17224 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.382123 17216 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:02.844034 17117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.760s	user 0.045s	sys 0.101s
I20260709 13:04:02.187731 17209 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.001477 15267 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:03.068216 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1144) took 2061 ms. Trace:
I20260709 13:04:03.068678 15267 rpcz_store.cc:276] 0709 13:04:01.007005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.979162 (+1972157us) service_pool.cc:224] Handling call
0709 13:04:02.979650 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.067838 (+ 88188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.068137 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:02.859534 17111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.720s	user 0.042s	sys 0.113s
I20260709 13:04:03.006831 17211 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:02.982169 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1146) took 1974 ms. Trace:
I20260709 13:04:03.004000 17201 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.013523 15093 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 4 to 6, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 6 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:02.590756 15839 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:03.057263 15162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.777s	user 0.013s	sys 0.023s
W20260709 13:04:03.078521 15162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.799s	user 0.014s	sys 0.024s
W20260709 13:04:03.078898 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 1.79975e+06us
W20260709 13:04:03.062005 16978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.968s	user 0.016s	sys 0.047s
I20260709 13:04:03.017354 17140 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:03.073416 15268 rpcz_store.cc:276] 0709 13:04:01.021507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.981104 (+1959597us) service_pool.cc:224] Handling call
0709 13:04:02.981486 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.981723 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.981762 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.981821 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:02.981864 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.981937 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.982091 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:02.946040 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45870 (request call id 1188) took 2023 ms. Trace:
W20260709 13:04:03.057890 17243 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:04:03.114723 15269 rpcz_store.cc:276] 0709 13:04:00.899571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.027731 (+1128160us) service_pool.cc:224] Handling call
0709 13:04:02.912811 (+885080us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:03.118274 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1202) took 1987 ms. Trace:
I20260709 13:04:03.118911 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1215) took 2160 ms. Trace:
W20260709 13:04:03.119581 15346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.024s	sys 0.046s
W20260709 13:04:03.120286 15346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.025s	sys 0.047s
I20260709 13:04:03.121405 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1302) took 1510 ms. Trace:
I20260709 13:04:03.119365 15189 rpcz_store.cc:276] 0709 13:04:00.933324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.933514 (+   190us) service_pool.cc:224] Handling call
0709 13:04:00.933823 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:00.937616 (+  3793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.937649 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:00.944277 (+  6628us) log.cc:844] Serialized 52 byte log entry
0709 13:04:01.320093 (+375816us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:01.320135 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.320209 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:02.837207 (+1516998us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:03.076796 (+239589us) raft_consensus.cc:1685] finished
0709 13:04:03.076816 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.093999 (+ 17183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1882,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":16722,"spinlock_wait_cycles":44422016,"thread_start_us":314842,"threads_started":1,"wal-append.queue_time_us":1315810}
W20260709 13:04:03.126765 15310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.536s	user 0.020s	sys 0.041s
W20260709 13:04:03.127206 15310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.537s	user 0.020s	sys 0.041s
I20260709 13:04:03.121951 15093 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 2 to 4, term changed from 3 to 4, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to <none>, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:03.118947 15268 rpcz_store.cc:276] 0709 13:04:01.130339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.117331 (+1986992us) service_pool.cc:224] Handling call
0709 13:04:03.117651 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.117847 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.117885 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.117939 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.117978 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.118048 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.118185 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:03.082579 16978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.989s	user 0.016s	sys 0.048s
I20260709 13:04:03.071990 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1149) took 2049 ms. Trace:
I20260709 13:04:03.135399 15267 rpcz_store.cc:276] 0709 13:04:01.022468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.070620 (+2048152us) service_pool.cc:224] Handling call
0709 13:04:03.071334 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.071564 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.071603 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.071662 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:03.071706 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.071779 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.071919 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:03.121204 16888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.522s	user 0.026s	sys 0.034s
I20260709 13:04:03.076530 17198 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.121762 15346 rpcz_store.cc:276] 0709 13:04:01.611438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.612130 (+   692us) service_pool.cc:224] Handling call
0709 13:04:01.652856 (+ 40726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.653260 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:01.782904 (+129644us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.976279 (+193375us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b1800185d40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:03.120747 (+1144468us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.120822 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:03.120935 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.121062 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.121356 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4240,"prepare.queue_time_us":140774,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":22707,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":8666,"spinlock_wait_cycles":26236160,"thread_start_us":1333152,"threads_started":1,"wal-append.queue_time_us":11999,"wal-append.run_cpu_time_us":1636,"wal-append.run_wall_time_us":1138901}
W20260709 13:04:03.152974 15309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.407s	user 0.017s	sys 0.025s
I20260709 13:04:03.150979 15093 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 2 to 3, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:03.056825 17224 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:03.146183 15091 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 170) took 15684 ms (client timeout 15000 ms). Trace:
W20260709 13:04:03.158428 15222 heartbeater.cc:646] Failed to heartbeat to 127.13.181.62:42621 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.181.62:42621 timed out after 15.000s (SENT)
W20260709 13:04:03.161502 15309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.416s	user 0.017s	sys 0.025s
I20260709 13:04:03.065331 17216 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:03.162155 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 1.4647e+06us
I20260709 13:04:03.055606 17189 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.076969 17084 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:03.125810 17140 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.183580 17189 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.184126 17189 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.184567 17189 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.182780 17084 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.195581 17084 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.198505 17084 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:03.156682 16978 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.199532 16978 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.202392 16978 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:03.163121 15093 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:03.146672 17200 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.203433 17200 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:03.203894 15093 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 3 to 5, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 5 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:03.151867 16888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.560s	user 0.027s	sys 0.034s
W20260709 13:04:03.130424 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 623989us
I20260709 13:04:03.205502 15093 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 2 to 4, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 4 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:03.212208 17189 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.159607 17198 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:03.164422 17220 consensus_meta.cc:287] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 1.032s	user 0.014s	sys 0.000s
I20260709 13:04:03.095227 17201 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:03.219930 15344 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.367s	user 0.030s	sys 0.020s
W20260709 13:04:03.220358 15344 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.030s	sys 0.020s
W20260709 13:04:03.222187 15265 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.982s	user 0.011s	sys 0.055s
W20260709 13:04:03.222539 15265 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.983s	user 0.011s	sys 0.055s
W20260709 13:04:03.179965 17020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.874s	user 0.012s	sys 0.034s
W20260709 13:04:03.235453 15342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.674s	user 0.012s	sys 0.034s
I20260709 13:04:03.205506 17200 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:03.265498 15312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.949s	user 0.025s	sys 0.052s
W20260709 13:04:03.283288 15312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.967s	user 0.025s	sys 0.053s
W20260709 13:04:03.283690 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 1.96773e+06us
I20260709 13:04:03.236756 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:03.301208 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1275) took 2165 ms. Trace:
W20260709 13:04:03.178297 17150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.282s	user 0.014s	sys 0.045s
W20260709 13:04:03.302485 17150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.014s	sys 0.051s
I20260709 13:04:03.301808 15337 rpcz_store.cc:276] 0709 13:04:01.135348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.137203 (+  1855us) service_pool.cc:224] Handling call
0709 13:04:01.137491 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.137861 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:01.138165 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.337020 (+198855us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.337860 (+   840us) log.cc:844] Serialized 26 byte log entry
0709 13:04:01.338023 (+   163us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:01.338072 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.338168 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.877400 (+539232us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b48001e0258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:03.218447 (+1341047us) raft_consensus.cc:1685] finished
0709 13:04:03.300867 (+ 82420us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.301093 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17705,"prepare.queue_time_us":3903,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3695,"raft.queue_time_us":230023,"raft.run_cpu_time_us":1236,"raft.run_wall_time_us":300125,"spinlock_wait_cycles":7387008,"thread_start_us":198064,"threads_started":1,"wal-append.queue_time_us":1387044}
I20260709 13:04:03.304107 17150 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:03.304697 17150 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.305183 17150 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:03.235857 15264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.014s	user 0.020s	sys 0.040s
W20260709 13:04:03.316038 15264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.094s	user 0.021s	sys 0.040s
W20260709 13:04:03.277050 15342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.715s	user 0.012s	sys 0.034s
W20260709 13:04:03.287768 17020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.988s	user 0.013s	sys 0.035s
W20260709 13:04:03.265076 16804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.424s	user 0.001s	sys 0.062s
I20260709 13:04:03.233368 17222 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:03.178747 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:03.334098 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 155420us
I20260709 13:04:03.335691 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:03.319242 17149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.735s	user 0.024s	sys 0.052s
W20260709 13:04:03.565362 17149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.989s	user 0.024s	sys 0.053s
W20260709 13:04:03.565773 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 230151us
W20260709 13:04:03.566439 15271 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.015s	sys 0.019s
I20260709 13:04:03.566588 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:03.568174 15271 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.015s	sys 0.019s
W20260709 13:04:03.327188 16678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.655s	user 0.026s	sys 0.029s
I20260709 13:04:03.283082 17189 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:03.283041 17204 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:03.568639 16678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.027s	sys 0.029s
W20260709 13:04:03.331571 16804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.502s	user 0.001s	sys 0.062s
I20260709 13:04:03.568817 17189 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.317947 17203 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:03.570081 17203 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.571416 17189 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.382767 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1175) took 4168 ms. Trace:
W20260709 13:04:03.383512 17250 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:04:03.384285 17244 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:04:03.392937 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77780.6us
I20260709 13:04:03.221705 17220 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:03.341966 17084 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:03.395783 17143 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.412021 17209 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.574990 17203 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.431139 16992 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.617456 16992 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:03.617956 16992 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:03.431334 17211 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:03.435289 17148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.160s	user 0.033s	sys 0.091s
W20260709 13:04:03.620688 17148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.353s	user 0.034s	sys 0.091s
I20260709 13:04:03.622525 17148 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:03.468432 17039 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.151s	user 0.000s	sys 0.027s
W20260709 13:04:03.623194 17039 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.312s	user 0.000s	sys 0.027s
W20260709 13:04:03.470768 17123 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.502s	user 0.016s	sys 0.084s
W20260709 13:04:03.624029 17123 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.656s	user 0.016s	sys 0.085s
I20260709 13:04:03.478966 17198 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:03.497766 17205 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.295s	user 0.013s	sys 0.001s
I20260709 13:04:03.497974 17201 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.629519 17201 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:03.629839 16992 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.630060 17201 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.630640 17201 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:03.500679 17263 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:04:03.505010 17224 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:03.505249 17251 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:04:03.622861 17148 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:03.635813 17148 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:03.636809 17148 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:03.503311 17216 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:03.517059 15190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.213s	user 0.036s	sys 0.091s
W20260709 13:04:03.600525 15312 connection.cc:256] RPC call timeout handler was delayed by -1.6808340259999568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:04:03.639343 15190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.336s	user 0.036s	sys 0.091s
I20260709 13:04:03.639803 17265 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.640117 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1217) took 2607 ms. Trace:
I20260709 13:04:03.640462 17265 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.640514 15190 rpcz_store.cc:276] 0709 13:04:01.032750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.032955 (+   205us) service_pool.cc:224] Handling call
0709 13:04:01.033408 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.033671 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:01.299284 (+265613us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.639797 (+2340513us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.639846 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.639884 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.639945 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.640067 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54433,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":2581270,"threads_started":2}
W20260709 13:04:03.516328 17241 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:04:03.527694 15842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.037s	sys 0.066s
W20260709 13:04:03.642597 15842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.037s	sys 0.066s
I20260709 13:04:03.643299 17260 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:03.525534 17242 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:04:03.643837 17260 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:03.542200 17257 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
W20260709 13:04:03.545073 15238 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.021s	sys 0.041s
W20260709 13:04:03.644932 15238 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.021s	sys 0.042s
W20260709 13:04:03.645273 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 970240us
I20260709 13:04:03.646106 17260 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:03.649058 17265 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:03.545461 15192 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.010s	sys 0.053s
W20260709 13:04:03.650972 15192 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.010s	sys 0.053s
I20260709 13:04:03.563699 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1136) took 3852 ms. Trace:
I20260709 13:04:03.568006 17268 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:04:03.219431 15091 rpcz_store.cc:269] 0709 13:03:47.435405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.436504 (+  1099us) service_pool.cc:224] Handling call
0709 13:03:48.112595 (+676091us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5677090 00007f36e5715f3a 00007f36eb4cc1cc 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc 00007f36e9a8a392 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:03.119490 (+15006895us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:57.195082 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:57.196915 (+  1833us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:57.196964 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:03:57.196996 (+    32us) tablet.cc:662] Decoding operations
0709 13:03:57.280356 (+ 83360us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:57.280494 (+   138us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:57.280539 (+    45us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:03:57.459259 (+178720us) tablet.cc:701] Row locks acquired
0709 13:03:57.459321 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:03:58.026061 (+566740us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b2c00013008. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4015a0a 00007f36e4015693 00007f36e4015631 00007f36e5748902 00007f36e57486dd 00007f36e9143243 00007f36e9142d58 00007f36e91479f1 00007f36e91479a9 00007f36e9147939
0709 13:03:58.026151 (+    90us) write_op.cc:270] Start()
0709 13:03:58.026385 (+   234us) write_op.cc:276] Timestamp: P: 1783602237465320 usec, L: 0
0709 13:03:58.026439 (+    54us) op_driver.cc:348] REPLICATION: starting
0709 13:03:58.046005 (+ 19566us) log.cc:844] Serialized 12525 byte log entry
0709 13:03:58.481821 (+435816us) op_driver.cc:464] REPLICATION: finished
0709 13:03:59.690748 (+1208927us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e9143ef0
0709 13:04:00.078410 (+387662us) write_op.cc:301] APPLY: starting
0709 13:04:00.078527 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:00.079120 (+   593us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:00.079159 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:00.937154 (+857995us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:00.967633 (+ 30479us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=32
0709 13:04:00.967792 (+   159us) write_op.cc:312] APPLY: finished
0709 13:04:00.968425 (+   633us) log.cc:844] Serialized 211 byte log entry
0709 13:04:01.618490 (+650065us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:01.708384 (+ 89894us) write_op.cc:454] Released schema lock
0709 13:04:01.794821 (+ 86437us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:01.856949 (+ 62128us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:01.859914 (+  2965us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":215515,"reported_tablets":43,"spinlock_wait_cycles":452566400,"child_traces":[["op",{"apply.queue_time_us":1596324,"apply.run_cpu_time_us":27353,"apply.run_wall_time_us":1742645,"num_ops":32,"prepare.queue_time_us":125031,"prepare.run_cpu_time_us":62195,"prepare.run_wall_time_us":1027261,"raft.queue_time_us":155663,"raft.run_cpu_time_us":43092,"raft.run_wall_time_us":1770261,"replication_time_us":455191,"spinlock_wait_cycles":30512896,"thread_start_us":2298732,"threads_started":5,"wal-append.queue_time_us":1444548,"wal-append.run_cpu_time_us":13117,"wal-append.run_wall_time_us":1154477}]]}
I20260709 13:04:03.382031 17140 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.575232 15263 rpcz_store.cc:276] 0709 13:03:59.214095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.584633 (+1370538us) service_pool.cc:224] Handling call
0709 13:04:00.585089 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.054516 (+469427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.054553 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.101002 (+ 46449us) log.cc:844] Serialized 26 byte log entry
0709 13:04:02.886297 (+1785295us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:02.918759 (+ 32462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.918865 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:03.382571 (+463706us) raft_consensus.cc:1685] finished
0709 13:04:03.382590 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.382711 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":278099,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":12810,"thread_start_us":2107556,"threads_started":2,"wal-append.queue_time_us":2239393}
I20260709 13:04:03.654711 15263 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:03.655609 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1206) took 2510 ms. Trace:
W20260709 13:04:03.343827 15340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.552s	user 0.036s	sys 0.040s
I20260709 13:04:03.567942 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:03.590431 17259 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:03.598023 17258 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.653784 17268 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.616374 17220 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:03.595022 17084 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:03.660730 17084 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:03.652904 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1214) took 2720 ms. Trace:
W20260709 13:04:03.662211 15841 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.022s	sys 0.027s
I20260709 13:04:03.652753 15265 rpcz_store.cc:276] 0709 13:03:59.711196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.769487 (+1058291us) service_pool.cc:224] Handling call
0709 13:04:00.769817 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.162994 (+393177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.163058 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.163631 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:04:03.222904 (+2059273us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:03.222944 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.223097 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:03.563362 (+340265us) raft_consensus.cc:1685] finished
0709 13:04:03.563390 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.563617 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18542,"raft.queue_time_us":120194,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6680,"thread_start_us":2359243,"threads_started":2,"wal-append.queue_time_us":2324676}
I20260709 13:04:03.661211 17140 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:03.597971 15311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.885s	user 0.035s	sys 0.023s
W20260709 13:04:03.665306 15311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.952s	user 0.035s	sys 0.023s
W20260709 13:04:03.657495 15340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.866s	user 0.036s	sys 0.040s
I20260709 13:04:03.604637 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1137) took 3881 ms. Trace:
W20260709 13:04:03.481359 15266 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.006s	sys 0.017s
W20260709 13:04:03.664261 15841 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.023s	sys 0.027s
W20260709 13:04:03.658039 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 90170.1us
W20260709 13:04:03.667531 15266 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.459s	user 0.006s	sys 0.017s
I20260709 13:04:03.655938 15263 rpcz_store.cc:276] 0709 13:04:01.144868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.654219 (+2509351us) service_pool.cc:224] Handling call
0709 13:04:03.654542 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.655270 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.655536 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:03.668028 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 914992us
I20260709 13:04:03.670675 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:03.667272 15265 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:03.672030 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1207) took 2526 ms. Trace:
W20260709 13:04:03.674121 15160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.001s	sys 0.013s
I20260709 13:04:03.666636 15264 rpcz_store.cc:276] 0709 13:03:59.723639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.784394 (+1060755us) service_pool.cc:224] Handling call
0709 13:04:00.786207 (+  1813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.101096 (+314889us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.101126 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:01.105526 (+  4400us) log.cc:844] Serialized 26 byte log entry
0709 13:04:03.316595 (+2211069us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:03.316649 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.316744 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:03.604322 (+287578us) raft_consensus.cc:1685] finished
0709 13:04:03.604353 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.604554 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12463,"raft.queue_time_us":121959,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":3369,"thread_start_us":2396020,"threads_started":2,"wal-append.queue_time_us":2403105}
W20260709 13:04:03.674604 15160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.001s	sys 0.013s
W20260709 13:04:03.675104 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 818329us
I20260709 13:04:03.673041 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1303) took 2010 ms. Trace:
I20260709 13:04:03.675973 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:03.675846 15340 rpcz_store.cc:276] 0709 13:04:01.663153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.663288 (+   135us) service_pool.cc:224] Handling call
0709 13:04:01.663610 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.663811 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:01.791124 (+127313us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.672625 (+1881501us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.672695 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:03.672752 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.672834 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.672976 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129324,"prepare.queue_time_us":134809,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":1875013,"threads_started":1,"wal-append.queue_time_us":1863097}
I20260709 13:04:03.677961 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:03.678758 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.008s	sys 0.007s
W20260709 13:04:03.679212 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.008s	sys 0.007s
I20260709 13:04:03.674404 15265 rpcz_store.cc:276] 0709 13:04:01.145133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.666545 (+2521412us) service_pool.cc:224] Handling call
0709 13:04:03.667089 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.671794 (+  4705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.671980 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:03.680320 17216 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.681869 17216 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:03.658556 17265 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.681074 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1155) took 2372 ms. Trace:
I20260709 13:04:03.658389 17259 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:03.664520 17224 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.659144 17268 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:03.661964 15192 rpcz_store.cc:276] 0709 13:04:00.932276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.932426 (+   150us) service_pool.cc:224] Handling call
0709 13:04:00.932768 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.932963 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:01.202826 (+269863us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.651494 (+2448668us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.652436 (+   942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.652536 (+   100us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.652598 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.652687 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.652840 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1203,"prepare.queue_time_us":854317,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":457572,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":2933,"spinlock_wait_cycles":12032,"thread_start_us":2707234,"threads_started":3,"wal-append.queue_time_us":2115535}
I20260709 13:04:03.684571 17148 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:03.686735 15264 rpcz_store.cc:276] 0709 13:04:01.308526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.675082 (+2366556us) service_pool.cc:224] Handling call
0709 13:04:03.675357 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.675528 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.675559 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.675598 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:03.680800 (+  5202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.680894 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.681022 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:03.694149 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:03.698616 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1210) took 1675 ms. Trace:
I20260709 13:04:03.699141 15264 rpcz_store.cc:276] 0709 13:04:02.023672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.697621 (+1673949us) service_pool.cc:224] Handling call
0709 13:04:03.697991 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.698197 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.698259 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.698313 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.698355 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.698419 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.698547 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:03.701314 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1211) took 1677 ms. Trace:
I20260709 13:04:03.702796 17286 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:03.703419 17286 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.703771 17286 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.691250 17140 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:03.658422 17258 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:03.717882 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47280.4us
I20260709 13:04:03.707612 17123 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:04:03.693934 17039 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:04:03.710256 17140 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:03.722319 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:03.727352 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:03.704346 17224 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.734529 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:03.736207 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:03.721302 16888 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:04:03.745604 15191 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.008s	sys 0.008s
W20260709 13:04:03.746037 15191 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.008s	sys 0.008s
I20260709 13:04:03.746802 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1213) took 2822 ms. Trace:
I20260709 13:04:03.747207 15191 rpcz_store.cc:276] 0709 13:04:00.924335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.924468 (+   133us) service_pool.cc:224] Handling call
0709 13:04:00.924804 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.925047 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:01.293147 (+368100us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.746365 (+2453218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.746436 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.746492 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.746575 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.746725 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162582,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":453187,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":65,"thread_start_us":2793657,"threads_started":3,"wal-append.queue_time_us":2081202}
W20260709 13:04:03.749222 15270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.010s	sys 0.003s
W20260709 13:04:03.749619 15270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.010s	sys 0.003s
W20260709 13:04:03.750409 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 83959.3us
I20260709 13:04:03.728312 17140 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:03.731395 17020 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:03.756064 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.738444 16978 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:03.740983 17200 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:03.724996 17264 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:04:03.767710 17260 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.761555 17216 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:03.744638 17123 consensus_queue.cc:1243] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:04:03.762346 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:03.782645 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.778710 17260 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.769881 17200 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:03.789345 15269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.026s	sys 0.022s
I20260709 13:04:03.789342 17039 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:03.793012 15341 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.003s	sys 0.010s
W20260709 13:04:03.793059 15269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.026s	sys 0.022s
W20260709 13:04:03.793438 15341 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.003s	sys 0.010s
I20260709 13:04:03.740000 17259 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.800395 16678 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:03.800851 16678 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:03.801504 17260 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:03.801684 16678 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.754669 17148 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:03.789219 17200 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:03.804804 15190 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:03.802887 16678 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.803444 17224 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:03.810070 15272 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.002s	sys 0.010s
I20260709 13:04:03.804096 17039 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:03.811996 15237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.002s	sys 0.016s
W20260709 13:04:03.812498 15237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.002s	sys 0.016s
W20260709 13:04:03.812831 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 894645us
W20260709 13:04:03.729475 15162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.009s	sys 0.043s
W20260709 13:04:03.841905 15162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.011s	sys 0.044s
W20260709 13:04:03.842473 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 762696us
W20260709 13:04:03.834044 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 128420us
W20260709 13:04:03.819411 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83291.1us
I20260709 13:04:03.845069 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:03.846029 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:03.810959 15272 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.002s	sys 0.010s
W20260709 13:04:03.848838 15093 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.015s	sys 0.028s
W20260709 13:04:03.849213 15093 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.015s	sys 0.028s
W20260709 13:04:03.849838 15268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.019s	sys 0.028s
W20260709 13:04:03.850136 15268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.019s	sys 0.028s
W20260709 13:04:03.850934 15267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.019s	sys 0.029s
W20260709 13:04:03.851251 15267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.019s	sys 0.029s
W20260709 13:04:03.815315 15839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.002s	sys 0.011s
I20260709 13:04:03.855353 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1208) took 2710 ms. Trace:
I20260709 13:04:03.701722 15264 rpcz_store.cc:276] 0709 13:04:02.024331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.700351 (+1676020us) service_pool.cc:224] Handling call
0709 13:04:03.700703 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.700932 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.700968 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.701022 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.701065 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.701133 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.701260 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:03.846581 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:03.848719 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:03.872146 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.873227 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.872531 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.882639 15194 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:04:03.849507 15840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.009s	sys 0.005s
W20260709 13:04:03.885076 15840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.010s	sys 0.005s
I20260709 13:04:03.887756 15264 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:03.887607 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.888456 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1213) took 1863 ms. Trace:
I20260709 13:04:03.873064 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:03.888803 15264 rpcz_store.cc:276] 0709 13:04:02.025412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.869508 (+1844096us) service_pool.cc:224] Handling call
0709 13:04:03.869895 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.888209 (+ 18314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.888401 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:03.892535 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:03.859351 17117 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.006s	sys 0.023s
W20260709 13:04:03.894130 17117 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.007s	sys 0.024s
I20260709 13:04:03.911952 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:03.888602 15839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.002s	sys 0.011s
I20260709 13:04:03.891189 17148 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.943537 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1214) took 1917 ms. Trace:
I20260709 13:04:03.944119 17084 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.944697 17140 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:03.852918 17260 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:03.852486 17205 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:04:03.949494 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:03.973599 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:03.974087 15194 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.974396 15188 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:03.831197 16978 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:03.953336 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.953620 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.955848 15189 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:03.979943 15195 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:03.953085 15344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.002s	sys 0.021s
I20260709 13:04:03.980763 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:03.981288 15344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.002s	sys 0.022s
I20260709 13:04:03.982227 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.958385 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:03.956379 15311 connection.cc:256] RPC call timeout handler was delayed by -1.866478882000024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:04:03.895042 17209 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.890767 17149 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:03.891295 17198 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:03.963843 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1209) took 1971 ms. Trace:
I20260709 13:04:03.964524 15264 rpcz_store.cc:276] 0709 13:04:02.025939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.892719 (+1866780us) service_pool.cc:224] Handling call
0709 13:04:03.943003 (+ 50284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.943194 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.943225 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.943267 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:03.943299 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.943355 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.943480 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:03.969544 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1290) took 2815 ms. Trace:
I20260709 13:04:04.000324 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.894659 17258 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:03.968161 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1196) took 3008 ms. Trace:
I20260709 13:04:04.001453 15192 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:04.001925 15266 rpcz_store.cc:276] 0709 13:04:00.959579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.206905 (+1247326us) service_pool.cc:224] Handling call
0709 13:04:02.207301 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.207575 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:03.668101 (+1460526us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.967700 (+299599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.967770 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:03.967830 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.967926 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.968088 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1358968,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":282,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5613,"thread_start_us":1758216,"threads_started":2}
I20260709 13:04:03.852770 17024 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:04:03.947309 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:03.972712 15342 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.021s	sys 0.011s
I20260709 13:04:03.972980 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1141) took 2967 ms. Trace:
I20260709 13:04:03.971227 17201 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:03.975085 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1204) took 2830 ms. Trace:
I20260709 13:04:03.982818 15195 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:03.984010 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.012701 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.012133 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.993738 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.013620 15195 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:03.952849 17203 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:04.014407 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.014485 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.013329 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.014295 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.000638 15341 rpcz_store.cc:276] 0709 13:04:01.153724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.174031 (+ 20307us) service_pool.cc:224] Handling call
0709 13:04:01.220761 (+ 46730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.221011 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:01.242480 (+ 21469us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.797370 (+2554890us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.969120 (+171750us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.969189 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.969245 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.969329 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.969477 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":719933,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":10149,"raft.queue_time_us":251550,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":27821,"thread_start_us":2725736,"threads_started":3,"wal-append.queue_time_us":1975598}
I20260709 13:04:04.012159 15268 rpcz_store.cc:276] 0709 13:04:01.144318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.130113 (+1985795us) service_pool.cc:224] Handling call
0709 13:04:03.130520 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.130811 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:03.850462 (+719651us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.974718 (+124256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.974769 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:03.974819 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.974882 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.975008 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":436628,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":4600,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7883,"thread_start_us":843250,"threads_started":2}
I20260709 13:04:04.006613 15272 rpcz_store.cc:276] 0709 13:04:01.005789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.897128 (+1891339us) service_pool.cc:224] Handling call
0709 13:04:02.996066 (+ 98938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.002267 (+  6201us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:03.847350 (+845083us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.972632 (+125282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.972688 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.972733 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.972803 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.972927 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":564431,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":23,"raft.queue_time_us":163,"spinlock_wait_cycles":15863040,"thread_start_us":949498,"threads_started":2}
I20260709 13:04:03.992621 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1304) took 2329 ms. Trace:
I20260709 13:04:04.018901 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.961212 16888 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:04.004113 15194 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:04:04.006511 15342 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.021s	sys 0.012s
W20260709 13:04:04.005322 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 113930us
I20260709 13:04:03.999826 15265 rpcz_store.cc:276] 0709 13:04:01.992344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.685406 (+1693062us) service_pool.cc:224] Handling call
0709 13:04:03.685746 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.685941 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:03.696109 (+ 10168us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.911245 (+215136us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.956960 (+ 45715us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.963466 (+  6506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.963568 (+   102us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:03.963609 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.963672 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.963790 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14400,"prepare.queue_time_us":15898,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":1742,"raft.queue_time_us":12831,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":53831,"spinlock_wait_cycles":11261952,"thread_start_us":190720,"threads_started":1,"wal-append.queue_time_us":297720}
I20260709 13:04:04.065886 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.067112 15197 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:03.868373 15263 rpcz_store.cc:276] 0709 13:04:01.145406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.668717 (+2523311us) service_pool.cc:224] Handling call
0709 13:04:03.669001 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.669192 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:03.669696 (+   504us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.854962 (+185266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.855011 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.855066 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.855146 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.855279 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2497,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":81,"thread_start_us":184945,"threads_started":1}
I20260709 13:04:04.067947 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1216) took 2010 ms. Trace:
I20260709 13:04:04.019713 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1215) took 1993 ms. Trace:
I20260709 13:04:04.071756 15265 rpcz_store.cc:276] 0709 13:04:02.057157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.065684 (+2008527us) service_pool.cc:224] Handling call
0709 13:04:04.065934 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.067617 (+  1683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.067653 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.067691 (+    38us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:04.067724 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.067796 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.067898 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:04.066428 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:04.066540 15193 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:04.000001 17084 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:04.081100 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.081750 15263 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:04.084637 15194 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:04.085263 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.028499 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:04.006981 17252 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.223s	user 0.001s	sys 0.001s
I20260709 13:04:04.089174 15195 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:04.072336 15264 rpcz_store.cc:276] 0709 13:04:02.026225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.018905 (+1992680us) service_pool.cc:224] Handling call
0709 13:04:04.019205 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.019367 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.019391 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.019436 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:04.019474 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.019542 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.019664 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:04.089738 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.087567 15193 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:04.106760 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.093873 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:03.981743 17265 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
W20260709 13:04:04.065104 17254 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:04:04.006839 17276 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:04.057901 17150 consensus_meta.cc:287] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.752s	user 0.006s	sys 0.005s
I20260709 13:04:04.006559 17220 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:04.139241 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:04.088188 17241 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:04:04.142819 17276 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:04.144136 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:04.144344 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1293) took 2920 ms. Trace:
I20260709 13:04:04.079603 17084 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:04.001093 17209 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.150254 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.075129 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:04.125576 17216 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.157410 15342 rpcz_store.cc:276] 0709 13:04:01.223899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.224012 (+   113us) service_pool.cc:224] Handling call
0709 13:04:01.241999 (+ 17987us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:01.275930 (+ 33931us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:01.307153 (+ 31223us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.929825 (+622672us) spinlock_profiling.cc:243] Waited 9.94 ms on lock 0x7b18001d8840. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1
0709 13:04:02.013189 (+ 83364us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b18001d8840. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:04.073184 (+2059995us) log.cc:844] Serialized 14 byte log entry
0709 13:04:04.075911 (+  2727us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:04.096276 (+ 20365us) log.cc:844] Serialized 582 byte log entry
0709 13:04:04.096486 (+   210us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:04.096535 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.096617 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.144101 (+ 47484us) raft_consensus.cc:1685] finished
0709 13:04:04.144129 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.144285 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19921,"prepare.queue_time_us":256001,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":117,"raft.queue_time_us":89098,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":43425,"spinlock_wait_cycles":37591552,"thread_start_us":2503266,"threads_started":2,"wal-append.queue_time_us":2300494}
I20260709 13:04:04.019783 17258 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.126s
I20260709 13:04:04.163116 15193 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
W20260709 13:04:04.165480 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.141721 17260 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:04.171396 17258 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:04.169454 15873 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:04.169914 17216 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.145252 17150 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.127704 17261 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:04.173950 17261 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:04.175071 17150 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.175350 15191 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:04.175441 17216 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.176151 17261 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:04.171792 17260 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.176745 17260 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.177553 17276 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.177865 16888 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.178553 17264 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:04.179366 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.180104 15194 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:04.180830 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.181429 17209 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.166381 15876 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:04.183333 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.184202 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.181798 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.178565 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.185263 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.186303 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.173300 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1190) took 3250 ms. Trace:
I20260709 13:04:04.187093 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.162539 17084 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.188405 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.189483 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.189975 15195 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:04.190249 15195 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:04.191695 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.192855 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.193838 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.198963 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.200038 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.183869 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.196254 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1143) took 3189 ms. Trace:
I20260709 13:04:04.197701 17303 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:04.194052 15189 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:04:04.211606 15197 raft_consensus.cc:2368] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:04:04.059259 17203 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.211001 15270 rpcz_store.cc:276] 0709 13:04:01.006474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.953613 (+1947139us) service_pool.cc:224] Handling call
0709 13:04:03.005049 (+ 51436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:03.005433 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.005482 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:03.006033 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:04:03.750023 (+743990us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:03.750078 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.750167 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.196051 (+445884us) raft_consensus.cc:1685] finished
0709 13:04:04.196078 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.196202 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51955,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":13835,"thread_start_us":682560,"threads_started":1,"wal-append.queue_time_us":1143888}
I20260709 13:04:04.186997 15271 rpcz_store.cc:276] 0709 13:04:00.922518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.101862 (+1179344us) service_pool.cc:224] Handling call
0709 13:04:02.102514 (+   652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.956760 (+854246us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:03.570954 (+614194us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.862298 (+291344us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.862361 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:03.862417 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.088506 (+226089us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b1800350020. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419
0709 13:04:04.173054 (+ 84548us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b5400011b54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:04.173107 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.173241 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11742,"prepare.queue_time_us":610196,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":100,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7806,"spinlock_wait_cycles":2020065792,"thread_start_us":904768,"threads_started":2,"wal-append.queue_time_us":625336}
I20260709 13:04:04.190960 15195 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.215413 15195 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.007719 17198 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:04.204454 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 220900us
I20260709 13:04:04.187462 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.201241 15268 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.221606 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1205) took 3077 ms. Trace:
I20260709 13:04:04.224901 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.239081 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.245276 15267 rpcz_store.cc:276] 0709 13:04:01.144583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.137258 (+1992675us) service_pool.cc:224] Handling call
0709 13:04:03.137690 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:03.866198 (+728508us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:03.866268 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:03.867604 (+  1336us) log.cc:844] Serialized 26 byte log entry
0709 13:04:04.133762 (+266158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:04.134597 (+   835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.134730 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:04.221320 (+ 86590us) raft_consensus.cc:1685] finished
0709 13:04:04.221347 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.221536 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74974,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":901387,"threads_started":2,"wal-append.queue_time_us":283270}
I20260709 13:04:04.285148 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.285988 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.200354 17200 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.157182 17220 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:04.223423 17291 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.211472 17039 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.211686 17278 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:04.293874 15162 connection.cc:256] RPC call timeout handler was delayed by -1.3944372869999597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:04:04.303846 15162 connection.cc:256] RPC call timeout handler was delayed by -1.2981372870000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:04:04.236111 16804 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:04.212918 17303 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:04.286201 15265 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:04.297263 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.322026 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.322374 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:04.297209 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 165583us
I20260709 13:04:04.325133 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:04.232198 17143 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:04.197746 17260 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:04.304173 15162 connection.cc:256] RPC call timeout handler was delayed by -1.1280372869999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1815s for a response
I20260709 13:04:04.231593 17024 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.295490 17253 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:04.320068 15190 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:04.286005 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.366075 15267 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.326406 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:04.329854 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.331245 15195 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:04.368357 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.369092 15195 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:04.371517 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:04.368221 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:04.332428 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.334587 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.358831 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.017393 15344 rpcz_store.cc:276] 0709 13:04:01.663543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.663966 (+   423us) service_pool.cc:224] Handling call
0709 13:04:01.664235 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.664415 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:03.221005 (+1556590us) log.cc:844] Serialized 14 byte log entry
0709 13:04:03.992289 (+771284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.992341 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:03.992385 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.992460 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.992571 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151089,"prepare.queue_time_us":152311,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":35945,"thread_start_us":2167277,"threads_started":2}
I20260709 13:04:04.372947 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.362313 15338 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:04.364073 15265 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:04.318058 17150 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.375502 15195 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:04.391400 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.389715 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:04.393774 15842 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:04.363310 17241 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.156s	user 0.007s	sys 0.002s
I20260709 13:04:04.401563 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.404305 15191 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
W20260709 13:04:04.404439 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.362893 17143 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.413012 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:04.402518 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 306689us
I20260709 13:04:04.402778 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.405757 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:04.324733 16804 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.418635 15191 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:04.406546 17189 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:04.323504 17261 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:04:04.421712 15346 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:04.422765 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:04.396771 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76043.9us
I20260709 13:04:04.428149 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.365595 17024 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.426537 15195 raft_consensus.cc:2410] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:04:04.419721 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.423612 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:04.414516 17294 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:04.387638 17148 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:04:04.434803 15267 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:04.422083 17209 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:04.424925 17020 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:04.411583 17283 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:04.443993 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.444983 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.411044 17313 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:04.404307 17150 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.451733 15195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:04.462163 15195 raft_consensus.cc:606] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:04.462674 15195 raft_consensus.cc:614] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:04.429384 17201 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:04.429837 17189 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:04.467761 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.469753 15267 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:04:04.436690 17294 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:04.445672 17209 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.443801 17204 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:04.431358 17111 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:04:04.470898 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:04.456082 17313 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.481745 17204 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:04.486578 17314 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:04:04.487463 17308 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:04:04.427217 17259 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:04:04.450802 17283 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:04.525105 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:04.495574 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 71668.4us
I20260709 13:04:04.530278 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:04.532887 15346 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:04:04.488862 17300 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:04:04.460304 17020 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:04.563314 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 138196us
I20260709 13:04:04.564178 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.567348 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.447460 17317 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:04:04.567911 15267 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.479967 17294 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.534395 17265 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:04.534509 17204 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.527930 17260 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:04.534713 17313 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.536443 17283 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.585873 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.484050 17209 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.589747 15267 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
W20260709 13:04:04.592846 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 168984us
I20260709 13:04:04.581852 17203 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.594417 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.578652 16978 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:04.577879 17200 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:04.582134 17265 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:04.606526 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.609872 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:04.610165 15195 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:04.610551 15338 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.612792 17143 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.618285 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:04.618753 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.621065 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.622051 15346 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:04:04.622854 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.623984 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.624292 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.624576 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:04.625339 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.625962 15345 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:04:04.628948 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.371731 17253 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.629557 15272 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:04:04.595402 17324 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:04:04.631009 17253 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.321386 17278 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.632306 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:04.632879 17286 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.923s	user 0.007s	sys 0.004s
I20260709 13:04:04.303311 17291 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.633082 17278 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.633474 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:04.633268 17286 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.612183 17198 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.422591 17303 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.634920 15265 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:04.635486 17220 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.635994 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.637398 17150 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.634338 15267 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:04.639577 17324 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:04.640027 17324 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:04.640825 17324 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.641957 15188 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:04.634934 17291 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.643854 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.641970 17324 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:04.647250 17286 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.622784 17020 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.654980 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:04.655804 15876 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:04.656116 17313 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.634994 15196 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:04.659721 17024 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.607247 16978 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.662083 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.609953 17265 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.665171 17204 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.668027 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.668474 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.683311 15190 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.687463 15267 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.662806 17313 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:04.619712 16804 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.689414 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.694932 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:04.695982 15267 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:04.699731 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.701817 15267 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:04.705312 15190 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:04.684960 16978 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:04.661630 17259 consensus_queue.cc:1175] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ca86ee1d194023b1414bbe226f4798" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:04:04.714466 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:04.720459 17204 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:04.721225 15265 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:04.703678 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.734409 15338 raft_consensus.cc:2410] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:04.733525 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.603480 17189 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.686160 17324 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:04:04.759348 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.722796 17313 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:04.781100 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 201232us
I20260709 13:04:04.783113 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.783227 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:04.783772 15266 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:04:04.784704 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.784931 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.785912 15266 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:04.738700 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.799307 15267 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:04.805128 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.806186 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:04.807412 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1201) took 3677 ms. Trace:
I20260709 13:04:04.807906 15269 rpcz_store.cc:276] 0709 13:04:01.130064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.116088 (+1986024us) service_pool.cc:224] Handling call
0709 13:04:03.116478 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.116726 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:03.794734 (+678008us) log.cc:844] Serialized 14 byte log entry
0709 13:04:04.806506 (+1011772us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b18000494e0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf 00007f36e5727038
0709 13:04:04.806757 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:04:04.806985 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.807063 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:04.807123 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.807206 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.807347 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23979,"prepare.queue_time_us":450564,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":20790,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":8156,"spinlock_wait_cycles":2796928,"thread_start_us":820220,"threads_started":2,"wal-append.queue_time_us":399763}
I20260709 13:04:04.737289 17317 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:04.735527 17119 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:04.804561 17324 consensus_queue.cc:1243] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:04.811741 17150 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:04.815395 17306 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:04:04.827067 17318 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:04:04.841724 15193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:04.844532 15193 raft_consensus.cc:606] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:04.844926 15193 raft_consensus.cc:614] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:04.818064 17325 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:04.737365 17283 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:04.814491 17286 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:04:04.836406 17084 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.648s	user 0.002s	sys 0.008s
I20260709 13:04:04.838500 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1217) took 2781 ms. Trace:
I20260709 13:04:04.852917 15263 rpcz_store.cc:276] 0709 13:04:02.057590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.082475 (+2024885us) service_pool.cc:224] Handling call
0709 13:04:04.082728 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.297572 (+214844us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.297600 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.297639 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:04.297669 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.838178 (+540509us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001b5154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:04.838257 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.838428 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493606144}
I20260709 13:04:04.854242 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.854774 15263 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:04.815243 17319 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.195s
I20260709 13:04:04.829561 17119 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:04.848510 17268 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.142s	user 0.003s	sys 0.009s
I20260709 13:04:04.812683 17313 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:04.864950 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.842190 17306 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:04.865983 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:04.890195 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.859174 17084 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.867874 17268 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.896631 15340 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:04.897037 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.897264 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:04.898435 15263 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:04.844648 17253 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:04:04.897610 15271 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:04.895910 17306 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.912076 17084 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:04.912575 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.912941 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.913326 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.913597 15271 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.914505 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.915460 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.915738 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.916090 15346 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:04.916355 15342 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:04.917285 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.918324 15341 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:04:04.918520 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:04.920867 15271 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:04.921568 17119 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.923417 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.924053 15343 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:04:04.924511 17268 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:04.885638 17336 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:04.852478 17273 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:04:04.928009 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 90056.9us
I20260709 13:04:04.928592 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.925904 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.929319 15346 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:04.931442 15197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:04.934132 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.852202 17325 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:04.964160 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.987308 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:04.968655 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.968219 17283 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:04.988795 17313 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:04.991245 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:04.981638 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:04.968431 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:04.957454 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.993212 15346 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:04.995607 15343 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:04:04.983744 17332 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:04:04.982728 17331 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:04:05.010246 15263 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:05.014989 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.016075 15341 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:05.015137 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.019207 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.039299 15868 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:05.039443 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.040126 15341 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:05.041347 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:04.997752 16804 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:04:05.044426 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.044576 15841 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:04.931135 17294 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.045857 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:05.046299 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:05.051162 15841 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.052608 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:05.055215 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.055137 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:04.931299 17336 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.059734 17209 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:05.063056 15272 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:05.063177 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.063804 15341 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:04:05.064546 17294 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:05.064754 17209 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:05.060491 17338 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.065433 17338 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.066808 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.067654 17338 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:05.047022 17283 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.068104 17268 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:05.055795 17276 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.060344 17325 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:05.067873 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.064646 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.073482 15338 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:05.073776 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.062033 17201 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.073675 15268 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:05.076005 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.076737 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.075048 17305 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.078864 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:05.078984 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.061576 17326 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:05.079253 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:05.097590 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 81670.8us
I20260709 13:04:05.101564 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.104120 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.080581 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.106606 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.108412 15269 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:05.108997 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.112890 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.114378 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.115140 15341 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:05.116323 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.117022 15341 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:05.119139 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.121390 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.118249 17335 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.136816 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.129743 17220 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:05.124120 17305 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.109855 17260 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:05.124873 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.077682 17325 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:04:05.124145 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.143505 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.144941 17335 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.153102 17335 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.123965 17313 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.155601 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.125396 17324 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.158263 15341 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:05.159287 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:05.159376 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:05.157338 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 107789us
I20260709 13:04:05.160851 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.168152 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:05.169536 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.170219 15341 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:05.171523 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.173954 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.143944 17260 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:05.210386 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.207726 17273 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.213025 17273 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.208745 15870 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:05.216526 15870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58400 (request call id 146) took 1233 ms. Trace:
I20260709 13:04:05.216691 17336 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:05.216899 15870 rpcz_store.cc:276] 0709 13:04:03.982764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.986818 (+  4054us) service_pool.cc:224] Handling call
0709 13:04:05.130611 (+1143793us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b58001d6498. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:04:05.142944 (+ 12333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:05.216217 (+ 73273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.216434 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11864960}
W20260709 13:04:05.218273 17355 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:04:05.219312 17364 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:04:05.220299 15839 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:05.173833 17285 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.220463 17260 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:05.211802 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 50663.7us
W20260709 13:04:05.227517 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 66724us
I20260709 13:04:05.170322 17335 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.157142 17358 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:05.222275 17265 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
W20260709 13:04:05.232599 17359 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:04:05.230608 17351 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:05.257447 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:05.260458 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.271539 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 111705us
I20260709 13:04:05.272217 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:05.246163 17320 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.677s	user 0.002s	sys 0.000s
I20260709 13:04:05.230473 17201 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:05.236263 17273 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:05.222204 16978 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.251124 17143 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:04:05.285035 17363 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:05.285446 17143 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:05.285575 17363 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:05.285851 17143 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:05.286650 17143 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.287642 15876 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:05.288273 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.289137 17305 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:05.289448 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:05.290261 17325 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:05.290467 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:05.290606 17325 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:05.291123 17201 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:05.291823 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.291553 17325 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.292555 15188 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:05.292062 17201 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.293360 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.293494 17325 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.294353 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.283881 17338 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:05.298822 17329 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:05.295650 17140 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:05.208900 17337 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:04:05.306771 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.236572 17360 raft_consensus.cc:2764] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:04:05.307546 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.243685 17361 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.286513 17363 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.249749 17123 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:05.236985 17265 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:05.314572 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 69192.3us
I20260709 13:04:05.316397 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:05.318123 15344 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:05.318178 17367 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:05.318953 17367 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:05.319983 17367 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.303054 17260 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.320937 15876 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:05.321139 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:05.321705 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1310) took 1028 ms. Trace:
I20260709 13:04:05.321913 17289 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:05.322207 15341 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:05.322342 17289 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:05.322983 17289 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.319337 16678 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:05.322111 15337 rpcz_store.cc:276] 0709 13:04:04.292968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.295011 (+  2043us) service_pool.cc:224] Handling call
0709 13:04:04.295458 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.314548 (+ 19090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.314593 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.314648 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:04.314693 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.321513 (+1006820us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5400424354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:05.321557 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.321657 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43288448}
I20260709 13:04:05.323571 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:05.332903 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.333554 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.331876 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.315301 17325 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:05.336050 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:05.338524 15271 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:05.340097 17140 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:05.338966 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:05.331092 17315 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:04:05.341364 17315 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:05.341701 17315 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:05.331846 16678 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:05.343974 17360 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:05.343756 16678 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.344411 17360 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.344810 17360 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.345046 16678 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.340474 17140 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:05.346397 17329 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.346724 17140 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.340478 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:05.348120 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.339214 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.349274 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:05.322417 17260 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:05.355257 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:05.342487 17315 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.330628 15876 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:05.364713 17265 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:05.359200 17264 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:05.368152 16978 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:05.339646 17325 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:05.370720 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.351401 17285 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:05.375200 15266 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.376549 15337 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:05.373500 15190 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:05.351562 17324 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.366732 17344 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:05.377902 17285 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:05.382598 17285 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.381143 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:05.383903 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:05.379386 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.381984 17265 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:05.387568 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.388514 15337 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
W20260709 13:04:05.388749 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.387090 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.396518 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.396687 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.389547 17368 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.394956 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45765.2us
I20260709 13:04:05.399626 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.406018 15266 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:05.408346 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:05.410503 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:05.413002 17368 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.420858 17368 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:05.421645 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:05.424731 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:05.426154 17313 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:05.409550 17329 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.397689 17344 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:05.439383 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.411687 17260 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.409569 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:05.480897 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.485800 15337 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:05.418772 17265 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:05.495826 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:05.416043 17337 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
W20260709 13:04:05.501230 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 93459.8us
I20260709 13:04:05.415475 17325 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.477293 17140 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.522099 17373 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:05.527109 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.529014 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1039) took 1330 ms. Trace:
I20260709 13:04:05.529371 15192 rpcz_store.cc:276] 0709 13:04:04.198873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.295193 (+ 96320us) service_pool.cc:224] Handling call
0709 13:04:05.526879 (+1231686us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8e9c 00007f36e25e8a5b 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:04:05.528954 (+  2075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4068608}
I20260709 13:04:05.530743 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.531352 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:05.531358 15271 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:05.531445 15268 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:05.575268 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:05.572003 17325 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.573851 17201 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:05.524690 17273 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:04:05.579963 17260 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.609273 17303 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:05.581388 17265 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:05.646448 17367 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:05.647400 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 146915us
I20260709 13:04:05.658063 17260 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.659677 17260 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.639278 17380 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:05.524480 17344 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.664037 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.667925 15269 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.666350 17367 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:05.667263 15188 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:05.670519 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.673223 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.670383 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.666945 17265 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.671927 17264 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:05.669577 17380 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.671849 17360 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.697088 15190 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:05.710675 15269 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:05.691995 17260 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:05.694078 17140 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:05.717044 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1019) took 1539 ms. Trace:
I20260709 13:04:05.717253 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.696151 17380 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:05.722041 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.719857 15189 rpcz_store.cc:276] 0709 13:04:04.177563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.183120 (+  5557us) service_pool.cc:224] Handling call
0709 13:04:05.716840 (+1533720us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b54001a5254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:05.716975 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22527232}
I20260709 13:04:05.722934 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:05.724138 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.724699 15189 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:05.725265 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.727546 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.728181 15341 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:05.728936 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:05.729830 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.729642 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.730603 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.731564 15341 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:05.734128 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.735607 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.691017 17264 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.739054 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.737600 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.745422 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.745055 15341 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:05.747985 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.697100 17285 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.745031 17289 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.756929 17393 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:05.757282 17143 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.750283 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.772217 15270 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:05.772281 15341 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:05.773953 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:05.774716 15269 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:05.728961 17380 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:05.760684 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.785513 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.776777 17393 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:05.913133 15192 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:05.913496 17392 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.015391 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:06.016320 15868 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:06.018833 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.914350 17329 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:05.776723 17330 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.020071 17330 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.917670 15189 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:06.020927 17330 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.021314 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.022500 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:05.918020 15342 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:06.023452 17384 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.024104 17384 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.024695 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1019) took 1107 ms. Trace:
I20260709 13:04:06.025089 15342 rpcz_store.cc:276] 0709 13:04:04.917330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.925518 (+  8188us) service_pool.cc:224] Handling call
0709 13:04:06.024536 (+1099018us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b54003ab1d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:06.024638 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2261239040}
I20260709 13:04:05.918288 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.919782 15270 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:05.920166 17380 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.920814 17289 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:06.035851 15337 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:05.923872 17285 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:05.924563 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.037760 15341 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:06.038388 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1040) took 1065 ms. Trace:
I20260709 13:04:06.039108 17380 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:05.931505 15191 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:06.014114 17392 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:05.935611 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:05.938599 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1307) took 1711 ms. Trace:
I20260709 13:04:06.044816 15340 rpcz_store.cc:276] 0709 13:04:04.226965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.227118 (+   153us) service_pool.cc:224] Handling call
0709 13:04:04.290620 (+ 63502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.896998 (+606378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.938255 (+1041257us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b540005ad54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:05.938527 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393265408}
I20260709 13:04:06.046545 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:05.940812 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48112 (request call id 74) took 1323 ms. Trace:
I20260709 13:04:06.048110 15344 rpcz_store.cc:276] 0709 13:04:04.617595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.618364 (+   769us) service_pool.cc:224] Handling call
0709 13:04:05.940580 (+1322216us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54003df254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:05.940716 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1602556160}
I20260709 13:04:05.942135 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.945640 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.950213 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.950968 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:05.958271 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:05.967741 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1013) took 1056 ms. Trace:
I20260709 13:04:06.052379 15338 rpcz_store.cc:276] 0709 13:04:04.911581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.912323 (+   742us) service_pool.cc:224] Handling call
0709 13:04:05.967484 (+1055161us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400176bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:05.967629 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368499072}
I20260709 13:04:05.968925 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1157) took 1337 ms. Trace:
I20260709 13:04:06.053828 15272 rpcz_store.cc:276] 0709 13:04:04.631413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.643598 (+ 12185us) service_pool.cc:224] Handling call
0709 13:04:05.968602 (+1325004us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54001d83d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:05.968811 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962232064}
I20260709 13:04:05.975713 15265 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:05.980168 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:05.982910 17324 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:05.985944 17315 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:06.058852 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 123313us
I20260709 13:04:05.989955 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1248) took 1402 ms. Trace:
I20260709 13:04:06.058990 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.990290 15345 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:06.000329 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1258) took 1072 ms. Trace:
I20260709 13:04:06.019636 15339 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 1.
I20260709 13:04:05.915874 17394 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.026691 15343 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:06.060721 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.061576 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.026347 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.038797 15341 rpcz_store.cc:276] 0709 13:04:04.973348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.786284 (+812936us) service_pool.cc:224] Handling call
0709 13:04:06.038315 (+252031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.062793 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.063490 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1039) took 1090 ms. Trace:
I20260709 13:04:06.063828 15341 rpcz_store.cc:276] 0709 13:04:04.973079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.062577 (+1089498us) service_pool.cc:224] Handling call
0709 13:04:06.063442 (+   865us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.060045 15188 rpcz_store.cc:276] 0709 13:04:04.927746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.307098 (+379352us) service_pool.cc:224] Handling call
0709 13:04:05.331736 (+ 24638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.668905 (+337169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.000085 (+331180us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54000c0dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:06.000264 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":771001728}
I20260709 13:04:06.064543 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.064334 17394 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.065191 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.065536 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1050) took 1086 ms. Trace:
I20260709 13:04:06.065840 15188 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:06.065932 15339 rpcz_store.cc:276] 0709 13:04:04.979245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.060463 (+1081218us) service_pool.cc:224] Handling call
0709 13:04:06.065478 (+  5015us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.046860 17306 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:06.047755 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:06.067317 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.072095 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:05.986799 17260 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:06.059772 15338 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:06.086773 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1038) took 1114 ms. Trace:
I20260709 13:04:06.073570 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.087193 15338 rpcz_store.cc:276] 0709 13:04:04.972826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.058733 (+1085907us) service_pool.cc:224] Handling call
0709 13:04:06.086726 (+ 27993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.064621 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:05.932840 15842 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:06.089577 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 156833us
I20260709 13:04:06.065320 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1326) took 1074 ms. Trace:
I20260709 13:04:06.066812 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.090440 15340 rpcz_store.cc:276] 0709 13:04:04.990837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.057870 (+1067033us) service_pool.cc:224] Handling call
0709 13:04:06.065266 (+  7396us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.090912 15188 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:05.939705 15196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1011) took 1929 ms (client timeout 1593 ms). Trace:
W20260709 13:04:06.091226 15196 rpcz_store.cc:269] 0709 13:04:04.010391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.013110 (+  2719us) service_pool.cc:224] Handling call
0709 13:04:05.939523 (+1926413us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54003e67d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:05.939649 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1423601920}
I20260709 13:04:06.088584 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1327) took 1096 ms. Trace:
I20260709 13:04:06.093765 15338 rpcz_store.cc:276] 0709 13:04:04.991685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.087846 (+1096161us) service_pool.cc:224] Handling call
0709 13:04:06.088140 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.088301 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.088326 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.088366 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.088398 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.088450 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.088539 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:05.926235 17264 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:06.056565 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:06.095726 15190 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:06.092315 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.096990 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:06.097893 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1054) took 1114 ms. Trace:
I20260709 13:04:06.098280 15341 rpcz_store.cc:276] 0709 13:04:04.984159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.064415 (+1080256us) service_pool.cc:224] Handling call
0709 13:04:06.097838 (+ 33423us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.066852 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.094880 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.099661 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1059) took 1060 ms. Trace:
I20260709 13:04:06.100106 15343 rpcz_store.cc:276] 0709 13:04:05.039569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.094630 (+1055061us) service_pool.cc:224] Handling call
0709 13:04:06.099587 (+  4957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.101270 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.099684 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1329) took 1104 ms. Trace:
I20260709 13:04:06.102901 15341 rpcz_store.cc:276] 0709 13:04:04.994828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.098895 (+1104067us) service_pool.cc:224] Handling call
0709 13:04:06.099244 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.099408 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.099432 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.099474 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.099503 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.099552 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.099639 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.102046 15343 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:04:06.105777 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.107321 15339 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:06.066985 17394 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:06.108469 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.108691 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.109331 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:06.107995 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1052) took 1128 ms. Trace:
I20260709 13:04:06.113220 15339 rpcz_store.cc:276] 0709 13:04:04.979788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.066638 (+1086850us) service_pool.cc:224] Handling call
0709 13:04:06.107926 (+ 41288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.059448 15195 rpcz_store.cc:276] 0709 13:04:04.587803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.661985 (+ 74182us) service_pool.cc:224] Handling call
0709 13:04:04.662274 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.662477 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:04.687730 (+ 25253us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.942783 (+1255053us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b1800396f40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e95e158f 00007f36e2620571 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd
0709 13:04:05.946420 (+  3637us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.989482 (+ 43062us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:05.989547 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:05.989608 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.989702 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.989867 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1287937,"prepare.queue_time_us":1198729,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":85,"raft.queue_time_us":68503,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":3141,"spinlock_wait_cycles":16936832,"thread_start_us":94871,"threads_started":1,"wal-append.queue_time_us":177270}
I20260709 13:04:06.109719 15343 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:06.114874 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.057627 17324 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:06.124087 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.128216 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:06.129098 15343 raft_consensus.cc:2410] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:04:06.129484 15237 connection.cc:256] RPC call timeout handler was delayed by -1.2025220020000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3128s for a response
I20260709 13:04:06.129617 15342 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:06.067133 17204 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:06.131592 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.131816 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1044) took 1157 ms. Trace:
I20260709 13:04:06.132326 15337 rpcz_store.cc:276] 0709 13:04:04.974430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.495356 (+520926us) service_pool.cc:224] Handling call
0709 13:04:06.131670 (+636314us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b54000965d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:06.131763 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1202542464}
I20260709 13:04:06.132405 15342 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:04:06.097604 17220 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.146561 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.140189 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.097160 17326 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.146234 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.147883 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.148870 15343 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:06.149899 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.150607 15343 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:06.151626 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.152340 15343 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:06.153352 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.148406 15340 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 1.
I20260709 13:04:06.109457 17294 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:06.154040 15343 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:06.122973 17260 consensus_queue.cc:1243] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:06.120015 17264 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.133584 17204 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.127389 17291 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:06.133802 15868 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:06.130761 17224 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.130890 17281 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.157642 17294 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.162724 17204 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.161466 17393 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:06.162555 17324 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.167309 17392 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:06.173910 17330 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.184384 17384 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:06.189224 17360 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:06.229116 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:06.233412 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.234822 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.235116 15194 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:06.122242 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:06.235719 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:06.237351 15196 raft_consensus.cc:2368] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:04:06.240099 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:06.241737 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:06.238754 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.244086 15188 raft_consensus.cc:2368] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:06.240257 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.244175 15196 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:06.233219 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.251197 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.252225 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:06.237147 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.256584 15268 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:04:06.258529 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:06.256317 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:06.259775 15190 raft_consensus.cc:2368] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:06.260103 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:06.260174 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.261039 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.254196 15272 raft_consensus.cc:1217] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:04:06.262494 15272 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:04:06.245479 15263 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:06.254180 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.261639 15188 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:06.254853 15189 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:06.265141 15196 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:06.265542 15188 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:06.255318 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:06.245960 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:06.273553 15263 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:06.268347 15189 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:06.261580 15195 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:06.275408 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.276574 15189 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:06.278844 15188 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:06.245241 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1174) took 1190 ms. Trace:
W20260709 13:04:06.286037 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.137681 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.288552 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.288903 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.290323 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.291695 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.295147 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.298171 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1321) took 1333 ms. Trace:
I20260709 13:04:06.300164 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.306100 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:06.307850 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 56) took 10884 ms. Trace:
I20260709 13:04:06.182510 17324 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:06.319959 17291 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:06.262934 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.331805 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:06.333775 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 88194.9us
I20260709 13:04:06.335752 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:06.336376 17330 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:06.313061 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 84546.5us
I20260709 13:04:06.347843 15340 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:06.349622 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.350183 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:06.350530 15339 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:06.350867 15269 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.351833 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.353670 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.176386 17294 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:06.363363 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.365414 15194 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:06.369421 15342 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:06.370733 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.371671 15342 raft_consensus.cc:2376] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6. Re-sending same reply.
I20260709 13:04:06.373239 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.374243 15342 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:06.325232 15093 rpcz_store.cc:276] 0709 13:03:55.422875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.423146 (+   271us) service_pool.cc:224] Handling call
0709 13:04:06.307592 (+10884446us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:04.197609 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:04.198177 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:04.198206 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:04:04.198245 (+    39us) tablet.cc:662] Decoding operations
0709 13:04:04.199081 (+   836us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:04.199140 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:04.199165 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:04:04.199757 (+   592us) tablet.cc:701] Row locks acquired
0709 13:04:04.199771 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:04:04.199909 (+   138us) write_op.cc:270] Start()
0709 13:04:04.200013 (+   104us) write_op.cc:276] Timestamp: P: 1783602244199863 usec, L: 0
0709 13:04:04.200039 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:04:04.200717 (+   678us) log.cc:844] Serialized 3150 byte log entry
0709 13:04:04.927597 (+726880us) op_driver.cc:464] REPLICATION: finished
0709 13:04:05.143184 (+215587us) write_op.cc:301] APPLY: starting
0709 13:04:05.145292 (+  2108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:05.145519 (+   227us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:05.145644 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:05.281770 (+136126us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:05.295468 (+ 13698us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:04:05.295518 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:05.295786 (+   268us) log.cc:844] Serialized 58 byte log entry
0709 13:04:05.295957 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.296074 (+   117us) write_op.cc:454] Released schema lock
0709 13:04:05.296115 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:05.296512 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:05.296539 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":136274,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":187356,"apply.run_cpu_time_us":3713,"apply.run_wall_time_us":156826,"num_ops":7,"prepare.queue_time_us":956958,"prepare.run_cpu_time_us":14559,"prepare.run_wall_time_us":465649,"raft.queue_time_us":144109,"raft.run_cpu_time_us":18155,"raft.run_wall_time_us":242458,"replication_time_us":692559,"thread_start_us":1326346,"threads_started":4,"wal-append.queue_time_us":491097,"wal-append.run_cpu_time_us":47329,"wal-append.run_wall_time_us":1629039}]]}
I20260709 13:04:06.387960 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.388863 15338 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:06.390185 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.395002 15339 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:06.395740 15197 raft_consensus.cc:606] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:06.395937 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1255) took 1745 ms. Trace:
I20260709 13:04:06.396447 15197 raft_consensus.cc:614] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:06.397493 17360 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:06.398192 15194 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:06.399572 17373 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:06.400151 17373 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.400622 17373 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:06.397856 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 108052us
I20260709 13:04:06.405046 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:06.324415 15345 rpcz_store.cc:276] 0709 13:04:04.964063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.964196 (+   133us) service_pool.cc:224] Handling call
0709 13:04:05.943174 (+978978us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:06.059972 (+116798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.296727 (+236755us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b54003df254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:06.297635 (+   908us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54003df250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:06.297887 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2358393984}
I20260709 13:04:06.407883 17379 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:06.409240 17379 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:06.396508 15193 rpcz_store.cc:276] 0709 13:04:04.650607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.845713 (+195106us) service_pool.cc:224] Handling call
0709 13:04:04.846061 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.846296 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:05.949276 (+1102980us) log.cc:844] Serialized 14 byte log entry
0709 13:04:06.395279 (+446003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.395407 (+   128us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.395470 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.395545 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.395719 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1262881,"prepare.queue_time_us":1105947,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":26918,"raft.queue_time_us":167831,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":291,"spinlock_wait_cycles":197504,"thread_start_us":285821,"threads_started":1,"wal-append.queue_time_us":200964}
I20260709 13:04:06.408937 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:06.413426 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.414036 15345 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:06.415287 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.416414 15345 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:06.416523 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.398823 17360 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.418643 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.167589 17224 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.419618 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.328395 17291 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:06.396394 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.418916 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:06.424853 17291 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.428488 15337 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:06.323464 15267 rpcz_store.cc:276] 0709 13:04:05.054256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.054394 (+   138us) service_pool.cc:224] Handling call
0709 13:04:05.054677 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:05.055547 (+   870us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:05.095408 (+ 39861us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.944822 (+849414us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18003546a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:04:06.244262 (+299440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.244425 (+   163us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.244597 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.244737 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.245003 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39259,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":27111,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":1067,"spinlock_wait_cycles":7473920,"thread_start_us":296908,"threads_started":2,"wal-append.queue_time_us":1081424}
I20260709 13:04:06.441241 17412 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:06.445956 15271 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:06.445834 17415 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:06.449326 17415 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.449802 17415 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:06.458545 17224 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:06.465520 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 130097us
I20260709 13:04:06.467972 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:06.471319 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:06.398747 17285 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:04:06.472316 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:06.160655 17264 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.457582 17291 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:06.493928 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 128248us
I20260709 13:04:06.500150 15343 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:06.500692 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1336) took 1226 ms. Trace:
I20260709 13:04:06.500908 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1334) took 1226 ms. Trace:
I20260709 13:04:06.501102 15342 rpcz_store.cc:276] 0709 13:04:05.274707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.499170 (+1224463us) service_pool.cc:224] Handling call
0709 13:04:06.499660 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.500343 (+   683us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:06.500372 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.500431 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.500459 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.500512 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.500618 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.501260 15343 rpcz_store.cc:276] 0709 13:04:05.274159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.459166 (+1185007us) service_pool.cc:224] Handling call
0709 13:04:06.459692 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.499792 (+ 40100us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b54000a9720. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5684dc0 00007f36e570f1c0 00007f36e5710231 00007f36e570cd8f 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c
0709 13:04:06.500664 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.500837 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57719680}
I20260709 13:04:06.474633 17360 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:06.444978 17379 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.485383 17224 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.509732 17385 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:04:06.520658 17416 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:06.521260 17385 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:06.521806 17385 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:06.521822 15340 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:06.535338 17205 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:06.542492 17338 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:06.543737 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:06.543871 17385 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.554505 15343 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:06.561582 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1337) took 1244 ms. Trace:
W20260709 13:04:06.567318 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 97821.9us
W20260709 13:04:06.571394 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.573119 15269 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:06.575930 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 84) took 1289 ms. Trace:
I20260709 13:04:06.576428 15342 rpcz_store.cc:276] 0709 13:04:05.286963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.502331 (+1215368us) service_pool.cc:224] Handling call
0709 13:04:06.560651 (+ 58320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.575407 (+ 14756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.575444 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.575583 (+   139us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:06.575615 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.575685 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.575838 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.577726 17365 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:06.580013 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:06.580894 15265 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:04:06.562323 15343 rpcz_store.cc:276] 0709 13:04:05.316838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.510503 (+1193665us) service_pool.cc:224] Handling call
0709 13:04:06.533850 (+ 23347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.558098 (+ 24248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.561393 (+  3295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.585896 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46386 (request call id 10) took 1692 ms. Trace:
I20260709 13:04:06.579016 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1339) took 1250 ms. Trace:
I20260709 13:04:06.597054 15342 rpcz_store.cc:276] 0709 13:04:05.328658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.577601 (+1248943us) service_pool.cc:224] Handling call
0709 13:04:06.578178 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.578652 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.578682 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.578727 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:06.578757 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.578818 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.578932 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.601297 17393 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:06.595510 15197 rpcz_store.cc:276] 0709 13:04:04.893894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.927163 (+ 33269us) service_pool.cc:224] Handling call
0709 13:04:06.585612 (+1658449us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54001a4854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5707853 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691 00007f36e3c5b60c 00007f36e3c5a8c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:06.585755 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3365900160}
I20260709 13:04:06.557353 17338 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:06.611593 17315 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:06.612113 17385 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:06.615345 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 148371us
W20260709 13:04:06.619527 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47247.6us
W20260709 13:04:06.627794 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.630008 17335 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:06.630667 17335 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:06.632346 17335 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.635444 17401 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:04:06.637733 17392 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:06.638266 17392 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:06.639431 17392 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.641480 17392 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.641609 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.644814 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.605535 17224 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:06.634361 17335 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.582998 17294 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:06.669039 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.671432 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.685592 15188 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:06.688486 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:06.689924 17291 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:06.690150 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.695528 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1342) took 1366 ms. Trace:
I20260709 13:04:06.696345 15342 rpcz_store.cc:276] 0709 13:04:05.329627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.598865 (+1269238us) service_pool.cc:224] Handling call
0709 13:04:06.622290 (+ 23425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.691461 (+ 69171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.691487 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.695118 (+  3631us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.695177 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.695263 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.695430 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.704226 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1341) took 1375 ms. Trace:
I20260709 13:04:06.704805 15343 rpcz_store.cc:276] 0709 13:04:05.329240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.607756 (+1278516us) service_pool.cc:224] Handling call
0709 13:04:06.657895 (+ 50139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.698911 (+ 41016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.698952 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.703850 (+  4898us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.703903 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.704007 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.704155 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:06.706668 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 137643us
W20260709 13:04:06.713862 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 78794.3us
W20260709 13:04:06.711041 17306 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.004s
I20260709 13:04:06.730332 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:06.692821 17224 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:06.759017 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:06.759681 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.761318 15343 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:06.762176 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1345) took 1431 ms. Trace:
I20260709 13:04:06.762540 15343 rpcz_store.cc:276] 0709 13:04:05.330540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.711947 (+1381407us) service_pool.cc:224] Handling call
0709 13:04:06.748506 (+ 36559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.761876 (+ 13370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.762113 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.767573 17264 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:06.768621 15197 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:06.769027 15197 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:06.769126 17330 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:06.769636 17330 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:06.770066 15197 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.749193 17291 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.771339 16678 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:06.776082 17394 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:06.778801 15197 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:06.747339 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 248101us
I20260709 13:04:06.782809 15191 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:04:06.784739 16678 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:06.785301 15188 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:06.786178 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 125107us
I20260709 13:04:06.785915 16678 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.787127 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:06.788384 17412 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:06.788798 17412 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:06.789168 17412 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:06.801612 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1332) took 1791 ms. Trace:
I20260709 13:04:06.778203 17394 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:06.799853 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1343) took 1469 ms. Trace:
I20260709 13:04:06.806532 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:06.804171 15342 rpcz_store.cc:276] 0709 13:04:05.330047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.701219 (+1371172us) service_pool.cc:224] Handling call
0709 13:04:06.757751 (+ 56532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.792760 (+ 35009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.792802 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.799503 (+  6701us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.799561 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.799645 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.799777 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.747210 17338 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.802045 15338 rpcz_store.cc:276] 0709 13:04:05.007585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.442624 (+1435039us) service_pool.cc:224] Handling call
0709 13:04:06.448172 (+  5548us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:06.522744 (+ 74572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.522776 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:06.523529 (+   753us) log.cc:844] Serialized 52 byte log entry
0709 13:04:06.693070 (+169541us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:06.694094 (+  1024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.694184 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.798955 (+104771us) raft_consensus.cc:1685] finished
0709 13:04:06.798980 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.799143 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87387,"raft.queue_time_us":37380,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":5115,"spinlock_wait_cycles":18816,"thread_start_us":166220,"threads_started":1,"wal-append.queue_time_us":270355}
I20260709 13:04:06.815449 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1335) took 1541 ms. Trace:
I20260709 13:04:06.812740 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1347) took 1323 ms. Trace:
I20260709 13:04:06.817910 15342 rpcz_store.cc:276] 0709 13:04:05.489214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.811253 (+1322039us) service_pool.cc:224] Handling call
0709 13:04:06.811806 (+   553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.812203 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.812241 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.812330 (+    89us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.812420 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.812508 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.812668 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.770741 17330 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.821818 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:06.816732 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 86599.8us
I20260709 13:04:06.820797 15339 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:06.817440 15345 rpcz_store.cc:276] 0709 13:04:05.274466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.469334 (+1194868us) service_pool.cc:224] Handling call
0709 13:04:06.474166 (+  4832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:06.520117 (+ 45951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.520155 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:06.520892 (+   737us) log.cc:844] Serialized 26 byte log entry
0709 13:04:06.701944 (+181052us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:06.701986 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.702048 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.815166 (+113118us) raft_consensus.cc:1685] finished
0709 13:04:06.815195 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.815379 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34705,"raft.queue_time_us":39146,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"thread_start_us":180615,"threads_started":1,"wal-append.queue_time_us":281626}
I20260709 13:04:06.800982 17315 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:04:06.818970 17264 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.837790 17401 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:06.833808 17204 consensus_meta.cc:287] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.008s
I20260709 13:04:06.844195 17204 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.850898 17330 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:06.856415 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.875586 15343 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:06.857213 15346 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:04:06.878938 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 78413us
I20260709 13:04:06.877173 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1346) took 1395 ms. Trace:
I20260709 13:04:06.881163 15343 rpcz_store.cc:276] 0709 13:04:05.482037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.777640 (+1295603us) service_pool.cc:224] Handling call
0709 13:04:06.817553 (+ 39913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.876974 (+ 59421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.877132 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.815062 17373 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:06.882244 15197 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:06.885236 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:06.888876 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1350) took 1364 ms. Trace:
I20260709 13:04:06.889302 15337 rpcz_store.cc:276] 0709 13:04:05.524704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.828915 (+1304211us) service_pool.cc:224] Handling call
0709 13:04:06.878495 (+ 49580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.888591 (+ 10096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.888615 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.888654 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:06.888679 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.888728 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.888825 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:06.895653 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 84983us
I20260709 13:04:06.819414 17394 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.891862 17384 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.902619 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1348) took 1402 ms. Trace:
I20260709 13:04:06.900313 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:06.904078 15338 rpcz_store.cc:276] 0709 13:04:05.500575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.822481 (+1321906us) service_pool.cc:224] Handling call
0709 13:04:06.884998 (+ 62517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.902355 (+ 17357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.902374 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.902404 (+    30us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:06.902422 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.902464 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.902557 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.897243 17360 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:04:06.907802 17384 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.908635 17360 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:06.909016 17366 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.909166 17360 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:06.911237 17294 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:06.912930 17373 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:06.913885 17326 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.757s	user 0.012s	sys 0.005s
I20260709 13:04:06.914361 17326 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:06.910777 17360 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:06.915207 17220 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.915442 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1351) took 1341 ms. Trace:
I20260709 13:04:06.915988 15345 rpcz_store.cc:276] 0709 13:04:05.573635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.829450 (+1255815us) service_pool.cc:224] Handling call
0709 13:04:06.883804 (+ 54354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.915104 (+ 31300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.915142 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.915185 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.915217 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.915273 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.915389 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.924934 15339 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:06.886585 17264 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:06.926175 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:06.929953 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1352) took 1313 ms. Trace:
I20260709 13:04:06.930524 15343 rpcz_store.cc:276] 0709 13:04:05.616419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.882101 (+1265682us) service_pool.cc:224] Handling call
0709 13:04:06.903190 (+ 21089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.929505 (+ 26315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.929547 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.929608 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:06.929650 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.929734 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.929883 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.887135 17415 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:06.933933 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.892154 17393 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:04:06.932412 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1333) took 1922 ms. Trace:
I20260709 13:04:06.944481 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1353) took 1324 ms. Trace:
I20260709 13:04:06.945297 15337 rpcz_store.cc:276] 0709 13:04:05.619691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.894865 (+1275174us) service_pool.cc:224] Handling call
0709 13:04:06.936170 (+ 41305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.943904 (+  7734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.943956 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.944023 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.944091 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.944201 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.944394 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.904850 17224 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:06.952672 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53798.5us
I20260709 13:04:06.923205 17419 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.957895 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1354) took 1336 ms. Trace:
W20260709 13:04:06.959507 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 74352.6us
I20260709 13:04:06.959625 15338 rpcz_store.cc:276] 0709 13:04:05.621898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.907160 (+1285262us) service_pool.cc:224] Handling call
0709 13:04:06.943745 (+ 36585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.957273 (+ 13528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.957320 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.957375 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.957421 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.957506 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.957808 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:06.937114 17220 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:06.962229 17260 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:06.964293 17220 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:06.965205 15095 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 4 to 2, term changed from 4 to 3, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from VOTER to NON_VOTER. New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
W20260709 13:04:06.967191 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45498.3us
I20260709 13:04:06.969014 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:06.969754 17291 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:06.970245 17291 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:06.970649 17291 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:06.974745 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67748.4us
I20260709 13:04:06.941448 15341 rpcz_store.cc:276] 0709 13:04:05.010132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.439536 (+1429404us) service_pool.cc:224] Handling call
0709 13:04:06.440189 (+   653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:06.440838 (+   649us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:06.622214 (+181376us) log.cc:844] Serialized 14 byte log entry
0709 13:04:06.919077 (+296863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:06.919142 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:06.932099 (+ 12957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.932189 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.932349 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":267572,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3837,"raft.queue_time_us":21812,"thread_start_us":394052,"threads_started":2}
I20260709 13:04:06.976752 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:06.979846 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1338) took 1662 ms. Trace:
I20260709 13:04:06.980377 15340 rpcz_store.cc:276] 0709 13:04:05.317356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.575852 (+1258496us) service_pool.cc:224] Handling call
0709 13:04:06.576381 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:06.586698 (+ 10317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:06.586727 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:06.587289 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 13:04:06.827132 (+239843us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:06.827171 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:06.827219 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:06.979605 (+152386us) raft_consensus.cc:1685] finished
0709 13:04:06.979627 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:06.979779 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9745,"raft.queue_time_us":23869,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":234,"thread_start_us":232344,"threads_started":1,"wal-append.queue_time_us":330395}
W20260709 13:04:06.987540 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 92976.4us
I20260709 13:04:06.987495 15870 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:06.995640 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:06.992262 17204 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:06.999552 17394 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.010103 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.013320 17358 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.007057 17360 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.017429 17325 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:07.017894 17325 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.018290 17325 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.017612 17324 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:07.019776 17424 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.132s	user 0.002s	sys 0.001s
I20260709 13:04:07.017565 17329 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:07.020488 17329 consensus_queue.cc:1243] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:04:07.026221 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.025830 17415 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.029608 17393 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.030440 17393 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.032666 17338 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.034509 17393 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:07.022298 17401 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.036041 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:07.036183 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.015450 17373 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:04:07.036777 15264 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.037060 17415 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:07.037652 17415 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.038126 17415 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:07.040756 15346 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1029) took 2071 ms (client timeout 1686 ms). Trace:
W20260709 13:04:07.041203 15346 rpcz_store.cc:269] 0709 13:04:04.969549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:05.078730 (+109181us) service_pool.cc:224] Handling call
0709 13:04:07.040488 (+1961758us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400059e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:07.040660 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3749335936}
I20260709 13:04:07.042833 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.043493 15344 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:07.043656 15188 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:07.045975 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1323) took 2057 ms. Trace:
I20260709 13:04:07.046303 15344 rpcz_store.cc:276] 0709 13:04:04.988345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.086910 (+1098565us) service_pool.cc:224] Handling call
0709 13:04:07.042977 (+956067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:07.043912 (+   935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.045765 (+  1853us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400059e50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:07.045901 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112566016}
I20260709 13:04:07.025573 17358 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.052321 17384 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.052948 17358 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.055730 15095 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 2 to 3, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:07.034783 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.013782 17224 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.068385 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.069756 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.071115 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.071818 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:07.072022 17204 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.072465 17264 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.072551 15870 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:07.074921 15311 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:06.999545 17419 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.076336 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.077232 17224 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.078271 17419 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.079916 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.083153 17392 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:07.023967 17412 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.084354 17385 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:07.084431 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49712us
I20260709 13:04:07.076062 17415 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.090018 15264 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
I20260709 13:04:07.084647 17324 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:07.095939 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.102175 17379 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:07.103200 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.093890 17325 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.126317 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:07.109546 17385 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:07.137712 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 106840us
I20260709 13:04:07.132086 17204 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:07.133615 17385 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.135178 17224 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.141234 17329 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.155565 17329 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.157866 17329 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:07.162173 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 81595.9us
I20260709 13:04:07.163445 17205 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:07.163918 17205 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.164052 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.164201 17291 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.164922 17205 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.165654 17224 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:07.172114 17224 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.172554 17224 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.165483 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:07.175354 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.175866 15868 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:07.175937 17325 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.144558 17335 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:04:07.177577 17412 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.181053 17415 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.176169 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.183966 17285 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.189148 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.194057 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.195009 17335 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:07.195498 17335 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:07.196408 17335 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:07.189149 17291 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.197878 17335 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.199581 17373 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.200665 17325 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:07.201123 17325 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.201543 17325 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.203280 17264 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.208637 16678 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:07.209813 17205 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.200335 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.222337 15268 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:04:07.226468 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 168988us
I20260709 13:04:07.232211 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.232859 15192 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.236756 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.237498 15264 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:07.242710 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.221379 17224 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.243916 17325 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.246075 17224 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.247810 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.253021 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.254158 15197 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:07.256595 15192 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.257519 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:07.258172 15269 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.259124 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:07.263512 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.263422 17264 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.269690 17264 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.270694 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.275580 17324 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:07.276298 17325 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.272177 17224 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:07.277264 16678 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:07.283501 15264 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:07.285581 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:07.288280 17264 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:07.290524 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47902.8us
I20260709 13:04:07.290975 17437 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.291872 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.293983 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.298416 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:07.298815 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:07.299202 15344 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:04:07.300806 17373 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:07.300963 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:07.301331 17373 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.301909 17431 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:07.294785 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.302488 17431 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.302739 17329 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.302377 17373 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.303889 17373 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.303674 17431 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.292692 17385 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.293099 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.283226 17324 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:07.308667 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:07.309319 15238 leader_election.cc:400] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:04:07.309620 15238 leader_election.cc:403] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:04:07.309082 17324 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.311400 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.311523 17429 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:07.311784 17329 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:07.312340 15272 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.315148 15238 leader_election.cc:400] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:07.315523 15238 leader_election.cc:403] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:07.315640 17385 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:07.316154 17291 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5.
I20260709 13:04:07.316817 17291 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:07.316810 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:07.317716 17291 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:07.318217 17291 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.318648 17291 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.317940 15868 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:07.311650 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.311728 15265 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:07.323908 15269 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.325829 15264 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:07.327706 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.283537 17224 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.330667 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.334892 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.335552 15196 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.335807 15188 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.332717 17329 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.339505 15263 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:07.339542 17329 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.343202 17329 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.342871 15196 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:07.343812 15868 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:07.343998 15238 leader_election.cc:400] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:07.344384 15238 leader_election.cc:403] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:07.345225 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.345294 17415 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:07.346113 17412 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.347618 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.348631 17412 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:07.344642 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51617us
I20260709 13:04:07.352854 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:07.353986 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.352793 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.359239 17338 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.359767 17338 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.361699 17338 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.362011 17385 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:07.361642 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.362586 17385 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.363070 17385 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.361755 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.355348 17224 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.370150 17412 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.371783 17285 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.372388 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.373270 17285 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:07.373481 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.374500 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.378206 15193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:07.378893 15193 raft_consensus.cc:606] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.379251 15193 raft_consensus.cc:614] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:07.379479 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:07.380604 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:07.381727 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51319.6us
I20260709 13:04:07.381857 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.382099 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.382429 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.382792 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.342937 17291 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.375802 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.377228 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.374889 17285 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:07.385046 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.391212 15269 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:07.401592 15272 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:07.407188 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:07.411741 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 59097us
I20260709 13:04:07.413195 15311 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:07.414009 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.416525 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.411796 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.426985 17390 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:04:07.428663 17385 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.430294 17204 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.423090 17401 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:07.430318 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:07.434080 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.411646 17429 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.400736 17329 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:07.439793 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48239.2us
I20260709 13:04:07.445725 17220 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.403505 17285 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.409039 17412 raft_consensus.cc:2764] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:04:07.422919 17264 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:07.436779 17401 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.440202 17315 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:07.468492 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.447800 17419 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:07.416855 17366 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:04:07.451817 17415 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:07.446653 17220 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.449882 17385 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.454887 17365 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:04:07.489797 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 110418us
I20260709 13:04:07.475878 17401 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.486590 17415 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:07.493925 17415 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.494719 17429 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:07.497364 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67108.6us
I20260709 13:04:07.480137 17315 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.460464 17360 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:04:07.505927 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.508352 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.505599 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:07.510469 15272 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.512827 17384 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.513458 17438 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.513597 17384 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.514060 17438 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.516165 17438 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.517786 17220 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.518674 15841 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.520573 15841 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.505266 17315 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.531850 17419 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.532137 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.532642 17419 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:07.533012 17419 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:07.533290 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 56760us
I20260709 13:04:07.533866 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.533401 17419 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.536386 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:07.537949 15271 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.540242 15190 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:07.459271 17285 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.531872 17291 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.501319 17324 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:04:07.604032 15272 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:07.538955 17204 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:07.583220 17437 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.611195 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.632844 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.633842 15190 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.595661 17412 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:07.635179 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:07.635210 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.605544 17394 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.643914 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:07.609748 17329 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.631968 17379 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:07.633641 17224 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.611822 17204 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.645673 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.650735 15265 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:07.637552 17285 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:07.667900 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 133026us
I20260709 13:04:07.637185 17335 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.646615 17429 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:07.670452 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 68545.2us
I20260709 13:04:07.635708 17264 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:07.637867 17412 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.673389 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.658592 17204 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.644193 17451 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.648449 17379 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.647001 17291 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.650552 17224 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.683085 15190 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:07.685459 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.669883 17335 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.686362 15191 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.655767 17394 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.680217 17412 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.689640 15344 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 4: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:07.692600 17401 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.694676 17260 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.695254 17384 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.695333 17401 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.697575 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:07.645705 17329 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.702347 15271 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:07.704025 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:07.704862 15868 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:07.705963 17394 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:07.707180 17448 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:04:07.684317 17365 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.672797 17431 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
W20260709 13:04:07.710443 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 266927us
I20260709 13:04:07.712742 17329 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.713052 17338 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:07.713616 17338 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:07.714720 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.718348 15272 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:07.717803 17264 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.718670 15195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:07.719312 15195 raft_consensus.cc:606] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:07.720463 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.721068 15264 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:07.721537 15188 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
W20260709 13:04:07.731245 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 85640.7us
I20260709 13:04:07.733629 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:07.734889 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:07.714614 17338 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.738775 15268 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:07.741156 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.741935 15191 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:04:07.743002 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.748337 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
W20260709 13:04:07.748742 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48996.6us
W20260709 13:04:07.751176 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 63062.1us
I20260709 13:04:07.734730 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:07.754133 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:07.749881 17224 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.755748 15267 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:07.753109 17412 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.756213 17451 raft_consensus.cc:2764] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:04:07.782650 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.783365 15268 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:07.788323 15342 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:07.783725 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:07.802071 15344 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.789439 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.796180 15263 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:07.794896 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.772760 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:07.813107 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.789839 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:07.791966 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:07.818526 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:07.818756 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.763599 17455 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:07.819247 15345 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:07.757266 17457 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:07.821754 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:07.777174 17335 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:07.836993 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.838271 15194 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.826535 17457 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.840874 17457 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.790983 15868 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:07.837744 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.792872 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:07.756887 17329 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:07.773070 17463 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:07.821362 17394 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:07.821221 17455 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.845050 15272 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.788909 17291 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.773627 17360 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:04:07.774144 17205 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:04:07.850080 15191 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:07.755909 17466 raft_consensus.cc:2764] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:04:07.757050 17325 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.854799 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.872068 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:07.774013 17315 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.855489 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:07.873088 15267 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:07.873301 17360 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:07.775380 17460 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:04:07.873734 17360 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.858881 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:07.874476 15189 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:07.874544 17460 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:07.875139 17460 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.875506 17205 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.875911 17205 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:07.876032 17460 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.876740 17205 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.878347 17205 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.756991 17379 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.879573 17379 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.868165 17412 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.868585 17204 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.880909 15271 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:07.882299 17204 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.788918 17419 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.864404 17463 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:07.884523 17419 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:07.885119 17463 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:07.857270 17394 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.886603 17394 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.851627 17329 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.888877 17329 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.859998 17455 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.894932 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:07.841423 15341 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:07.897043 17365 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:07.859727 15870 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.901296 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:07.902132 15263 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.911635 17324 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:07.912238 17324 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.912671 17324 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.877799 17460 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:07.872308 15269 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:07.778173 17415 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:07.963973 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 266446us
I20260709 13:04:07.965698 15337 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:07.967090 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50890us
I20260709 13:04:07.876665 17325 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.975003 15264 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:07.984977 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:07.992928 15338 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.992041 15343 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.975852 17335 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.973141 17401 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:07.995595 17325 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:07.996531 17457 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.001895 17455 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:07.874639 17360 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.017714 15870 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:07.992970 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:08.039000 15268 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:07.985891 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.065119 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:08.065636 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.063920 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:08.064642 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.076561 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:08.081171 15337 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:08.052892 17390 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:04:08.057837 17358 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:04:08.062956 17335 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.069653 17438 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:04:08.107443 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 121686us
I20260709 13:04:08.088753 17224 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:08.108147 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.064827 17401 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.077899 17431 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:04:08.113248 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.099761 17474 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:08.120132 17474 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.120539 17474 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.121145 17390 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:08.121572 17390 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:08.123229 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:08.124096 15876 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:08.109163 17392 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.124867 17392 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.125944 17457 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:08.119436 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:08.100714 17330 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:08.108249 17360 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:08.130012 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.134156 15192 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:08.131882 15340 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:08.088135 17329 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.098208 17325 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.112075 17438 consensus_queue.cc:1243] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:04:08.138513 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:08.138651 17415 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:08.140362 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62740.7us
I20260709 13:04:08.111888 17224 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.147900 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.141530 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:08.122370 17390 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.164924 15345 raft_consensus.cc:2368] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5.
I20260709 13:04:08.165678 15263 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:08.140645 17437 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.199659 17463 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.200335 17463 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.203327 17463 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:08.205106 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:08.206221 15876 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:08.168978 17464 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:08.169539 17419 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:08.159987 17325 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:08.176461 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 57133us
I20260709 13:04:08.177682 17455 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.167412 17365 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.180482 15195 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:04:08.181007 17394 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.182708 17401 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.183223 17315 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.184814 17329 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:08.189347 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:08.190811 17392 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.191670 17390 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.247301 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.247849 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:08.194708 17452 consensus_queue.cc:1175] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)" } } last_received_current_leader { term: 1 index: 3 } }
I20260709 13:04:08.221518 17325 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.253432 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.222522 17338 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.222425 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:08.223420 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 146960us
I20260709 13:04:08.225004 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.228142 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.265260 15195 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.238730 15344 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:08.218847 15343 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:08.228914 15337 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:08.152722 17224 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.272938 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.238375 15190 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:08.223067 17464 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:08.249573 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:08.283337 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:08.289721 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67359.9us
I20260709 13:04:08.290622 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:08.291736 17451 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:08.291882 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.293179 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:08.250075 15093 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 2 to 4, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1), VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2), VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3), VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 4 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:08.296586 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:08.247272 15868 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:08.337735 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83011.5us
I20260709 13:04:08.338877 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:08.340080 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61498.8us
W20260709 13:04:08.340655 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 115744us
I20260709 13:04:08.345410 15195 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:04:08.352169 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55657.5us
I20260709 13:04:08.341055 17438 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:08.354187 17438 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.354559 17438 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.299340 17415 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:08.355700 17415 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.356130 17415 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.336412 17285 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:04:08.358027 17470 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:08.362246 17477 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:04:08.231501 17365 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.365594 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.360427 17204 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:08.364907 17455 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:08.398711 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:08.336750 17462 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:04:08.387360 17204 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.415560 17204 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.417418 15870 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:08.418536 17335 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.395536 17291 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:08.423362 17291 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.423775 17291 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.426962 17437 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:08.427729 17394 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:08.429386 17324 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:04:08.429818 17324 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.431169 17474 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.433173 17474 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:08.434242 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.378072 17260 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:08.407202 17384 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:08.444583 15338 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:08.409205 17463 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.447297 17463 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.449280 17463 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.410776 17315 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.449447 17438 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.449970 17315 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.360242 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:08.413563 17365 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.414007 17264 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.451684 17264 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.396101 17455 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:08.439966 17470 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:08.443104 17379 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:08.453774 17379 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:08.453662 17455 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.455075 17455 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.454774 17379 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.456127 17379 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:08.457234 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 160940us
I20260709 13:04:08.458050 17486 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:08.458565 17486 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:08.459451 17486 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.462532 15192 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:04:08.464457 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76492.5us
I20260709 13:04:08.443940 17324 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.452420 17415 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:08.467010 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 124673us
I20260709 13:04:08.469035 15093 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 2 to 4, term changed from 3 to 6, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to <none>, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:08.474148 15093 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 2 to 5, term changed from 4 to 6, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:08.476352 15093 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 3 to 5, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 5 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.478775 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.481564 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 4, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 4 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:08.484961 17324 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:08.500234 17324 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:08.501178 17324 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.504029 15868 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:08.506358 17224 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.507956 17438 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:08.498106 15095 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 158) took 20034 ms (client timeout 15000 ms). Trace:
I20260709 13:04:08.498919 17315 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.467712 17437 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:08.478652 17462 consensus_queue.cc:1243] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:04:08.532275 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.534866 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.535528 15192 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:08.533053 15191 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:08.480876 17338 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:04:08.541641 17204 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.545589 17204 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:08.528613 17366 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.530826 17451 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:08.546708 17366 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:08.483685 17431 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:08.529098 17437 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.562554 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.564167 15191 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.566942 17415 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:08.573321 17366 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:08.575771 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.576439 15189 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:08.577404 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.577800 17291 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.578438 17373 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:08.578750 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.579079 17373 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:08.579392 15192 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.580174 17373 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.583124 17264 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.583295 17464 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.584529 17464 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:08.587848 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.591009 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.591638 15195 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:04:08.565443 17437 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.587844 17373 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.618637 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.620048 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.623919 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.620901 17338 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.625151 17330 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:08.625624 17330 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:08.567333 17224 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:08.626443 17330 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:08.516340 15095 rpcz_store.cc:269] 0709 13:03:48.463391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.483838 (+ 20447us) service_pool.cc:224] Handling call
0709 13:04:08.498005 (+20014167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:07.226316 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:07.226997 (+   681us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:07.227066 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:04:07.227089 (+    23us) tablet.cc:662] Decoding operations
0709 13:04:07.296392 (+ 69303us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:07.296506 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:07.296534 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:07.296900 (+   366us) tablet.cc:701] Row locks acquired
0709 13:04:07.296946 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:04:07.297109 (+   163us) write_op.cc:270] Start()
0709 13:04:07.297251 (+   142us) write_op.cc:276] Timestamp: P: 1783602247297049 usec, L: 0
0709 13:04:07.297286 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:04:07.298007 (+   721us) log.cc:844] Serialized 979 byte log entry
0709 13:04:07.553830 (+255823us) op_driver.cc:464] REPLICATION: finished
0709 13:04:07.742623 (+188793us) write_op.cc:301] APPLY: starting
0709 13:04:07.742750 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:07.742888 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:07.743065 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:07.743603 (+   538us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:07.743863 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:04:07.743923 (+    60us) write_op.cc:312] APPLY: finished
0709 13:04:07.744213 (+   290us) log.cc:844] Serialized 28 byte log entry
0709 13:04:07.744411 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.744512 (+   101us) write_op.cc:454] Released schema lock
0709 13:04:07.744569 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:07.745016 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.745047 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1193668,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":120482,"apply.run_cpu_time_us":2382,"apply.run_wall_time_us":57217,"num_ops":2,"prepare.queue_time_us":150905,"prepare.run_cpu_time_us":13603,"prepare.run_wall_time_us":233339,"raft.queue_time_us":30545,"raft.run_cpu_time_us":45316,"raft.run_wall_time_us":80535,"replication_time_us":256360,"thread_start_us":385519,"threads_started":4,"wal-append.queue_time_us":185857}]]}
W20260709 13:04:08.631826 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.617791 17366 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:08.634773 15192 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:08.663544 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.628935 17264 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:08.677997 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.630555 17463 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:08.676546 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 337690us
I20260709 13:04:08.681519 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:08.679332 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 326458us
I20260709 13:04:08.674310 17329 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:08.677929 17264 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.683550 17463 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.695689 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.698210 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.730448 15266 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:08.699918 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.731331 15264 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:08.732527 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.701758 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.733841 15271 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:08.702929 15841 leader_election.cc:400] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5.
I20260709 13:04:08.705091 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.734534 15841 leader_election.cc:403] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:04:08.734915 15272 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:08.709937 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.711860 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:08.712788 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:08.736582 15267 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:08.722877 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.693620 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:08.736343 15269 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:08.727547 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44906us
I20260709 13:04:08.740870 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.741963 15263 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:08.686676 17260 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:08.736321 15268 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:08.686810 17384 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:08.674593 17366 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:08.687371 17385 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:08.690892 17329 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.750331 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.688155 17306 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.749507 15272 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:08.763392 15265 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:08.729321 17264 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.742115 17486 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5.
I20260709 13:04:08.684484 17315 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:04:08.742662 17463 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.794523 15192 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:08.723937 17325 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:04:08.753803 17384 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.751834 17260 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.795074 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.760749 17329 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:08.759467 17291 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:08.802008 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 336152us
W20260709 13:04:08.795562 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.773761 15269 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:04:08.815335 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 381126us
I20260709 13:04:08.818673 15191 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:08.830278 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:08.831816 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:08.832660 17415 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:08.833413 17415 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:08.836123 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.836898 17291 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:08.837533 17291 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.837888 17291 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.790828 17379 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:04:08.843768 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:08.804608 17384 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:08.847056 17224 raft_consensus.cc:2764] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:04:08.848533 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:08.776580 17306 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.849304 17224 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:08.849712 17224 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:08.850071 17224 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.850993 17306 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:08.855222 17330 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.806217 17260 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.846171 17291 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.866626 15266 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:08.863133 15269 pending_rounds.cc:85] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 3
I20260709 13:04:08.864396 15263 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:08.865679 15264 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:08.859886 17480 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:08.873219 15270 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:08.871593 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:08.873479 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:08.875821 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:08.876010 17490 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:04:08.867270 15269 pending_rounds.cc:107] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:04:08.886574 15269 raft_consensus.cc:2889] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:08.816882 17498 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:08.888677 15267 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:08.898284 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:08.898921 15341 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:08.904198 15267 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:08.865871 17224 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.882771 17366 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:08.908397 15340 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:08.909361 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:08.909937 15339 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.910172 17264 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.911314 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:08.911952 15876 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:08.912652 17291 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:08.913952 15341 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:08.883292 17482 raft_consensus.cc:993] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:04:08.916699 15264 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:08.842805 17437 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.922798 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:08.929797 15264 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:08.915151 17401 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:08.957188 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.936667 15339 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:08.939989 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:08.940635 17260 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.942741 17393 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.944564 17494 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:08.958930 15346 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:08.882663 17463 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:08.894512 17483 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:04:08.963022 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:08.964165 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:08.971017 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:08.965818 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:08.974382 15343 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:08.925441 17385 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:08.971356 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:08.973487 15340 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:08.975203 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:08.931142 17498 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:08.981493 15338 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:08.995927 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:08.986116 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.922592 17415 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:04:08.962443 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:09.015278 15264 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:09.015621 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:08.999059 15266 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:08.994556 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.016395 15197 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.971060 17401 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:09.023077 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.002031 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:08.970198 17462 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:08.981199 17482 raft_consensus.cc:1081] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:04:09.004352 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:08.986580 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:08.974500 17393 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.054534 17452 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:09.056427 17224 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.056761 17474 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:08.982692 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:09.020331 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.057837 17474 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:09.058009 17463 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.020078 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.024278 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.024471 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.002379 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:09.026759 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.082314 15337 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:09.083546 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.083803 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:08.988665 15188 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:09.047600 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.084372 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.085263 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.076927 15197 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:09.052088 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.056948 17338 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:09.020905 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.089267 15189 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 7. Ops: []
I20260709 13:04:09.089615 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:09.058115 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 75476.4us
W20260709 13:04:09.059212 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 57284.9us
I20260709 13:04:09.091472 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:09.092959 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:09.060012 17325 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:09.061126 15876 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:09.058282 17474 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.063576 17264 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.021713 17306 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:09.071379 17483 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:09.071575 17498 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.055164 17491 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:09.073068 17473 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:09.074864 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.058362 15194 raft_consensus.cc:2368] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:04:09.086782 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.102910 17379 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.125176 17379 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.056135 17260 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.127246 17379 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.127847 17379 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:09.128202 17379 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.129032 17379 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.130317 17379 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.098263 15338 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:09.062633 17329 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.135658 17291 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:09.136173 17291 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:09.135883 17384 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.114956 17491 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.137058 17291 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.138286 17291 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.139005 17491 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.143813 17285 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:08.971727 17494 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.144377 17285 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.144852 15343 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.145260 17285 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.145991 17494 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.104310 15345 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:09.146608 17285 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:09.105175 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.105535 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.055639 17452 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:09.069859 15266 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:09.056324 17393 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.085145 17335 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.096006 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:09.115655 17437 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.115900 17508 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:09.117522 17474 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.119716 17483 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:09.120740 15340 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:09.055176 17385 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.106976 17463 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.165961 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.153738 17452 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.168581 17452 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.169533 17452 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:09.112152 17415 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.171557 17508 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:09.172089 17508 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.171635 17415 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.172938 17508 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.122786 15870 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:09.174153 17508 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.174474 17415 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.175218 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:09.163658 17483 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.175678 17512 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:09.176363 17483 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.177666 17483 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.143919 17384 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.053649 17462 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.181334 17462 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:09.058040 17373 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:09.182001 17373 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.182463 17373 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:09.184412 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 88505.8us
I20260709 13:04:09.102468 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:09.194456 17373 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.196719 17373 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:09.151962 15344 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:09.106310 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:09.203581 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 97355.9us
I20260709 13:04:09.204304 16678 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:09.204986 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.205504 16678 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.153540 15345 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:09.154054 15346 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 2: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:09.206342 16678 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.154343 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.208794 15190 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:09.158584 15343 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:09.162572 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.163365 17455 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.176713 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.210619 15192 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.179217 17291 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:09.137401 17329 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.174818 17474 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.075717 17401 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.149425 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.228910 15197 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.187587 17462 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:09.183626 17335 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.211826 15188 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:09.213220 15344 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:09.236606 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.237284 15193 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:09.241127 15197 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:09.244906 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.245740 15191 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:09.256994 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:09.257230 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45785.5us
I20260709 13:04:09.214057 17482 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:09.259415 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 156986us
W20260709 13:04:09.260092 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45484us
I20260709 13:04:09.237321 17365 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:09.240736 17291 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:09.273242 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:09.275466 15190 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:09.279703 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:09.285069 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.285645 15346 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.227720 17455 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.294587 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:09.261107 17462 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.302863 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.245190 17498 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:04:09.264156 17494 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.325942 15238 leader_election.cc:400] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:04:09.376811 15238 leader_election.cc:403] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:04:09.376849 15197 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:09.327184 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:09.330698 17366 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:09.333467 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:09.387126 15876 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.285394 17393 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:09.334072 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:09.391415 15269 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:09.334894 15266 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:09.335057 17335 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.335738 15264 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:09.291797 17491 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:04:09.326970 17373 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.328023 17496 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:04:09.292608 15192 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:09.337204 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:09.337337 17437 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:09.338042 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:09.271359 17330 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:04:09.343571 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:04:09.344786 17264 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:09.345388 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 79198.2us
I20260709 13:04:09.347246 17392 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:09.348404 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59865.8us
I20260709 13:04:09.404270 17325 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:09.465037 17373 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.349380 17291 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.360613 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:09.261952 17482 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:09.474232 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:09.376335 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 81857.2us
I20260709 13:04:09.379208 17512 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:09.381573 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55821.2us
I20260709 13:04:09.489527 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:09.489842 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.386250 17455 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.386526 17415 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:04:09.376263 15189 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 2.
I20260709 13:04:09.489991 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:09.398317 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:09.456988 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:09.401499 17511 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:04:09.284490 17385 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:04:09.468312 15267 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:09.501621 15267 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:09.471119 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.490274 15272 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:09.483402 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:09.483685 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:09.484277 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:09.474330 15266 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:09.484341 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:09.474574 17504 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:09.482287 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:09.495229 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 97092.8us
I20260709 13:04:09.498306 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:09.503836 15264 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.509773 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:09.504211 15271 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 2: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:09.504959 15269 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:09.503604 15268 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.507117 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.493014 17482 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:09.551306 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48641.6us
I20260709 13:04:09.503232 17358 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:09.568917 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:09.576406 15263 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:09.527652 15269 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:09.503968 17437 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.571242 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.586364 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:09.573633 15264 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:09.478497 17264 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.477072 17392 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.520925 17329 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.507622 17512 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:09.575426 17491 raft_consensus.cc:2764] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:04:09.591601 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.598690 15189 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:04:09.586117 17437 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.548552 17315 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:09.587525 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:09.576074 17358 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.492939 17462 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.600623 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:09.578003 17415 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:09.577126 15267 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.579308 17285 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:09.624632 15264 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
W20260709 13:04:09.601191 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 110775us
I20260709 13:04:09.626891 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:09.645327 17438 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.645874 17438 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.594504 17329 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:09.627321 17518 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:04:09.597081 17515 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.091s	user 0.004s	sys 0.008s
I20260709 13:04:09.602523 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.651439 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.660389 15267 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:09.651728 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:09.661082 15345 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 2.
W20260709 13:04:09.638948 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 136119us
I20260709 13:04:09.624029 17365 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:09.662252 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:09.622026 17437 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.656688 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:09.658835 15343 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:09.658589 17512 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.623747 17358 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.655396 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:09.673074 15339 raft_consensus.cc:2368] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:04:09.640161 17525 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:09.655902 17329 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.664676 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:09.659965 17338 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:09.629709 17315 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:09.682862 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80411.7us
I20260709 13:04:09.688620 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.690502 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:09.672566 17224 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:09.651883 17415 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.651767 17285 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.692478 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.698469 15346 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:09.687255 17494 raft_consensus.cc:2764] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:04:09.675791 17365 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:09.714175 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.721292 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.722188 15190 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:09.688822 17373 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.706322 17525 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.730943 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.684324 17264 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.734141 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:09.734268 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.734913 15189 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:09.716315 17384 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:09.694005 17338 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.735332 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:09.728711 17224 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:09.736878 17492 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:09.744321 15312 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:09.738399 17527 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:09.732527 17438 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.762125 17365 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.763785 17315 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.519829 17504 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:09.764418 17315 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.768527 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:09.776770 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:09.767987 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 111485us
I20260709 13:04:09.795439 15268 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:09.874879 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:09.759212 17505 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260709 13:04:09.743553 17492 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:09.755143 17325 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:09.879196 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 102497us
I20260709 13:04:09.880380 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:09.882489 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 224660us
I20260709 13:04:09.773782 15876 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:04:09.772156 17516 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
W20260709 13:04:09.856989 17483 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 13:04:09.931866 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:09.886631 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 299204us
I20260709 13:04:09.768533 17453 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:09.848392 17493 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:09.799551 17474 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.534s	user 0.000s	sys 0.008s
I20260709 13:04:09.920601 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:09.940491 15345 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:09.771853 17523 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:09.933085 15267 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:09.841956 17519 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:04:09.885047 17492 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:09.933744 15876 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:04:09.761785 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 114315us
I20260709 13:04:09.839195 17392 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:09.935864 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:09.775012 17437 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.772233 17503 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:09.878612 17315 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.867202 17384 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:09.885671 17463 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
I20260709 13:04:09.766999 17224 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.939284 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:09.881850 17360 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:09.846865 17527 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.771507 17533 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:09.859354 17508 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:09.881919 17526 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:09.842406 17496 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:10.010589 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45061.3us
I20260709 13:04:09.859687 17329 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:09.956928 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 212673us
I20260709 13:04:09.955982 15343 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:09.962214 17315 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.944305 17415 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:09.964031 15267 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:09.885345 17325 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.966351 15338 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:04:09.967561 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 87317.9us
I20260709 13:04:10.010046 17508 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:10.005270 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.025360 15264 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:10.005599 15189 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:04:09.947517 17493 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:09.939235 17486 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:04:10.008533 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:10.029456 15193 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:10.029757 15193 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:09.953076 17453 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:10.030895 17453 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.894224 17482 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:10.015322 17285 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.009594 15265 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:09.961571 15839 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:10.039146 15342 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:10.040901 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:10.018985 15267 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:10.002055 17460 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.002671 17306 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:10.007618 17463 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.010442 17452 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:04:10.022751 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.008961 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.014258 17360 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:10.041344 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.011555 17527 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.042265 17542 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.158s
I20260709 13:04:10.042701 17338 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.013152 17526 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.049180 17532 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.071373 17431 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:10.003801 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.028100 17415 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:10.072535 15268 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:10.050952 15267 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:09.948052 17523 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.048110 17379 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:10.061882 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.084733 15267 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:10.085327 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.054960 15193 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.016665 17496 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.091553 15193 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.071848 17431 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:10.061470 17419 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:04:10.094266 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 132804us
I20260709 13:04:10.054833 17306 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.111218 17545 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.112669 17306 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:10.050551 17460 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.107187 17360 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.119946 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.112361 17493 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:10.121057 17534 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:04:10.122087 15265 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:10.103936 17533 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:10.060655 17543 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 13:04:10.124010 17543 consensus_queue.cc:1243] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:10.124929 15265 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:10.094664 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:10.063511 17508 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.049899 17384 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.112588 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.084348 17379 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.116638 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.126622 15269 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:10.133450 15268 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:10.134691 15267 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:04:10.135215 15267 pending_rounds.cc:85] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 3
I20260709 13:04:10.134928 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.135463 15267 pending_rounds.cc:107] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:04:10.104256 17419 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.136868 15267 raft_consensus.cc:2889] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:10.124672 17291 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:10.136080 17533 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:10.145409 17496 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.196540 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.197218 17527 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.197569 17508 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:10.136534 17379 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:10.132859 17452 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:10.174574 15193 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:10.157971 17482 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.181305 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.140673 17419 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.207823 17452 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.139285 17545 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:10.183864 17523 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.184230 17431 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.211943 17431 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.125928 17504 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:10.185232 17525 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:10.186861 17358 consensus_meta.cc:287] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.003s
I20260709 13:04:10.195664 17490 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.214541 17490 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.216646 17490 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.217713 17492 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.202214 17460 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:10.219060 15337 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
W20260709 13:04:10.202715 17551 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:10.207300 17415 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:10.219870 17325 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.218073 17419 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.220332 17415 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.127455 17315 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.224308 17315 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.211074 17452 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:10.227936 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:10.239774 15268 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:10.241986 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 97769.3us
W20260709 13:04:10.227412 17522 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.629s	user 0.006s	sys 0.000s
I20260709 13:04:10.244832 17545 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:10.248248 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:10.249259 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.249893 17545 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:10.251681 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:10.251900 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.252596 15868 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:10.252643 15337 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:10.254457 17452 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.255654 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:10.263636 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.266175 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.267239 17533 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:10.267807 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:10.269059 15268 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:04:10.269837 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:10.271842 17545 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:10.275477 17533 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:10.276268 17533 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:10.277491 17533 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.226338 17419 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.305176 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.306298 15237 leader_election.cc:400] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
W20260709 13:04:10.308606 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.308674 17525 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.313999 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:10.314739 15868 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.314898 15873 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:10.308840 17545 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:10.316038 17545 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:10.316973 17545 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.318372 17554 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:10.329457 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:10.323392 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1410) took 1050 ms. Trace:
I20260709 13:04:10.330284 15263 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:10.330401 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.330307 15340 rpcz_store.cc:276] 0709 13:04:09.273101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.274309 (+  1208us) service_pool.cc:224] Handling call
0709 13:04:09.366745 (+ 92436us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8eee 0000000000375939 00007f36ea65c1e0 00007f36ea7250c4 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:04:09.366970 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.601808 (+234838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.601839 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:09.601880 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:09.601933 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.323160 (+721227us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400174dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:10.323208 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.323330 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":544605184}
I20260709 13:04:10.330977 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:10.332918 15189 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.334066 17530 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.334153 17379 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.334618 17530 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.336951 17530 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:10.341140 15189 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:10.332890 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.244800 17358 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.346308 15266 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:10.348130 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.350806 15268 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
W20260709 13:04:10.411778 17560 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:10.417657 17526 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.418334 17452 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.419384 17358 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.423146 17492 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.416515 17379 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:10.410131 17470 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:04:10.430621 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.431464 15267 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 4: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:10.431552 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52781.1us
I20260709 13:04:10.436081 17384 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.436157 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.436664 15268 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:10.436671 17384 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.439278 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.439985 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.438910 17384 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:10.441708 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.456779 15339 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:10.461151 15876 pending_rounds.cc:85] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 6
I20260709 13:04:10.461517 15876 pending_rounds.cc:107] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:04:10.461810 15876 raft_consensus.cc:2889] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:10.463678 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.468734 15271 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:10.431290 17530 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.472899 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:10.473675 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.476900 17260 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:10.478600 15346 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:10.479828 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.480064 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:10.480705 15266 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:10.481329 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:10.481839 15337 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.435326 17526 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:10.483820 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.494174 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.494900 15338 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:10.495893 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:10.495750 17526 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.497989 17526 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.498752 15268 raft_consensus.cc:2410] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:10.469076 15868 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:10.445652 17493 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:04:10.503567 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:10.504350 15874 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:10.507669 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:10.494251 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.510366 15345 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:10.483306 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:10.511215 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.512027 15345 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
I20260709 13:04:10.487491 17530 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.513906 17530 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.468674 17464 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:10.515534 17464 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.517460 17464 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.520859 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:10.521828 17525 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:10.522343 17525 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:10.530541 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:10.531461 15346 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.532603 15338 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:10.533252 15337 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
W20260709 13:04:10.514776 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65408.5us
I20260709 13:04:10.537591 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.538489 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:10.539049 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53093us
I20260709 13:04:10.539331 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:10.554168 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:10.554913 15337 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:10.557961 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:10.561712 17462 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:10.563349 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.563709 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:10.564220 15263 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:10.561728 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:10.567315 15193 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.567797 15271 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:10.574321 15346 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:04:10.577919 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:10.579704 15345 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:10.580578 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.581344 15192 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:10.581876 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.579520 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:10.582497 15191 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:10.582626 15265 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:10.583161 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:10.583734 15266 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:10.562577 17462 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.584425 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.568420 17431 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:10.583057 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:10.589505 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.586398 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:10.593294 15346 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:10.597385 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:10.582086 17526 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:10.575459 17390 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:10.598321 15842 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:10.602654 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:10.602792 15263 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:10.591246 15337 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:10.603657 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:10.592355 17431 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.606242 15346 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:10.615233 15193 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:04:10.616137 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.625252 15338 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:10.604811 17358 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:10.617785 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.618785 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:10.628675 16678 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:10.629192 16678 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:10.629933 16678 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.626657 15346 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:10.587663 17452 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:10.631806 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:10.604799 17390 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.669183 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:10.671132 17536 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:04:10.671855 17260 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:10.672652 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:10.672855 17536 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:10.673539 17548 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:10.673969 17548 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.674304 17548 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.657770 17553 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.675575 17553 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.678072 17553 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:10.678179 17543 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.633622 17493 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.678697 17543 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.679169 17493 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.578675 17525 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.680975 17543 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.614404 17315 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:10.683300 17315 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.683529 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:10.685491 17315 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.687359 17464 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.624092 17431 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:10.617708 17512 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.687867 17464 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:10.691251 17561 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:10.616310 17526 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:10.691744 15196 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:10.692727 17464 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.692886 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.692516 17526 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.693933 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:10.694602 15196 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:10.617867 17379 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:10.695336 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.670385 17390 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:10.696069 15188 raft_consensus.cc:2368] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:04:10.696763 17462 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.623690 17533 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:10.697397 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:10.697703 17533 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:10.698180 17533 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:10.698534 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:10.700326 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.701113 15197 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:10.701825 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:10.668259 17552 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:10.704684 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 57) took 3622 ms. Trace:
I20260709 13:04:10.705564 15190 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:10.660832 17358 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:10.709085 17358 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:10.709698 15195 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:10.660323 17528 raft_consensus.cc:2764] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:04:10.712525 17390 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.714028 15188 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.715375 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.717406 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.718021 15346 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:10.718842 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.705075 15093 rpcz_store.cc:276] 0709 13:04:07.082618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.082842 (+   224us) service_pool.cc:224] Handling call
0709 13:04:10.704618 (+3621776us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:08.908468 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:08.909036 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:08.909074 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:04:08.909097 (+    23us) tablet.cc:662] Decoding operations
0709 13:04:08.909787 (+   690us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:08.909872 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:08.909908 (+    36us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:08.910550 (+   642us) tablet.cc:701] Row locks acquired
0709 13:04:08.910571 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:04:08.910721 (+   150us) write_op.cc:270] Start()
0709 13:04:08.910838 (+   117us) write_op.cc:276] Timestamp: P: 1783602248910676 usec, L: 0
0709 13:04:08.910861 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:09.024727 (+113866us) log.cc:844] Serialized 2205 byte log entry
0709 13:04:09.769164 (+744437us) op_driver.cc:464] REPLICATION: finished
0709 13:04:10.006386 (+237222us) write_op.cc:301] APPLY: starting
0709 13:04:10.009270 (+  2884us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:10.027196 (+ 17926us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:10.050489 (+ 23293us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:10.113722 (+ 63233us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:10.114006 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:04:10.114077 (+    71us) write_op.cc:312] APPLY: finished
0709 13:04:10.114406 (+   329us) log.cc:844] Serialized 46 byte log entry
0709 13:04:10.114651 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:10.114861 (+   210us) write_op.cc:454] Released schema lock
0709 13:04:10.114951 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:10.136300 (+ 21349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:10.139395 (+  3095us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":492671,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":183607,"apply.run_cpu_time_us":3831,"apply.run_wall_time_us":155588,"num_ops":5,"prepare.queue_time_us":377272,"prepare.run_cpu_time_us":18291,"prepare.run_wall_time_us":248276,"raft.queue_time_us":160628,"raft.run_cpu_time_us":12961,"raft.run_wall_time_us":117989,"replication_time_us":858150,"thread_start_us":387878,"threads_started":4,"wal-append.queue_time_us":207812}]]}
I20260709 13:04:10.728502 15265 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:10.729720 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.729943 15345 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:10.730572 15190 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:10.731881 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:10.734040 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.734153 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:10.735299 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:10.740321 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:10.671181 17564 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:04:10.742182 15263 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:10.687896 17329 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.675566 17437 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:10.748284 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:10.750584 15190 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:10.744508 17545 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.743535 17379 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:10.747184 17482 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:10.811467 17482 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:10.812495 17482 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.822315 15188 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:10.823570 17503 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:10.824150 17503 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.826224 17503 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.831283 17493 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:10.837742 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.838160 15188 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:10.739277 17508 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:04:10.845827 15312 leader_election.cc:400] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:04:10.846141 15312 leader_election.cc:403] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:10.800073 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 46257.3us
I20260709 13:04:10.728770 17543 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:10.743320 17565 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:10.739518 17536 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:10.809490 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.849089 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:10.849493 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.850142 15264 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:10.851082 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:10.846814 17562 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:04:10.833717 17379 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.835951 17329 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:10.869642 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:10.868680 17493 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:04:10.855808 17335 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5.
I20260709 13:04:10.862413 17453 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.866001 17379 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.855412 17543 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.883618 17462 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.870931 17329 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.914884 15190 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:10.913626 17553 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.922263 17553 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:10.929453 15266 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
W20260709 13:04:10.938824 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 71458.8us
I20260709 13:04:10.941344 15339 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:10.944362 17533 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.950558 17545 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:10.951768 15267 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:10.957752 17553 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:10.960634 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:10.916193 17462 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.907778 17536 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:10.977133 17329 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:10.981602 17571 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:04:10.985536 17568 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:04:10.988380 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:10.990128 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:10.995922 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 125238us
I20260709 13:04:11.002352 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:11.003242 15342 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.004487 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:11.010591 17329 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.013899 17543 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.015794 15342 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:11.015986 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.017143 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.018294 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:11.005643 17455 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:11.005143 17545 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.028312 15312 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.003386 17525 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:11.023846 17260 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:11.024129 17553 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:11.039848 17453 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:04:11.052680 17588 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.062270 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:10.991577 17548 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.029187 17329 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:11.027340 17581 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:11.055842 17503 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:11.081823 15197 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:11.065788 17455 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:11.093288 17462 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.093343 17548 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.079115 17544 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:11.094600 17590 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:04:11.096972 17581 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.097483 17581 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.104024 17581 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.119833 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:11.120644 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:11.071723 17525 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.126623 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.127326 17508 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.127538 17525 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.130422 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.079492 17588 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:11.132903 17455 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:11.132476 17379 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.142130 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:11.136014 17508 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.134600 17588 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.147554 17508 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.143252 17492 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:11.148587 17582 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:11.148919 17492 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:11.149399 17492 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.149232 17582 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.150401 17379 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.150508 15870 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:11.151302 15193 raft_consensus.cc:2368] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7.
I20260709 13:04:11.151394 17582 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.152233 17525 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:11.128165 17205 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:04:11.163831 17431 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.138799 17528 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.177192 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.197876 17205 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.233728 17543 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:11.267405 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.281759 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.282750 15346 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:11.295614 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:11.303828 17473 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.304203 17464 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:11.304795 17528 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.312495 17545 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.313136 17553 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:11.319555 17431 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.319715 17470 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.320858 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.378582 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.322240 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:11.379247 15346 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:11.323449 17584 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:11.326416 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:11.384097 15189 raft_consensus.cc:2368] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:11.365262 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:11.369503 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 307303us
I20260709 13:04:11.384871 15342 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.369817 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:11.363379 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:11.385952 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:11.386404 15340 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.376988 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.379856 15338 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:11.388235 15343 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:11.389828 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.382282 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:11.392380 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.389050 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.375567 17358 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.399012 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.402607 15343 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:11.402908 15312 leader_election.cc:400] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7.
I20260709 13:04:11.403220 15312 leader_election.cc:403] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:11.403891 15343 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:11.404237 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:11.401412 15345 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:11.407214 15337 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:11.407387 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.407696 15193 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:11.410175 17492 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.412282 17525 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:11.399629 15342 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:11.420528 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.419080 17581 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7.
I20260709 13:04:11.425016 15189 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:11.374763 17473 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.377411 17528 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.399350 17431 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:11.379063 17545 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.436203 17492 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.415347 17544 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:11.437759 17525 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.383524 17464 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:04:11.382040 17553 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.438884 16678 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:11.470752 16678 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.471253 16678 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:11.446030 15189 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:11.415848 17358 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.384449 17470 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.461020 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:11.472878 15267 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.473616 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:11.474416 15271 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.462081 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:11.475358 15193 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:11.462510 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.455089 17546 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:11.469506 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.476198 15268 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:11.477854 15263 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:11.479543 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:11.481076 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:11.481683 15266 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.480353 15263 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:11.484169 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.418797 17532 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:04:11.504905 17532 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:11.507232 17470 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.510881 15263 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:11.511252 17205 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:11.513327 15191 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:11.487507 15270 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:11.488852 17492 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.489466 17358 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.490439 15265 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:11.518213 16678 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.492699 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:11.520289 15266 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:11.497080 17473 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.497881 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.524010 15189 raft_consensus.cc:606] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.524549 15189 raft_consensus.cc:614] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:11.498471 17493 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:11.528549 15197 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:11.499217 17545 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.499998 15271 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:11.531420 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.515693 15267 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:11.498494 15340 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:11.532832 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.471705 17431 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:11.521216 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:11.522226 15190 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:11.528102 16678 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.533641 15263 raft_consensus.cc:2368] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7.
I20260709 13:04:11.535081 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.535930 15265 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:11.537807 15267 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.538349 17431 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.531131 17544 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:11.539528 17544 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:11.539892 17544 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:11.554952 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.556517 15263 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:11.534237 17453 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:11.562986 15265 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:11.551416 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.525728 17492 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:11.574067 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 149032us
I20260709 13:04:11.576725 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:11.585448 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 152988us
I20260709 13:04:11.534531 17493 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.587507 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.595866 16678 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:11.596329 16678 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.596726 16678 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.579267 17503 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.639042 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.612995 17543 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:11.618515 17597 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:04:11.630867 17473 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.635262 15194 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:11.560313 17315 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:04:11.651954 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.661278 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.671664 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.672111 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.672536 15263 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:11.672758 15267 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:11.682121 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.684917 15267 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:11.652423 16678 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.652737 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:11.685032 17338 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:11.686673 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.586345 17546 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.687557 17602 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.687948 15309 leader_election.cc:400] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7.
I20260709 13:04:11.687441 17546 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.654057 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:11.685940 17503 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:11.688761 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.692584 17546 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.693106 17605 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:11.693611 17605 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.695526 17553 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.695714 17605 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.696346 17607 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.654132 17543 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.698441 15265 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:11.701180 17390 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.686674 17338 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.702204 17338 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.703349 17503 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:11.710433 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56437.2us
I20260709 13:04:11.710130 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:11.713207 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:11.723531 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:11.724347 15191 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:11.706923 17528 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.695609 17533 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.737172 15339 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:04:11.731146 17526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.007s	sys 0.030s
I20260709 13:04:11.743948 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.718999 17464 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:11.663996 17473 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.751675 16678 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:11.756176 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:11.764213 15338 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:11.758277 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:11.747440 15339 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:11.767383 15339 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:11.785158 15339 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:11.785787 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.728324 17315 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:11.790509 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43726.5us
I20260709 13:04:11.737363 17390 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:11.794682 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.798698 17602 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:11.696969 17607 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:11.765414 17464 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.812299 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:11.747963 17526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.007s	sys 0.031s
I20260709 13:04:11.788444 17605 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:04:11.823751 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110631us
I20260709 13:04:11.833757 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.845062 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:11.846020 15341 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:11.846712 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:11.847450 15337 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.758770 17580 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:04:11.787240 17494 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:04:11.845031 15338 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:11.818351 17335 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.822031 17464 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.832113 17530 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.821995 17390 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:11.864903 15337 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:11.861053 15162 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:11.874524 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:11.850901 17608 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:11.852931 17611 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.858560 17548 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:11.866683 17492 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.902315 17390 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.860203 17379 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:04:11.843437 17605 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:11.918352 17338 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.921221 17338 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.866796 17335 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.925575 17335 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.927390 17379 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.928426 17358 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.881287 17493 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:11.927767 17628 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:11.929636 17628 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.929970 17628 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.931325 17607 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:11.880046 17608 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:11.888330 17611 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:11.953536 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 79058.1us
I20260709 13:04:11.979725 15238 leader_election.cc:400] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:11.987331 15238 leader_election.cc:403] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:11.937343 17533 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.012457 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:12.011744 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56320.8us
I20260709 13:04:11.969231 17431 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:11.951359 17482 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 13:04:12.037039 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 159772us
I20260709 13:04:12.045950 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:12.046840 15263 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:12.047885 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:12.048610 15263 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:12.013796 17525 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:12.011701 17607 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.012070 17470 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.018074 17631 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:12.060225 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:11.965528 17543 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.017292 17545 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:12.015398 17528 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 13:04:12.111745 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 96412.4us
I20260709 13:04:12.038957 17384 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:04:12.077419 17544 consensus_meta.cc:287] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.002s
I20260709 13:04:12.031313 17431 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.018535 17533 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.055181 17548 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:12.082544 17473 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:12.138561 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 78400.7us
I20260709 13:04:12.114830 17608 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.200268 15337 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:12.114334 17530 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:12.145712 17431 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.083153 17553 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.114s
I20260709 13:04:12.058334 17621 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.142s
I20260709 13:04:12.111881 17607 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.161262 17525 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:12.109671 17470 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.197633 17609 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:12.128213 17384 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.160801 17545 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:04:12.237382 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.128672 17544 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.238319 15341 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:12.241014 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.242470 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:12.243153 15264 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.083479 17631 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.247946 17470 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:12.249261 17632 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:04:12.250691 17464 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:12.251506 17619 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:04:12.251726 17635 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:04:12.256769 17623 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:04:12.258075 17628 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.258517 17611 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:12.263365 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 147382us
I20260709 13:04:12.264467 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1108) took 1083 ms. Trace:
I20260709 13:04:12.264838 15194 rpcz_store.cc:276] 0709 13:04:11.181070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.393986 (+212916us) service_pool.cc:224] Handling call
0709 13:04:11.634829 (+240843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:11.655894 (+ 21065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.264268 (+608374us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b5400235fd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:12.264394 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553122176}
I20260709 13:04:12.231499 17636 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:12.229007 17525 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.302544 15264 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:12.304859 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:12.305689 17553 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.307855 15337 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:12.280333 17532 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.278282 17611 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.284729 17470 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.320529 17529 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.357162 17529 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.277897 17548 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.359051 17640 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:12.359143 17611 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.359632 17640 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.361595 17611 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.316155 17553 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.364462 17525 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.364989 17470 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.366933 17470 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.367178 17639 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.367687 17639 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.296566 17530 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.357481 17605 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:12.371690 17543 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.372574 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.236403 17609 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.373893 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:12.374114 17622 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.467s	user 0.004s	sys 0.000s
I20260709 13:04:12.374378 15194 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:12.374538 15190 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:12.374717 17609 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.375288 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.376281 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.439698 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.442870 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:12.448799 15192 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:12.453194 15337 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:12.375923 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.457111 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.462574 15189 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:12.490361 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:12.563089 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.582139 15191 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:04:12.551666 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:12.414317 17605 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.530781 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.431565 17607 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:12.620074 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 129829us
I20260709 13:04:12.618058 15337 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:12.429824 17544 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:12.461719 17379 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.626041 17379 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.429548 17529 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.559749 17553 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.621820 17605 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.629225 17605 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.317462 17532 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.622968 17644 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:12.630162 17644 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.630573 17644 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.637847 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:12.429731 17431 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.377879 17628 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.629525 17379 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:12.435774 17640 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:12.640658 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:12.638970 17608 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:12.653334 17532 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:12.652884 15337 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:12.658674 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.669497 15344 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:12.664912 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.666903 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:12.667634 17431 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.671298 15345 raft_consensus.cc:2368] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:12.651989 17529 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:04:12.530736 17637 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 13:04:12.683770 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.376488 17626 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.683840 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.700188 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.701017 15342 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:12.681290 15162 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:12.703413 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:12.706368 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 1.60032e+06us
I20260709 13:04:12.562546 17639 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.709266 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.709995 15193 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:12.706365 17608 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:12.711355 17490 raft_consensus.cc:2764] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:04:12.679162 17379 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:12.724932 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 1.56357e+06us
W20260709 13:04:12.726701 17594 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:04:12.741319 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.744038 15193 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:12.721608 17643 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:04:12.747673 17630 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.859s	user 0.002s	sys 0.000s
I20260709 13:04:12.753576 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:12.754252 15190 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.754372 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.754802 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.754969 15192 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:12.755164 17636 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.755724 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.757618 17621 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.758200 17621 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.759302 17550 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.759841 17550 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.761404 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1433) took 1614 ms. Trace:
I20260709 13:04:12.721149 17543 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.763337 17543 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.764369 17539 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:12.762809 17550 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:12.765216 17634 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.547s	user 0.000s	sys 0.001s
I20260709 13:04:12.764869 15190 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:12.765460 17543 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.780737 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:12.781039 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1134) took 1173 ms. Trace:
W20260709 13:04:12.782819 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51597.7us
I20260709 13:04:12.782692 15346 rpcz_store.cc:276] 0709 13:04:11.607292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.607469 (+   177us) service_pool.cc:224] Handling call
0709 13:04:11.607816 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:11.653243 (+ 45427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:11.653279 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:11.682776 (+ 29497us) log.cc:844] Serialized 26 byte log entry
0709 13:04:12.010637 (+327861us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:12.010676 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.010742 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:12.764566 (+753824us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:12.766590 (+  2024us) raft_consensus.cc:1685] finished
0709 13:04:12.766609 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:12.780969 (+ 14360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17663,"raft.queue_time_us":49029,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":19951,"spinlock_wait_cycles":7134080,"thread_start_us":289266,"threads_started":1,"wal-append.queue_time_us":401379}
I20260709 13:04:12.734279 17379 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.761765 15196 rpcz_store.cc:276] 0709 13:04:11.147142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.393191 (+246049us) service_pool.cc:224] Handling call
0709 13:04:11.393519 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:11.491632 (+ 98113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:11.491668 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:11.492145 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:04:11.601159 (+109014us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:11.601217 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.761045 (+1159828us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b54000fa0d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:12.761089 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:12.761128 (+    39us) raft_consensus.cc:1685] finished
0709 13:04:12.761139 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:12.761347 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7661,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":224741248,"thread_start_us":108560,"threads_started":1,"wal-append.queue_time_us":259791,"wal-append.run_cpu_time_us":1545,"wal-append.run_wall_time_us":1005620}
I20260709 13:04:12.765861 17550 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:12.723284 17626 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.740482 17644 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:12.764976 17539 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.815828 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:12.815969 15876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 173) took 1771 ms. Trace:
I20260709 13:04:12.856719 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.823900 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:13.035830 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:13.039637 15876 rpcz_store.cc:276] 0709 13:04:11.037960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.049764 (+ 11804us) service_pool.cc:224] Handling call
0709 13:04:11.050040 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:11.050237 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:11.066530 (+ 16293us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.675607 (+1609077us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b18002cefc0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:04:12.793648 (+118041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:12.793727 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:12.793806 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.793908 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:12.794076 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39209,"prepare.queue_time_us":16569,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1275,"raft.queue_time_us":1618736,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":13144,"spinlock_wait_cycles":10705664,"thread_start_us":117711,"threads_started":1}
I20260709 13:04:13.044368 15193 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:12.742118 17650 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.045670 17650 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:12.767076 17490 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:12.757637 17464 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:12.773679 17535 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.774816 17643 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:13.056209 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 106506us
I20260709 13:04:13.065919 15191 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:13.066018 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:13.066494 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 359045us
I20260709 13:04:13.060490 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.978051 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:13.067507 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.061504 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.069346 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:13.043186 17648 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:04:12.805919 17379 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.073741 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:13.043989 17625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.003s	sys 0.007s
I20260709 13:04:12.951625 15869 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:13.059770 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:12.853423 17486 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:12.991321 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:13.071106 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.073770 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.076303 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:12.793443 17419 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.274s
I20260709 13:04:13.077592 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.063541 17490 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.051101 17550 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:13.173170 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68693.5us
I20260709 13:04:13.173563 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1443) took 1605 ms. Trace:
I20260709 13:04:13.173905 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:13.067170 17637 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.080173 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:13.174016 15188 rpcz_store.cc:276] 0709 13:04:11.567833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.569719 (+  1886us) service_pool.cc:224] Handling call
0709 13:04:11.570164 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:11.570628 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:12.257308 (+686680us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b180039c1c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf 00007f36e5727038
0709 13:04:12.414754 (+157446us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.774823 (+360069us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.042568 (+267745us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.042852 (+   284us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:13.042908 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.042993 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.150312 (+107319us) raft_consensus.cc:1685] finished
0709 13:04:13.173366 (+ 23054us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.173503 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":743,"prepare.queue_time_us":179539,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":26,"raft.queue_time_us":3616,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":22155,"spinlock_wait_cycles":3835776,"thread_start_us":468430,"threads_started":2,"wal-append.queue_time_us":645017}
I20260709 13:04:13.219235 17550 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.070151 17535 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.187392 17494 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.293157 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:13.284005 17648 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:04:13.258544 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:13.182144 17486 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.332883 17662 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.333847 17486 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.334319 17494 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.069795 17650 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:13.172602 17379 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.216910 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:12.861429 17608 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.336393 17494 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:13.337512 17379 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.185650 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:13.177256 17633 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.983s	user 0.003s	sys 0.002s
I20260709 13:04:12.755728 17636 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.354899 15194 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
W20260709 13:04:13.077392 17625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.003s	sys 0.008s
I20260709 13:04:13.226857 17490 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:13.099354 17621 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.224319 17482 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:13.188192 17492 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:13.082170 17651 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:04:13.220095 17464 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:13.224694 15162 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:13.218899 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:13.264859 17329 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.333496 17662 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.097824 17626 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:13.346495 15197 raft_consensus.cc:2368] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
W20260709 13:04:13.356724 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 139917us
I20260709 13:04:13.365938 17264 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:13.387568 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:13.389703 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 165116us
I20260709 13:04:13.405821 15188 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:13.406405 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:13.406864 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:13.410394 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1418) took 1367 ms. Trace:
I20260709 13:04:13.418068 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:13.387951 17492 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.410794 15265 rpcz_store.cc:276] 0709 13:04:12.042619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.044573 (+  1954us) service_pool.cc:224] Handling call
0709 13:04:12.243945 (+199372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:12.244349 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.244380 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:12.267607 (+ 23227us) log.cc:844] Serialized 52 byte log entry
0709 13:04:12.449735 (+182128us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:12.530868 (+ 81133us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.600814 (+ 69946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.600941 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:12.635609 (+ 34668us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b180042c760. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:13.397698 (+762089us) raft_consensus.cc:1685] finished
0709 13:04:13.410179 (+ 12481us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.410329 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":760,"prepare.queue_time_us":96770,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":19347,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":32436,"spinlock_wait_cycles":31871616,"thread_start_us":173955,"threads_started":1,"wal-append.queue_time_us":466542}
I20260709 13:04:13.183440 17637 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.421168 15189 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:13.397192 17621 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:13.567687 17590 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.443483 17492 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:13.561424 17453 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:13.674410 17453 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.677601 17453 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:13.397933 17464 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.681095 17464 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:13.421377 17264 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:13.682457 17264 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.566251 17539 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.650588 17621 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:13.570434 17379 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:13.443164 17650 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:13.693113 17621 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.653535 17655 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.517s
I20260709 13:04:13.693727 17650 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.653851 17529 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:04:13.693102 17379 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.696161 17650 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.733145 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1487) took 1428 ms. Trace:
I20260709 13:04:13.735482 15341 rpcz_store.cc:276] 0709 13:04:12.304695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.305998 (+  1303us) service_pool.cc:224] Handling call
0709 13:04:12.306385 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:12.308462 (+  2077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.308491 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:12.308926 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:04:12.721031 (+412105us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:12.721087 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.721165 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.732873 (+1011708us) raft_consensus.cc:1685] finished
0709 13:04:13.732894 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.733071 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1610,"raft.queue_time_us":2374,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5635,"thread_start_us":357676,"threads_started":1,"wal-append.queue_time_us":539586}
I20260709 13:04:13.388672 17482 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.702497 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.703419 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.704299 15193 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:13.707705 15339 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:04:13.698262 17669 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:04:13.098603 17643 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.730154 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.749404 15342 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:04:13.697208 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:13.568274 17590 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:13.558969 17666 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:04:13.753402 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.560060 17636 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:13.767516 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:13.757228 17668 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.808969 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:13.757701 17503 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.816902 17589 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:13.842598 17654 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.565s	user 0.000s	sys 0.001s
I20260709 13:04:13.844044 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1419) took 1801 ms. Trace:
I20260709 13:04:13.844431 15267 rpcz_store.cc:276] 0709 13:04:12.042946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.044660 (+  1714us) service_pool.cc:224] Handling call
0709 13:04:12.045093 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:12.434328 (+389235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.434360 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:12.448374 (+ 14014us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.036375 (+588001us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:13.036418 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.036486 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.843828 (+807342us) raft_consensus.cc:1685] finished
0709 13:04:13.843849 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.843986 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79608,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":739844,"threads_started":2,"wal-append.queue_time_us":519255}
I20260709 13:04:13.827845 17482 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.843004 17589 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.824281 17491 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.399294 17329 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.823971 17539 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:04:13.951372 17670 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:13.952028 17670 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.952641 17670 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:13.955893 17661 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.935567 17494 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.937369 17490 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.937662 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:13.852160 17503 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.971856 17494 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.958410 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:13.956590 17661 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.963534 17637 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:13.844949 17668 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.945914 17491 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:13.985679 17453 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.977510 17490 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:13.989416 17679 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.994714 17661 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.019133 17679 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.021505 17679 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.023113 17379 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.025363 17668 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.032155 17590 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:13.995604 15870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58398 (request call id 155) took 2841 ms. Trace:
I20260709 13:04:14.000240 17503 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.037557 15870 rpcz_store.cc:276] 0709 13:04:11.154226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.154574 (+   348us) service_pool.cc:224] Handling call
0709 13:04:11.154894 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:12.967793 (+1812899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.976464 (+  8671us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:12.977592 (+  1128us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.994797 (+1017205us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b1800393f40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1
0709 13:04:13.994962 (+   165us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:13.995003 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.995137 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.995202 (+    65us) raft_consensus.cc:1685] finished
0709 13:04:13.995219 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.995505 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1582751,"raft.queue_time_us":1566000,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":12806,"spinlock_wait_cycles":57105792,"thread_start_us":515411,"threads_started":2,"wal-append.queue_time_us":311666}
I20260709 13:04:14.004096 17588 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:13.988911 15869 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:14.061107 17526 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.061358 17491 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.061739 17526 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.062806 17329 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:14.063498 17532 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.063884 17605 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.008437 17453 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.064072 17532 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.064437 17605 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.066022 17453 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.066232 17532 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.009933 17492 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.068831 17492 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.008090 17455 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:14.069288 17437 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.069733 17639 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.069564 17455 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:14.069864 17437 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.070973 17526 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.071911 17525 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:14.072125 17437 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.072690 17437 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:14.073114 17470 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.073746 17470 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.073195 17437 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:14.075539 17642 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.076407 17642 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.076745 17647 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:14.072958 17588 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.066746 17605 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.083281 17609 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.083412 17605 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.083877 17609 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.084561 17588 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.072415 17525 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.081147 17553 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:14.075450 17545 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.090217 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:14.104735 15269 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.081733 17490 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:14.082671 17589 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.082535 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:14.111145 15265 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:14.083949 17605 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.077256 17503 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.016105 17494 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.099278 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:14.163398 15263 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:14.104647 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.166980 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.167834 15264 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:14.120937 17691 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.169375 17691 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.172073 17691 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.172729 17691 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.173240 17691 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:14.125048 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 186846us
I20260709 13:04:14.178763 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:14.179834 15342 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:14.180230 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:14.181070 15341 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:04:14.149574 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80219.4us
I20260709 13:04:14.071501 17526 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:14.191810 17526 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:14.193989 17526 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:14.195266 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:14.197818 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:14.200161 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:14.160384 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.233949 15270 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:14.070243 17639 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:14.078084 17532 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:04:14.154542 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 79928.9us
I20260709 13:04:14.237249 15263 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:14.238495 15269 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:14.268457 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:14.211678 17533 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.129670 17545 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.386001 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:14.290566 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.324034 15265 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:14.379166 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:14.388146 15269 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:14.291838 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:14.427129 15197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1450) took 1637 ms (client timeout 1720 ms). Trace:
W20260709 13:04:14.434808 15197 rpcz_store.cc:269] 0709 13:04:12.752360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.755484 (+  3124us) service_pool.cc:224] Handling call
0709 13:04:14.389532 (+1634048us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001e82d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:14.389646 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338944384}
I20260709 13:04:14.435343 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:14.379522 17605 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.436702 17605 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:14.436843 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.437197 17605 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:14.437786 17605 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.407294 17536 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:14.427414 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.440688 15265 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:14.441722 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.440049 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:14.442912 15269 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:14.444039 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:14.369107 17437 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:14.444833 15342 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:14.445252 17437 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:14.445868 17437 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.446395 17437 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:14.391094 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:14.328246 17691 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.449043 15263 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:14.391304 15264 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:14.450134 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:14.451148 15266 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:14.384788 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:14.452649 15266 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:14.291725 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.441974 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.456964 15267 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
W20260709 13:04:14.406940 15839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.595s (SENT) [suppressed 63 similar messages]
I20260709 13:04:14.370911 17647 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:14.457614 17533 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:14.460489 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:14.211484 17503 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.438771 17536 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.368265 17525 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.358814 17642 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.279608 17532 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:14.439388 17553 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:14.488682 17492 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.507162 17492 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.509223 17492 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.510115 17639 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:14.498195 17631 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.511931 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:14.495434 17683 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:14.496488 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:14.496544 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:14.517457 15870 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:14.496559 17681 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:14.505559 17503 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.515089 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:14.490702 15342 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:14.574952 17631 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:14.576786 15264 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:14.477819 17533 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.583806 15267 raft_consensus.cc:2368] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6.
I20260709 13:04:14.481333 17588 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.489271 17562 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.591526 15263 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:14.485735 17589 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:14.629988 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.632373 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.848501 15270 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:14.849376 15267 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:14.631942 17533 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.632872 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:14.578913 17536 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.904995 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:14.871959 17453 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:14.908294 17453 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.579849 17683 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.909618 17455 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:14.686167 17562 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.685350 17588 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.911808 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:14.912873 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 505962us
I20260709 13:04:14.872599 17384 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:14.922590 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 514739us
I20260709 13:04:14.863122 17589 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.905673 15873 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
W20260709 13:04:14.974723 15238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.014s	sys 0.021s
W20260709 13:04:14.975283 15238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.014s	sys 0.021s
W20260709 13:04:14.975656 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 775526us
I20260709 13:04:14.976606 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:14.990939 17329 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.991349 17588 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:14.991684 17329 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:14.994714 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:15.033494 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 57028us
I20260709 13:04:15.033752 15337 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
W20260709 13:04:14.963478 17670 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 1.010s	user 0.014s	sys 0.000s
I20260709 13:04:15.040998 15267 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.038899 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:15.049578 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:15.053045 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:15.059515 17639 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:15.060158 17639 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:15.060659 17639 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.063401 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.064136 15264 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:15.065099 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.066217 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:15.070246 15237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.005s	sys 0.017s
W20260709 13:04:15.071542 15237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.006s	sys 0.017s
W20260709 13:04:15.072882 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 804503us
I20260709 13:04:15.075978 15237 leader_election.cc:400] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
W20260709 13:04:15.056245 17605 consensus_meta.cc:287] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.001s
I20260709 13:04:15.078656 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:15.081439 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.055227 17642 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:15.085788 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:15.088042 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:15.036149 17696 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:15.072484 17607 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:15.048743 17553 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:04:15.084102 17532 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:15.047808 17670 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:15.063580 17692 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:04:15.101352 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.102711 15264 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:15.102968 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.105895 15270 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:15.106945 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.107971 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:15.108886 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.109790 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.085382 17642 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:15.099064 15267 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:15.115836 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.117216 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.117343 15270 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:15.118132 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.118737 15270 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:15.119457 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.121210 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.122328 15269 raft_consensus.cc:2410] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:15.096616 17329 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:15.096196 17607 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.101917 17553 consensus_queue.cc:1243] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:15.084632 17605 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:15.138844 15876 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:15.104300 17437 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.657s	user 0.012s	sys 0.000s
I20260709 13:04:15.140128 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.116739 17494 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:15.116988 17696 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:15.142791 15267 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:15.147436 15266 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:15.124958 17642 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:15.142274 17607 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.145149 17437 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.152315 17693 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:15.152540 17686 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:04:15.153337 15266 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:04:15.156658 17437 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.157660 15266 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:15.158100 15266 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:15.154652 15269 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:15.161090 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.161433 15345 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:04:15.162086 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1139) took 2503 ms. Trace:
I20260709 13:04:15.162384 15345 rpcz_store.cc:276] 0709 13:04:12.658969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.671835 (+ 12866us) service_pool.cc:224] Handling call
0709 13:04:15.161013 (+2489178us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:04:15.161186 (+   173us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.161833 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.162032 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26691328}
I20260709 13:04:15.158792 15266 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.165452 15266 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.169359 17545 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.174324 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.173578 17473 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.181270 17473 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.183305 17473 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.184378 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.153322 17706 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:15.188319 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 100347us
I20260709 13:04:15.164219 17453 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:15.193598 17455 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:04:15.196559 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1501) took 1019 ms. Trace:
I20260709 13:04:15.171868 17562 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:15.200800 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.200922 15192 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:15.201465 15190 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:15.196931 15339 rpcz_store.cc:276] 0709 13:04:14.177467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.180772 (+  3305us) service_pool.cc:224] Handling call
0709 13:04:14.181050 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:14.455266 (+274216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.455309 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:14.455791 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.913732 (+457941us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:14.913879 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.913941 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.196382 (+282441us) raft_consensus.cc:1685] finished
0709 13:04:15.196401 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.196508 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86989,"raft.queue_time_us":274803,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":455668,"threads_started":1,"wal-append.queue_time_us":668477}
I20260709 13:04:15.189538 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:15.193012 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:15.211081 17607 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.218554 17553 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:15.222370 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.222886 15876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58400 (request call id 177) took 1371 ms. Trace:
I20260709 13:04:15.194598 17589 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:15.215612 17701 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.175s	user 0.001s	sys 0.001s
I20260709 13:04:15.243685 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:15.245776 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 52761.8us
W20260709 13:04:15.226939 17688 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:04:15.246435 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.226773 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:15.231917 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.240056 15267 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:15.239715 15876 rpcz_store.cc:276] 0709 13:04:13.851056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.031101 (+180045us) service_pool.cc:224] Handling call
0709 13:04:14.031547 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.142196 (+1110649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.222618 (+ 80422us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004858d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:15.222820 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546112768}
I20260709 13:04:15.204906 17473 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.250377 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.251681 15192 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 4 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:04:15.244984 17562 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:15.263172 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.330231 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:15.341908 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68634.1us
W20260709 13:04:15.346201 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 153259us
I20260709 13:04:15.363386 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1150) took 2301 ms. Trace:
I20260709 13:04:15.363801 15343 rpcz_store.cc:276] 0709 13:04:13.062042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.071159 (+  9117us) service_pool.cc:224] Handling call
0709 13:04:13.071580 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.071848 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.071877 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.077154 (+  5277us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.388247 (+311093us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:13.408287 (+ 20040us) log.cc:844] Serialized 14 byte log entry
0709 13:04:13.419183 (+ 10896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.419274 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.224608 (+1805334us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b1800462580. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:15.341871 (+117263us) raft_consensus.cc:1685] finished
0709 13:04:15.363138 (+ 21267us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.363286 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10151,"prepare.queue_time_us":23786,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":66417,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":14623744,"thread_start_us":289501,"threads_started":1,"wal-append.queue_time_us":555961}
I20260709 13:04:15.364053 15266 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:04:15.367396 15266 pending_rounds.cc:85] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 4
I20260709 13:04:15.367805 15266 pending_rounds.cc:107] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:04:15.368211 15266 raft_consensus.cc:2889] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:15.370244 17717 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:15.247272 17662 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.377790 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.378706 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.382305 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.384567 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.385960 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:15.387202 15191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1449) took 2628 ms (client timeout 1693 ms). Trace:
I20260709 13:04:15.343740 17553 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:15.387774 15191 rpcz_store.cc:269] 0709 13:04:12.752087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.754571 (+  2484us) service_pool.cc:224] Handling call
0709 13:04:15.380602 (+2626031us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54003e58d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:15.380772 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713529088}
W20260709 13:04:15.383905 17608 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.649s	user 0.018s	sys 0.010s
I20260709 13:04:15.377523 17490 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:04:15.363075 17706 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:15.406730 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:15.399348 17608 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.710s	user 0.019s	sys 0.010s
I20260709 13:04:15.414794 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.413255 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:15.419421 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1425) took 1350 ms. Trace:
I20260709 13:04:15.342670 17473 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.419842 15271 rpcz_store.cc:276] 0709 13:04:14.068829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.080183 (+ 11354us) service_pool.cc:224] Handling call
0709 13:04:14.080633 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:14.084860 (+  4227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.084890 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:14.085321 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.471845 (+386524us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:14.471886 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.471956 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.419149 (+947193us) raft_consensus.cc:1685] finished
0709 13:04:15.419177 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.419346 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3746,"raft.queue_time_us":113504,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":385767,"threads_started":1,"wal-append.queue_time_us":843399}
W20260709 13:04:15.428884 17710 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:04:15.407877 17631 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:15.436709 17672 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:15.437211 17672 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:15.437574 17672 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:15.424539 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.406224 17670 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.453166 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:15.454905 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:15.456261 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:15.420943 17582 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:15.472972 15191 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:15.480288 15196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1463) took 2676 ms (client timeout 1516 ms). Trace:
I20260709 13:04:15.480825 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:15.480774 15196 rpcz_store.cc:269] 0709 13:04:12.804284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.805692 (+  1408us) service_pool.cc:224] Handling call
0709 13:04:15.479993 (+2674301us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54001e78d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:15.480186 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3274318080}
I20260709 13:04:15.447403 17605 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:15.474537 17591 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:15.483732 17591 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.484246 17591 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.471364 17490 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 13:04:15.496002 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 146342us
I20260709 13:04:15.497275 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:15.499298 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.472738 17582 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.478281 17384 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:15.504014 15191 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:15.509609 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.510643 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:15.512200 17545 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.516477 17545 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.504596 17662 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:15.517168 17714 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:15.504987 17706 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:15.518368 17706 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.519261 17545 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.525058 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1507) took 1321 ms. Trace:
I20260709 13:04:15.525163 17639 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.527560 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.529012 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.529203 15192 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:04:15.529585 15192 pending_rounds.cc:85] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 3
I20260709 13:04:15.529974 15192 pending_rounds.cc:107] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 13:04:15.505751 17582 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.609340 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:15.605086 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:15.531441 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:15.558455 15194 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1134) took 2265 ms (client timeout 2189 ms). Trace:
I20260709 13:04:15.635234 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.589222 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1433) took 1493 ms. Trace:
I20260709 13:04:15.648394 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1328) took 1530 ms. Trace:
W20260709 13:04:15.557446 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.602378 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:15.556352 15192 raft_consensus.cc:2917] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 13:04:15.643680 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:15.650825 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:15.530601 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.547878 15271 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:15.568698 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.577387 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:15.619102 15195 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:04:15.616698 15193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1132) took 2424 ms (client timeout 2373 ms). Trace:
I20260709 13:04:15.525547 15341 rpcz_store.cc:276] 0709 13:04:14.203540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.449919 (+246379us) service_pool.cc:224] Handling call
0709 13:04:14.460859 (+ 10940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.504188 (+ 43329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.504214 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:14.504253 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:14.504287 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.524824 (+1020537us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5400174dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:15.524872 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.524994 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99184384}
I20260709 13:04:15.557147 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:15.640981 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.548666 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:15.714777 15193 rpcz_store.cc:269] 0709 13:04:13.192468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.193321 (+   853us) service_pool.cc:224] Handling call
0709 13:04:15.616390 (+2423069us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54000fb4d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:15.616599 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722841344}
W20260709 13:04:15.715363 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 166801us
I20260709 13:04:15.716722 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:15.717870 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.717898 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.642179 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:15.719002 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:15.719707 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77626.1us
I20260709 13:04:15.717866 15192 raft_consensus.cc:2889] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:15.714618 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1498) took 1538 ms (client timeout 1963 ms). Trace:
W20260709 13:04:15.720697 15340 rpcz_store.cc:269] 0709 13:04:14.176659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.179215 (+  2556us) service_pool.cc:224] Handling call
0709 13:04:15.602226 (+1423011us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:04:15.714552 (+112326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16361216}
I20260709 13:04:15.716017 15263 rpcz_store.cc:276] 0709 13:04:14.118439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.449578 (+331139us) service_pool.cc:224] Handling call
0709 13:04:14.591190 (+141612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:14.634951 (+ 43761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.648100 (+1013149us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001d92d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:15.648311 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324957568}
I20260709 13:04:15.718873 15188 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:15.719729 15271 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
W20260709 13:04:15.715521 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:15.612790 17676 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.823s	user 0.009s	sys 0.026s
I20260709 13:04:15.508450 17384 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:15.556802 17722 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:04:15.620163 17700 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.712s	user 0.007s	sys 0.010s
W20260709 13:04:15.671409 15162 connection.cc:256] RPC call timeout handler was delayed by -1.1798645149999629s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 13:04:15.716845 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:15.729350 15344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1497) took 1553 ms (client timeout 1901 ms). Trace:
I20260709 13:04:15.720498 15272 rpcz_store.cc:276] 0709 13:04:14.096303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.097826 (+  1523us) service_pool.cc:224] Handling call
0709 13:04:14.162404 (+ 64578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.458367 (+295963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.458402 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:14.458446 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:14.458489 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.588997 (+1130508us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54003287d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:15.589038 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.589163 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680149888}
W20260709 13:04:15.743947 15162 connection.cc:256] RPC call timeout handler was delayed by -1.0744521359999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
W20260709 13:04:15.743976 15344 rpcz_store.cc:269] 0709 13:04:14.176381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.179118 (+  2737us) service_pool.cc:224] Handling call
0709 13:04:15.577240 (+1398122us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:04:15.729290 (+152050us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16383744}
I20260709 13:04:15.727491 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:15.731554 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:15.731611 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 122331us
W20260709 13:04:15.558406 17718 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:15.749039 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:15.749528 17264 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:15.749919 17264 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.728202 17562 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:15.728924 17631 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:15.520524 17706 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.771673 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:15.647910 17315 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:04:15.714123 15194 rpcz_store.cc:269] 0709 13:04:13.292758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.292897 (+   139us) service_pool.cc:224] Handling call
0709 13:04:15.558258 (+2265361us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54002364d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:15.558383 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61245824}
I20260709 13:04:15.791381 15345 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:04:15.791519 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:15.791751 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.792644 15194 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:15.789916 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46344 (request call id 65) took 11383 ms. Trace:
I20260709 13:04:15.793692 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.794656 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:15.795863 15337 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:04:15.738615 15160 connection.cc:256] RPC call timeout handler was delayed by -1.952090326000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:04:15.680220 17543 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.644701 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:15.636812 17542 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:15.790848 17315 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:15.577677 17473 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.813254 17543 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.820511 17543 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.823271 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:15.824198 15342 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.740041 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.544685 17628 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.587662 17644 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.745477 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:15.645787 17683 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:15.649044 17607 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.597213 17609 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.599153 17470 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.746994 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:15.840071 17542 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:15.747601 15197 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:15.847350 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.847991 17542 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:15.848518 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.848735 17662 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:15.849922 15197 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:15.850136 17699 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.940s	user 0.004s	sys 0.000s
I20260709 13:04:15.644932 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:15.572589 17533 consensus_meta.cc:287] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
I20260709 13:04:15.851377 17533 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:15.568092 17689 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.661s	user 0.002s	sys 0.000s
I20260709 13:04:15.750069 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:15.852497 15264 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.753059 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:15.851404 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1432) took 1755 ms. Trace:
I20260709 13:04:15.636745 17658 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.757537 17672 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:15.868137 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 122740us
I20260709 13:04:15.586494 17535 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:15.879908 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 115694us
I20260709 13:04:15.574304 17492 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.165s
I20260709 13:04:15.759509 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.643002 17679 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:04:15.617938 17692 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:15.772146 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.739571 17384 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:15.735065 17453 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:15.792660 17611 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:15.752588 17605 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:15.828394 15270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.051s	sys 0.079s
I20260709 13:04:15.758914 17264 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.833745 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.757380 17670 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:15.757537 17562 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:15.771401 17659 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:15.793397 15192 rpcz_store.cc:276] 0709 13:04:04.366699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.477664 (+110965us) service_pool.cc:224] Handling call
0709 13:04:05.929701 (+1452037us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b54002b69a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e568a520 00007f36e5713b42 00007f36e5712800 00007f36e570b9fa 00007f36ea6d34c9 00007f36e3c4fc54 00007f36e3c4fbe2 00007f36e3c4fb11 00007f36e3c4fa8c 00007f36e3c4ed42
0709 13:04:06.041558 (+111857us) log.cc:844] Serialized 494 byte log entry
0709 13:04:06.463368 (+421810us) spinlock_profiling.cc:243] Waited 44.5 ms on lock 0x7b54002b69a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5686142 00007f36e5666eaa 00007f36e566dd53 00007f36e566dcd9 00007f36e566dc69 00007f36e566dc31 00007f36e566cdfd 000000000038f354 000000000038f199 00007f36e2620475
0709 13:04:15.750323 (+9286955us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160881,"raft.queue_time_us":179509,"raft.run_cpu_time_us":4818,"raft.run_wall_time_us":187432,"spinlock_wait_cycles":115964928,"thread_start_us":190640,"threads_started":1,"wal-append.queue_time_us":141640,"wal-append.run_cpu_time_us":1996,"wal-append.run_wall_time_us":1004310}
I20260709 13:04:15.771756 17639 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:15.787660 17631 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:15.854327 15268 rpcz_store.cc:276] 0709 13:04:14.095987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.096415 (+   428us) service_pool.cc:224] Handling call
0709 13:04:14.096764 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:14.125332 (+ 28568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.125360 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:14.125797 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.481224 (+355427us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:14.481265 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.481330 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.797150 (+1315820us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:15.851106 (+ 53956us) raft_consensus.cc:1685] finished
0709 13:04:15.851130 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.851333 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8396,"raft.queue_time_us":262332,"raft.run_cpu_time_us":583,"raft.run_wall_time_us":8072,"spinlock_wait_cycles":20267904,"thread_start_us":222517,"threads_started":2,"wal-append.queue_time_us":576527}
I20260709 13:04:15.753206 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.882521 17658 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.796737 17589 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:15.813478 17706 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.756757 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:15.882905 15160 connection.cc:256] RPC call timeout handler was delayed by -1.6100903260000905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.209s for a response
W20260709 13:04:15.983681 15160 connection.cc:256] RPC call timeout handler was delayed by -1.5290903260000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
I20260709 13:04:15.976140 17562 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.987502 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.963601 17453 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:15.886842 15265 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:15.874035 15264 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:15.840857 17494 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:04:15.844091 17628 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.900511 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1472) took 1771 ms. Trace:
I20260709 13:04:15.910385 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.997581 15263 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:15.912948 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.914251 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.916637 15269 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:15.895594 15092 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:15.953843 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:15.955518 17315 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:15.956899 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 48161.4us
I20260709 13:04:15.957039 15267 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:04:15.960526 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 229031us
I20260709 13:04:16.010706 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:15.965372 15342 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:15.887409 17644 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:04:15.978698 17631 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.972046 15188 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:15.984014 17641 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:15.988636 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.989373 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.024588 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.024906 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.025787 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.026552 15191 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:15.883714 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 131972us
I20260709 13:04:16.027560 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.029305 15092 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:15.999852 17453 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:16.030206 17526 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:16.030805 17526 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.031365 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.030956 15092 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:16.032997 17526 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.033170 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:16.033933 15268 raft_consensus.cc:2368] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6.
I20260709 13:04:16.012929 17712 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:16.034468 17712 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.994346 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:15.995057 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 126048us
I20260709 13:04:15.999778 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:15.997344 15195 rpcz_store.cc:276] 0709 13:04:14.129001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.131214 (+  2213us) service_pool.cc:224] Handling call
0709 13:04:15.618546 (+1487332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.714085 (+ 95539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.900160 (+186075us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000fb4d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:15.900321 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3189886720}
I20260709 13:04:16.032466 15092 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 2 to 3, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:16.020407 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:15.961899 17692 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:15.991259 15192 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:16.034736 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.051070 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.051716 15270 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:15.971593 17611 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.052544 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.053453 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.971586 17605 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.060084 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.060541 17605 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.061180 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:16.061868 15269 raft_consensus.cc:2368] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
I20260709 13:04:16.062276 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.063126 15263 raft_consensus.cc:2368] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
I20260709 13:04:16.063844 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.063997 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.064774 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.065342 15263 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:16.065454 15264 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:04:16.067287 17697 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.160s	user 0.010s	sys 0.006s
I20260709 13:04:16.067404 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.068025 15190 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:16.068444 17728 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:16.068889 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.069311 15268 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:16.069880 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:16.070125 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 105) took 2034 ms. Trace:
I20260709 13:04:16.062717 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:16.026408 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:15.981455 17659 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.056609 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.056905 15092 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 4, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:15.973531 17591 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:15.992899 17706 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.070945 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.071632 15192 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:04:16.097388 17655 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:16.080911 17494 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.667204 17655 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:16.082321 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.667670 17494 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:16.641392 17740 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:04:16.097009 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.668464 17655 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:16.189596 17628 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.096810 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:16.022629 17329 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:16.673007 15272 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:16.674204 17655 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:16.053153 15270 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:16.193493 17470 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:16.072801 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:16.678083 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 605291us
I20260709 13:04:16.678821 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.679247 17608 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:16.679736 17608 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:16.680011 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.680709 15190 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:16.680534 17608 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.681402 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.682394 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:16.665479 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 592874us
I20260709 13:04:16.684273 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:16.667351 17605 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:16.669533 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:16.687373 17605 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.688047 15196 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:04:16.688776 17542 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:16.669327 17658 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:16.487084 17562 consensus_meta.cc:287] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.502s	user 0.004s	sys 0.004s
I20260709 13:04:16.690352 17562 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:16.693517 17562 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:16.693642 17729 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:16.694209 17729 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.695190 17644 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:16.696345 17729 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:16.697230 17747 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:16.698356 17747 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.671613 17315 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:16.702454 17747 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:16.336112 17727 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.314s	user 0.000s	sys 0.000s
W20260709 13:04:16.582734 17582 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.002s
I20260709 13:04:16.100754 17692 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:16.644088 17631 consensus_meta.cc:287] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.003s
I20260709 13:04:16.707463 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 140) took 1358 ms. Trace:
I20260709 13:04:16.070477 15338 rpcz_store.cc:276] 0709 13:04:14.035519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.036070 (+   551us) service_pool.cc:224] Handling call
0709 13:04:14.036507 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:14.046301 (+  9794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.046344 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:14.078214 (+ 31870us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.632374 (+554160us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:14.632430 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.632534 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.066645 (+1434111us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:16.069800 (+  3155us) raft_consensus.cc:1685] finished
0709 13:04:16.069820 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.070032 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34378,"raft.queue_time_us":10004,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":25920,"spinlock_wait_cycles":7373696,"thread_start_us":400299,"threads_started":1,"wal-append.queue_time_us":752987}
I20260709 13:04:16.674096 17591 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:16.675355 17730 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:16.098624 17384 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.708117 17692 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:16.676386 17659 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:16.638933 17453 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.608s	user 0.006s	sys 0.000s
I20260709 13:04:16.676537 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:16.677958 17470 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:16.685164 15265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1334) took 2295 ms (client timeout 2461 ms). Trace:
W20260709 13:04:16.685536 15238 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.004s	sys 0.007s
I20260709 13:04:16.685456 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:16.732748 15238 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.004s	sys 0.007s
I20260709 13:04:16.732954 15191 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
W20260709 13:04:16.733207 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 631248us
I20260709 13:04:16.690778 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:16.691193 17605 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:16.344323 17723 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
I20260709 13:04:16.670360 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.670854 17672 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:16.699914 15190 pending_rounds.cc:85] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 2
I20260709 13:04:16.738332 15190 pending_rounds.cc:107] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:04:16.738659 15190 raft_consensus.cc:2889] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:16.669869 17494 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:16.699918 15196 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:04:16.203714 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:16.707152 17631 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.674099 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.710165 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.710500 15269 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
W20260709 13:04:16.740237 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 536596us
I20260709 13:04:16.711153 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:16.741061 15342 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.742704 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.712316 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.712630 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.744315 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:16.744552 15344 raft_consensus.cc:2410] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:16.744658 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.744834 15338 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.745286 15337 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:16.722028 17730 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:16.713567 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.707858 15266 rpcz_store.cc:276] 0709 13:04:15.348741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.369525 (+ 20784us) service_pool.cc:224] Handling call
0709 13:04:15.476711 (+107186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.501126 (+ 24415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.501156 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.509032 (+  7876us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.890199 (+381167us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:15.890268 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.890391 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.707259 (+816868us) raft_consensus.cc:1685] finished
0709 13:04:16.707277 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.707388 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14359,"raft.queue_time_us":6836,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":6158,"thread_start_us":229208,"threads_started":1,"wal-append.queue_time_us":424691}
I20260709 13:04:16.720129 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.749029 15346 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:16.749804 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.750011 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:16.306185 17726 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:04:16.228502 17642 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.075s	user 0.008s	sys 0.005s
W20260709 13:04:16.666019 17715 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.008s	sys 0.043s
I20260709 13:04:16.738420 17591 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:16.731017 15189 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.686477 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:16.443140 17639 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:16.732271 15265 rpcz_store.cc:269] 0709 13:04:14.390064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.441645 (+ 51581us) service_pool.cc:224] Handling call
0709 13:04:16.684996 (+2243351us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54001da1d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:16.685103 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3290796928}
I20260709 13:04:16.715117 17712 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:16.735817 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45102.4us
W20260709 13:04:16.755854 17715 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.008s	sys 0.044s
I20260709 13:04:16.766462 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:16.768028 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:16.312489 17533 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.746183 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.713406 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.723212 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:16.751355 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.751806 15342 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:16.772541 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:16.753408 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.715519 17582 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.776477 17384 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:16.729786 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.777202 15341 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:16.735383 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:16.778141 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.778580 15345 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:16.756649 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.733188 17453 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:16.769963 15339 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:16.753070 17747 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:16.782330 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.771229 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.773504 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.774521 15344 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:16.776242 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:16.777118 17582 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:16.747502 17659 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:16.764470 15338 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:16.784162 15342 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:16.782946 15339 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:16.784708 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:16.785485 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1527) took 1024 ms. Trace:
I20260709 13:04:16.757676 17642 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.787950 15344 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6.
I20260709 13:04:16.787784 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.770388 17728 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:16.787801 15345 rpcz_store.cc:276] 0709 13:04:15.760751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.792277 (+ 31526us) service_pool.cc:224] Handling call
0709 13:04:15.842190 (+ 49913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.779332 (+937142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.783424 (+  4092us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54000b6b54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:16.785423 (+  1999us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153015680}
I20260709 13:04:16.789598 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:16.790211 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.779527 17494 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:16.788261 17659 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:16.773324 17639 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.782078 17747 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.791419 17611 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.799867 15337 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:16.793574 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:16.803081 15346 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:16.790604 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:16.791844 15343 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:16.780895 17533 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.791929 15344 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:16.781447 17679 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:04:16.802735 17746 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.126s	user 0.003s	sys 0.000s
I20260709 13:04:16.800573 17639 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.795629 17659 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:16.796007 17741 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:04:16.793663 17729 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:16.797772 17631 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:16.797076 17642 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.809182 17728 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:16.801801 17747 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:16.850009 17543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.009s	sys 0.010s
I20260709 13:04:16.724731 15092 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 4 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.831404 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:16.954649 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 148956us
I20260709 13:04:16.905192 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.904839 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:16.908068 17264 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.930s	user 0.007s	sys 0.003s
I20260709 13:04:16.910112 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:16.789891 17730 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.856207 17729 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:16.800005 17470 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.841441 15342 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:16.855863 17706 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:16.844313 17533 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.923240 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:16.918669 17453 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:16.924536 15341 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:16.970546 15309 leader_election.cc:400] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6.
I20260709 13:04:16.976538 15309 leader_election.cc:403] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:04:16.959426 17264 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.967372 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1521) took 1213 ms. Trace:
I20260709 13:04:16.982925 17494 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:16.983467 15340 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:16.983829 17494 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:16.986268 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1519) took 1237 ms. Trace:
I20260709 13:04:16.962299 17729 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:16.955003 15092 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 4, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 4 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:16.958106 17679 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:16.968874 17728 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:04:16.996474 17543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.009s	sys 0.011s
I20260709 13:04:16.987001 15340 rpcz_store.cc:276] 0709 13:04:15.748397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.752014 (+  3617us) service_pool.cc:224] Handling call
0709 13:04:15.752264 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.984401 (+1232137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.985677 (+  1276us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400271ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:16.986155 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2830289664}
I20260709 13:04:16.972781 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:16.982223 15343 rpcz_store.cc:276] 0709 13:04:15.753743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.753856 (+   113us) service_pool.cc:224] Handling call
0709 13:04:15.754122 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.842136 (+1088014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.966733 (+124597us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003df254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:16.967154 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2382573440}
W20260709 13:04:17.018322 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62244us
I20260709 13:04:17.006878 17730 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.020622 17683 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:04:17.010560 17533 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.029109 17264 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:17.080037 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.063957 17453 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.087867 17264 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6.
W20260709 13:04:17.080456 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110683us
W20260709 13:04:17.097004 15238 leader_election.cc:336] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.562s (SENT)
I20260709 13:04:17.097932 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:17.099824 17759 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:04:17.100445 15092 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 4, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 4 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.104647 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:17.105252 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1150) took 1041 ms. Trace:
I20260709 13:04:17.104262 15092 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:17.099872 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:17.109133 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1380) took 1075 ms. Trace:
I20260709 13:04:17.101261 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:17.108352 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 364841us
I20260709 13:04:17.109647 15263 rpcz_store.cc:276] 0709 13:04:16.033683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.065918 (+ 32235us) service_pool.cc:224] Handling call
0709 13:04:16.066176 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.080174 (+ 13998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.080217 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.663818 (+583601us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.976760 (+312942us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:17.082085 (+105325us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.108512 (+ 26427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.108655 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.108703 (+    48us) raft_consensus.cc:1685] finished
0709 13:04:17.108715 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.108912 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26121,"prepare.queue_time_us":7531,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":13398,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6688,"thread_start_us":282460,"threads_started":1,"wal-append.queue_time_us":362989}
I20260709 13:04:17.105737 15188 rpcz_store.cc:276] 0709 13:04:16.063404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.688121 (+624717us) service_pool.cc:224] Handling call
0709 13:04:16.688408 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.688709 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.688736 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.689172 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.995328 (+306156us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:16.995494 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.995681 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.104771 (+109090us) raft_consensus.cc:1685] finished
0709 13:04:17.104794 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.104993 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":262995,"threads_started":1,"wal-append.queue_time_us":393235}
I20260709 13:04:17.118158 15189 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
W20260709 13:04:17.118415 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 387423us
I20260709 13:04:17.119143 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1159) took 1053 ms. Trace:
I20260709 13:04:17.123551 15193 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.123633 17760 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:17.134856 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:17.125301 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:17.142722 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:17.144428 17643 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:17.146425 17643 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:17.147081 17608 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:17.147660 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:17.148696 17543 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.149240 17543 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.149470 15188 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:17.150523 17543 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.154098 15160 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:17.158639 17543 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:17.159183 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 87238.9us
I20260709 13:04:17.160759 17755 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:17.160506 15092 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 4 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 5 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.161556 17755 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:17.163369 15842 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.595s (SENT)
I20260709 13:04:17.163511 17760 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:17.164397 17760 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.165009 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:17.166584 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:17.167639 17641 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:17.169306 17536 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:17.146927 17643 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.126861 17494 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.131162 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1504) took 1539 ms. Trace:
I20260709 13:04:17.134554 17659 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.135671 17730 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:17.179720 15194 rpcz_store.cc:276] 0709 13:04:15.591345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.796416 (+205071us) service_pool.cc:224] Handling call
0709 13:04:15.796841 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.076422 (+279581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.076469 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.665857 (+589388us) log.cc:844] Serialized 26 byte log entry
0709 13:04:17.067523 (+401666us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:17.067653 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.068986 (+  1333us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540024ca54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:17.069051 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.130529 (+ 61478us) raft_consensus.cc:1685] finished
0709 13:04:17.130571 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.130886 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54177,"raft.queue_time_us":24295,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":95573,"spinlock_wait_cycles":586357632,"thread_start_us":331458,"threads_started":1,"wal-append.queue_time_us":406484}
I20260709 13:04:17.135747 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:17.106809 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:17.182680 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76106.6us
I20260709 13:04:17.182950 17760 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.183892 15309 leader_election.cc:400] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
I20260709 13:04:17.185287 15309 leader_election.cc:400] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
I20260709 13:04:17.185581 15309 leader_election.cc:403] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:17.186470 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:17.138626 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1152) took 1074 ms. Trace:
I20260709 13:04:17.187129 17264 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:17.187364 17729 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
I20260709 13:04:17.187623 17264 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:17.188099 17264 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.188541 17729 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:17.140956 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.182973 15197 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:17.143133 15189 rpcz_store.cc:276] 0709 13:04:16.065759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.676304 (+610545us) service_pool.cc:224] Handling call
0709 13:04:17.119009 (+442705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:17.176091 17761 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:17.162963 17755 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.176743 17536 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.176682 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.177471 17641 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:17.177534 17643 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.182108 17659 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.187181 15190 rpcz_store.cc:276] 0709 13:04:16.063910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.699314 (+635404us) service_pool.cc:224] Handling call
0709 13:04:16.699718 (+   404us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:16.741791 (+ 42073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.741818 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:16.742459 (+   641us) log.cc:844] Serialized 78 byte log entry
0709 13:04:17.122425 (+379966us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:17.122539 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.122709 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.138143 (+ 15434us) raft_consensus.cc:1685] finished
0709 13:04:17.138165 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.138397 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1114,"raft.queue_time_us":2013,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6482,"spinlock_wait_cycles":32128,"thread_start_us":309120,"threads_started":1,"wal-append.queue_time_us":380516}
I20260709 13:04:17.193269 17761 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:17.199362 17760 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:17.203302 17761 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:17.203662 17734 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:17.204161 17734 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.203861 17760 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.205286 17734 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:17.193437 17536 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.209455 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.199422 17730 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:17.212281 15194 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:17.214386 17536 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:17.215536 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:17.217154 17628 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.217810 15345 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:17.220006 17643 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:17.222939 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69087.7us
I20260709 13:04:17.223966 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:17.224983 17628 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:17.225433 17628 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:17.225893 17628 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:17.225559 17264 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:17.227342 17536 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.231194 17734 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:17.232199 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:17.233276 17659 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:17.233805 17659 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:17.234284 17659 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.240106 17729 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:17.240657 17729 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.241006 17729 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:17.242034 17692 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:17.242719 17692 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:17.245703 17692 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:17.247260 17494 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:17.249563 17760 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.251704 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:17.253466 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:17.255719 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.257901 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:17.261605 15345 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:17.234917 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:17.279071 17734 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:17.279196 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.288540 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.293316 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.293831 17628 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.299749 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.301133 15194 raft_consensus.cc:2410] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:17.303381 17734 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:17.303754 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 88443us
W20260709 13:04:17.306459 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.308035 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.308475 15190 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:17.311213 15197 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:17.318998 17729 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:17.319727 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:04:17.319013 15339 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:17.322062 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 87286.9us
I20260709 13:04:17.286420 17761 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:17.327391 17562 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:04:17.327657 17730 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:17.306764 17734 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.329110 17760 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.336213 17628 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.350461 17760 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.353055 15343 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:17.354334 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:17.355543 15842 leader_election.cc:336] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.837s (SENT)
I20260709 13:04:17.355835 15346 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:17.355942 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:17.353354 17760 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.357748 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:17.397294 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.398818 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61428.8us
I20260709 13:04:17.402148 15339 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:17.395628 17679 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:17.404673 17679 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:17.405826 17679 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.403484 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.413177 15190 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:17.415329 15343 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:17.416575 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:17.417050 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:17.417248 17761 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:17.403270 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:17.415241 17655 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:17.440804 15238 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.713s (SENT)
I20260709 13:04:17.441428 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:17.442489 17760 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:17.442380 17761 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:17.445272 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:17.447994 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 92548.3us
I20260709 13:04:17.424151 17641 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:04:17.456291 17494 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:17.456818 17494 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:17.457975 17494 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.442381 17679 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.464499 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:17.431777 17264 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:17.464648 17761 consensus_queue.cc:1243] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:04:17.471066 17631 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:17.471604 17631 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:17.472007 17631 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:17.468048 17728 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:17.475728 17728 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:17.476145 17728 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:17.481662 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.454526 17659 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:17.485209 17659 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:17.487213 17755 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:17.490329 17729 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:17.500835 17494 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.508128 17760 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:17.521919 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 46688us
I20260709 13:04:17.508852 17760 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.538326 17761 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:17.549557 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:17.550902 15269 raft_consensus.cc:2410] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:17.555109 17760 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.555583 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:17.556526 15267 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:17.558202 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.559268 15266 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.559625 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.563540 15269 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:17.571331 17692 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:17.572029 17692 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:17.575311 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 185120us
I20260709 13:04:17.576273 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:17.577236 17755 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:17.577692 17755 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.577740 17536 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:17.578135 17755 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.578456 17536 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:17.575481 17543 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:17.580809 17543 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.581912 17543 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:17.586635 17643 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.587266 17643 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.588382 17643 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.589352 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.589736 17643 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.590953 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:17.592880 15270 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:17.578969 17536 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.594723 15270 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:17.592931 17761 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:04:17.597582 17761 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:17.597846 17641 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:17.598459 17641 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.599620 17641 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.601480 17641 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:17.602922 17543 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.603521 15266 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:17.585765 17692 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:17.610538 15269 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:17.593007 17760 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:17.617085 17760 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:17.635922 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.639715 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 63552.4us
I20260709 13:04:17.640337 17728 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.641507 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:17.653187 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 56241.9us
I20260709 13:04:17.656248 17760 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:17.669513 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.675495 17755 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:17.675736 17631 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.738220 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.740017 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:17.678123 17536 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.761134 17644 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:04:17.734807 17659 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:17.764071 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 172676us
I20260709 13:04:17.775791 15339 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:17.773347 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:17.784880 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.767269 17659 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:17.799492 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 158235us
W20260709 13:04:17.806546 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.772468 17628 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:17.772476 17728 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:17.812249 15345 raft_consensus.cc:1217] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[3.2-9.5]   Dedup: 3.2->[5.3-9.5]
I20260709 13:04:17.817279 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:17.815766 15345 pending_rounds.cc:85] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 2
W20260709 13:04:17.822677 15842 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.147s (SENT)
I20260709 13:04:17.813140 17659 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:17.819005 15345 pending_rounds.cc:107] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:04:17.875595 15345 raft_consensus.cc:2889] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.813923 17628 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:17.878433 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.881496 15345 pending_rounds.cc:107] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:04:17.881950 15345 raft_consensus.cc:2889] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:17.882088 15269 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:17.882529 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.888983 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 76161.4us
I20260709 13:04:17.891110 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.891988 15267 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.891150 15342 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:04:17.895956 17628 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:17.897295 17773 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.897768 17628 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:17.896030 17774 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:04:17.900041 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.900346 17760 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:04:17.901183 17771 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:04:17.901111 17760 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:17.903374 15267 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:17.903475 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.904219 15266 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:17.907387 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 106967us
W20260709 13:04:17.908124 15842 leader_election.cc:336] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.179s (SENT)
I20260709 13:04:17.909875 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:17.911798 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:17.945318 15266 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:17.955945 15197 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:17.922582 17536 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:17.962352 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 176557us
I20260709 13:04:17.965003 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:17.967634 15238 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.189s (SENT)
I20260709 13:04:17.967724 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.968708 15267 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.961899 17692 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.996932 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:17.975248 17644 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:18.007424 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.995781 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:18.012722 15270 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.012799 15267 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:18.026525 17631 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:18.027433 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.028236 15338 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:18.029661 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:18.031895 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43638.6us
I20260709 13:04:18.032413 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:17.984907 17755 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:18.038762 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 211974us
I20260709 13:04:18.039963 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:17.991513 17692 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:18.050845 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.051661 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 89967us
I20260709 13:04:18.052959 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.038177 17644 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:18.054694 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:18.058754 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:18.059538 15272 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:18.063936 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.066205 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 66083.9us
W20260709 13:04:18.067822 17778 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 13:04:18.067641 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.068725 15342 raft_consensus.cc:2410] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:18.073783 15272 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:18.075575 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.070334 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.058646 17779 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:18.099088 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.100286 15337 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:18.097069 15269 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:18.045729 17494 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:04:18.118595 17781 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.121s	user 0.000s	sys 0.002s
I20260709 13:04:18.085207 17264 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:18.131575 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.132261 15338 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:18.128793 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:18.137876 17672 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:18.138528 17672 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:18.139693 17672 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:18.147467 17679 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:18.147804 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 81630us
I20260709 13:04:18.155874 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:18.154839 15238 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.373s (SENT)
I20260709 13:04:18.163661 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.123450 17779 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:18.162566 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.165808 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.166467 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:18.167450 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:18.168591 15340 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:18.174798 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.172330 15337 raft_consensus.cc:2376] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6. Re-sending same reply.
I20260709 13:04:18.058925 17644 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.177515 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.177515 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.177731 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.185542 15341 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:18.184090 15344 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:18.164935 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:18.188529 15342 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:18.200044 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:18.193146 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.209782 15339 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:18.208336 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.168507 17643 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:04:18.212162 15341 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:18.164354 17659 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.214074 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:18.229557 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65794.7us
W20260709 13:04:18.231940 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.244118 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:18.284833 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.203619 17655 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:18.197549 17761 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:18.290335 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.292544 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.289038 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:18.312879 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 184154us
I20260709 13:04:18.316176 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:18.316521 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 103438us
I20260709 13:04:18.213465 17543 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
W20260709 13:04:18.323064 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.318343 17679 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.334120 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 115964us
I20260709 13:04:18.336393 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:18.337319 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.338380 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.335543 15346 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:18.341374 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 52668.9us
I20260709 13:04:18.346738 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:18.347798 15342 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:18.349618 15344 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:18.351790 17795 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:18.350401 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.332041 17755 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:18.346117 17692 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:18.357870 17715 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:18.360473 15346 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:18.324716 17655 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:18.364193 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.328661 17779 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:18.371675 17786 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:04:18.373143 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.373473 17760 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:18.360025 17788 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:04:18.375890 17788 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:18.376271 17788 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:18.377216 17788 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:18.389001 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.378662 17788 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.335523 17679 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.357950 17755 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:18.404184 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 86200us
W20260709 13:04:18.408140 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.415920 17631 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:18.416501 17655 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:18.416628 17631 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:18.416489 15342 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:04:18.429692 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.419575 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.452579 17659 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:18.485677 17679 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:18.486532 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:18.491066 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.407574 17755 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:18.491474 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51773.7us
I20260709 13:04:18.490705 15270 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:18.514063 17803 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:18.515520 17803 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:18.515944 17803 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:18.517007 17803 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:18.519387 17791 raft_consensus.cc:2764] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:04:18.519773 17782 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.520411 17802 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:04:18.505756 17755 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.562665 17543 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.569489 17264 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:18.570030 17264 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:18.569692 17543 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.571002 17264 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.572069 17264 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:18.520538 17782 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:18.591670 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.594767 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 244817us
I20260709 13:04:18.596328 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:18.597254 17797 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:18.598259 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 154138us
I20260709 13:04:18.598516 17797 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:18.640408 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.641227 17715 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:18.642117 17805 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:04:18.640224 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 126096us
I20260709 13:04:18.642518 17805 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:18.641607 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.641434 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 294964us
W20260709 13:04:18.609576 17775 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.698s	user 0.003s	sys 0.002s
I20260709 13:04:18.660717 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:18.662570 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:18.663586 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:18.664155 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:18.674299 17755 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.676435 15193 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:18.676460 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:18.678436 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.679435 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:18.680187 15191 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:18.664458 17805 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.680713 17782 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:18.684324 15192 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:18.686515 17801 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:04:18.688248 17543 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:18.688792 17543 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:18.692394 17659 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:18.694141 17659 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:18.694522 17659 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:18.696121 17728 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:18.696524 17728 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:18.697328 17728 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.698402 17728 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:18.700321 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:18.705955 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.705005 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:18.707497 17809 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:18.685112 17805 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:18.723598 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47238.9us
I20260709 13:04:18.733857 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:18.679270 17803 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.741639 17794 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.742334 17794 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:18.744861 17794 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:18.757433 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:18.735596 17788 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:18.730077 17729 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.762394 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80547.6us
I20260709 13:04:18.763002 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:18.734838 17755 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:18.772037 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:18.779616 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.789237 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:18.789891 15339 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:18.763820 17788 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:18.795536 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.795650 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.798528 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:18.772938 17631 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:18.804685 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:18.777235 17692 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:18.801724 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:18.810457 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53105.5us
I20260709 13:04:18.767143 17729 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.801461 17788 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.820150 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:18.814771 17692 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.820995 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:18.821301 17760 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:18.761164 17797 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:18.819517 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:18.834619 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:18.828830 17692 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:18.833585 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:18.842175 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:18.841971 17494 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:18.844923 17789 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:18.869527 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.839547 17800 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:18.881973 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 63549.6us
I20260709 13:04:18.883351 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:18.886847 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44800.2us
I20260709 13:04:18.842414 17755 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:18.838410 17814 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:18.879542 17800 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:18.892668 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:18.893983 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:18.897768 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:18.903721 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.904507 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 87433us
I20260709 13:04:18.893574 17800 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.907902 17830 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:18.911158 17792 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:18.900243 17789 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:18.967650 17796 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:18.972028 17825 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:18.986089 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.917168 17494 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:19.008828 17831 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:19.009038 17788 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.011729 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 83343.4us
I20260709 13:04:18.916558 17792 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:19.027010 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 143743us
I20260709 13:04:19.027899 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.029402 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.018764 17760 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:19.026546 15842 leader_election.cc:336] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.792s (SENT)
I20260709 13:04:19.031677 15842 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:19.042724 17729 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:19.042789 17760 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.051964 17789 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.047215 17494 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:19.053264 17820 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.158s	user 0.007s	sys 0.000s
I20260709 13:04:19.053187 17789 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:18.983817 17796 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:19.056577 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.059168 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 161475us
I20260709 13:04:19.011852 17825 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.053187 17494 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.057847 17803 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:19.060305 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.016681 17780 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:19.034003 17830 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:19.076301 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 102699us
I20260709 13:04:19.055347 17655 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:19.095053 17822 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.118s	user 0.002s	sys 0.012s
I20260709 13:04:19.094835 17796 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.097321 17692 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.099520 17828 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:04:19.097990 17796 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.094179 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.102358 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:19.104769 17826 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:04:19.071614 17803 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:19.112071 15339 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:19.130503 17803 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.083344 17800 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.131942 15342 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:19.133129 17800 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:19.133972 17795 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:19.108629 17792 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.086419 17827 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:19.138564 17827 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.139437 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:19.061175 17825 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.084961 17641 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.115906 17643 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:19.142469 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.175577 15195 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:19.175769 15272 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
W20260709 13:04:19.176095 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 73904.3us
I20260709 13:04:19.144289 17628 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:19.147385 17692 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.090361 17830 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:19.148061 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:19.148456 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:19.200002 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.161121 17641 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.150629 17832 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:19.151275 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:19.211750 15266 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.093679 17797 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:19.152463 15340 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:19.153354 17788 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.150645 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.088892 17780 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.164214 15188 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:19.143649 17827 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:19.182332 17814 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:04:19.189038 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.224788 17780 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.188881 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:19.189694 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:19.191444 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:19.210357 17773 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:19.226480 15189 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:19.193552 15192 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:19.200433 17830 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.198470 15190 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:19.147938 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.146219 17659 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.200453 15270 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:19.201448 15193 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:19.179286 17628 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:19.201494 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:19.204123 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.204589 17823 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:19.207962 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.175405 17643 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:19.214519 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.221131 17715 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:19.228514 15266 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
W20260709 13:04:19.232100 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.247614 15195 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
W20260709 13:04:19.318599 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 117223us
I20260709 13:04:19.325641 15270 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
W20260709 13:04:19.327208 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 176631us
I20260709 13:04:19.215013 17832 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.328974 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 88571.1us
I20260709 13:04:19.300202 17814 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.291836 17773 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.341426 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.341681 17773 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.342902 17783 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:19.346333 17728 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:19.347236 15093 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 6 to 9, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 9 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:19.349493 17792 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:19.349895 17792 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.350708 17792 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.352128 17792 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.357878 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.359117 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.360666 17789 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:19.361290 17789 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.361896 17264 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:04:19.364391 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.365049 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.365672 15266 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:19.230564 17797 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.215945 17803 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.315641 17715 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:19.315397 17788 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:19.383147 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.328497 17827 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:19.339607 17800 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:19.391501 17803 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.404835 15093 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 5 to 7, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 7 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.394896 17628 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.412891 15238 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.551s (SENT)
I20260709 13:04:19.385461 17715 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.419795 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.362550 17789 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.411378 17805 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:19.381595 17643 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.424638 17805 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:19.425156 17643 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.417549 15839 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.427656 17779 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:19.428058 17779 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.428625 17779 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:19.414269 15238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.561s (SENT) [suppressed 66 similar messages]
W20260709 13:04:19.429508 15238 leader_election.cc:336] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.586s (SENT)
I20260709 13:04:19.429940 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.430707 17692 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:19.425244 17805 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.438879 17628 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.439729 17779 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.425184 17797 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.340178 17755 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:04:19.444021 17755 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:19.444442 17755 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:19.444931 17779 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:19.395767 17659 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.317634 17823 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.430984 15238 leader_election.cc:336] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.610s (SENT)
I20260709 13:04:19.434362 17641 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:19.434548 17832 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.435554 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:19.421700 17827 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.437147 17825 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.408890 15093 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 6 to 7, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:19.452997 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70128.3us
W20260709 13:04:19.455852 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.455981 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 93340us
I20260709 13:04:19.457664 17264 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:19.467159 15238 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.620s (SENT)
I20260709 13:04:19.402876 17788 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.500270 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.499663 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.486052 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:19.445430 17755 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.487954 17825 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.489676 17823 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.476783 17827 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:19.374241 17814 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.502303 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.505910 17755 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:19.506073 15238 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.625s (SENT)
W20260709 13:04:19.517220 15238 leader_election.cc:336] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.635s (SENT)
I20260709 13:04:19.517632 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:19.506579 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 161391us
I20260709 13:04:19.517750 15093 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 3 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:19.512128 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.528661 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 161660us
I20260709 13:04:19.513998 15873 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:19.531188 17692 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:19.532055 17264 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.535633 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.536396 17803 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:19.536938 17803 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.509477 17832 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:19.540140 15238 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.665s (SENT)
I20260709 13:04:19.540566 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.514089 17773 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:19.466889 17805 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.544044 15263 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.545631 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:19.546711 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.547099 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.547847 15272 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:19.547361 15265 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:19.550541 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.551923 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:19.552567 15269 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.551863 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.555539 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.556166 15344 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.557541 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.558897 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.559528 15345 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:19.559689 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.560459 17803 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.560770 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.560945 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.561595 15346 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:19.561717 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.562434 15342 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:19.562800 15346 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:19.563339 17760 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:19.564147 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.544198 17692 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:19.564427 15338 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:19.564793 17692 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.565449 15238 leader_election.cc:336] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.762s (SENT)
I20260709 13:04:19.561333 15345 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:19.565945 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.564814 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.569890 15343 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:19.569362 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:19.575387 15238 leader_election.cc:336] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.968s (SENT)
I20260709 13:04:19.575456 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.575989 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.581097 15269 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:19.544076 17848 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:19.584568 17760 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:04:19.582213 17728 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:19.591383 17728 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.591333 15093 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 5 to 6, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 6 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:19.593210 15093 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 5, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 5 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.594059 17728 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:19.588744 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.590621 15266 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:04:19.600827 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.584597 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:19.570894 17797 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:19.606604 15092 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 167) took 18337 ms (client timeout 15000 ms). Trace:
I20260709 13:04:19.612294 17692 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.582865 17803 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:19.614003 17803 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:19.570940 17773 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.616217 15344 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:19.582067 17780 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:19.603331 15196 raft_consensus.cc:606] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:19.619879 15196 raft_consensus.cc:614] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:19.621450 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.569849 17789 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:04:19.618928 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.629637 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.595652 17832 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:19.633176 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 87617.1us
I20260709 13:04:19.635116 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.636283 17854 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:19.582223 17779 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:04:19.658746 15194 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:19.653558 15195 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:19.627965 17780 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:19.633446 17832 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.658636 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.619342 17797 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.664975 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76319.7us
I20260709 13:04:19.668684 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:19.666452 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.653398 17264 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:19.616765 15092 rpcz_store.cc:269] 0709 13:04:01.269858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.270293 (+   435us) service_pool.cc:224] Handling call
0709 13:04:19.606500 (+18336207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:17.486213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:17.487160 (+   947us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:17.487219 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:04:17.487257 (+    38us) tablet.cc:662] Decoding operations
0709 13:04:17.492898 (+  5641us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:17.492978 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:17.493007 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:04:17.493942 (+   935us) tablet.cc:701] Row locks acquired
0709 13:04:17.494137 (+   195us) write_op.cc:260] PREPARE: finished
0709 13:04:17.494341 (+   204us) write_op.cc:270] Start()
0709 13:04:17.494496 (+   155us) write_op.cc:276] Timestamp: P: 1783602257494266 usec, L: 0
0709 13:04:17.494517 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:04:17.495378 (+   861us) log.cc:844] Serialized 4003 byte log entry
0709 13:04:18.350187 (+854809us) op_driver.cc:464] REPLICATION: finished
0709 13:04:18.712325 (+362138us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e9143ef0
0709 13:04:18.879695 (+167370us) write_op.cc:301] APPLY: starting
0709 13:04:18.889643 (+  9948us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:18.927129 (+ 37486us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:18.927182 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:19.096085 (+168903us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:19.096428 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:04:19.096477 (+    49us) write_op.cc:312] APPLY: finished
0709 13:04:19.096808 (+   331us) log.cc:844] Serialized 76 byte log entry
0709 13:04:19.097044 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:19.097178 (+   134us) write_op.cc:454] Released schema lock
0709 13:04:19.097248 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:19.097649 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:19.097681 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68677,"reported_tablets":42,"spinlock_wait_cycles":157312,"child_traces":[["op",{"apply.queue_time_us":470305,"apply.run_cpu_time_us":6105,"apply.run_wall_time_us":258670,"num_ops":10,"prepare.queue_time_us":52028,"prepare.run_cpu_time_us":62469,"prepare.run_wall_time_us":392616,"raft.queue_time_us":201474,"raft.run_cpu_time_us":48593,"raft.run_wall_time_us":476534,"replication_time_us":839882,"spinlock_wait_cycles":7662976,"thread_start_us":867457,"threads_started":4,"wal-append.queue_time_us":501093}]]}
I20260709 13:04:19.676419 15266 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:19.674569 17760 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:19.662772 17780 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.677537 17843 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:04:19.671471 17264 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.678750 17264 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.665527 17832 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.660615 17854 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:19.652921 17631 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:04:19.696892 15195 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:04:19.703658 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.691156 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.713564 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 138153us
I20260709 13:04:19.695441 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:19.720525 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54214.7us
W20260709 13:04:19.735682 15238 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.033s (SENT)
I20260709 13:04:19.736567 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:19.738305 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.747134 15842 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.246s (SENT)
W20260709 13:04:19.755069 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59712.3us
I20260709 13:04:19.755859 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:19.759632 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.657622 17845 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:04:19.692911 17789 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:19.691677 17729 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:19.677731 17760 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:19.692129 17814 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.692196 17792 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:19.706439 17788 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.694888 17854 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:19.735675 17692 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:19.675093 17715 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.787178 17849 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:04:19.789283 17853 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:04:19.735620 17494 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:04:19.768452 17789 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.771111 17729 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.775156 17760 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.779189 17792 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:19.816447 17794 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:19.817077 17790 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:04:19.831611 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.821594 17715 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:19.827144 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70224.5us
I20260709 13:04:19.759655 17773 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.786588 17855 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:19.838716 17830 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.827860 17792 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:19.839502 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.843842 15340 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:19.840195 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.787158 17857 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:19.790169 17858 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:19.840399 17794 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:19.841929 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.847301 17790 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:19.826223 17729 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:19.858191 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.852742 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:19.854265 17790 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.859776 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.860065 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.860422 17790 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.863770 17790 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.860512 17794 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.865415 17805 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.867408 15265 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:19.868026 17832 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.869179 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:19.869715 17780 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.819353 17843 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:19.870460 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.871526 17855 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:19.872562 17855 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.858285 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.874548 17830 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.860813 17865 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:19.876720 17779 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:19.878444 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 110851us
I20260709 13:04:19.879576 17800 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:19.879271 17264 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.879962 17800 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:19.880878 17800 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.881567 15339 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:19.881956 15263 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:19.882282 17800 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.882493 17795 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:19.844681 17803 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:19.887300 17803 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:19.888236 17851 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.311s	user 0.000s	sys 0.002s
I20260709 13:04:19.887744 17792 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.888302 17803 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.889650 17803 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.890110 17854 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:19.892695 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.861145 17789 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:19.893582 17780 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.895545 15272 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:19.870165 17832 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:19.881448 17264 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:19.904311 15190 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:04:19.904763 15190 pending_rounds.cc:85] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 4
I20260709 13:04:19.905043 15190 pending_rounds.cc:107] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:04:19.905315 15190 raft_consensus.cc:2889] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:19.906363 15263 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:19.906229 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.907110 15340 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.904562 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:19.907766 15189 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:19.911304 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.913008 15191 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:19.915755 15192 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:19.916419 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.919410 15873 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:19.894326 17858 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:19.921171 17830 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:19.922542 17857 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:19.922923 17857 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:19.923924 17857 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:19.925079 17857 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.927165 17797 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:19.921420 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:19.929126 15193 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:19.921599 15195 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:04:19.930491 15195 pending_rounds.cc:85] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 5
I20260709 13:04:19.930820 15195 pending_rounds.cc:107] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:19.930953 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.930974 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:19.931808 15266 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:19.931866 15263 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:19.931156 15195 raft_consensus.cc:2889] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:19.895205 17865 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:19.944573 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.946094 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:19.947002 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:19.949546 15340 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
W20260709 13:04:19.962575 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.966562 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.967841 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:19.939670 17494 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.957531 15189 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:19.937316 17848 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:19.971975 15238 leader_election.cc:336] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.852s (SENT)
I20260709 13:04:19.974752 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.976766 15343 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:04:19.949311 17858 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.984704 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:19.995476 15238 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.859s (SENT)
I20260709 13:04:19.996099 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.002293 17862 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:20.003067 17862 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.003466 17862 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.965540 17264 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:04:19.976140 17643 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.003890 15868 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:20.012293 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.968040 17728 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:04:20.023856 17861 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:04:20.024751 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.024652 17760 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:20.025434 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.996089 17830 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:20.027448 17792 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:20.031137 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:20.038806 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43575.8us
I20260709 13:04:20.039377 15344 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:19.976192 17494 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.040589 17855 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:20.041204 17788 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.042701 15272 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:20.058386 15263 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:20.006371 17729 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.064399 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.065007 15265 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.066054 15266 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:20.044888 15238 leader_election.cc:336] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.034s (SENT)
I20260709 13:04:20.015762 17643 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.049788 17868 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:20.068460 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.069545 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:19.992650 17858 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:20.053778 17773 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:20.039737 17865 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.078487 17494 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:20.076736 17868 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:20.077531 15238 leader_election.cc:336] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.093s (SENT)
I20260709 13:04:20.080370 17773 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:20.074147 17755 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:20.084026 17855 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:20.086150 15238 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.104s (SENT)
I20260709 13:04:20.088486 17760 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:20.088883 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.070577 17867 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:04:20.066469 17788 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.095777 15263 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:20.088415 17858 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:20.082150 17643 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:20.104985 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.107957 15266 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:20.108069 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.109686 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.109990 15266 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:20.106082 15263 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:20.105506 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.110270 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.111179 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.071390 17848 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.114517 15267 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:20.083889 17729 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:20.084760 17854 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:20.112869 17773 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.120342 17773 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.086230 17868 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:20.122954 17788 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:20.104241 17760 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:20.129774 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.139647 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.143826 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.119118 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.144537 15266 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:20.145457 15191 raft_consensus.cc:2368] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11.
I20260709 13:04:20.151194 15338 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:20.151571 15189 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:20.152710 15267 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:20.150867 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:20.156287 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.157193 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:20.157922 15873 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:20.135248 17643 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:20.171316 15868 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:20.176551 17643 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:20.178750 17643 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:20.172175 15337 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:20.174275 17845 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:20.175078 15265 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:20.175557 15191 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:20.181183 15266 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
W20260709 13:04:20.171584 17869 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:04:20.187369 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.189356 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.189628 17789 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:20.192903 17875 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.129s	user 0.001s	sys 0.002s
I20260709 13:04:20.194119 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.252933 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.195276 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.197722 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.213331 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.253621 15266 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:20.254091 15270 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:20.254578 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.255200 15266 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:20.256079 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.256588 15266 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:20.215207 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 89492.4us
W20260709 13:04:20.233145 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.232599 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 71839us
I20260709 13:04:20.246955 15194 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:20.260147 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:20.253161 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:20.269896 15873 raft_consensus.cc:2368] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6.
W20260709 13:04:20.273221 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.274449 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:20.274660 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:20.279590 15339 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.280320 17865 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:20.281047 17865 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:20.282177 17865 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.276151 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:20.277115 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.278142 15268 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.290417 15339 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:20.298379 15268 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:20.299371 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.314280 15265 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:20.300602 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.315079 15266 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:20.315248 15270 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.302699 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.306962 15162 leader_election.cc:400] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6.
I20260709 13:04:20.308924 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.315910 15162 leader_election.cc:403] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:20.316063 15192 raft_consensus.cc:2368] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11.
I20260709 13:04:20.316237 15269 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.308324 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.311185 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:20.317025 15267 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:20.317211 15194 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:20.310256 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:20.312752 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.246265 17845 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:20.255237 17780 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:20.322191 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:20.322575 15264 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:20.321105 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.326344 15346 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:20.326404 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:20.326586 15266 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:04:20.324147 17780 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:20.331614 15190 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:20.333218 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:20.334169 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.334827 15267 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:20.338873 15265 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:20.336223 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:20.340397 15268 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:04:20.255218 17827 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:04:20.348383 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:20.340811 15268 pending_rounds.cc:85] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 4
I20260709 13:04:20.351464 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.350806 15267 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:20.351720 15268 pending_rounds.cc:107] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:04:20.350334 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.353579 15268 raft_consensus.cc:2889] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:20.353893 15192 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.299894 17779 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:04:20.331849 17783 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.358325 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:20.278491 17790 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:04:20.361842 15270 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:20.363014 17803 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:20.364382 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.364825 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.365437 15267 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:20.329699 17867 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:20.347807 17631 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:20.369764 15264 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:20.369733 17848 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:20.382134 15197 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:20.374130 17823 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:20.346822 17795 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:20.348037 17861 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.322945 17794 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:04:20.368446 15269 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:20.402568 15265 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:20.374317 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.395964 15190 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:20.339169 17792 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:04:20.396538 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:20.404035 15188 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:20.420331 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.423462 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.424055 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.424774 15269 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.429873 15271 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:20.434710 15190 raft_consensus.cc:2368] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10.
I20260709 13:04:20.394219 17631 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.397583 17805 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.455323 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.462545 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.462994 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.442636 17795 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:20.467242 17862 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.467160 17795 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.474812 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:20.483342 17872 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 13:04:20.422219 17823 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:20.442852 17858 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:20.478102 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.424142 17672 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:20.442999 17848 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:20.368834 17845 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:20.496115 15238 leader_election.cc:336] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.705s (SENT)
I20260709 13:04:20.512295 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.461299 17631 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:20.489611 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.474771 15269 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:20.497709 15190 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:20.515606 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.499691 15270 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:20.490924 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:20.517112 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 180986us
I20260709 13:04:20.422920 17861 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.525781 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.527536 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.491333 17672 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.473526 17805 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.530705 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.514815 17643 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.484136 17850 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.086s
W20260709 13:04:20.548974 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 216901us
W20260709 13:04:20.593528 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.542474 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 139846us
I20260709 13:04:20.595922 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.596812 15188 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:20.597602 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.599160 17643 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.531139 17803 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:20.603811 15190 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:20.604202 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:20.529335 17845 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:20.621330 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 87519.9us
I20260709 13:04:20.621677 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.623548 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.623344 15238 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.839s (SENT)
I20260709 13:04:20.624761 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:20.626122 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.503202 17858 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.534122 17783 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6.
W20260709 13:04:20.628891 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 133035us
I20260709 13:04:20.550525 17672 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.636423 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.637639 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.667771 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44461.3us
I20260709 13:04:20.634490 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:20.689845 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55440.3us
W20260709 13:04:20.687696 15238 leader_election.cc:336] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.212s (SENT)
I20260709 13:04:20.690698 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.691500 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.694953 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.697405 15267 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:04:20.664240 17862 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:20.703795 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.704952 15193 raft_consensus.cc:2410] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:04:20.667425 17803 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:20.708149 15238 leader_election.cc:336] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.277s (SENT)
I20260709 13:04:20.708752 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:20.715827 15269 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:20.710655 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:20.699820 17796 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:20.739809 17780 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:20.740048 17879 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:04:20.728449 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:20.731087 17886 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:04:20.735456 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.736213 17861 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:20.702011 17832 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:20.746873 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.720690 17865 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:20.758822 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.760344 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.665653 17823 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:20.751443 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 216011us
I20260709 13:04:20.766558 15338 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:20.670220 17848 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.771498 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.778877 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.761878 17845 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.750157 17796 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:20.785308 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.787626 17845 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.793612 17845 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:20.794230 17773 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.673s	user 0.012s	sys 0.000s
I20260709 13:04:20.794567 17796 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:20.796831 17789 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.002s
I20260709 13:04:20.796900 17643 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:20.799083 15195 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:20.799871 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.800752 15193 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:20.800581 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.802183 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.814752 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.815342 17887 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:04:20.816293 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.816908 17892 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:04:20.814780 17858 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:20.818691 15195 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:20.823470 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.826278 17885 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:04:20.832049 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.837688 15193 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:20.842077 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.843379 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.844445 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.846817 15194 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:20.847893 15197 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:20.847409 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.851114 15238 leader_election.cc:336] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.191s (SENT)
I20260709 13:04:20.851723 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.851016 15193 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:20.854127 15238 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.198s (SENT)
I20260709 13:04:20.833145 17631 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.856240 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.857314 15238 leader_election.cc:336] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 3.115s (SENT)
I20260709 13:04:20.858109 15839 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:20.858951 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.861138 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.861366 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:20.862129 15194 raft_consensus.cc:2410] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:04:20.865738 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.867537 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.869086 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.871724 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.874624 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.883217 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.857169 17803 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:20.888983 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.879739 17889 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.338s	user 0.004s	sys 0.000s
I20260709 13:04:20.892539 17908 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.898237 17865 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:20.898530 15194 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:20.899912 17655 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:20.903074 17805 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:20.876037 17780 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:20.934794 17780 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:20.935876 17780 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:20.927399 17655 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:20.888072 17897 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:20.950582 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:20.951383 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 94100.8us
I20260709 13:04:20.953570 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.954543 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.976169 15193 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.960335 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:20.961714 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:20.979080 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.979732 15194 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.952958 17897 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:04:20.959869 17907 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:20.927759 17908 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:20.990679 17631 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:20.991536 15345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:04:20.988435 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.996049 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.997345 15190 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:21.000620 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.002329 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:20.998651 15345 raft_consensus.cc:606] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Received request to transfer leadership
I20260709 13:04:21.003193 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:20.951764 17655 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:21.003868 15190 raft_consensus.cc:2376] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7. Re-sending same reply.
I20260709 13:04:21.012181 15194 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:21.011797 17908 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:21.012491 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.013057 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.000197 17672 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:21.013729 17655 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:21.013895 15194 raft_consensus.cc:2410] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:04:21.015604 17672 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:21.020192 17881 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.490s	user 0.000s	sys 0.001s
I20260709 13:04:21.023121 15870 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:04:21.023582 15870 pending_rounds.cc:85] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 8
I20260709 13:04:21.023792 15870 pending_rounds.cc:107] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:04:21.024001 15870 raft_consensus.cc:2889] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:21.021279 15193 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:21.033347 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:21.034075 15870 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:21.036911 17897 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:21.034788 17672 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:04:21.041353 15345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:04:21.042235 15345 raft_consensus.cc:606] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Received request to transfer leadership
I20260709 13:04:21.048779 15870 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:04:21.072921 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.073477 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.079296 15343 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:21.080130 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:21.081094 15340 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:21.083896 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:21.119603 15238 leader_election.cc:336] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.652s (SENT)
I20260709 13:04:21.088256 15342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34528
I20260709 13:04:21.110173 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.129231 15342 raft_consensus.cc:606] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Received request to transfer leadership
I20260709 13:04:21.109771 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.129156 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.087587 15337 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:04:21.104694 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.130198 15194 raft_consensus.cc:2368] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:21.128719 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:21.088629 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:21.131804 15192 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:21.131613 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:21.141211 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.266995 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:21.198321 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 78798.6us
W20260709 13:04:21.227679 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.269884 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.270514 15238 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.856s (SENT)
W20260709 13:04:21.271736 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.271814 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:21.106186 17888 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.584s	user 0.000s	sys 0.003s
I20260709 13:04:21.098634 15338 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:21.269690 15344 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
W20260709 13:04:21.274369 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.108456 17729 raft_consensus.cc:993] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower 2a3d3cf7ed3b453ebeccda54becdb6e1 to start an election
I20260709 13:04:21.104991 17755 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.103576 17823 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.175971 17915 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:21.088961 17795 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:21.104374 17918 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:21.128147 17790 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.254375 17902 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.198180 17908 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:04:21.169485 17865 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:21.271416 17797 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.284538 17858 raft_consensus.cc:1081] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Signalling peer 2a3d3cf7ed3b453ebeccda54becdb6e1 to start an election
I20260709 13:04:21.286759 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.331523 15192 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:21.288100 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.282752 17832 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:21.288806 17790 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.091787 17909 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.190s
W20260709 13:04:21.300416 15312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.006s	sys 0.009s
W20260709 13:04:21.348338 15312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.006s	sys 0.009s
W20260709 13:04:21.348754 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 960461us
I20260709 13:04:21.228538 17905 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:04:21.108580 17672 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:04:21.167799 17796 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.117s
I20260709 13:04:21.193078 17848 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:04:21.285390 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:21.285789 17918 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:21.366087 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80776.5us
I20260709 13:04:21.366799 17897 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:21.366518 17918 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.367244 17897 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:21.284245 17823 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:21.367569 17918 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:21.367714 17897 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:21.368028 17848 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:21.350670 17760 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.369027 17760 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.360503 17909 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.343520 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.283742 17755 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.383945 15270 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:21.369328 17823 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:21.362192 17867 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:21.359462 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 58) took 10375 ms. Trace:
I20260709 13:04:21.395102 15270 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:21.389179 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:21.396971 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:21.400918 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:21.433255 15271 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:21.433646 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:21.435660 15342 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:21.435928 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:21.436559 15265 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:21.437520 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:21.443087 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 71610.3us
I20260709 13:04:21.443222 17760 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:21.444797 17715 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:21.445314 17715 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.447743 15869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 205) took 1018 ms. Trace:
I20260709 13:04:21.447862 17715 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:21.448071 15195 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:21.448340 17823 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:21.449107 17823 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:21.449666 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:21.450212 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.451337 17823 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:21.451947 15268 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:21.453022 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.369874 17909 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.453693 15196 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 2.
I20260709 13:04:21.455492 17909 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:21.456024 15196 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:21.462396 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.309904 17902 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:21.467691 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 161748us
I20260709 13:04:21.476207 15195 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:21.481163 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:21.482013 15264 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:21.483333 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 92969.8us
I20260709 13:04:21.462039 17755 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:21.394788 15093 rpcz_store.cc:276] 0709 13:04:10.984405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.987324 (+  2919us) service_pool.cc:224] Handling call
0709 13:04:21.359357 (+10372033us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:19.816656 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:19.847544 (+ 30888us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:19.847582 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:04:19.847600 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:19.848436 (+   836us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:19.848525 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:19.848554 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:04:19.849137 (+   583us) tablet.cc:701] Row locks acquired
0709 13:04:19.849158 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:04:19.849311 (+   153us) write_op.cc:270] Start()
0709 13:04:19.849423 (+   112us) write_op.cc:276] Timestamp: P: 1783602259849258 usec, L: 0
0709 13:04:19.849444 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:04:19.891340 (+ 41896us) log.cc:844] Serialized 2495 byte log entry
0709 13:04:20.027822 (+136482us) op_driver.cc:464] REPLICATION: finished
0709 13:04:20.201703 (+173881us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e9143ef0
0709 13:04:20.548529 (+346826us) write_op.cc:301] APPLY: starting
0709 13:04:20.551130 (+  2601us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:20.631540 (+ 80410us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:20.633277 (+  1737us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:20.799201 (+165924us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:20.818145 (+ 18944us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:04:20.818195 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:20.818485 (+   290us) log.cc:844] Serialized 52 byte log entry
0709 13:04:20.818660 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:20.818790 (+   130us) write_op.cc:454] Released schema lock
0709 13:04:20.818840 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:20.819267 (+   427us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:20.819296 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":303869,"reported_tablets":7,"spinlock_wait_cycles":8960,"child_traces":[["op",{"apply.queue_time_us":494501,"apply.run_cpu_time_us":3864,"apply.run_wall_time_us":294112,"num_ops":6,"prepare.queue_time_us":208981,"prepare.run_cpu_time_us":3985,"prepare.run_wall_time_us":75021,"replication_time_us":178212,"spinlock_wait_cycles":10256640,"thread_start_us":442589,"threads_started":2}]]}
W20260709 13:04:21.513216 15238 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.561s (SENT)
I20260709 13:04:21.525408 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:21.330538 17797 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:21.521951 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 87242.6us
W20260709 13:04:21.551679 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.516176 17867 consensus_queue.cc:1243] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:21.562253 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.522524 17790 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:21.594542 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:21.604075 17805 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:21.604548 17805 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.604761 17863 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:21.605329 17863 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:21.614521 15196 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:21.614920 15341 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:21.568771 17909 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.616719 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.566671 15195 raft_consensus.cc:2376] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6. Re-sending same reply.
I20260709 13:04:21.576726 17797 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:21.589213 17902 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:21.448266 15869 rpcz_store.cc:276] 0709 13:04:20.429114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.442482 (+ 13368us) service_pool.cc:224] Handling call
0709 13:04:20.467434 (+ 24952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:20.467813 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:20.467846 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:20.468345 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:04:20.714489 (+246144us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:21.292663 (+578174us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b18002cf620. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf
0709 13:04:21.292849 (+   186us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.315566 (+ 22717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.339570 (+ 24004us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.349812 (+ 10242us) raft_consensus.cc:1685] finished
0709 13:04:21.400939 (+ 51127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.447656 (+ 46717us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14234,"prepare.queue_time_us":174849,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":68539,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":20966,"spinlock_wait_cycles":9316608,"thread_start_us":273748,"threads_started":2,"wal-append.queue_time_us":310330}
I20260709 13:04:21.592585 15870 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d"
dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
 from {username='slave'} at 127.0.0.1:58404
I20260709 13:04:21.598160 17925 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:21.604933 17805 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:21.578089 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.614936 15196 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:21.640609 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.644059 15196 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.635380 15870 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:21.665889 15870 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.645550 15197 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:04:21.666700 15197 pending_rounds.cc:85] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 2
I20260709 13:04:21.666929 15197 pending_rounds.cc:107] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:04:21.667181 15197 raft_consensus.cc:2889] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:21.648047 15339 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:21.648631 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.668177 15193 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
W20260709 13:04:21.668697 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.650828 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.669543 15190 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:21.632362 15271 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:21.670408 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.652549 15194 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:21.671751 17643 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:21.665534 15196 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.675237 15190 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:04:21.679375 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.663656 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:21.642494 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.682325 15192 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:21.691841 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:21.751762 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1605) took 1370 ms. Trace:
I20260709 13:04:21.606523 17863 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.756731 15188 rpcz_store.cc:276] 0709 13:04:20.381668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.598527 (+216859us) service_pool.cc:224] Handling call
0709 13:04:20.598870 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.184420 (+585550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.184468 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.185075 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.506094 (+321019us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:21.506153 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.506256 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.751441 (+245185us) raft_consensus.cc:1685] finished
0709 13:04:21.751472 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.751688 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":501021,"raft.queue_time_us":499486,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":25620,"thread_start_us":396011,"threads_started":2,"wal-append.queue_time_us":364847}
I20260709 13:04:21.767810 15188 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:21.645283 17925 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.773128 17925 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:21.640208 17909 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:21.730945 15238 leader_election.cc:336] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.666s (SENT)
I20260709 13:04:21.700029 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.778774 15193 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:21.696252 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.694209 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:21.691666 15190 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:21.784467 17905 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:21.785010 17905 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:21.700435 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:21.662442 15264 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:21.642735 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.786064 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:21.785857 17905 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.774336 17729 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.787200 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56308.7us
I20260709 13:04:21.787055 17729 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.790329 17729 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:21.792477 17924 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:04:21.792737 17909 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:21.795050 15197 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:21.799677 15197 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:21.802034 15197 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:21.804248 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.724777 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.806202 15195 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:21.790410 15238 leader_election.cc:336] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.689s (SENT)
I20260709 13:04:21.822259 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:21.826319 15197 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:21.842185 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.838035 15870 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:21.684580 17795 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:21.846172 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.846863 15190 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
W20260709 13:04:21.849005 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 58624.1us
W20260709 13:04:21.850065 15238 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.707s (SENT)
I20260709 13:04:21.850538 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:21.643987 17908 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:21.787020 17905 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.855728 15191 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:21.860809 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:21.863104 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.868750 15238 leader_election.cc:336] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.757s (SENT)
W20260709 13:04:21.882529 15238 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.780s (SENT)
W20260709 13:04:21.885524 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.842242 17901 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:21.847106 17863 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.903208 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.927881 15190 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:21.912743 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.870163 17760 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:21.886807 17890 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:21.899696 17925 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.934465 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.934345 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:21.937017 15189 raft_consensus.cc:2376] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6. Re-sending same reply.
I20260709 13:04:21.867660 17908 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.944837 17805 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:21.946465 17897 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.001s
I20260709 13:04:21.911265 17930 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:21.948661 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:21.926718 17919 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:04:21.952440 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.955268 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 432489us
I20260709 13:04:21.957808 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:21.958452 15264 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.963449 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:21.964470 15270 raft_consensus.cc:2368] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6.
I20260709 13:04:21.965724 17631 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:21.968511 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:21.968269 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:21.969219 15271 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.946982 17897 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:21.931146 17901 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.970850 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:21.984318 15238 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.843s (SENT)
W20260709 13:04:21.985291 15238 leader_election.cc:336] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.846s (SENT)
I20260709 13:04:21.985743 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:21.990442 15264 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:21.952814 17803 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:22.013293 15191 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:21.982295 15193 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
W20260709 13:04:21.999023 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.000397 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 472229us
I20260709 13:04:21.999105 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:21.939990 17925 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.961035 17805 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.008757 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:21.979393 17865 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:22.017573 15238 leader_election.cc:336] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.527s (SENT)
I20260709 13:04:21.949710 17890 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:21.996307 17832 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:21.960986 17672 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:04:22.039021 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:21.998227 17858 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:21.994258 17760 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:22.020691 15196 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
W20260709 13:04:22.046947 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.185555 15196 pending_rounds.cc:85] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 4
I20260709 13:04:22.185899 15196 pending_rounds.cc:107] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:04:22.186129 15196 raft_consensus.cc:2889] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:22.186151 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.060209 15238 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.873s (SENT)
I20260709 13:04:22.187333 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.072839 15195 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:22.058422 15197 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:22.011267 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.189824 15264 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:21.952956 17795 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:22.110741 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.994611 17936 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:04:22.123667 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:22.155804 17931 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
W20260709 13:04:22.156940 15147 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46314.6us
I20260709 13:04:22.160068 17897 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.059100 17655 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:04:22.123485 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.174432 17901 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.016778 15868 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:22.179142 17939 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:04:22.219946 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 159756us
W20260709 13:04:22.221158 15238 leader_election.cc:336] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.932s (SENT)
I20260709 13:04:22.221700 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.223021 15870 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.000123 17790 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:04:21.960508 17919 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.059528 17937 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:22.192509 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:22.111435 17858 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.248438 17858 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.255626 17908 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.257072 17925 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.112733 17932 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:22.194447 15271 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:22.198299 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.180680 17729 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:22.258790 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.258720 17729 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:22.259984 17729 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.091432 17832 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.263738 17919 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.264613 17832 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:22.228185 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.195864 17928 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:22.232360 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.233366 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.234057 17933 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.187563 17803 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:22.265848 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 266872us
I20260709 13:04:22.234639 17930 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:22.267201 15265 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 2.
W20260709 13:04:22.266960 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 251157us
I20260709 13:04:22.198096 17760 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.290496 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:22.271767 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 265294us
W20260709 13:04:22.292809 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.274245 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:22.298549 17934 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:22.299326 17934 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:22.300029 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:22.300724 15344 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.300308 17934 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.306344 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.310230 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.310946 15263 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:22.314040 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.314848 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:22.316577 15270 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:22.318687 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.319464 15270 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:22.278988 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:22.284768 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.271988 17890 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.285812 15268 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:22.324522 15265 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:22.331692 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.332687 15265 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:22.341316 15344 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:22.344828 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.346045 15271 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:22.351486 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.354679 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:22.350852 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 129739us
I20260709 13:04:22.358954 17920 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.360075 17920 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.363320 17902 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.363721 17948 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:22.364008 17902 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.364445 17948 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:22.365289 17948 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.367987 17949 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:22.369109 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:22.369688 17760 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.371183 17901 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.371723 17901 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:22.373767 17901 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.374358 17901 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:22.287729 17933 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:22.376612 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:22.377039 17905 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.001s
W20260709 13:04:22.379088 17940 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.121s	user 0.002s	sys 0.002s
I20260709 13:04:22.328430 17930 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:04:22.380802 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.321656 17803 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.382998 17890 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:22.383638 17890 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.384087 17890 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.384380 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 186) took 1006 ms. Trace:
I20260709 13:04:22.384816 15868 rpcz_store.cc:276] 0709 13:04:21.378343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.389107 (+ 10764us) service_pool.cc:224] Handling call
0709 13:04:22.384076 (+994969us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54005e0e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:22.384213 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304128384}
I20260709 13:04:22.385532 17803 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.373427 17858 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.382405 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:22.366614 17902 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.403060 15265 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:22.410022 15265 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:22.353256 17643 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.353018 17926 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.377110 17933 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
W20260709 13:04:22.451561 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69268.1us
I20260709 13:04:22.388374 17755 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.452173 15342 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:22.457741 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:22.486536 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.503772 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.444089 17827 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:22.389635 17901 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 13:04:22.506770 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 392509us
I20260709 13:04:22.449445 17919 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.455961 17926 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.517262 17919 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.504926 17755 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.519687 17919 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.515341 17920 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.520179 17858 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:22.491238 17930 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.521107 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:22.521680 15267 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:22.516536 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:22.522293 15842 leader_election.cc:336] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.704s (SENT)
I20260709 13:04:22.516677 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.522744 15842 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.523190 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:22.529973 15238 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.137s (SENT)
I20260709 13:04:22.530570 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.507051 17795 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.504664 17902 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:22.546658 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:22.449108 17643 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.560978 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:22.528023 17805 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:22.561486 17933 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:22.567088 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.558179 17954 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:22.568720 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 241851us
I20260709 13:04:22.577494 15267 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:22.591643 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.565068 17865 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:22.562711 17918 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:22.559448 17827 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:04:22.534502 17930 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.621462 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:22.620599 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45649.7us
I20260709 13:04:22.571538 17655 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:22.631119 15238 leader_election.cc:400] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:22.631623 15238 leader_election.cc:403] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:22.632998 17905 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:22.633390 17655 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:22.633741 15868 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:22.632695 17803 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:22.634325 17655 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.635046 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.636608 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:22.634318 17803 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.637689 17858 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.639375 17803 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.640302 17729 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:22.588548 17954 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.640036 15091 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.643318 17755 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.643952 17954 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.642901 15091 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:04:22.640302 17938 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.383s	user 0.010s	sys 0.000s
W20260709 13:04:22.644537 17945 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:22.646317 17948 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.647260 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1481) took 1123 ms. Trace:
I20260709 13:04:22.648099 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:22.646270 15091 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.647935 15266 rpcz_store.cc:276] 0709 13:04:21.524067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.526897 (+  2830us) service_pool.cc:224] Handling call
0709 13:04:21.555184 (+ 28287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.828177 (+272993us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:21.840912 (+ 12735us) log.cc:844] Serialized 14 byte log entry
0709 13:04:22.323715 (+482803us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.349359 (+ 25644us) log.cc:844] Serialized 26 byte log entry
0709 13:04:22.349532 (+   173us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:22.349579 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.349675 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.646949 (+297274us) raft_consensus.cc:1685] finished
0709 13:04:22.646971 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.647158 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5832,"prepare.queue_time_us":15400,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":7763,"raft.queue_time_us":49412,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":18803,"thread_start_us":702306,"threads_started":2,"wal-append.queue_time_us":646141}
I20260709 13:04:22.649693 17948 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:22.650454 15091 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.655546 17858 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:22.656352 17858 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:22.656116 17952 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:22.657649 17858 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.588749 17805 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:22.654071 15091 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.668581 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:22.673065 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.659622 17933 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:22.667825 17905 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.675609 17827 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:22.676167 17827 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:22.677102 17827 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.678280 17909 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:22.678840 17909 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:22.679661 17956 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:04:22.680570 15341 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.680967 17909 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.683555 17643 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:22.684104 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:22.684876 15338 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:22.685271 15338 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:22.685866 17930 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.658809 17952 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:04:22.620019 17865 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:22.688939 17942 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.450s	user 0.000s	sys 0.007s
I20260709 13:04:22.690461 17865 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.686190 15338 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:22.660151 17863 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:04:22.691984 15338 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.599161 17864 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:04:22.687431 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:22.694990 15193 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:22.698324 15195 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:22.698844 15195 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:22.699752 15195 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.706607 15346 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:22.709456 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:22.710974 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 50353.6us
I20260709 13:04:22.716934 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.563519 17795 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:22.723356 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54894.6us
I20260709 13:04:22.724471 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.725047 15341 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:22.726078 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:22.726806 15344 raft_consensus.cc:2368] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7.
I20260709 13:04:22.729773 15345 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:22.729665 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.730875 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.731354 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:22.732542 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.732874 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:22.733678 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.739441 15338 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:22.742888 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.744004 17926 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.720845 17897 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:22.744962 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.746479 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.746703 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:22.747582 15193 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:22.747937 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.748805 15340 raft_consensus.cc:2410] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:22.749687 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:22.752743 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:22.753021 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.725417 15339 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:22.753789 15193 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:22.754057 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:22.757400 15193 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:22.720264 15091 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.763746 15195 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:22.694396 17890 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:22.770506 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:22.771502 15193 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:22.777617 15263 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:22.785689 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:22.786765 15193 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:22.794667 17890 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:22.795231 15191 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:22.800745 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:22.801501 15272 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.805725 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:22.813349 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:22.814522 15263 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:04:22.819882 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93458.6us
I20260709 13:04:22.822525 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.808924 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:22.821558 15841 leader_election.cc:400] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7.
I20260709 13:04:22.828475 15841 leader_election.cc:403] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:22.887566 15195 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:22.887760 15091 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.901965 15272 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:22.905788 15091 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:22.911572 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 102722us
W20260709 13:04:22.912225 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 106101us
I20260709 13:04:22.912820 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:22.900135 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:22.918359 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 95904.9us
I20260709 13:04:22.919795 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:22.945742 15091 catalog_manager.cc:5697] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 6, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:22.949074 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:22.949877 15195 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.821398 17865 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:22.900439 17936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.002s	sys 0.020s
W20260709 13:04:22.949079 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 424001us
I20260709 13:04:22.924054 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:22.974368 15091 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:22.982236 15091 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 6, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:22.986220 15195 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
W20260709 13:04:22.971973 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 411054us
W20260709 13:04:22.992193 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68245.4us
I20260709 13:04:22.946883 17949 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.923215 17948 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.827807 17930 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.149s
W20260709 13:04:22.976166 17936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.003s	sys 0.021s
I20260709 13:04:22.951951 17803 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:22.953127 17864 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:23.044997 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.038641 15842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.023s	sys 0.021s
I20260709 13:04:22.946395 17933 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:22.898566 17926 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:04:22.977082 17729 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:22.971369 17890 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.976346 17954 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:22.979631 17796 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.077s
W20260709 13:04:23.049160 15842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.023s	sys 0.022s
I20260709 13:04:23.045984 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:23.051124 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:23.060182 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 437465us
I20260709 13:04:22.977777 17897 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:04:23.079420 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.043226 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 117217us
I20260709 13:04:23.048193 17864 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.054068 17901 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:23.126135 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 603820us
I20260709 13:04:23.126904 15195 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:23.047793 17949 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.043658 17963 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:23.035883 17865 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:23.057648 17795 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:23.061636 17933 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:23.146041 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 226317us
W20260709 13:04:23.146792 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 95756.8us
I20260709 13:04:23.062407 17729 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.171888 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:23.064198 17858 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:04:23.076826 17970 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:23.167047 15195 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:23.052927 17948 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.161548 17864 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:23.149963 17931 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:04:23.173449 15091 catalog_manager.cc:5697] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 4, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 4 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:23.174583 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.134613 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:23.232415 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.155964 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:23.195675 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.062716 17928 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:04:23.151952 17918 raft_consensus.cc:2764] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:04:23.193079 17933 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:23.084074 17890 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.169523 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:23.156510 17950 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:23.164433 15143 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:04:23.241449 15842 leader_election.cc:336] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.577s (SENT)
W20260709 13:04:23.242718 15842 leader_election.cc:336] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.618s (SENT)
W20260709 13:04:23.235438 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 63636.5us
I20260709 13:04:23.171195 17963 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.224156 17976 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:23.239151 17973 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:23.239399 17960 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:04:23.198233 17729 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:23.241608 15143 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 35e75f905ad042d89b465e6461b29a5d already in progress
W20260709 13:04:23.248229 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 73719.2us
I20260709 13:04:23.261754 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:23.203619 17955 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.262831 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:23.167922 17901 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.291523 15091 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:23.260342 15143 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 35e75f905ad042d89b465e6461b29a5d already in progress
I20260709 13:04:23.203783 17795 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 13:04:23.275704 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.197741 17865 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:23.332370 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.271340 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:23.332810 15091 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 7, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.248129 17950 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.248391 17848 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:23.249481 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:23.252852 17926 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:23.266814 17803 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:23.246089 17963 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:23.267072 17976 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:23.265594 15869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 212) took 1263 ms. Trace:
I20260709 13:04:23.292624 17954 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:23.349704 17803 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:23.354351 17858 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:23.309736 17955 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:23.354835 15091 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 5, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:23.357235 17865 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.358857 17928 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:23.344234 17848 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.349268 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:23.380649 15265 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.010s	sys 0.022s
W20260709 13:04:23.361991 17962 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:04:23.379189 15091 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:23.389508 15265 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.011s	sys 0.022s
W20260709 13:04:23.371677 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 116888us
I20260709 13:04:23.344238 17988 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:23.344655 17950 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:23.350328 17926 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:23.377666 17968 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 13:04:23.376708 17803 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:23.261552 17973 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:23.380719 17965 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
W20260709 13:04:23.424273 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 344922us
I20260709 13:04:23.381978 17848 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:23.426795 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:23.419667 15091 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:23.430215 15160 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.430238 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 159004us
I20260709 13:04:23.433779 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.396420 17972 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:04:23.396641 17988 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.378793 17858 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.452399 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.459918 17974 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260709 13:04:23.450093 17795 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.449779 17988 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:23.471324 17926 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.472787 17955 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.475378 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1495) took 1054 ms. Trace:
W20260709 13:04:23.503545 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51148.9us
W20260709 13:04:23.466686 17994 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:04:23.481220 17973 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:23.482326 17981 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:23.466095 17920 raft_consensus.cc:2764] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:23.482645 17655 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:23.487514 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 309560us
I20260709 13:04:23.487205 17976 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.366524 15869 rpcz_store.cc:276] 0709 13:04:21.983577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.003242 (+ 19665us) service_pool.cc:224] Handling call
0709 13:04:22.127636 (+124394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.195926 (+ 68290us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:22.503922 (+307996us) log.cc:844] Serialized 14 byte log entry
0709 13:04:23.192817 (+688895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:23.197782 (+  4965us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:23.213878 (+ 16096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.231851 (+ 17973us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.246799 (+ 14948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5297,"prepare.queue_time_us":346374,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2552,"raft.queue_time_us":222623,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21330,"thread_start_us":822305,"threads_started":3,"wal-append.queue_time_us":543161}
I20260709 13:04:23.499557 17954 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.501046 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1492) took 1148 ms. Trace:
I20260709 13:04:23.504655 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.501581 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 353990us
I20260709 13:04:23.503257 15270 rpcz_store.cc:276] 0709 13:04:22.420817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.426873 (+  6056us) service_pool.cc:224] Handling call
0709 13:04:22.427379 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.427852 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.427894 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.446554 (+ 18660us) log.cc:844] Serialized 26 byte log entry
0709 13:04:22.818320 (+371766us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:22.818377 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.818478 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:23.475118 (+656640us) raft_consensus.cc:1685] finished
0709 13:04:23.475141 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.475302 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":192,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5233,"thread_start_us":295941,"threads_started":1,"wal-append.queue_time_us":894223}
W20260709 13:04:23.511266 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 267605us
I20260709 13:04:23.500272 17949 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.464792 18008 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:23.495983 15091 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 4, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.549273 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:04:23.550931 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46385.8us
I20260709 13:04:23.546367 15271 rpcz_store.cc:276] 0709 13:04:22.352839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.353001 (+   162us) service_pool.cc:224] Handling call
0709 13:04:22.386692 (+ 33691us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.387714 (+  1022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.387765 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.403813 (+ 16048us) log.cc:844] Serialized 26 byte log entry
0709 13:04:22.820596 (+416783us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:22.820644 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.820718 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:23.500755 (+680037us) raft_consensus.cc:1685] finished
0709 13:04:23.500783 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.500966 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1285,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":26683,"thread_start_us":308238,"threads_started":1,"wal-append.queue_time_us":562604}
I20260709 13:04:23.557318 17933 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.510089 17975 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:23.560256 17901 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.537770 17805 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:23.500730 17795 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:23.591377 15238 leader_election.cc:336] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.576s (SENT)
I20260709 13:04:23.639277 17901 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:23.596210 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:23.597218 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43876.8us
I20260709 13:04:23.540381 17948 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:23.635949 15839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.034s	sys 0.068s
I20260709 13:04:23.540596 17926 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:23.561254 17890 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.639667 15091 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.545104 17797 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:23.561105 17920 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:23.588629 17827 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:23.589596 17932 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:23.545418 17796 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:23.593585 17975 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:23.649401 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 100190us
I20260709 13:04:23.651928 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:23.664651 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.595887 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 114000us
W20260709 13:04:23.681034 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 89688.7us
W20260709 13:04:23.682143 15238 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.688s (SENT)
I20260709 13:04:23.684384 15160 leader_election.cc:400] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6.
I20260709 13:04:23.684799 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:23.685256 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:23.668361 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 72210.4us
W20260709 13:04:23.668999 15839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.035s	sys 0.069s
W20260709 13:04:23.686970 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 698616us
I20260709 13:04:23.555194 17954 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.675896 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1627) took 1011 ms. Trace:
I20260709 13:04:23.616308 17729 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.708809 17729 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.677449 15091 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:23.709892 15091 catalog_manager.cc:5697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.711308 18007 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:04:23.712080 15091 catalog_manager.cc:5697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 3, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.714040 17933 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.677233 17932 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:23.713855 15091 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:23.553788 17264 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:04:23.715248 17932 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:23.716318 17932 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:23.704280 15196 rpcz_store.cc:276] 0709 13:04:22.664486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.695123 (+ 30637us) service_pool.cc:224] Handling call
0709 13:04:22.695543 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.696121 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.696166 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.696684 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 13:04:23.054560 (+357876us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:23.054599 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.054665 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:23.675642 (+620977us) raft_consensus.cc:1685] finished
0709 13:04:23.675662 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.675822 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1386,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":22893,"thread_start_us":307168,"threads_started":1,"wal-append.queue_time_us":513643}
I20260709 13:04:23.718523 15091 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 6, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.721577 15091 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 5, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.722615 17970 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7.
I20260709 13:04:23.681229 17796 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.679711 17797 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.696623 17918 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:23.687990 17928 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:23.699541 18011 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:23.656260 18008 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:04:23.722348 17963 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.669543 17948 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:23.705477 17890 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:23.682515 17950 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.723608 15091 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 5, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:23.761390 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76207.4us
W20260709 13:04:23.694697 17996 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:04:23.749969 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62119.1us
I20260709 13:04:23.677127 17901 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:23.767056 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:23.753407 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68690.5us
I20260709 13:04:23.687732 17930 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:23.775048 17950 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.776732 17795 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.776943 15091 catalog_manager.cc:5697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } }
I20260709 13:04:23.682930 17920 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:23.780269 17797 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.757912 17928 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.781006 18011 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:23.782424 17864 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.001s
I20260709 13:04:23.781997 18011 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.754709 17858 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.686254 17975 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:23.667178 18009 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
W20260709 13:04:23.762410 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80938us
I20260709 13:04:23.688711 18003 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:04:23.824186 17729 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:23.824608 17729 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:23.824657 18003 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:23.782770 17928 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.825332 18003 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.825436 17729 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.826117 17901 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:23.768836 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.828032 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59272.8us
I20260709 13:04:23.828752 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:23.829186 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:23.829816 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:23.831435 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:23.832104 17827 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:23.832386 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:23.832787 17973 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:23.829970 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:23.779768 17920 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.829898 15338 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:04:23.755307 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49041.8us
I20260709 13:04:23.842636 17970 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:23.843835 17970 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:23.826829 17729 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:23.849555 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:23.851516 15267 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:23.852039 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:23.778772 15091 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.759311 17918 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:23.807932 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.806965 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:23.784251 17796 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.812984 17963 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.813112 17954 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:23.813834 17989 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:23.814209 18021 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:23.859084 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:23.859711 15272 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:23.815774 17805 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:23.782850 17864 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.731222 17988 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.853820 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:23.854076 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:23.855379 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:23.832533 18009 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:23.871984 15340 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:23.855934 15264 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:23.832674 17827 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:23.856904 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:23.873893 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:23.873939 15091 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:23.844982 17970 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:23.867058 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 78091.6us
I20260709 13:04:23.867820 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:23.869410 15271 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:04:23.883219 15271 pending_rounds.cc:85] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 3
I20260709 13:04:23.883590 15271 pending_rounds.cc:107] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:04:23.883980 15271 raft_consensus.cc:2889] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:23.870267 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:23.874830 15264 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:23.861882 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:23.871352 15267 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
W20260709 13:04:23.877231 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46331us
I20260709 13:04:23.879213 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:23.887063 15263 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:23.887094 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:23.862052 17805 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:23.891669 15272 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:23.883373 15265 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:23.894204 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:23.894793 15265 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:23.896322 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:23.896418 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:23.901741 15264 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:23.880621 17796 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:23.897114 15271 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:23.876688 18009 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:23.907173 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:23.915422 15265 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:23.865700 17803 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:23.933462 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.928457 17918 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.939911 18022 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:23.940032 17755 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:23.940454 17796 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:23.941915 17864 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.906764 17973 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:23.865742 17989 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:23.922271 18009 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:24.049798 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 142475us
I20260709 13:04:24.051013 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:23.997591 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 101261us
W20260709 13:04:24.052881 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 170050us
I20260709 13:04:23.869701 18021 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.988019 18022 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:24.047806 17969 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:04:23.991010 17848 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.545s	user 0.015s	sys 0.005s
I20260709 13:04:23.973191 18003 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:23.989095 18008 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:23.993619 17755 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:24.045605 17865 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.078928 17973 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:24.085529 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:24.133440 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:24.149080 15337 raft_consensus.cc:2410] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:24.148851 17973 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:24.137038 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62157us
I20260709 13:04:24.150131 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:24.149847 17973 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:23.985754 17975 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.151335 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:24.153988 18024 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:04:24.067202 18022 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:24.126360 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:24.127166 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:24.127967 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:24.054375 17920 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.160712 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:24.219956 15346 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:04:24.217572 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62643us
I20260709 13:04:24.279080 15194 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:24.279465 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.280159 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.280169 15196 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:24.054105 17827 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.287288 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.128495 17755 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.309124 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:24.309917 15195 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:24.320330 15195 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:04:24.222333 17932 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:04:24.325093 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:24.326166 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:24.327288 15194 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:24.328449 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.359243 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.361562 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.362171 15192 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:24.365154 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:24.366577 15192 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:24.155854 17890 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.185s
I20260709 13:04:24.099174 17848 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.157110 17865 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.424759 15339 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:04:24.432425 15266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.014s
W20260709 13:04:24.432912 15266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.000s	sys 0.014s
I20260709 13:04:24.433746 15192 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:24.276186 17920 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.164847 17796 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:24.453879 18027 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.482s	user 0.000s	sys 0.001s
I20260709 13:04:24.460243 17897 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.466183 17803 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:24.471352 17863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.004s	sys 0.014s
I20260709 13:04:24.494453 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:24.475186 18023 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:24.508725 18020 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.438s	user 0.000s	sys 0.001s
W20260709 13:04:24.527837 17863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.004s	sys 0.014s
I20260709 13:04:24.506559 17928 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:24.552297 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 498622us
I20260709 13:04:24.503906 17897 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:24.544027 17973 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:24.553694 17989 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:24.661860 18021 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:24.690546 18029 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
W20260709 13:04:24.691063 18028 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:04:24.539285 17803 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:24.820039 17803 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.822925 17848 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:24.689349 18032 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:24.775728 15264 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:24.776242 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:24.843768 15263 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:24.776340 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:24.844779 15265 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:24.784514 15311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.008s	sys 0.008s
W20260709 13:04:24.846621 15311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.008s	sys 0.008s
W20260709 13:04:24.785171 15842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.014s	sys 0.002s
W20260709 13:04:24.852782 15842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.014s	sys 0.002s
I20260709 13:04:24.773118 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:24.645543 15160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.004s	sys 0.012s
W20260709 13:04:24.854400 15160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.004s	sys 0.012s
I20260709 13:04:24.543607 18023 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:24.784897 15344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.005s	sys 0.012s
W20260709 13:04:24.879295 15344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.005s	sys 0.013s
I20260709 13:04:24.884085 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:24.887545 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 832511us
I20260709 13:04:24.888650 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:24.890163 18050 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:24.890926 18050 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:24.893198 17989 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:24.893759 17989 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:24.902902 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.912823 17848 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:24.914814 17848 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:24.915406 17848 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.915850 17848 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:24.931607 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 378373us
I20260709 13:04:24.886150 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:24.939456 18052 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.940208 18052 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:24.941246 18026 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.659s	user 0.000s	sys 0.009s
I20260709 13:04:24.943502 18056 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:24.943974 18044 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.944216 18056 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:24.944734 18044 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:24.945248 18059 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:24.945276 18044 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.945904 18059 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.947764 18055 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:24.948159 18059 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:24.949236 18047 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:24.947768 18044 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:24.940780 18025 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.335s	user 0.000s	sys 0.006s
W20260709 13:04:24.952769 18009 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.887s	user 0.006s	sys 0.005s
I20260709 13:04:24.953369 15874 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:24.953240 18009 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:24.955116 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 66586.8us
I20260709 13:04:24.950945 18047 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:24.956048 17729 consensus_meta.cc:287] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.111s	user 0.014s	sys 0.001s
I20260709 13:04:24.957482 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:24.958295 17805 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.047s	user 0.005s	sys 0.009s
I20260709 13:04:24.864526 18032 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.959553 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.959925 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.960243 15192 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:24.960558 15193 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:24.955952 18047 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.961719 18032 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:24.963099 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:24.963413 17932 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.963900 17932 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:24.965737 17975 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:24.966015 17932 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:24.960768 18023 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:24.968776 15338 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:24.970714 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1519) took 1107 ms. Trace:
I20260709 13:04:24.972332 15263 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:24.973119 15193 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:24.974221 15192 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:24.974303 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:24.975090 15188 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.971179 15272 rpcz_store.cc:276] 0709 13:04:23.861251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.861631 (+   380us) service_pool.cc:224] Handling call
0709 13:04:24.968251 (+1106620us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b54002f1cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:24.968408 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11700480}
I20260709 13:04:24.977135 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:24.979341 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.958721 17805 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.800225 17928 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:24.990867 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:25.086773 15842 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.080s (SENT) [suppressed 32 similar messages]
I20260709 13:04:25.067337 15191 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:25.137614 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.072400 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:24.995847 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1515) took 1145 ms. Trace:
W20260709 13:04:25.038674 15266 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.007s	sys 0.011s
W20260709 13:04:25.141110 15266 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.007s	sys 0.016s
I20260709 13:04:25.141767 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1514) took 1291 ms. Trace:
I20260709 13:04:25.068794 15188 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:25.142127 15266 rpcz_store.cc:276] 0709 13:04:23.850104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.850820 (+   716us) service_pool.cc:224] Handling call
0709 13:04:23.865437 (+ 14617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.865656 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:23.866372 (+   716us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.141452 (+1275080us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:25.141507 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:25.141547 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.141607 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.141715 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":738,"prepare.queue_time_us":932,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":6044,"raft.queue_time_us":505823,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"thread_start_us":1274684,"threads_started":2,"wal-append.queue_time_us":1102832}
I20260709 13:04:24.980072 15189 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
W20260709 13:04:25.054607 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 168516us
I20260709 13:04:25.005112 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:25.054316 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.007791 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:25.151652 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:25.153206 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 145492us
I20260709 13:04:25.154958 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:25.155738 15190 raft_consensus.cc:2376] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8. Re-sending same reply.
I20260709 13:04:25.144906 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:25.151726 15193 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:25.158087 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:25.158627 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:04:25.159190 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:25.165990 18032 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:25.166501 18032 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:25.060034 15869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 218) took 1284 ms. Trace:
I20260709 13:04:25.166899 18032 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:25.059361 17858 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:24.978453 17949 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.014s	sys 0.003s
W20260709 13:04:25.070657 17755 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.666s	user 0.018s	sys 0.002s
W20260709 13:04:25.069175 18022 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.793s	user 0.006s	sys 0.006s
I20260709 13:04:25.163820 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:25.168150 17949 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.018s	sys 0.004s
I20260709 13:04:25.066444 17865 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.603448 17918 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.571380 18050 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.340260 17848 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.604219 17918 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:25.167169 15869 rpcz_store.cc:276] 0709 13:04:23.775442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.775717 (+   275us) service_pool.cc:224] Handling call
0709 13:04:23.776081 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.125127 (+349046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.135281 (+ 10154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:24.216597 (+ 81316us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:24.254854 (+ 38257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.059782 (+804928us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54004858d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:25.059831 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.059972 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675494272}
I20260709 13:04:25.152356 18047 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:25.139696 15269 rpcz_store.cc:276] 0709 13:04:23.850378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.850715 (+   337us) service_pool.cc:224] Handling call
0709 13:04:23.851016 (+   301us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:23.851517 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.851559 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:23.852341 (+   782us) log.cc:844] Serialized 78 byte log entry
0709 13:04:23.988665 (+136324us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:24.066820 (+ 78155us) log.cc:844] Serialized 14 byte log entry
0709 13:04:24.067080 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.067179 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.422865 (+355686us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b180008f980. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620557 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:24.836312 (+413447us) raft_consensus.cc:1685] finished
0709 13:04:24.863630 (+ 27318us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.995758 (+132128us) inbound_call.cc:177] Queueing success response
0709 13:04:25.135358 (+139600us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b180008f980. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
Metrics: {"mutex_wait_us":63158,"prepare.queue_time_us":80635,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":2598,"raft.queue_time_us":4482,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":5053,"spinlock_wait_cycles":35535616,"thread_start_us":106647,"threads_started":1,"wal-append.queue_time_us":288797}
I20260709 13:04:25.440718 18064 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.438963 18060 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:25.171447 17264 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:25.535333 17897 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:25.609285 17264 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:25.171612 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:25.508972 15311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.030s
I20260709 13:04:25.610075 17264 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:25.610664 15311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.010s	sys 0.031s
I20260709 13:04:25.064904 18009 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.603834 17865 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.140633 17988 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.612957 17865 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.609248 18022 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.615175 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:25.608431 18064 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.615823 15272 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:04:25.617149 17865 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.617861 18022 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.602953 17805 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.118618 17890 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.620347 17865 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:25.520453 15091 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.014s	sys 0.008s
I20260709 13:04:25.172122 17954 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:25.341091 18033 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:25.116107 18030 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.325s	user 0.002s	sys 0.000s
I20260709 13:04:25.348387 18031 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:25.346333 17795 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:25.617659 18064 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.524883 17803 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:25.628575 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:25.628794 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 465015us
I20260709 13:04:25.631978 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:24.973353 17920 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.106400 18004 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:25.580235 18057 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:25.640426 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:25.171734 18046 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:25.603214 18072 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:25.109980 18059 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.167658 17858 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:25.235107 18007 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:25.682755 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:25.668329 15091 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.017s	sys 0.009s
I20260709 13:04:25.683830 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.669385 18073 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:25.684617 15193 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:25.669636 18009 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:25.481196 17998 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.608513 18060 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:24.953449 18052 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:25.674537 15082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46023.8us
I20260709 13:04:25.674283 18069 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:25.694821 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.501647 17919 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:25.679306 15842 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.020s
I20260709 13:04:25.668820 18033 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.681638 17858 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:25.687775 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.698946 15190 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:25.700078 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.689112 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.689831 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.702085 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.703142 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.690064 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.704833 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.706108 15188 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:04:25.674629 17827 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.692829 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.673650 17890 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:25.696921 15842 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.004s	sys 0.021s
I20260709 13:04:25.171357 17989 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.698150 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.686417 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.716181 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.673283 17954 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:25.709107 15189 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:25.672572 17865 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.703753 15194 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:25.708228 18033 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:25.712971 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 626212us
W20260709 13:04:25.733456 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.686483 17805 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.633193 17755 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.684796 17949 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.674335 17795 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:25.721387 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.722359 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:25.723814 15271 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:25.680780 18046 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.684036 18059 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.729660 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1511) took 1880 ms. Trace:
I20260709 13:04:25.673215 18031 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.682827 18072 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:25.708384 17919 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.676142 18004 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.795930 15268 rpcz_store.cc:276] 0709 13:04:23.849209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.849554 (+   345us) service_pool.cc:224] Handling call
0709 13:04:23.849850 (+   296us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:23.850207 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.850232 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:23.858272 (+  8040us) log.cc:844] Serialized 52 byte log entry
0709 13:04:23.998241 (+139969us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:23.998285 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.998355 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:25.115206 (+1116851us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:25.729378 (+614172us) raft_consensus.cc:1685] finished
0709 13:04:25.729398 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.729600 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":390,"raft.queue_time_us":2361,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5259,"spinlock_wait_cycles":95886208,"thread_start_us":109237,"threads_started":1,"wal-append.queue_time_us":772264}
I20260709 13:04:25.798943 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.801353 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:25.802475 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:25.802857 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.821522 15190 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:25.809613 18073 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:25.813894 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.680585 18057 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.816102 17890 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.816244 17755 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:25.816419 15272 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:25.794967 17949 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:25.793069 17920 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:25.819798 15191 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 3: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:25.821626 15193 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:25.696631 18009 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.833189 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.836280 17918 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:25.694886 17998 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:25.718031 17827 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.701200 18069 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:25.769521 17805 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.084303 17264 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:26.138119 15312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.002s	sys 0.013s
W20260709 13:04:26.026333 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 383735us
W20260709 13:04:26.173862 15312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.003s	sys 0.014s
W20260709 13:04:26.168962 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 402315us
W20260709 13:04:26.175652 15238 leader_election.cc:336] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.223s (SENT)
I20260709 13:04:26.176148 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:26.172390 15311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.012s	sys 0.007s
W20260709 13:04:26.137938 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 462890us
W20260709 13:04:26.177491 15311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.012s	sys 0.007s
I20260709 13:04:25.870268 15197 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:26.166945 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 360958us
I20260709 13:04:26.172566 15194 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:25.814457 17848 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.182281 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:25.838546 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.178853 15842 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.188712 15193 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:26.189433 17264 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.183192 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:25.874859 18041 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.050s	user 0.003s	sys 0.009s
I20260709 13:04:26.190800 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.196260 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.196976 15193 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:26.193782 15194 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
W20260709 13:04:25.875950 18032 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
I20260709 13:04:26.194772 15190 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:26.197050 15189 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:26.166687 17919 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:26.202087 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.168383 18031 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.200057 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:26.195600 17955 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:26.201148 15193 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49393a249e3f433db3840189ee7dc630"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:26.190977 18052 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:26.202900 15197 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:26.191455 18007 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:26.212004 15193 raft_consensus.cc:606] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:26.209971 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:26.210876 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.214169 15193 raft_consensus.cc:614] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:26.194922 17918 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.214483 15194 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:26.216346 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:26.192655 17930 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:04:26.172202 17928 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:26.213580 17989 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:26.201357 17926 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:04:26.211829 17955 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.203850 18033 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.204070 18032 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.218355 17848 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:26.231310 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 129) took 2151 ms. Trace:
I20260709 13:04:26.243304 15340 rpcz_store.cc:276] 0709 13:04:24.079942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.082024 (+  2082us) service_pool.cc:224] Handling call
0709 13:04:24.082500 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:24.137321 (+ 54821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.137350 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:24.148626 (+ 11276us) log.cc:844] Serialized 26 byte log entry
0709 13:04:24.436314 (+287688us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:24.436371 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.436464 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:25.870318 (+1433854us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:26.228719 (+358401us) raft_consensus.cc:1685] finished
0709 13:04:26.228746 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.231220 (+  2474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54347,"raft.queue_time_us":69245,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":71,"spinlock_wait_cycles":49245056,"thread_start_us":287276,"threads_started":1,"wal-append.queue_time_us":663510}
I20260709 13:04:26.232394 17955 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:26.224056 17858 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.218658 18031 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:26.242213 18032 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.249601 17848 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.253575 17848 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.255468 18007 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.223282 18052 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:26.227954 17989 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.259749 17989 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.248103 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 146) took 1277 ms. Trace:
I20260709 13:04:26.255894 18060 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.261796 15192 rpcz_store.cc:276] 0709 13:04:24.971384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.971860 (+   476us) service_pool.cc:224] Handling call
0709 13:04:24.973845 (+  1985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.974687 (+   842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.247838 (+1273151us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b54001a4d50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:26.248025 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3783936}
I20260709 13:04:26.219152 17918 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.270231 18072 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:26.270597 17858 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.271164 17954 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:26.181164 17920 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.036326 18073 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.250490 17901 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.281780 17930 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.294896 17930 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.295650 17918 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.297461 17930 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.286773 17890 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.301781 17955 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:26.303547 17998 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.304155 17998 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:26.304505 18033 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.304790 17955 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:26.305114 18086 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:04:26.306733 18084 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:26.266146 18031 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:26.311260 18081 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.311801 18081 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:26.312355 18031 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:26.313436 18069 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:26.314055 17901 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.314489 18081 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:26.316197 17901 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.317296 17805 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.298552 17890 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.318851 15189 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:26.320152 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.321220 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:26.322454 15189 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:26.323755 15192 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:26.325917 15193 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:26.304523 17998 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.328281 17989 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:26.328820 17998 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:26.330344 17989 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.331233 17949 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:26.308707 17954 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.332482 17954 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.335290 17954 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.345273 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.346467 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:26.342306 18009 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.355995 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.357836 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:26.359061 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.360222 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:26.354043 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 144163us
I20260709 13:04:26.364539 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:26.374070 17989 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:26.381158 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.383311 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:26.384749 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:26.395460 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 213193us
W20260709 13:04:26.396610 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 200428us
I20260709 13:04:26.400048 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.355643 18034 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.403223 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.353540 17796 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:26.373044 17655 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:26.307510 18084 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.391731 18009 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.410588 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:26.408418 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:26.409847 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.415346 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:26.420542 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:26.446910 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.453579 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:26.473660 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.448807 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.448462 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.452648 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.476425 15346 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:26.477559 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.479781 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.413950 18095 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:26.408350 18098 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:26.480568 15344 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:26.551546 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:26.454296 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:26.417094 17655 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.420849 18052 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:26.484390 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.447743 17864 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:26.627502 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 143182us
I20260709 13:04:26.485466 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.419064 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:26.445727 18088 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:26.492962 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:26.632615 15190 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:26.494277 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:26.447458 17631 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:26.419364 17949 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.208s
I20260709 13:04:26.411823 18034 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.635977 17631 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:26.445622 18083 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.146s
I20260709 13:04:26.643644 18088 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:26.496567 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.488027 17954 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.491925 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:26.481295 18101 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:04:26.490944 18096 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:26.593263 15346 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:26.453038 17905 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:26.444846 18009 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.630252 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:26.481295 18007 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:26.645619 15345 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:26.646729 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.487558 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:26.647212 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 226730us
I20260709 13:04:26.413779 17796 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.667806 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.718997 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:26.720219 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 73566.1us
I20260709 13:04:26.721189 15192 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:26.632652 17805 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:26.721902 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.720685 18007 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.725121 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.626531 17655 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.725677 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:26.668224 18091 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:04:26.733492 15337 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:26.736555 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:26.737183 15874 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:26.736747 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.738474 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.744566 18060 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:26.751675 18060 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:26.751755 18034 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.752329 18060 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.649082 18100 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.768424 17264 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:26.731137 18083 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:26.761461 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1273) took 1065 ms. Trace:
I20260709 13:04:26.724251 17954 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:26.763339 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.745121 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:26.767536 15190 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:26.769979 17264 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:26.761795 15192 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:26.770541 15191 rpcz_store.cc:276] 0709 13:04:25.715407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.722113 (+  6706us) service_pool.cc:224] Handling call
0709 13:04:26.761181 (+1039068us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b54002256d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:26.761366 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65963264}
I20260709 13:04:26.841395 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:26.891551 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 125391us
W20260709 13:04:26.892297 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 133235us
I20260709 13:04:26.893281 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:26.894974 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1654) took 2447 ms. Trace:
I20260709 13:04:26.897680 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1655) took 2445 ms. Trace:
I20260709 13:04:26.897022 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.898213 15196 rpcz_store.cc:276] 0709 13:04:24.324269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.324388 (+   119us) service_pool.cc:224] Handling call
0709 13:04:24.324813 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:24.367371 (+ 42558us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:24.367398 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:26.254444 (+1887046us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:04:26.254851 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:04:26.286496 (+ 31645us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:26.286549 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.286919 (+   370us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:26.739724 (+452805us) raft_consensus.cc:1685] finished
0709 13:04:26.739754 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.769505 (+ 29751us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42117,"raft.queue_time_us":131550,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8153,"spinlock_wait_cycles":14989568,"thread_start_us":31254,"threads_started":1,"wal-append.queue_time_us":101382}
I20260709 13:04:26.734841 18007 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:26.633971 17864 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.744212 17926 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.895521 15195 rpcz_store.cc:276] 0709 13:04:24.323893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.391565 (+ 67672us) service_pool.cc:224] Handling call
0709 13:04:24.406306 (+ 14741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:24.464718 (+ 58412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.464765 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:24.478048 (+ 13283us) log.cc:844] Serialized 26 byte log entry
0709 13:04:24.982863 (+504815us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:24.982900 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.759753 (+1776853us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b54003e5dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:26.759818 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:26.759886 (+    68us) raft_consensus.cc:1685] finished
0709 13:04:26.759906 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.771453 (+ 11547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33115,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6271,"spinlock_wait_cycles":133230976,"thread_start_us":438539,"threads_started":1,"wal-append.queue_time_us":1004773,"wal-append.run_cpu_time_us":1924,"wal-append.run_wall_time_us":1057191}
I20260709 13:04:26.746481 17920 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:26.935344 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:26.937050 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 95747.1us
I20260709 13:04:26.764783 17905 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:26.772991 18098 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.175s
I20260709 13:04:26.762485 18097 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:26.949287 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55012.5us
I20260709 13:04:26.776429 17805 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.963625 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:26.956173 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:26.952466 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.890878 18052 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:26.730369 18094 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.194s
I20260709 13:04:26.964915 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:26.966655 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:26.971704 17264 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:26.736295 18088 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.974543 17264 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:26.947685 17988 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:26.947395 17930 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.948055 17954 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.922224 18068 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:04:26.956910 17905 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:26.979492 17933 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:26.929641 18083 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:26.982811 17264 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:26.922894 18055 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:04:26.728962 18096 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:26.999392 15341 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:27.012212 17264 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.018333 17264 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:27.020386 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44804.3us
I20260709 13:04:26.889094 18100 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:26.972738 17926 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.973817 18095 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:04:26.966619 18084 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:27.015780 18052 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:27.022104 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:26.983865 17988 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.984117 17930 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.011636 17905 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:27.014976 17933 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:27.060527 17926 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.973474 17805 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:27.076339 18052 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.088269 17930 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:27.085500 17988 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:27.090618 17933 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:27.084357 18081 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:27.097321 17926 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:27.167451 15188 raft_consensus.cc:606] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:27.251502 15188 raft_consensus.cc:614] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:27.169359 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:27.256803 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:27.257309 17805 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:27.257678 15191 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:27.174540 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:27.263648 15193 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:27.265096 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:27.185783 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 288683us
W20260709 13:04:27.189065 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 222332us
I20260709 13:04:27.271302 17901 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.272260 17901 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.277055 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:27.110131 18081 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:27.106494 18083 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.125957 18096 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:27.127692 18100 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:27.135586 18103 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.407s	user 0.006s	sys 0.000s
I20260709 13:04:27.109526 18009 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:27.198954 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 169912us
I20260709 13:04:27.208523 17796 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:27.220860 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 165851us
I20260709 13:04:27.224601 17864 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:27.272691 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:27.079470 15341 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:04:27.444293 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:27.445715 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:27.446113 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:27.105527 18052 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:27.449733 17930 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:27.281775 15197 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1278) took 1479 ms (client timeout 1568 ms). Trace:
I20260709 13:04:27.283761 15194 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:27.287416 18093 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:27.293123 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:27.297670 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 184) took 1683 ms. Trace:
W20260709 13:04:27.299240 15272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 186) took 1684 ms (client timeout 2061 ms). Trace:
I20260709 13:04:27.299559 18116 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.258921 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:27.304131 15338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1665) took 3455 ms (client timeout 1598 ms). Trace:
W20260709 13:04:27.299256 15271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 188) took 1659 ms (client timeout 1579 ms). Trace:
I20260709 13:04:27.311973 17901 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.353910 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:27.354610 18081 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.355800 15189 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:04:27.356990 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80171.3us
I20260709 13:04:27.354604 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:27.370507 15868 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 191) took 3546 ms (client timeout 1821 ms). Trace:
I20260709 13:04:27.375310 18095 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:27.381983 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.384445 17890 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.383968 17933 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:27.386391 17655 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.005s
I20260709 13:04:27.389483 17988 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.397697 18039 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:27.382881 17865 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.399844 18113 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.401767 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.402933 18044 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.403702 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:27.405361 18046 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.409411 18057 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.410794 18058 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:27.494086 18058 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:27.495193 17926 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.496049 18058 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.498431 17926 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.412016 18059 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.436117 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.436494 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:27.440109 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:27.446957 17998 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 1.117s	user 0.013s	sys 0.026s
W20260709 13:04:27.471218 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116993us
I20260709 13:04:27.498744 18058 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:27.453267 15338 rpcz_store.cc:269] 0709 13:04:23.848364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.848509 (+   145us) service_pool.cc:224] Handling call
0709 13:04:27.303621 (+3455112us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000b5c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.303839 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2463404416}
W20260709 13:04:27.455471 15868 rpcz_store.cc:269] 0709 13:04:23.823415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.831075 (+  7660us) service_pool.cc:224] Handling call
0709 13:04:27.369886 (+3538811us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b54000e51d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.370177 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5879952768}
I20260709 13:04:27.479060 15340 raft_consensus.cc:2376] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8. Re-sending same reply.
I20260709 13:04:27.522571 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:27.522927 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:27.479944 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.524147 15267 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:27.524286 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:27.480716 17933 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.481438 17631 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:27.478734 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:27.526345 17631 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:27.526533 18113 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.527146 17631 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:27.529044 18113 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.529335 17631 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:27.475603 17655 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:27.530272 18081 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:27.483520 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:27.531327 17797 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.532377 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:27.532060 17797 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.533598 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:27.484110 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:27.535102 15191 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:27.485541 18099 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:27.535516 15191 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:27.535862 18099 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:27.536556 15191 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.537613 15191 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:27.452674 15272 rpcz_store.cc:269] 0709 13:04:25.631480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.631639 (+   159us) service_pool.cc:224] Handling call
0709 13:04:27.298582 (+1666943us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400013bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.298982 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324271360}
I20260709 13:04:27.452255 15270 rpcz_store.cc:276] 0709 13:04:25.613970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.614086 (+   116us) service_pool.cc:224] Handling call
0709 13:04:25.614423 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:25.840922 (+226499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:25.840955 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:25.840997 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:25.841030 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.297083 (+1456053us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002a8ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:27.297156 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:27.297396 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520466176}
W20260709 13:04:27.453348 15271 rpcz_store.cc:269] 0709 13:04:25.640042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.640179 (+   137us) service_pool.cc:224] Handling call
0709 13:04:27.298582 (+1658403us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b54000d8254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.298982 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108713216}
I20260709 13:04:27.482599 15192 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:04:27.490828 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:27.504629 18120 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:27.514109 17729 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:27.515326 17948 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:27.519816 17998 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:27.502779 17954 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:27.521016 15269 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:27.525936 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:27.535519 15189 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:27.488653 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46386 (request call id 16) took 1057 ms. Trace:
I20260709 13:04:27.539659 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:27.485899 17930 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:27.541162 15869 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:27.542963 17988 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.583715 15338 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:27.592344 15338 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:27.504164 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 231639us
W20260709 13:04:27.451282 15197 rpcz_store.cc:269] 0709 13:04:25.802144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.802266 (+   122us) service_pool.cc:224] Handling call
0709 13:04:27.281349 (+1479083us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b5400211bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.281573 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112371456}
I20260709 13:04:27.504611 17905 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.499322 15266 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:27.553365 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.473919 18039 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:27.556072 17797 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:27.574622 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:27.575695 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 164) took 1181 ms. Trace:
I20260709 13:04:27.576001 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:27.576162 17655 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:27.576864 18060 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.014s
I20260709 13:04:27.579438 17998 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.579902 15189 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:27.581120 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:27.543632 15265 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:27.584704 18094 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:27.587576 15344 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:27.588220 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:27.589202 18004 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.542681 17795 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:27.592494 15337 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:27.572572 15188 rpcz_store.cc:276] 0709 13:04:26.394745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.494157 (+ 99412us) service_pool.cc:224] Handling call
0709 13:04:27.442306 (+948149us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54000c17d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5707853 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691 00007f36e3c5b60c 00007f36e3c5a8c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.452126 (+  9820us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1200801152}
I20260709 13:04:27.504973 18068 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.558156 18120 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:27.626286 15344 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:27.635876 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.638510 15874 raft_consensus.cc:2410] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:27.501447 18044 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.501616 18093 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.645232 15269 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.643643 15272 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:27.647076 15267 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.504005 18116 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.639858 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.648738 15270 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:27.630338 18068 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:27.652256 15191 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:04:27.630155 18120 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:27.651471 15197 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:27.654048 15191 pending_rounds.cc:85] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 5
I20260709 13:04:27.627944 17631 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:27.654717 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:27.656888 15191 pending_rounds.cc:107] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:27.673239 15191 raft_consensus.cc:2889] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:27.655074 18068 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.676016 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.675582 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:27.627130 18060 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.681349 15341 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:27.687333 15346 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:27.692451 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:27.612864 15195 rpcz_store.cc:276] 0709 13:04:26.394397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.935596 (+541199us) service_pool.cc:224] Handling call
0709 13:04:26.935894 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:27.171458 (+235564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:27.171555 (+    97us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:27.172826 (+  1271us) log.cc:844] Serialized 26 byte log entry
0709 13:04:27.323411 (+150585us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:27.389851 (+ 66440us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b480021c258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:27.469908 (+ 80057us) log.cc:844] Serialized 14 byte log entry
0709 13:04:27.477874 (+  7966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.569466 (+ 91592us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:27.569514 (+    48us) raft_consensus.cc:1685] finished
0709 13:04:27.575311 (+  5797us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:27.575504 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12570,"prepare.queue_time_us":246032,"raft.queue_time_us":23887,"raft.run_cpu_time_us":3725,"raft.run_wall_time_us":426321,"spinlock_wait_cycles":8046848,"thread_start_us":517229,"threads_started":3,"wal-append.queue_time_us":242170}
I20260709 13:04:27.686612 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:27.698427 15337 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:27.704520 15874 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:27.710896 15188 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
W20260709 13:04:27.711768 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 69854.9us
I20260709 13:04:27.712170 15188 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:27.712623 15188 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:27.713678 17729 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:27.714146 17729 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:27.714563 17729 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:27.714870 17864 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:27.715212 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 49193.6us
I20260709 13:04:27.716524 17864 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:27.716687 15311 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:27.717698 17797 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:27.718065 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:27.719014 15342 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:27.719343 18003 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:27.720103 17631 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.722221 17631 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:27.724264 15266 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:27.709323 15272 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:27.722281 17827 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.728857 17905 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.735841 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:27.736634 15263 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:27.737183 18124 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:04:27.736759 15188 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.739660 15188 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:27.741884 18052 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:27.743148 18007 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.006s
I20260709 13:04:27.743170 15264 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:04:27.743804 18007 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.745805 17729 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.747643 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:27.750871 15272 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:27.751600 15340 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:27.753063 15263 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:27.750255 15188 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:04:27.766966 15272 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:27.767802 15188 pending_rounds.cc:85] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 4
I20260709 13:04:27.771683 15188 pending_rounds.cc:107] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:04:27.772135 15188 raft_consensus.cc:2889] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:27.797621 15270 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
W20260709 13:04:27.771355 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70952.1us
W20260709 13:04:27.814640 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 96634.3us
I20260709 13:04:27.820969 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1674) took 1189 ms. Trace:
I20260709 13:04:27.821442 15339 rpcz_store.cc:276] 0709 13:04:26.629096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.631057 (+  1961us) service_pool.cc:224] Handling call
0709 13:04:26.631379 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:26.968281 (+336902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:26.968312 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:26.968357 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:26.968401 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.811967 (+843566us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400423e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:27.812043 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:27.818268 (+  6225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774378752}
I20260709 13:04:27.822531 18058 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:27.836124 18058 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:27.836278 18044 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.837618 18058 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:27.839424 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:27.859483 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.850277 17755 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:27.864689 17755 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:27.875718 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1685) took 1527 ms. Trace:
I20260709 13:04:27.909067 15341 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:27.734704 15267 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:27.946478 15269 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:27.887162 15268 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:28.233856 15194 rpcz_store.cc:276] 0709 13:04:26.347871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.389124 (+ 41253us) service_pool.cc:224] Handling call
0709 13:04:27.283254 (+894130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:27.456052 (+172798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:27.875410 (+419358us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b5400211bd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.875621 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055404416}
I20260709 13:04:28.223124 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:28.238161 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:27.868924 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 100906us
W20260709 13:04:28.241822 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:27.995697 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53930.8us
W20260709 13:04:28.128283 18132 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
W20260709 13:04:28.208609 18120 consensus_meta.cc:287] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.002s
I20260709 13:04:28.221231 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:27.893121 18095 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:28.216195 18058 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:27.892343 18052 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:27.871698 15869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 193) took 1479 ms. Trace:
I20260709 13:04:27.866012 18116 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:28.248356 18120 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.266589 15267 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:28.272238 15263 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:28.257251 15869 rpcz_store.cc:276] 0709 13:04:26.392307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.407257 (+ 14950us) service_pool.cc:224] Handling call
0709 13:04:27.871411 (+1464154us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54006301d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:27.871612 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089251200}
I20260709 13:04:28.276108 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:28.260074 17755 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:28.280196 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:28.274879 15868 raft_consensus.cc:2368] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8.
W20260709 13:04:28.274371 18068 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.573s	user 0.013s	sys 0.000s
I20260709 13:04:28.268549 18060 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:28.287549 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.287529 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.288504 15269 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:28.288839 15267 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:28.274632 18116 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.297693 15874 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:04:28.299285 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.299849 15267 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:28.303021 15263 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:28.291005 18068 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.309100 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.326489 15263 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:04:28.325390 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.312547 18116 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.341639 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:28.343493 15263 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:28.326196 18052 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:28.335513 18095 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:04:28.342618 15238 connection.cc:256] RPC call timeout handler was delayed by -1.2376439249999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 13:04:28.349951 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.352260 18120 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:28.357342 18141 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:28.358875 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.346604 17755 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:04:28.362573 17755 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:28.362975 17755 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:28.351346 18095 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:28.363636 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1688) took 1114 ms. Trace:
I20260709 13:04:28.357398 18120 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:28.364105 15340 rpcz_store.cc:276] 0709 13:04:27.249470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.522624 (+273154us) service_pool.cc:224] Handling call
0709 13:04:28.363428 (+840804us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400272ed4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:28.363548 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":504698112}
I20260709 13:04:28.366075 15267 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:28.367192 15263 raft_consensus.cc:2410] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:28.368113 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.350526 18052 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:28.359686 18139 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:04:28.371656 18095 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:28.372540 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:28.374330 18116 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:28.389303 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.365378 18068 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:28.392316 17998 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:28.393061 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.367585 18120 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.395412 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.395889 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.396425 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.400843 15874 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:28.403682 18140 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:04:28.406364 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.407191 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 134) took 1918 ms. Trace:
W20260709 13:04:28.393975 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51599.9us
I20260709 13:04:28.415490 15343 rpcz_store.cc:276] 0709 13:04:26.447093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.447209 (+   116us) service_pool.cc:224] Handling call
0709 13:04:26.447536 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:26.637392 (+189856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:26.637428 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:26.637486 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:26.637523 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:28.350780 (+1713257us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000974d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:28.352773 (+  1993us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:28.365516 (+ 12743us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436153600}
I20260709 13:04:28.418876 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:28.419260 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.420629 15266 raft_consensus.cc:2368] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:28.416752 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.423467 18116 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.423995 15339 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:28.424149 18116 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.424654 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.425318 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.425433 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.425653 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.425364 15191 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
W20260709 13:04:28.429394 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:28.432511 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 160620us
I20260709 13:04:28.432654 15343 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:28.434320 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.434620 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:28.363993 17755 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.411554 17998 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:28.434257 18095 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:28.436553 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.424033 18114 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:28.437958 15194 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:28.438429 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.439404 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.437156 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.442055 15340 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:28.437144 18068 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:04:28.446970 15266 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.447712 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.449927 15339 raft_consensus.cc:2410] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:28.452288 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.452884 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.441260 17998 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.454445 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.457283 15345 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:28.463470 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.463775 15237 leader_election.cc:400] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8.
I20260709 13:04:28.464284 15237 leader_election.cc:403] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:28.465684 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.467557 18098 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:28.468191 18098 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:28.468570 18098 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.471611 18052 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:28.472627 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.473407 15194 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:28.474555 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.475324 17755 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:28.476099 15270 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:28.476408 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.477197 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.477721 15270 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.477952 15340 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:04:28.467607 15345 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.479631 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1537) took 1078 ms. Trace:
I20260709 13:04:28.479830 18116 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:28.455709 18039 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.442621 18095 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:28.480088 15268 rpcz_store.cc:276] 0709 13:04:27.401339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.403202 (+  1863us) service_pool.cc:224] Handling call
0709 13:04:28.479179 (+1075977us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54001da6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:28.479468 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199031040}
I20260709 13:04:28.481055 18039 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:28.481652 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.482127 18095 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:28.490922 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1540) took 1088 ms. Trace:
I20260709 13:04:28.491614 15264 rpcz_store.cc:276] 0709 13:04:27.402640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.406183 (+  3543us) service_pool.cc:224] Handling call
0709 13:04:27.406818 (+   635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:27.743828 (+337010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:28.490505 (+746677us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54002a8fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:28.490826 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772639616}
I20260709 13:04:28.495048 18092 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:28.495604 18092 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:28.496678 18092 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:28.498203 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.499487 15194 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:28.504081 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.498086 18092 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.508340 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.525297 15340 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:28.528311 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 83101.6us
I20260709 13:04:28.536676 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.548020 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.548967 15191 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
W20260709 13:04:28.549932 15342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1677) took 1815 ms (client timeout 1891 ms). Trace:
W20260709 13:04:28.550489 15342 rpcz_store.cc:269] 0709 13:04:26.734136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:26.902667 (+168531us) service_pool.cc:224] Handling call
0709 13:04:28.535114 (+1632447us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54002724d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:28.549836 (+ 14722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1691385600}
I20260709 13:04:28.553552 15271 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:28.554772 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.555732 15271 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:28.556715 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.557435 15271 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:28.558298 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.567183 15194 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:04:28.567724 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.568172 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.568723 15344 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.569075 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.569953 18099 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:28.572170 18007 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:28.574039 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.575237 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.580199 18093 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:28.567409 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.581552 15339 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:28.581852 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.582758 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.582965 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1539) took 1180 ms. Trace:
I20260709 13:04:28.583650 15265 rpcz_store.cc:276] 0709 13:04:27.402219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.403258 (+  1039us) service_pool.cc:224] Handling call
0709 13:04:27.403871 (+   613us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:27.616359 (+212488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:28.582699 (+966340us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400349754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:28.582912 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320256768}
I20260709 13:04:28.584221 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.585379 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.581885 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.587100 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:28.587440 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51543.4us
I20260709 13:04:28.583649 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.588374 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.588937 15265 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:28.584383 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.590292 15196 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:28.591238 18116 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:28.591936 18116 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.592144 18120 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:28.593132 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.594229 18116 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:28.594324 15264 raft_consensus.cc:2410] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:28.567401 17729 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:28.595659 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.595759 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.596418 15191 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:28.574651 15342 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.601804 15265 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:28.602779 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.603528 15265 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:28.575184 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.606956 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.612602 15270 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:28.613164 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.613840 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:28.615897 15341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1697) took 1235 ms (client timeout 1573 ms). Trace:
I20260709 13:04:28.615995 15343 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:28.616379 15341 rpcz_store.cc:269] 0709 13:04:27.380088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.446881 (+ 66793us) service_pool.cc:224] Handling call
0709 13:04:28.615634 (+1168753us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003aacd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:28.615829 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":310001536}
I20260709 13:04:28.620484 15270 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:28.544656 18095 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.625103 15265 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:28.629117 15342 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:28.558948 15271 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
W20260709 13:04:28.633025 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 70145.9us
I20260709 13:04:28.614755 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.643784 15263 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:28.646258 15268 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:28.647357 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.648828 15266 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:28.652134 15344 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:28.651935 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:04:28.655573 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.656769 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1548) took 1076 ms. Trace:
I20260709 13:04:28.657207 15272 rpcz_store.cc:276] 0709 13:04:27.580363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.559883 (+979520us) service_pool.cc:224] Handling call
0709 13:04:28.638979 (+ 79096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:28.655780 (+ 16801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:28.655820 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:28.655888 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:28.655931 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:28.656007 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:28.656590 (+   583us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b54002a80d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:28.656710 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181130112}
I20260709 13:04:28.659312 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.660145 15268 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:28.661316 15338 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:28.662957 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.673117 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.674506 15272 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:28.676507 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.676700 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:28.678644 15266 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.679978 15268 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:04:28.688261 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:28.689070 15192 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:28.651329 18114 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:28.686189 15271 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:28.694201 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:28.695582 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:28.695835 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 43992us
I20260709 13:04:28.696717 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.697656 15263 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:28.698746 15272 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:28.699981 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.698643 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:28.702136 15189 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:28.703111 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.703295 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.703886 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.653880 18093 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:28.713725 15193 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:28.685091 18052 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:28.720510 15266 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:28.692723 18120 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:28.663738 17827 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:28.724754 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.729709 15340 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:28.725477 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.730391 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.725767 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:28.726909 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.725693 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:28.731817 15346 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:28.671298 18099 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:04:28.737110 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:28.733084 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.729188 18120 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:28.742529 18120 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:28.763082 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 91873.3us
I20260709 13:04:28.762429 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.789029 15188 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:28.804385 15266 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:28.734290 18052 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.807466 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:28.811161 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:28.814678 15263 raft_consensus.cc:2376] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10. Re-sending same reply.
I20260709 13:04:28.779518 18093 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:28.832695 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.835155 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:28.841009 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 104002us
W20260709 13:04:28.844051 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 101509us
I20260709 13:04:28.844731 15268 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:28.830641 18093 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.839884 18044 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:28.856600 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:28.809998 18116 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:04:28.854911 18145 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:04:28.862735 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:28.873765 15197 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:28.862506 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.879528 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.881071 15266 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:28.886193 15263 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.887007 15193 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.859716 18093 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.889576 18159 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:28.857934 18044 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.830011 18144 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:04:28.910795 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:28.830284 18114 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:28.919824 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:28.921341 15188 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:28.860073 18147 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:04:28.861187 17755 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:04:28.925038 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 75040us
I20260709 13:04:28.922173 18120 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:28.932780 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.936051 15263 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:28.911064 18044 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.899857 18159 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:28.898839 18088 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.203s
W20260709 13:04:28.947191 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 218651us
I20260709 13:04:28.931929 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:28.961668 15191 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:29.024184 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 173884us
I20260709 13:04:29.033514 15272 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:29.036274 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.044160 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:29.045645 15189 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
W20260709 13:04:29.034418 15839 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.579s (SENT)
I20260709 13:04:29.047353 15266 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:29.049185 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:28.937086 17948 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:04:29.002149 17755 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:28.937988 17998 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:29.057345 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 270512us
I20260709 13:04:29.060235 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.067633 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.070482 15263 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.085099 18174 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:29.085755 18174 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:29.086992 18174 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.088613 18174 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:29.102828 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.103581 15266 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:29.106895 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.046641 18058 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:04:29.130244 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 97254.4us
W20260709 13:04:29.118394 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 158570us
W20260709 13:04:29.129455 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.130463 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 58690.6us
I20260709 13:04:29.111567 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:29.132519 15189 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:29.133579 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.134121 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.057893 17755 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:29.140100 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 105720us
I20260709 13:04:29.070632 18156 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.100509 18052 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:29.148629 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:29.105531 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:29.157931 18156 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:29.161487 18156 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:29.162433 17755 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.170729 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.173528 15189 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
W20260709 13:04:29.162408 18039 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.681s	user 0.006s	sys 0.008s
I20260709 13:04:29.182132 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:29.190737 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.106019 18116 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.085s
W20260709 13:04:29.176188 18151 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:04:29.193711 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:29.194855 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:29.200162 17998 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:29.205837 17729 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:29.207526 18167 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:29.207664 18154 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:29.208434 18052 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:29.210711 17959 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:29.183207 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.187426 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.216925 15874 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:29.220288 15267 raft_consensus.cc:2376] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8. Re-sending same reply.
W20260709 13:04:29.237347 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65453.8us
W20260709 13:04:29.174777 18098 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.706s	user 0.004s	sys 0.009s
I20260709 13:04:29.255810 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.255954 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:29.248999 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.175184 18095 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.001s
W20260709 13:04:29.246371 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51608.5us
I20260709 13:04:29.247939 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.259667 18167 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:29.251642 17729 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:29.260353 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.277491 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:29.277972 15267 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:29.278410 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.254469 15271 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:29.245322 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 63348.9us
I20260709 13:04:29.263298 15197 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
W20260709 13:04:29.280030 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 128840us
I20260709 13:04:29.276564 15263 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:29.283695 15193 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:04:29.283658 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.286883 15189 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:29.287007 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 254836us
W20260709 13:04:29.252313 18157 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.151s	user 0.004s	sys 0.000s
I20260709 13:04:29.246601 18039 raft_consensus.cc:2764] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:04:29.290310 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.239120 18156 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.246946 18155 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:29.291302 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.291453 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:29.251427 18166 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:04:29.291712 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.253604 18052 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:29.295845 15192 consensus_meta.cc:287] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.577s	user 0.014s	sys 0.002s
I20260709 13:04:29.297086 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.253796 17959 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:29.252537 18154 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:29.376303 18167 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.377334 18154 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.252638 15093 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 9 to 11, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:29.384121 17755 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.390425 18171 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:29.390921 18171 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:29.391887 18171 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.393155 18171 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:29.395251 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44122.2us
I20260709 13:04:29.236253 18152 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:04:29.397943 18152 consensus_queue.cc:1243] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:29.398484 18152 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:29.398801 18152 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:29.399768 18152 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.401098 18152 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:29.405267 18177 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:29.405900 18177 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:29.406822 18177 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.409094 15093 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:29.410888 17729 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.412221 17729 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:29.413081 18177 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:29.413244 15093 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 6 to 7, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 7 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.282755 18088 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.138s
I20260709 13:04:29.415932 18088 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:29.416334 18088 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:29.415216 15093 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 1 to 3, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 3 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.417315 18088 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:29.421502 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:29.421887 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.422565 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 71406us
I20260709 13:04:29.247115 18159 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.430351 18159 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.388231 15269 raft_consensus.cc:2368] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:29.285626 18095 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8.
I20260709 13:04:29.370815 15268 raft_consensus.cc:2410] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:29.371272 18068 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:29.409912 18092 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.895s	user 0.000s	sys 0.010s
I20260709 13:04:29.444806 18068 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.449566 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:29.450156 15338 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:04:29.288374 18007 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.151s
I20260709 13:04:29.433151 18052 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.436337 18174 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:29.418937 18088 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.465622 18174 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:29.351467 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46837.2us
I20260709 13:04:29.466713 18174 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.371836 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.441876 18156 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.372797 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.475430 18092 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.476006 18092 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:29.476905 18068 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:29.477648 15270 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:29.373214 15192 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
W20260709 13:04:29.373733 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116506us
I20260709 13:04:29.479439 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:29.481125 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:29.481892 18146 raft_consensus.cc:2764] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:29.374464 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.253322 18044 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.170231 18162 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 13:04:29.375945 17959 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.433854 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.484642 18044 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:29.486379 18044 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.434265 18154 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:29.486999 18044 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.487167 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:29.488312 15874 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:29.489738 18044 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:29.490330 18044 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:29.490669 18044 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:29.491618 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.485718 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51977.7us
I20260709 13:04:29.493490 17959 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.494372 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.495155 18144 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.496341 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.497161 15188 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:29.491089 18044 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:29.500877 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.435638 15267 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:04:29.419963 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.454620 15343 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.453369 15264 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:29.504776 15342 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:29.455420 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.456060 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.446470 18155 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:29.482596 17827 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:29.475183 15271 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
W20260709 13:04:29.503600 15839 leader_election.cc:336] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 2.061s (SENT)
I20260709 13:04:29.482998 15265 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:29.509671 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:29.298611 18120 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:29.299211 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.314894 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.516266 15263 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:29.497210 18144 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:29.484566 18092 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:29.518157 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 203423us
W20260709 13:04:29.524072 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49885.9us
I20260709 13:04:29.522316 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:29.529434 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.529382 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:29.530752 15344 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:29.528828 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:29.538841 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:29.539738 15340 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:29.521567 18095 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.541275 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:29.546432 15337 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:29.546797 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:29.518953 18112 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.281010 18098 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:29.563002 18182 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.555224 15270 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:29.566165 15160 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.533s (SENT)
I20260709 13:04:29.566437 15346 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:29.577028 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.578212 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.555401 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.579161 15263 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:29.555816 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 271399us
I20260709 13:04:29.556277 18039 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.557070 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:29.582582 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 60363.9us
I20260709 13:04:29.583058 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.583817 15268 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:29.546159 18177 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:29.557937 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:29.550773 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:29.524572 18144 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.525908 18120 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.561897 18060 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:04:29.520787 17827 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:29.575884 15272 raft_consensus.cc:2410] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:29.568221 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:29.593472 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.596549 15343 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
W20260709 13:04:29.603268 15160 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.598s (SENT)
I20260709 13:04:29.605046 15339 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:04:29.605432 15160 leader_election.cc:336] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.610s (SENT)
W20260709 13:04:29.606122 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.607007 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.594852 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.608659 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.610136 15268 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:29.568403 17948 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:29.612821 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.619731 15263 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
W20260709 13:04:29.621094 15160 leader_election.cc:336] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.671s (SENT)
I20260709 13:04:29.624362 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.566668 18146 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.627277 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:29.575659 18182 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.598250 18144 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.631242 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.629367 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:29.591746 18177 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:29.633927 18177 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.635246 18156 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:29.636324 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.637121 15269 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:29.637984 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.638476 15269 raft_consensus.cc:2376] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11. Re-sending same reply.
I20260709 13:04:29.611414 18174 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.658259 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:29.640365 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.659580 15272 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
W20260709 13:04:29.645259 18093 consensus_meta.cc:287] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.734s	user 0.008s	sys 0.002s
I20260709 13:04:29.645424 18182 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:29.620198 18120 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:29.592598 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:29.666164 15192 raft_consensus.cc:606] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:29.666517 15192 raft_consensus.cc:614] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:29.649989 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.651242 18146 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:29.567920 17998 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:04:29.652050 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.654201 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1540) took 1185 ms. Trace:
I20260709 13:04:29.631879 15268 raft_consensus.cc:2376] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11. Re-sending same reply.
I20260709 13:04:29.603679 15868 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:29.669636 15270 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:29.656100 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.647194 18155 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.621830 18058 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:29.658128 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1288) took 1231 ms. Trace:
I20260709 13:04:29.672443 15195 rpcz_store.cc:276] 0709 13:04:28.426807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.431548 (+  4741us) service_pool.cc:224] Handling call
0709 13:04:29.653671 (+1222123us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001e69d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:29.658069 (+  4398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548067200}
I20260709 13:04:29.653288 18098 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:29.655398 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.668486 15264 rpcz_store.cc:276] 0709 13:04:28.468725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.595434 (+126709us) service_pool.cc:224] Handling call
0709 13:04:29.654039 (+1058605us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b54000d8254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:29.654145 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970416384}
I20260709 13:04:29.596984 18039 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.683869 17998 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:29.684355 17998 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:29.685431 18146 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:29.675460 18182 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:29.568403 18044 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:29.679327 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 58268us
W20260709 13:04:29.686830 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 81078.4us
I20260709 13:04:29.688498 18044 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:29.689020 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.689528 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.698113 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.698830 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.699242 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.685354 17998 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:29.688455 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.671101 15263 raft_consensus.cc:2368] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
I20260709 13:04:29.666630 17948 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:29.703305 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:29.705070 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.671586 18154 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:29.706153 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:29.706501 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:29.709635 15197 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.665495 18174 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.709610 15188 raft_consensus.cc:2376] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8. Re-sending same reply.
I20260709 13:04:29.713388 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.719434 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.667062 18093 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.705669 18058 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:29.723870 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:29.727818 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.727851 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:29.712999 18098 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:29.742769 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.746503 15268 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 3: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:29.747849 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.750488 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.747013 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:29.750732 17948 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.751348 15264 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:29.752198 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.752753 15264 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:29.753644 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.754786 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.756055 15268 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:29.752375 18058 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.756953 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.757318 15269 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:29.758703 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:29.760545 15264 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:29.754310 17998 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.763917 15270 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:04:29.764367 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.773258 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.774575 15197 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:29.776014 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:29.760597 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72262.6us
I20260709 13:04:29.776829 15267 raft_consensus.cc:2376] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6. Re-sending same reply.
I20260709 13:04:29.770799 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.760879 18093 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:29.770889 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:29.777841 15263 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:29.778074 15272 raft_consensus.cc:2376] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7. Re-sending same reply.
W20260709 13:04:29.780529 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.783463 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.795953 15264 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:29.806839 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.810889 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:29.812733 15192 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 3.
I20260709 13:04:29.811394 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:29.815455 15190 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:29.783012 17959 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:04:29.762353 18154 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:29.726750 17827 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.835047 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:29.840462 18154 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:29.840658 15263 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:29.840950 18154 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:29.842074 15263 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:29.841857 18154 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:29.844727 15263 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:29.816277 18044 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:29.852178 15263 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:29.856757 15869 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:29.857772 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.857596 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:29.857679 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.868324 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:29.869606 15268 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:29.877821 15267 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:29.877946 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:29.878625 15346 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:29.871451 18154 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.847386 18165 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:29.849200 18120 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:29.832918 18093 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:04:29.930820 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.930349 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 123588us
W20260709 13:04:29.947646 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44292.3us
I20260709 13:04:29.948123 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:29.882350 18146 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:29.873262 18092 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:04:29.967321 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.887622 18039 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:29.978653 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 196624us
I20260709 13:04:29.980109 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:29.904150 18120 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:29.897706 18162 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:04:29.989058 18120 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.905146 18159 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:04:29.904811 18052 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:30.034749 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.979019 18174 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:30.053453 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 57522.4us
W20260709 13:04:30.059542 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109630us
W20260709 13:04:30.056098 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77672.2us
W20260709 13:04:30.055675 15841 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.590s (SENT)
I20260709 13:04:30.063560 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:29.987663 18098 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:30.052904 18088 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.003s
W20260709 13:04:30.035333 18166 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:29.968119 18196 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.269s
I20260709 13:04:30.069656 15266 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8.
I20260709 13:04:29.906564 18165 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.072837 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:30.075942 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.069326 18098 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:30.055411 18092 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:30.074364 18189 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:04:30.048753 18188 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:30.084111 18188 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:30.084846 17755 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.700s	user 0.013s	sys 0.000s
I20260709 13:04:30.085119 18188 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:30.087522 18197 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:04:30.088487 18191 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:04:30.089044 18052 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.076210 18114 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:30.078843 18098 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:30.109625 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:30.082126 18112 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:30.114241 18196 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:30.112052 15312 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:30.130498 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 93267.5us
W20260709 13:04:30.120987 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 132146us
I20260709 13:04:30.079350 18159 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:04:30.105741 18174 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:30.106442 18114 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:30.147285 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 79476.7us
I20260709 13:04:30.148054 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.129649 18196 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.129890 18182 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:30.161393 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:30.140311 18184 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:30.165254 18114 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:30.134342 18177 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.167995 18196 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:30.179445 18184 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.196774 18154 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:30.201572 18144 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.000s
I20260709 13:04:30.201741 18154 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.202042 18144 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:30.231047 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.247432 15265 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:30.204398 15271 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:30.254849 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55500.3us
I20260709 13:04:30.259274 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.208431 18184 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.199965 18174 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:30.246389 18144 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.292342 15868 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:30.292580 18098 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.293985 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1561) took 1110 ms. Trace:
I20260709 13:04:30.204931 18114 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.294396 15266 rpcz_store.cc:276] 0709 13:04:29.183505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.236751 (+ 53246us) service_pool.cc:224] Handling call
0709 13:04:30.293687 (+1056936us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54004155d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:30.293915 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816763776}
W20260709 13:04:30.272318 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 366269us
I20260709 13:04:30.185257 18182 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:30.253592 18198 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 13:04:30.274976 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 126981us
I20260709 13:04:30.275683 18092 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:30.276046 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:30.277096 18154 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:30.277736 18211 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:04:30.335392 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:30.278445 18207 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:04:30.280941 15874 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:30.329793 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:30.281632 18205 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:04:30.274437 17827 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:30.337569 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61625.7us
I20260709 13:04:30.342413 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:30.345825 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 153268us
W20260709 13:04:30.346675 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:30.357614 18052 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:30.359130 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.348331 18144 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:04:30.356627 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.356508 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.341909 17827 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:30.366530 17827 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:30.371125 18154 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:30.371647 18154 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:30.372038 18154 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:30.363811 18152 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.961s	user 0.022s	sys 0.000s
I20260709 13:04:30.375409 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.349179 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:30.343636 18209 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:30.377918 18156 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:30.381281 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.345556 18098 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.345587 18092 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:30.391708 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.388806 18182 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:30.393783 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44731.2us
I20260709 13:04:30.397812 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.410799 18088 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:30.411343 18088 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.412202 18088 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.412871 15343 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:30.415557 15193 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:30.417416 18160 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:30.417857 18160 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.396672 18210 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:30.418886 18210 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:30.419282 18210 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.419205 18160 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.420410 18160 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.422920 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:30.423609 15343 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:30.396935 18144 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:30.428782 17827 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:30.435417 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 104237us
I20260709 13:04:30.376485 18165 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.413183 18088 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:30.383236 18209 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:30.449172 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:30.452598 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:30.453594 18156 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:30.452791 18209 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:30.463172 18177 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.464042 18155 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:30.494378 15238 connection.cc:256] RPC call timeout handler was delayed by -1.3280203929999743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
I20260709 13:04:30.473500 18039 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:30.453500 18195 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:04:30.502676 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 104925us
I20260709 13:04:30.504151 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:30.506182 15263 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:30.498436 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:30.453317 18146 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:04:30.474848 18156 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:30.513206 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 64143.2us
I20260709 13:04:30.515746 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.496309 18155 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.517721 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:30.495949 18165 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:30.518971 18120 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.002s
I20260709 13:04:30.521404 18120 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:30.523639 17827 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.529186 15196 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:30.529960 18196 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.514722 17998 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:04:30.532956 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:30.534812 18154 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.543648 18112 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:30.516728 18156 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:30.551964 15160 leader_election.cc:400] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:30.553040 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.555065 18152 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:30.555611 18188 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:30.556030 18188 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:30.556969 18092 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:30.557407 15191 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:30.559226 18223 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:30.559463 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:30.559706 18223 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.514672 18039 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.548655 18194 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:30.549307 18165 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.550223 18154 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.551561 17998 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:30.556828 18188 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.548918 18222 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:30.556397 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.548130 15265 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:30.556761 18177 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.520462 18155 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:30.578495 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:30.533771 18120 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:30.598855 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:30.600515 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.601063 15191 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:30.585247 17998 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:04:30.605182 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 90854.4us
I20260709 13:04:30.568109 18194 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:30.602072 15238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.642s (SENT) [suppressed 68 similar messages]
I20260709 13:04:30.606976 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.610339 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1562) took 1057 ms. Trace:
I20260709 13:04:30.610736 15271 rpcz_store.cc:276] 0709 13:04:29.553208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.555876 (+  2668us) service_pool.cc:224] Handling call
0709 13:04:29.556158 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:30.251417 (+695259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.610113 (+358696us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54001b3854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:30.610281 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490378624}
W20260709 13:04:30.612768 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56452.1us
I20260709 13:04:30.601887 18188 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:30.602813 18154 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:30.613163 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:30.602895 18222 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.626921 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.623493 18196 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:30.625104 18093 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:30.581959 18201 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:04:30.631722 18153 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:30.632337 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.634333 15191 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:30.620937 18146 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.612727 18112 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:30.581043 18210 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.571415 18184 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:30.602568 18177 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.640293 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.641615 15309 leader_election.cc:400] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
I20260709 13:04:30.642096 15309 leader_election.cc:403] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:30.560563 18223 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.633034 18218 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:30.647647 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.649091 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:30.632503 18120 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:30.653802 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.636881 18152 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:30.633754 18153 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:30.678514 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:30.686326 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47683.6us
I20260709 13:04:30.687119 15160 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.635699 18146 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.675323 18152 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:30.658756 18195 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:30.674787 18154 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.634977 18039 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.639132 18194 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.696614 18199 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.697131 18194 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.699829 18222 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.702461 18210 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.703284 18153 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.704838 18153 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.708770 18184 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:30.712543 18209 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:30.715503 18165 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.681609 18201 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:30.681424 17729 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:30.717176 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:30.718088 15190 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.691761 18152 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.717506 17729 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.694870 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.690672 18223 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:30.683786 18120 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:30.686879 18092 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:30.682585 18218 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:30.730897 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47378.7us
I20260709 13:04:30.759976 18120 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:30.767678 18184 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.768257 18184 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.770319 18184 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:30.772569 18146 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.776041 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:30.776933 15874 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:30.764882 17729 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.779819 18156 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.782035 18156 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.731375 18114 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:30.724598 18112 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:30.800311 18112 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:30.802621 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:30.803382 15193 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:30.803514 18177 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.740046 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:30.788069 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 93268.4us
I20260709 13:04:30.806172 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.807161 18114 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:30.807615 18114 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:30.807955 17948 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:30.809072 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77052us
I20260709 13:04:30.810338 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:30.807163 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.811129 17948 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.738714 18218 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.808080 18114 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.754799 17998 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:30.812693 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.813000 17998 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.815932 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:30.817173 18093 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:30.817560 18093 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.817929 18093 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:30.807680 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:30.820206 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.820278 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.788064 15190 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:30.844295 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:30.741928 18209 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:30.844257 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.849522 15874 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:30.834273 17827 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:30.854460 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 118285us
I20260709 13:04:30.855228 15311 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:30.859138 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.818917 18154 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:30.835960 18156 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:30.856976 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.864032 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:30.864135 15339 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:30.836525 18199 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:30.853111 18201 raft_consensus.cc:2764] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:04:30.869884 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:30.875208 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:30.875335 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:30.900238 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:30.901670 17827 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:30.902618 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 59) took 7316 ms. Trace:
I20260709 13:04:30.797888 18152 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.854637 18092 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:30.904810 18152 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.876067 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.907222 15337 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:30.908099 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:30.909276 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.910384 15160 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:30.911394 18222 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:30.913451 18209 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:04:30.914229 18209 raft_consensus.cc:2764] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:30.914835 18209 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.866534 18155 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.917742 18188 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:30.903061 15093 rpcz_store.cc:276] 0709 13:04:23.556122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.556317 (+   195us) service_pool.cc:224] Handling call
0709 13:04:30.872415 (+7316098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:30.076057 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:30.090185 (+ 14128us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:30.090239 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:04:30.090276 (+    37us) tablet.cc:662] Decoding operations
0709 13:04:30.091130 (+   854us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:30.091199 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:30.091226 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:30.091837 (+   611us) tablet.cc:701] Row locks acquired
0709 13:04:30.091887 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:04:30.092059 (+   172us) write_op.cc:270] Start()
0709 13:04:30.092219 (+   160us) write_op.cc:276] Timestamp: P: 1783602270091989 usec, L: 0
0709 13:04:30.092242 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:04:30.132209 (+ 39967us) log.cc:844] Serialized 2115 byte log entry
0709 13:04:30.543929 (+411720us) op_driver.cc:464] REPLICATION: finished
0709 13:04:30.635810 (+ 91881us) write_op.cc:301] APPLY: starting
0709 13:04:30.637726 (+  1916us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:30.673545 (+ 35819us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:30.692224 (+ 18679us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:30.748072 (+ 55848us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:30.748272 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:04:30.748323 (+    51us) write_op.cc:312] APPLY: finished
0709 13:04:30.748590 (+   267us) log.cc:844] Serialized 46 byte log entry
0709 13:04:30.748775 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.748880 (+   105us) write_op.cc:454] Released schema lock
0709 13:04:30.748924 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:30.749307 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.749337 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":237631,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":69133,"apply.run_cpu_time_us":3307,"apply.run_wall_time_us":124597,"num_ops":5,"prepare.queue_time_us":262450,"prepare.run_cpu_time_us":29002,"prepare.run_wall_time_us":228358,"raft.queue_time_us":140969,"raft.run_cpu_time_us":15405,"raft.run_wall_time_us":55966,"replication_time_us":451524,"thread_start_us":342628,"threads_started":4,"wal-append.queue_time_us":212902}]]}
I20260709 13:04:30.923657 18155 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.858817 17755 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:30.925195 18092 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:30.925894 18160 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:30.926295 18092 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:30.927591 18160 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:30.927965 18160 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.928216 18092 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:30.928596 18092 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.928831 18160 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.929389 18092 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.930194 18160 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:30.930491 18092 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:30.935772 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.939445 18242 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.940028 18242 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.940982 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:30.941125 18093 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.942158 18242 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:30.942735 18242 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:30.862490 18088 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:30.944743 17948 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:30.952550 15095 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:30.953281 18209 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:30.954181 18039 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:30.955591 18007 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:30.956025 18007 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.957067 15190 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:30.956625 15095 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 4 to 9, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 9 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.956910 18007 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:30.959282 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:30.898121 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:30.959432 15191 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:30.960193 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 62227.3us
I20260709 13:04:30.962077 18007 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.968355 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:30.970000 15095 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 3 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.991860 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:30.993016 15342 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:30.994506 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:30.995939 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:30.992988 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:30.997294 15271 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:30.930828 18195 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
I20260709 13:04:30.974829 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.004645 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.004899 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.005353 15265 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:31.006958 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.007382 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:30.999961 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.011686 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.012180 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.012733 15271 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:31.012812 15269 raft_consensus.cc:2376] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9. Re-sending same reply.
I20260709 13:04:31.007943 15266 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:31.013913 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.014524 15270 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:30.967975 18088 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:30.968326 18177 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.991109 17755 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:30.991241 18154 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.999719 18209 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:04:31.033350 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.034871 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.035534 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.036351 15269 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:31.025041 15095 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 3 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.029670 15267 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:31.029893 15342 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:31.006032 18222 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.010740 18058 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:31.036419 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.037942 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.040074 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:31.029991 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 146728us
I20260709 13:04:31.000325 18242 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:31.040382 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.006371 18144 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.035066 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.038741 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.048156 15271 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.017086 18152 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:31.042682 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.044651 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:31.056633 15190 raft_consensus.cc:1217] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 13:04:31.057116 15190 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:04:31.058347 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.058632 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.058948 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.059549 15189 raft_consensus.cc:2368] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:04:31.060669 15264 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:31.063851 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.064692 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.065750 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.066274 15266 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.025698 17755 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.068192 15194 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:31.025565 18238 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:31.032155 18188 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:31.087946 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.072487 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:31.072788 18175 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:04:31.039067 18182 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:31.073738 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.041945 18093 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:31.075335 15267 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:31.076112 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.010116 18039 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:04:31.078321 18156 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.079867 18044 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:31.063494 17827 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:31.032372 18230 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.084498 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:31.086838 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.107740 15189 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.086759 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.091799 15271 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:31.092788 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:31.093668 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.110507 15190 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:31.083021 17755 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.037987 18154 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.096136 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.045346 18058 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:31.091353 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.098901 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.099728 15268 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:31.030686 18177 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.103967 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.102186 15270 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.125617 18177 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.128324 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.103787 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.129061 15346 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:31.130151 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.130733 15264 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:31.106168 18060 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:31.032486 18114 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.071871 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.108974 15197 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:31.102581 18238 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:31.142784 17827 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.114142 18044 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.143373 17827 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:31.143409 18238 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.145430 15095 catalog_manager.cc:5697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 1 to 4, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 4 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.058826 18218 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:31.148940 18218 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.149811 15192 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:31.151845 18044 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.151988 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.152583 18114 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.050025 18222 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.140909 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.110924 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.156319 15188 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:31.073113 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.102548 18188 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.101819 18160 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.103528 18165 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:31.119115 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.168609 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.169752 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.170325 15268 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:31.120157 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.120826 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.121083 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.115553 18230 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.122047 15339 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:31.115933 18209 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:31.178013 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.130944 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.179169 18222 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:31.179767 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.181044 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.182416 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.185935 15196 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:04:31.186352 15196 pending_rounds.cc:85] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 5
I20260709 13:04:31.186569 15196 pending_rounds.cc:107] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:04:31.186812 15196 raft_consensus.cc:2889] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:31.186887 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.188169 15191 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:31.188445 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.191526 15192 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:31.104836 18182 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.132898 15263 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:31.133515 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.103875 17729 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:31.139245 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.210278 15344 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.139449 15189 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:31.140837 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.211326 15267 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.141680 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.211822 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.059940 18144 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.160852 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.214380 15269 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.215431 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.215651 15188 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:31.216226 15189 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:31.216356 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.165624 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:31.166896 15091 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 171) took 22704 ms (client timeout 15000 ms). Trace:
I20260709 13:04:31.171379 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.169296 15272 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:31.175844 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.193202 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.194796 18154 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.203135 18209 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:31.222798 15265 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:31.202924 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:31.168771 18195 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.204835 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.206135 15194 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:31.229382 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.206588 15264 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:31.208645 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:31.209236 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:31.205000 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:31.158682 15266 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:31.232424 15344 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:31.232662 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.233213 15266 raft_consensus.cc:2376] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4. Re-sending same reply.
I20260709 13:04:31.227011 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.221812 15337 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:31.132469 15270 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:31.234025 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.226643 15189 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:31.234541 15266 raft_consensus.cc:2376] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7. Re-sending same reply.
W20260709 13:04:31.235641 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.231381 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.235635 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.241168 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:31.241820 15344 raft_consensus.cc:2376] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8. Re-sending same reply.
I20260709 13:04:31.242947 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.243181 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.240795 18044 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:31.245059 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.245270 18044 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.246579 15197 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:04:31.276662 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.288343 15188 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:31.288795 15269 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:31.289462 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.291002 15269 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:31.209962 17729 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:31.175674 18160 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.292773 15340 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:31.299563 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:31.292852 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46440.2us
I20260709 13:04:31.183722 18165 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.292258 15269 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:31.303859 15269 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:31.115706 18088 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.245692 18044 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:31.298243 15267 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:31.299172 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.310935 18114 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:31.213773 18039 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:04:31.312430 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.334951 15191 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:31.250366 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.307523 15265 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:31.307679 15269 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:31.242457 18194 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:31.309115 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.163017 18242 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.357504 15341 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:31.304996 18184 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:04:31.312970 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:31.302064 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.358867 15197 raft_consensus.cc:2368] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:31.317183 15264 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:31.360225 15264 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:31.217990 15091 rpcz_store.cc:269] 0709 13:04:08.462227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.462502 (+   275us) service_pool.cc:224] Handling call
0709 13:04:31.166672 (+22704170us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:25.694577 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:25.817492 (+122915us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:25.817541 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:04:25.817569 (+    28us) tablet.cc:662] Decoding operations
0709 13:04:26.095154 (+277585us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:26.095249 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:26.095297 (+    48us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:04:26.258837 (+163540us) tablet.cc:701] Row locks acquired
0709 13:04:26.258868 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:04:26.259096 (+   228us) write_op.cc:270] Start()
0709 13:04:26.259242 (+   146us) write_op.cc:276] Timestamp: P: 1783602266259018 usec, L: 0
0709 13:04:26.259272 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:04:26.309474 (+ 50202us) log.cc:844] Serialized 11310 byte log entry
0709 13:04:27.127975 (+818501us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:27.414309 (+286334us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5708e28 00007f36e9143581 00007f36e9142d58 00007f36e91479f1 00007f36e91479a9 00007f36e9147939 00007f36e9147901 00007f36e9146b2d 000000000038f354 000000000038f199
0709 13:04:27.835397 (+421088us) op_driver.cc:464] REPLICATION: finished
0709 13:04:28.314539 (+479142us) write_op.cc:301] APPLY: starting
0709 13:04:28.314698 (+   159us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:28.318449 (+  3751us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:28.318515 (+    66us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:28.502534 (+184019us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:28.503078 (+   544us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=29
0709 13:04:28.503135 (+    57us) write_op.cc:312] APPLY: finished
0709 13:04:28.515340 (+ 12205us) log.cc:844] Serialized 193 byte log entry
0709 13:04:28.515601 (+   261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:28.539021 (+ 23420us) write_op.cc:454] Released schema lock
0709 13:04:28.583131 (+ 44110us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:28.583680 (+   549us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:28.583709 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17220,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":470444,"apply.run_cpu_time_us":10446,"apply.run_wall_time_us":269248,"num_ops":29,"prepare.queue_time_us":1370997,"prepare.run_cpu_time_us":61368,"prepare.run_wall_time_us":1732462,"raft.queue_time_us":265777,"raft.run_cpu_time_us":19787,"raft.run_wall_time_us":531563,"replication_time_us":1575830,"spinlock_wait_cycles":14888192,"thread_start_us":2135054,"threads_started":4,"wal-append.queue_time_us":281605,"wal-append.run_cpu_time_us":55031,"wal-append.run_wall_time_us":2915950}]]}
I20260709 13:04:31.240631 18177 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:31.311511 18114 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.319885 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:31.321130 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 111935us
I20260709 13:04:31.240743 18175 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:31.322475 15346 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:31.299721 18007 raft_consensus.cc:2764] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:04:31.315718 18172 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.333021 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:31.344499 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.345144 15271 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:31.242051 18195 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.367962 15267 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:04:31.368497 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.329768 18039 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:31.357110 18194 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.389249 15271 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:31.392804 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:31.404106 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.406967 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:31.373917 18039 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:31.420747 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 124504us
I20260709 13:04:31.414718 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.447434 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:31.447660 15197 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:31.448622 15874 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:31.394649 18194 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.453971 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:31.458309 18254 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.331487 18209 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.459548 18176 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.458436 18195 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:31.409926 18060 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.408393 18007 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.390810 18120 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:04:31.474371 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.478551 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:31.373008 18175 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.460580 18160 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:31.483587 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 63454.5us
I20260709 13:04:31.487859 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:31.489679 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:31.481500 18195 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:31.490412 18195 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:31.490732 18223 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:31.491055 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:31.491240 18223 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:31.492108 18223 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.492810 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:31.493060 18223 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.490935 18195 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.493396 17827 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.494549 18159 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.495283 18159 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:31.495414 18210 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:31.496136 18039 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:31.497159 18039 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.499910 18144 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:31.500579 18144 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:31.500975 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:31.501468 18175 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:31.501971 15874 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:31.502364 18144 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:31.492825 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.506683 18199 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:31.465195 18218 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:31.375066 18172 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.507247 18199 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:31.502794 18144 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:31.513733 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109752us
I20260709 13:04:31.526542 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.515457 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:31.527763 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.374917 17729 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.471954 18230 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.482923 18155 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:31.529356 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:31.537242 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:31.533615 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.535526 15192 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:31.526185 18160 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:31.483110 18182 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.544186 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:31.541038 15190 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:31.526865 18199 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.553129 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.553828 15188 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:31.555423 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:31.533042 18254 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.533344 18176 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:31.565567 15339 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:31.567262 15192 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:31.558542 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.485664 18007 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.507308 18058 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.536741 18222 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.537217 18155 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:31.580933 18155 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.583860 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.584585 18223 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:31.586017 18114 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.584580 15340 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:31.571575 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:31.547784 17998 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:31.590703 18144 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.591763 17998 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:31.592489 18144 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:31.592993 17998 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.543568 18120 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:31.595698 18248 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:04:31.596459 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.578101 15188 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:31.597843 15340 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:31.578454 15346 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:31.578780 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.579231 18060 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:31.601197 18060 consensus_queue.cc:1243] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:31.600596 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:31.601908 18044 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.603248 18114 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:31.603430 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:31.552999 18165 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.552177 18195 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:31.621865 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63409.6us
I20260709 13:04:31.625563 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:31.626042 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54552.3us
I20260709 13:04:31.542470 18218 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:04:31.576890 18182 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:31.634507 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.570974 18256 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:31.662997 18165 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:31.664661 18165 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:31.623461 18114 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:31.670172 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.632625 18120 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.673857 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.639670 18254 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:31.613250 18176 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:31.605325 18184 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:04:31.687997 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:31.682964 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 95370.3us
I20260709 13:04:31.688716 15263 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:31.688993 15269 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:04:31.689340 15269 pending_rounds.cc:85] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 3
I20260709 13:04:31.652988 18257 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:31.689570 15269 pending_rounds.cc:107] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:04:31.689705 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.689843 15269 raft_consensus.cc:2889] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:31.683495 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 155931us
I20260709 13:04:31.690276 15263 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:31.691532 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.613310 18222 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.674938 18152 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:31.694554 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:31.676491 18182 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:31.690224 18254 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:31.674938 18114 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:31.698601 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.692221 15263 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:04:31.705521 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.710672 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.711364 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.712234 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.712394 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.713853 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:31.715435 18092 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.785s	user 0.015s	sys 0.000s
I20260709 13:04:31.717629 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.718554 18044 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.718608 18257 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:31.722869 18176 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:31.724367 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.726644 15346 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:04:31.742228 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 102669us
I20260709 13:04:31.698284 18060 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 13:04:31.831301 18254 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.844812 15338 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:31.846419 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:31.847007 15338 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:31.846959 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.832141 18172 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:31.848353 15265 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:31.834285 18195 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:31.835772 18114 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.852120 18114 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:31.854112 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:31.855116 15263 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:31.856482 15263 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:31.696543 18152 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:31.871694 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 91010.1us
W20260709 13:04:31.872311 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 143966us
I20260709 13:04:31.838374 15344 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:31.841967 18201 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:31.842633 15264 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:31.709271 18175 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:31.708071 17755 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 13:04:31.862425 15265 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:31.886276 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:31.887295 15265 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:31.837457 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 56919.3us
I20260709 13:04:31.854789 15269 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:31.896806 15269 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:31.900782 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 266332us
I20260709 13:04:31.901952 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.904541 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:31.912983 15269 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:31.914525 15269 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:04:31.876221 18152 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:31.883157 18252 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.899060 18175 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.877223 18201 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:31.913062 18177 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:31.939230 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.962047 18177 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:31.962666 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:31.948150 18258 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:04:31.950037 18222 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:31.950935 18196 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.951678 18007 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:31.884245 18112 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:04:31.911464 17755 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:31.983196 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:31.984536 15267 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:31.985746 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:31.942924 18175 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.961043 18194 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:31.993848 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 299693us
W20260709 13:04:31.995265 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93350.5us
I20260709 13:04:31.971139 15265 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:31.883366 18223 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:04:31.974869 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:31.916297 15269 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:31.979954 15196 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:31.981796 15189 pending_rounds.cc:85] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 4
I20260709 13:04:31.996332 15238 leader_election.cc:400] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:04:31.997236 15189 pending_rounds.cc:107] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:04:31.997545 15238 leader_election.cc:403] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:04:31.982672 18201 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.986290 15267 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:31.975556 18165 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.983018 15188 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:31.997622 15189 raft_consensus.cc:2889] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:31.992079 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.005739 15194 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:32.000187 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:31.990975 18210 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:32.025758 15337 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:32.026885 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.027573 15194 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:32.002084 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.033309 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.943408 18252 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.000377 18256 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:32.007136 18039 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 13:04:32.045632 15191 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:32.048074 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:32.036473 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:32.049446 15346 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:32.037361 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.039215 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.052003 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:31.977447 18182 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.024104 18044 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 3. Current term is 4.
I20260709 13:04:32.053393 18044 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:32.053789 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.054082 18044 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:32.054731 18044 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:31.989496 18196 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:31.963161 18177 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.057523 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.026561 18007 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.036723 18201 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:32.061986 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.061847 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.076454 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.077064 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.080871 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.082485 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:32.089705 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.024784 18165 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.059224 17755 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:32.107359 15346 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:04:32.108361 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 59953.7us
I20260709 13:04:32.094058 18044 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:32.067067 15868 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:32.070910 18120 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:32.085373 18114 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:32.059659 18230 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:04:32.084342 18256 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:32.092207 18257 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:32.092021 18210 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:32.115275 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:32.118016 18156 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:04:32.115839 18153 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:32.116969 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.141831 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.120436 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1625) took 1017 ms. Trace:
I20260709 13:04:32.121490 15196 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:32.147445 15192 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:32.121716 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.148528 15269 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:32.122339 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.149415 15265 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:32.102866 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:32.084142 18254 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:32.127398 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.152704 15267 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:32.153134 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50415.7us
I20260709 13:04:32.131811 15272 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:32.074712 18218 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:04:32.133937 18209 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.134433 18152 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.094430 18039 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:04:32.153873 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:32.147254 15263 rpcz_store.cc:276] 0709 13:04:31.095853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.857246 (+761393us) service_pool.cc:224] Handling call
0709 13:04:31.857538 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:31.857767 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:31.857791 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:31.858263 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:04:31.904861 (+ 46598us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:31.938886 (+ 34025us) log.cc:844] Serialized 14 byte log entry
0709 13:04:31.939499 (+   613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.939575 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:32.113019 (+173444us) raft_consensus.cc:1685] finished
0709 13:04:32.113059 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.113288 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353,"prepare.queue_time_us":50094,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":644,"raft.run_wall_time_us":7564,"spinlock_wait_cycles":15344000,"thread_start_us":46136,"threads_started":1,"wal-append.queue_time_us":118105}
I20260709 13:04:32.084949 18007 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.158994 15874 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:32.170109 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.132850 18222 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:32.172925 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 57797.9us
W20260709 13:04:32.165815 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 83427.7us
I20260709 13:04:32.129972 18112 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:32.138432 18156 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:32.159226 15265 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
W20260709 13:04:32.157482 18155 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.004s
I20260709 13:04:32.170898 15272 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:32.175611 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.176673 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.137718 18257 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:32.168582 15267 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:32.256584 15338 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:32.257184 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80614.4us
I20260709 13:04:32.162254 18210 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:32.197573 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.169466 18088 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:32.258044 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:32.263430 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 89816.4us
I20260709 13:04:32.136636 18275 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:32.161078 18255 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.259115 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:32.259689 18269 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:04:32.254196 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.260284 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:32.261308 18182 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:32.262903 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.180974 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:32.285053 18114 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:32.258059 18155 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.285074 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.285790 18114 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:32.286723 18114 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.287418 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.222232 18222 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.289727 18218 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:32.290161 18165 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.174155 18068 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:32.290952 18068 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.291405 18068 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.290032 18222 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:32.258409 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:32.287328 18155 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.296327 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:32.297166 18155 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:32.297258 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.297828 18155 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:32.298306 15190 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:32.298831 18155 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:32.301451 18144 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.004s
I20260709 13:04:32.303217 18152 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.276736 15188 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:32.308437 18195 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:32.309042 18195 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:32.310096 18195 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.240913 18238 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:04:32.271306 18284 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:32.241353 18156 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:32.312165 18284 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.221101 18223 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:04:32.312693 18188 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:32.312776 18284 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:32.312794 18156 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.314962 18156 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.281680 18257 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.256281 18254 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:04:32.164390 18209 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.270354 18088 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:32.171651 18199 consensus_meta.cc:287] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
W20260709 13:04:32.317534 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 59574.3us
I20260709 13:04:32.359587 15238 leader_election.cc:400] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:32.360049 15238 leader_election.cc:403] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:32.172195 18272 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.320174 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:32.364012 18288 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:32.364494 18288 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.364997 18288 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.369956 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1323) took 1167 ms. Trace:
I20260709 13:04:32.372129 18194 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:32.343822 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56468.1us
I20260709 13:04:32.373396 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:32.351143 18283 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:04:32.331264 15188 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:32.351734 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:32.350765 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 109679us
W20260709 13:04:32.377627 18247 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.058s	user 0.001s	sys 0.002s
I20260709 13:04:32.373584 18172 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.393785 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.370517 15337 rpcz_store.cc:276] 0709 13:04:31.202184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.247101 (+ 44917us) service_pool.cc:224] Handling call
0709 13:04:31.305008 (+ 57907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.026218 (+721210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.369601 (+343383us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002724d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:32.369877 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656940416}
I20260709 13:04:32.400784 15338 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:32.345654 18182 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:32.411854 15346 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
W20260709 13:04:32.405398 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.407485 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:32.413360 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 232481us
I20260709 13:04:32.351387 18092 raft_consensus.cc:2764] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:04:32.372241 18295 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.410399 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.352553 18275 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:32.420390 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 61003.1us
I20260709 13:04:32.404399 18195 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:32.431437 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.431809 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.432797 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:32.386745 18144 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:04:32.413008 18112 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:32.436899 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83877.5us
I20260709 13:04:32.430685 18218 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:32.440933 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.444840 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.447247 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.388593 18199 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:32.450143 18290 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.063s	user 0.002s	sys 0.001s
I20260709 13:04:32.447880 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:32.464967 18249 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.465932 18249 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:32.467010 18160 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.467743 18160 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.471306 18275 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:32.473652 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.473785 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:32.412349 18172 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:32.451386 18279 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:04:32.394714 18272 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.453406 18287 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:32.437381 18268 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:32.436414 18194 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:32.456909 18093 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:32.440798 18223 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:04:32.484099 15189 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:32.448549 18254 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:32.462863 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.487869 15197 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:32.489061 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.477128 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.495905 15267 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:32.505836 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.507627 18223 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:32.508008 18267 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:32.508486 18144 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.508601 18267 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:32.438504 18088 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.440337 18210 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.433055 18295 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.517966 18295 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.444434 18112 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.487605 18176 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:32.512198 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.532181 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.521414 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.509045 18267 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:32.525323 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:32.537955 18254 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.538115 18144 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:32.539209 18120 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.544982 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:32.545727 15345 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:32.546689 15346 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:32.539968 18249 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.497009 18291 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:32.508087 18223 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:32.551519 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.548950 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:32.531996 18287 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:32.533617 15869 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:32.558554 18297 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:32.560019 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:32.564038 15337 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:04:32.560699 18175 consensus_meta.cc:287] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 13:04:32.508244 18172 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:32.562654 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 79053.9us
I20260709 13:04:32.571702 15272 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:32.541615 18165 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.552317 18152 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:32.584800 18285 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:04:32.563021 18291 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:32.551826 18254 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.574699 18297 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.595021 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.596220 15265 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:32.586105 18112 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.553833 18144 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.554421 18176 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:32.606611 18176 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.607394 18254 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.563436 18287 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.609483 18287 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:32.580101 18209 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:32.555137 18249 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.603484 18297 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.592669 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:32.554308 18120 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.633823 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:32.590711 18199 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.580850 18175 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.641557 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.643873 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.645135 15265 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:32.628422 18068 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.649845 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.603916 18272 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.650153 15189 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:32.668125 15271 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:04:32.668326 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.669337 15269 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:32.668362 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.670483 15190 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:32.670778 15268 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:32.670864 15190 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:32.674513 15191 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:32.669800 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:32.676523 15189 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:32.676455 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.629683 18152 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:32.589975 18284 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.679586 18093 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:32.682536 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.690200 15188 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:32.683935 15340 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:32.685626 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:32.675662 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.692574 15191 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:32.671654 15190 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.693931 15190 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:32.687937 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:32.628800 18112 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:04:32.707010 18250 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:32.701267 18291 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.707609 18250 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:32.708081 18250 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:32.710332 15869 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:32.711212 18293 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:32.712381 18144 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.712018 18293 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:32.695031 18172 consensus_queue.cc:1175] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ca86ee1d194023b1414bbe226f4798" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: [7.6-7.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:32.717305 18284 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:32.718066 15195 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:32.650295 18194 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:04:32.721233 18302 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:32.723548 18152 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.686621 18199 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:32.731859 15188 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:32.739763 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.743938 15190 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:04:32.751215 15190 pending_rounds.cc:85] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 5
I20260709 13:04:32.749276 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:32.751828 15190 pending_rounds.cc:107] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:04:32.689458 18209 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:04:32.752801 15190 raft_consensus.cc:2889] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:32.734944 18176 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:32.752467 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.755362 17729 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:32.756264 18120 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.676677 18223 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.756299 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1761) took 1179 ms. Trace:
I20260709 13:04:32.772920 15344 rpcz_store.cc:276] 0709 13:04:31.576778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.578524 (+  1746us) service_pool.cc:224] Handling call
0709 13:04:32.756089 (+1177565us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400173ed4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:32.756230 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296366336}
I20260709 13:04:32.735384 18302 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:32.687777 18255 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:04:32.766055 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:32.800786 18259 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:04:32.801304 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:32.741325 18188 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:32.802536 18120 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:32.802947 18120 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.803236 18182 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:32.803539 18120 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:32.726572 18267 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.804409 18266 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:32.754607 18175 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:32.743258 18194 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:04:32.776155 18304 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:04:32.780957 18249 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.826293 18218 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:32.735248 18201 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:04:32.827525 18288 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.763389 18068 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:32.783937 18196 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:32.784260 18223 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:32.833455 18288 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.787388 18252 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.750903 18254 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:32.774804 18176 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:32.770205 18256 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:32.789472 18007 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:32.793184 18160 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:32.794929 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1329) took 1081 ms. Trace:
I20260709 13:04:32.795434 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:32.844820 15340 rpcz_store.cc:276] 0709 13:04:31.713141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.713285 (+   144us) service_pool.cc:224] Handling call
0709 13:04:31.827585 (+114300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.695426 (+867841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.794591 (+ 99165us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400340154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:32.794833 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968731904}
I20260709 13:04:32.793617 18287 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.753115 18144 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:04:32.840921 18176 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.772378 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:32.810024 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.862584 15190 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:32.864217 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:32.875308 15874 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:32.877568 18209 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.878192 18209 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.882570 18209 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:32.884140 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.884577 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:32.885401 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.887001 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:32.814833 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 114938us
I20260709 13:04:32.818768 18257 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:04:32.896601 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:32.819166 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.900043 15188 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:32.802834 18188 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.805667 18267 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.820485 18297 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:32.821533 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.864581 18242 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.910072 15267 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:32.803718 18182 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.915802 18182 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:32.917299 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.918062 15272 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:32.850261 18287 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.850813 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1621) took 1756 ms. Trace:
I20260709 13:04:32.920218 15264 rpcz_store.cc:276] 0709 13:04:31.094637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.360939 (+266302us) service_pool.cc:224] Handling call
0709 13:04:31.361181 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:31.877511 (+516330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.850558 (+973047us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54002a80d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:32.850744 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106705792}
W20260709 13:04:32.922046 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:32.850813 15193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1792) took 1892 ms (client timeout 2186 ms). Trace:
I20260709 13:04:32.855242 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:32.860741 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:32.861222 15266 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:32.929628 15266 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:32.827661 18218 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:32.890458 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.935701 15263 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:32.890290 18222 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.816547 18259 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:32.901144 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.903214 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:32.941550 15192 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:32.903981 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:32.905455 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.943511 15265 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:32.912262 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:32.944144 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.919478 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.922753 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:32.945631 15264 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:32.896301 18256 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:32.925652 15193 rpcz_store.cc:269] 0709 13:04:30.958803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.958935 (+   132us) service_pool.cc:224] Handling call
0709 13:04:32.850641 (+1891706us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003e71d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:32.850744 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398647040}
I20260709 13:04:32.907325 18188 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:32.950747 15272 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:32.960107 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:32.907989 18156 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:32.873476 18120 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.962649 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:32.963471 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:32.961220 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:32.965969 15188 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:32.963637 15344 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:32.964341 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 52290us
I20260709 13:04:32.895296 18293 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:32.937659 17729 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.962657 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:32.971350 15343 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:33.036478 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.037684 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:32.949280 18256 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.907120 18252 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 13:04:33.040242 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77670.9us
I20260709 13:04:33.038686 15339 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:32.974752 15267 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:33.046782 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:33.048062 15193 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:32.984602 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:33.049147 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:33.050015 15193 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:33.053718 15263 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
W20260709 13:04:33.053818 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 69471.6us
I20260709 13:04:32.940042 18242 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.062537 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.058591 15841 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:33.064800 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:32.963739 18068 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.038200 17729 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.071300 18308 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:32.974946 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:04:33.037292 18283 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:33.071121 18317 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.165s
I20260709 13:04:32.975731 18175 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.951771 18266 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:04:33.063503 18195 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.075103 15841 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.969846 18152 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:04:33.077085 15193 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:04:32.976410 18268 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:32.800894 18302 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.032356 18201 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.032642 18275 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.073734 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.103097 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:32.947495 18222 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.040221 18293 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:33.052657 18160 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.086216 15192 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:33.080986 18068 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.054801 18256 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:32.961277 18058 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.135663 18264 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.137660 15196 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:33.093521 18195 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.091240 15345 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:32.973809 18156 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:32.950201 18259 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.101898 18307 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:33.099507 18175 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.132869 18293 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.148723 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:33.150029 18175 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.105271 18266 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:33.105932 18297 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:33.155083 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:33.105763 18201 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:33.107407 18275 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.111256 18007 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.115828 17827 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.086588 18308 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:04:33.117558 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1772) took 1070 ms. Trace:
I20260709 13:04:33.086683 18184 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:33.072767 18223 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:04:33.119463 18257 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.122262 18238 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:33.120962 15195 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:33.140923 15196 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:33.141002 15192 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:33.138985 18195 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.202984 18257 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.203867 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1805) took 1695 ms. Trace:
I20260709 13:04:33.205579 18257 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.144594 18156 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.129279 17729 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.125871 17998 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:33.208181 17998 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.208585 17998 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.152446 15346 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:33.150625 18266 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:33.212950 18266 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.214195 18266 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.205227 15197 rpcz_store.cc:276] 0709 13:04:31.508208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.508360 (+   152us) service_pool.cc:224] Handling call
0709 13:04:31.508632 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.495019 (+986387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.203233 (+708214us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54002260d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:33.203785 (+   552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251679104}
I20260709 13:04:33.199795 18238 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:33.156049 15345 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.221491 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:33.159477 18007 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.174216 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:33.139670 18160 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.180521 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.236860 15337 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:33.161053 18120 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.181602 15338 rpcz_store.cc:276] 0709 13:04:32.047532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.047707 (+   175us) service_pool.cc:224] Handling call
0709 13:04:33.117373 (+1069666us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001766d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:33.117495 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477914880}
I20260709 13:04:33.195451 18184 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.207229 18242 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.223596 15196 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:04:33.251691 18319 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:33.217276 18238 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.253607 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 154) took 1181 ms. Trace:
I20260709 13:04:33.254701 18238 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:33.254120 15341 rpcz_store.cc:276] 0709 13:04:32.072207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.072382 (+   175us) service_pool.cc:224] Handling call
0709 13:04:32.094484 (+ 22102us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.094830 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.094878 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:32.852202 (+757324us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b180037c3c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a
0709 13:04:32.852600 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 13:04:32.966732 (+114132us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:32.966770 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.966860 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.253195 (+286335us) raft_consensus.cc:1685] finished
0709 13:04:33.253225 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.253530 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":607,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":15499,"spinlock_wait_cycles":9947904,"thread_start_us":113748,"threads_started":1,"wal-append.queue_time_us":287388}
I20260709 13:04:33.260397 18068 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.237758 18264 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:33.264276 18264 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:33.265290 18264 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:33.266155 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.266706 18264 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:33.132627 18268 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:33.178989 18201 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:33.179304 18175 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.248667 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:33.180320 18250 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.270673 15196 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:33.258491 18182 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.337476 15190 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:33.328715 18325 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.339542 18325 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.340482 18058 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.342025 18325 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.342262 18285 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.325794 17998 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.342993 18285 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.350929 15271 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:33.341287 18058 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.344110 18175 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.237293 18007 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.358255 17998 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.359177 18266 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.359789 18266 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.307060 18188 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.284019 18068 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.362150 18068 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.345417 18218 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.346632 15192 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:33.327157 18312 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.338609 18268 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.348728 15345 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:33.353794 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:33.346382 18256 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:33.337970 18299 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.753s	user 0.003s	sys 0.001s
I20260709 13:04:33.356871 18182 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.357107 18058 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.352087 18285 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:33.383646 18256 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.385044 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:33.385991 15196 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:33.268970 18184 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.276944 18160 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.341285 18250 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.275637 15343 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:33.366335 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:33.279002 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 176012us
I20260709 13:04:33.389303 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:33.389997 15192 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:33.392180 15192 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:33.392530 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.393230 15265 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:33.377873 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:33.378118 15874 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:33.379200 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.332963 18195 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.372366 18188 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.406585 18195 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.409447 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.382470 18268 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.387856 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:33.398653 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.425416 15270 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:33.426898 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:33.400751 15269 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:33.428891 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.430400 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.431193 15269 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:33.431730 15196 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:33.404241 18249 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:33.368305 18312 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.406596 18007 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.416391 15344 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:04:33.417656 15267 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:33.418883 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.421149 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.444247 15265 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:33.445806 18114 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:33.446374 18114 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:33.447283 18114 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.448365 18114 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.453795 15264 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:33.435591 15270 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:04:33.473791 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 96066.3us
I20260709 13:04:33.437026 18249 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:33.477187 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.478678 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.479372 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.442788 18120 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:33.482630 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:33.485889 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:33.486280 15338 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.479547 15343 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:33.461845 18257 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:04:33.484393 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.490645 15346 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:33.490868 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:33.461875 18250 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.494123 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:33.495002 15343 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.499871 15337 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:33.500008 18007 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.500065 18068 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.500982 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.501555 15337 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:33.502807 15337 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 13:04:33.503304 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:33.503692 18331 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:33.503664 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:33.512420 15339 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.512686 15346 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.503628 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.503852 18256 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:33.521194 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:33.522184 15271 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.521217 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.523373 15338 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:33.523983 15345 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:33.481043 18302 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.528477 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.552819 18302 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:33.553411 18302 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:33.553583 18322 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.356s	user 0.002s	sys 0.000s
I20260709 13:04:33.554243 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.493240 18307 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:33.485248 18218 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.525372 18266 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:33.534197 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48397.4us
W20260709 13:04:33.534811 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.535250 18195 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:33.535246 18007 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:33.536229 15343 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:33.541198 18184 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.566644 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 180) took 1090 ms. Trace:
I20260709 13:04:33.569154 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.519522 18256 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:33.578225 15346 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:33.556665 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:33.546118 18175 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.570688 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.581248 15270 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:33.515862 18250 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.572333 15263 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:04:33.572640 15264 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:33.575620 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.578120 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.559978 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.585906 15267 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:33.580556 15268 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:33.581941 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.516098 18120 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.569205 15194 rpcz_store.cc:276] 0709 13:04:32.476294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.480820 (+  4526us) service_pool.cc:224] Handling call
0709 13:04:32.481140 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.486805 (+  5665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.486836 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.206092 (+719256us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:04:33.206915 (+   823us) log.cc:844] Serialized 26 byte log entry
0709 13:04:33.422550 (+215635us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:33.422609 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.422727 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.559805 (+137078us) raft_consensus.cc:1685] finished
0709 13:04:33.559826 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.566583 (+  6757us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1513,"raft.queue_time_us":3611,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6101,"spinlock_wait_cycles":5185152,"thread_start_us":215042,"threads_started":1,"wal-append.queue_time_us":256301}
I20260709 13:04:33.586982 15269 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:33.588344 15339 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:33.555399 18307 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.593696 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.596633 15269 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:33.595077 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:33.561758 18176 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:33.599001 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.601961 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:33.542862 15271 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:33.590485 18308 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:33.576520 18007 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:33.607842 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:33.591677 18112 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:04:33.608593 15874 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:33.608777 18007 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.609969 18325 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:33.611573 18264 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.612043 18264 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.612371 18264 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.612854 18184 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.615134 18160 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:33.616596 18307 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.579813 18194 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:04:33.617777 18196 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:33.618347 18196 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:33.568637 17948 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.619565 17948 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.620040 17948 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.621466 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:33.622479 18275 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.627235 18182 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:33.627985 18182 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:33.629163 18182 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.632264 18255 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:33.632742 18255 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:33.633574 18255 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.633746 18256 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.634622 18293 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.565922 18195 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.556341 18249 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.598120 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:33.689643 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.690267 15269 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:33.659929 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55820.1us
I20260709 13:04:33.692850 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:33.689546 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.694545 15189 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:33.639091 15874 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:33.699826 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:33.700414 15270 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.701347 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.663348 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.704053 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.706137 15269 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:33.701349 15841 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:33.727607 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:33.727823 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 64703.2us
I20260709 13:04:33.728341 15263 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:33.728839 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:33.634955 18255 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.729377 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.733186 15263 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:33.711678 15264 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:33.598125 18092 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:33.702800 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.690779 18176 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.641783 18312 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.615181 18120 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:33.706188 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:33.635880 18256 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.731102 18307 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.758108 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.792723 15343 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 3.
I20260709 13:04:33.739509 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:33.747583 15346 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:33.765880 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.784046 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:33.795521 15268 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.782377 15271 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:33.779716 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.698110 18298 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.638305 18250 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:33.788537 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48618us
I20260709 13:04:33.697134 18257 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.694305 18266 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.800880 15270 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:33.780138 18092 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.726569 18254 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:04:33.802326 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62121.6us
I20260709 13:04:33.714426 18287 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:33.597661 17729 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.183s
I20260709 13:04:33.731137 17998 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:33.826676 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.824740 18298 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.780118 18218 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.779438 18249 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.831321 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.779636 18176 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:33.731318 18275 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:33.802557 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 218687us
I20260709 13:04:33.779520 18114 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:33.788625 18325 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.708596 18068 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:04:33.694276 18313 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.132s
I20260709 13:04:33.788866 18259 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.805907 18120 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:33.731563 18293 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:04:33.830922 18092 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.860486 18324 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:33.861845 18159 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:33.844424 18184 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:04:33.826617 18194 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.887490 18194 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.833442 18308 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:33.863168 18330 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:33.889263 18068 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:33.889791 18068 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:33.889724 18330 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:33.890969 18068 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.892223 18068 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.891768 18330 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.837164 18238 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:33.895570 18238 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.896401 18293 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:33.896847 18293 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:33.897717 18293 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.900166 18230 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.900746 18230 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.901680 18254 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.902383 18254 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.905115 18254 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.905908 18288 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:33.906368 18288 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:33.908499 18230 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:33.910274 18194 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:33.912490 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:33.914657 18238 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.869614 18275 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.843312 18337 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.841267 18218 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.869778 18058 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:33.879148 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.884568 15268 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:33.872074 18114 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:33.854089 17998 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:33.889907 18308 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.845574 18177 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:33.833145 18287 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:33.921247 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:33.834281 18266 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.831117 18257 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:33.922343 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56997us
I20260709 13:04:33.918991 18298 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:33.919814 18120 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.739614 18196 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.852131 18210 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.981655 18210 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:33.982299 18210 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.868671 18325 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:33.921422 18337 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.990689 18337 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.930193 18058 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.972242 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:33.911283 18288 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:33.964797 18287 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.965453 18293 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.992887 18325 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:34.004196 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:34.019186 15345 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:34.019639 15346 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:34.020634 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:34.005558 15343 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:33.928028 18218 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.919294 18275 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:34.010959 15338 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:34.015170 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:34.031595 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 188492us
W20260709 13:04:34.028589 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56432.2us
I20260709 13:04:33.996798 18298 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.928574 18260 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:04:33.935832 17948 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:34.034806 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:34.006582 18058 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.062264 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:34.066601 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 360491us
W20260709 13:04:34.037845 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 205284us
I20260709 13:04:33.973137 18177 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:34.040221 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:34.041916 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:34.050014 18257 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:34.057533 18336 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.198s	user 0.000s	sys 0.003s
I20260709 13:04:34.057780 18222 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:34.036263 18325 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:34.059293 18196 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.018636 17998 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:34.016017 18323 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.017129 18195 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:34.027150 18288 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.080047 18275 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:04:34.042982 18338 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:04:34.103219 18323 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.106109 18323 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:34.076828 18272 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:04:34.039165 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:33.995409 18120 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:34.078047 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:34.071556 18250 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:34.042815 18298 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.099857 18176 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.036913 18114 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.071811 18172 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:34.071951 18339 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:34.110960 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71890.3us
W20260709 13:04:34.121801 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 316236us
I20260709 13:04:34.073268 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:34.131697 15269 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:34.135273 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.135628 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.136732 15263 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:34.115118 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:34.138243 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:34.151659 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.109974 18264 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:34.155296 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83185.6us
I20260709 13:04:34.122112 18249 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:34.156644 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.140820 18172 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.158128 18346 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:34.159746 18257 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:34.162153 15339 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:34.162745 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:34.163923 18176 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:34.164168 15194 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:04:34.190352 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.190996 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:34.165143 15268 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:34.165402 15190 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:34.166422 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:34.193284 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:34.193691 15196 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:34.194497 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:34.195199 15190 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 4: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:34.194859 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:34.171214 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:34.196246 15192 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:34.118068 18272 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:34.179934 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52373.4us
I20260709 13:04:34.183691 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:34.155946 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.209369 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:34.210274 15189 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:34.186100 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.186599 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.211077 15271 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:34.198637 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:34.211278 15264 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:34.211910 15190 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:34.214666 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:34.199401 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:34.202620 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:34.156900 18182 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:34.176440 18165 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.196734 18201 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.228154 18188 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:34.230814 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:34.217178 15194 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:34.237939 15190 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:34.246233 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:34.254590 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.260593 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:34.261328 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:34.261780 15337 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:34.223621 15192 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:34.231252 18176 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:04:34.240067 18259 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:34.185091 18250 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:04:34.246188 18257 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:34.247373 18272 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:34.237738 18343 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:34.332207 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 182396us
I20260709 13:04:34.354452 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:34.250406 18266 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:34.250156 17948 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
W20260709 13:04:34.367352 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:34.410255 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.442140 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:34.271509 18338 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:34.471702 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 129885us
I20260709 13:04:34.473793 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:34.478808 15268 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:04:34.480726 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 266119us
I20260709 13:04:34.304605 18188 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:34.486930 18188 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:34.322073 18344 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.246429 18058 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.546734 15341 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:34.249871 18165 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.252892 18201 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.441388 18259 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:34.544785 18242 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.196s
W20260709 13:04:34.800873 18340 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.452s	user 0.002s	sys 0.000s
I20260709 13:04:34.657577 18176 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.863339 18176 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.828928 18345 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:34.798866 18351 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:04:34.864055 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 211) took 1270 ms. Trace:
W20260709 13:04:34.800534 18337 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.809s	user 0.007s	sys 0.004s
I20260709 13:04:34.494963 18323 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:34.690472 18353 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
W20260709 13:04:34.744884 18302 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.191s	user 0.013s	sys 0.002s
I20260709 13:04:34.544000 18199 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:34.716334 18338 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:34.629823 18344 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.741447 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.765712 18272 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.768127 15338 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
W20260709 13:04:34.861713 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 631804us
W20260709 13:04:34.905598 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.906493 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.691090 18257 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.690578 18328 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:34.882665 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:34.889544 18324 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:34.676885 18266 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.913447 18266 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.909509 18242 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.915815 18266 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:34.889039 15267 rpcz_store.cc:276] 0709 13:04:33.593632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.593764 (+   132us) service_pool.cc:224] Handling call
0709 13:04:33.610189 (+ 16425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.610556 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:33.610591 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.611525 (+   934us) log.cc:844] Serialized 26 byte log entry
0709 13:04:33.842398 (+230873us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:33.842437 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.842510 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:34.863784 (+1021274us) raft_consensus.cc:1685] finished
0709 13:04:34.863810 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.863984 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4669,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":230425,"threads_started":1,"wal-append.queue_time_us":339773}
I20260709 13:04:34.916282 18278 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:34.890218 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.917068 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:34.917685 15267 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:34.917891 18287 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.888s	user 0.004s	sys 0.005s
I20260709 13:04:34.899192 18199 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.918668 18199 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:34.918356 18287 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.924853 15874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58398 (request call id 192) took 1303 ms. Trace:
I20260709 13:04:34.915665 18242 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.910586 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:34.975705 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 65207.8us
I20260709 13:04:34.928645 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.883092 18114 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:34.921669 18278 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.943390 15272 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:34.921022 18328 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:34.937237 18293 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.910s	user 0.008s	sys 0.005s
W20260709 13:04:34.938980 18339 consensus_meta.cc:287] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.763s	user 0.010s	sys 0.001s
I20260709 13:04:34.893602 18337 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.946188 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1648) took 2033 ms. Trace:
I20260709 13:04:34.896450 18323 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.945201 18287 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:34.946659 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.892082 18345 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:34.948050 18092 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.028s	user 0.006s	sys 0.008s
I20260709 13:04:34.949074 18153 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:34.994705 18365 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.902810 18222 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:34.950505 18230 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.951316 18324 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.888923 18256 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:04:34.899966 18302 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:34.932235 18356 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.933837 18201 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:34.952473 18058 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:34.931708 18196 consensus_meta.cc:287] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.000s
W20260709 13:04:34.928839 18288 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.828s	user 0.009s	sys 0.001s
W20260709 13:04:34.937071 18218 consensus_meta.cc:287] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.000s
I20260709 13:04:34.953084 18344 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:34.955231 15337 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:34.956197 18284 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:34.956645 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.956979 18068 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.957185 18266 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.957557 18357 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:34.958493 18358 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:34.940896 18210 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.958s	user 0.012s	sys 0.000s
I20260709 13:04:34.893906 18259 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:34.958884 15093 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.317093 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:34.961997 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:34.977728 15270 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:35.035898 18222 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.030969 18153 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.907363 15268 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:34.979468 15267 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:34.978288 15874 rpcz_store.cc:276] 0709 13:04:33.621047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.621188 (+   141us) service_pool.cc:224] Handling call
0709 13:04:34.924659 (+1303471us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b54006ce8d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:34.924786 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38937344}
W20260709 13:04:35.004590 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.017185 15266 rpcz_store.cc:276] 0709 13:04:32.912807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.930665 (+ 17858us) service_pool.cc:224] Handling call
0709 13:04:32.932454 (+  1789us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.949410 (+ 16956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.949441 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.901023 (+951582us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b180034abc0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a
0709 13:04:33.902473 (+  1450us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:04:33.902934 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:04:34.175483 (+272549us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:34.175531 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.175618 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:34.945896 (+770278us) raft_consensus.cc:1685] finished
0709 13:04:34.945925 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.946109 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16484,"raft.queue_time_us":16884,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11916,"spinlock_wait_cycles":10094848,"thread_start_us":234458,"threads_started":1,"wal-append.queue_time_us":434392}
I20260709 13:04:34.993604 18275 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:34.950305 18255 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.170s	user 0.006s	sys 0.005s
W20260709 13:04:35.016394 18182 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.000s	sys 0.016s
I20260709 13:04:34.993716 18165 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:34.931733 18199 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.035889 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:35.017055 18223 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.019831 18339 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:34.975517 18338 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:34.994361 18155 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:04:35.055189 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.064240 18068 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:35.060889 15340 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:35.002290 18278 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.130645 18199 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.130998 18278 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.029408 18092 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.131562 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.132535 15345 raft_consensus.cc:2410] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:35.133478 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:35.133782 18092 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:35.134028 15345 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:35.060293 18218 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.136760 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.089015 15263 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:35.142905 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 165594us
I20260709 13:04:35.113334 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.062448 18344 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.145965 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:35.089896 18369 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.119695 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.037654 18230 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.054626 18287 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:35.121950 18275 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.163214 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.124434 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:35.116779 18182 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.000s	sys 0.016s
I20260709 13:04:35.128365 18165 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:35.128592 18196 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:35.143108 15346 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:35.147643 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.132483 18302 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:35.112154 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:35.117807 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.144512 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.109826 18256 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.095504 18337 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:35.156606 15267 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:35.189960 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.190541 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.117574 18373 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.048504 18356 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:35.193975 18376 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:35.165180 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.096390 18359 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:04:35.168063 18218 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.194882 15190 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:04:35.194984 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49087.7us
I20260709 13:04:35.169095 18324 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.168200 18195 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.205904 18256 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.206454 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.034487 18365 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.207755 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.208789 18153 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.201428 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.205456 18257 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.059839 18266 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.148608 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.211557 15263 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:35.060009 18284 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.182106 15266 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.172559 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:35.144131 18222 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:35.095816 18347 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.185258 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.131604 18223 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.087281 18358 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.157756 18092 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:35.165937 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.195525 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.223794 15192 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:35.225082 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.225688 15192 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.205441 18230 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.206223 18195 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.169409 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.209187 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:35.210494 18153 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:35.211465 15269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 217) took 1300 ms (client timeout 1538 ms). Trace:
I20260709 13:04:35.174814 18182 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:35.092226 18210 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.190891 15188 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:35.209687 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.174847 18278 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:35.058729 18328 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.222458 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:35.193813 18373 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.176184 18287 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.162240 18344 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.174497 18275 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.162580 18369 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.340893 15345 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:35.302875 15267 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:35.473388 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.448292 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:35.230773 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.475796 15195 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.480129 15194 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:35.481657 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.204191 18272 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.475751 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.204447 18363 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.484695 15266 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:35.442818 15874 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:35.485550 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1685) took 1154 ms. Trace:
W20260709 13:04:35.486726 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.487607 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49515.8us
I20260709 13:04:35.180357 18176 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:35.228854 18092 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.557879 15270 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:35.220854 18357 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.474242 15263 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:35.196609 18201 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:35.471757 15269 rpcz_store.cc:269] 0709 13:04:33.911457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.912236 (+   779us) service_pool.cc:224] Handling call
0709 13:04:35.211301 (+1299065us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400290254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:35.211412 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502383872}
I20260709 13:04:35.492220 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:35.501592 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 292584us
I20260709 13:04:35.580396 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.571952 15196 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
W20260709 13:04:35.580796 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 88670.2us
I20260709 13:04:35.571872 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.581933 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:35.582026 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.583215 15269 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:35.509589 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.492324 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.565994 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.584183 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.485922 15266 rpcz_store.cc:276] 0709 13:04:34.359789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.111853 (+752064us) service_pool.cc:224] Handling call
0709 13:04:35.485481 (+373628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:35.585582 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.586403 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.194514 18376 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:35.588515 15188 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:35.588899 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.596745 15266 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:35.586607 15194 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:35.600164 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:35.187505 18165 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:35.530876 18230 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:35.280244 18222 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:35.600975 15266 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.313041 18317 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:35.562938 15197 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:35.568040 18374 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:04:35.340155 18337 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.294585 18218 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:35.497457 18153 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.405519 18288 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.598547 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:35.472057 18278 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:35.229174 18347 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.275959 18257 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:35.690893 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.617055 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 246956us
I20260709 13:04:35.646446 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:35.620167 18268 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.629760 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.718006 15269 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.717334 15874 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:35.599115 18376 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:35.721167 15345 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:35.721562 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.592664 18357 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.563244 18092 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.724584 15263 raft_consensus.cc:2410] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:35.724720 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:35.726473 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.4:42201 timed out after 1.787s (SENT) [suppressed 2 similar messages]
W20260709 13:04:35.718710 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.728070 15341 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:35.731508 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.731709 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:35.733361 18230 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.733227 15269 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:35.735014 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.740056 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.741710 15345 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 3.
I20260709 13:04:35.743844 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.747282 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.748631 15269 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:35.750757 18339 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.751348 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.752135 18339 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:35.753018 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.763118 15269 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:35.565356 18380 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:35.765151 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.523967 18363 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.751096 15266 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:35.640419 18328 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:35.769598 15197 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.667445 18389 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:35.791633 18375 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.484s	user 0.000s	sys 0.001s
I20260709 13:04:35.703255 18182 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.792135 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:35.616415 18222 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.592430 18272 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.788488 18201 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:35.619948 18188 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:35.711114 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:35.659387 18377 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:35.714495 18223 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:35.792771 15269 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.667874 18379 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:35.756078 18153 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:35.798429 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47297.5us
I20260709 13:04:35.600126 18356 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:35.763643 18218 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.811607 18396 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:04:35.813192 18373 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.813856 18223 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.802845 18230 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:35.814505 18088 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:35.815629 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:35.843098 18357 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.843255 18218 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.815904 18257 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.818172 15192 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:35.844419 15343 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:35.765748 18337 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.849267 18337 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:35.818423 15190 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:35.826983 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 241470us
I20260709 13:04:35.826733 15269 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:35.767863 18288 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:35.852414 18288 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.795689 18222 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.646975 18317 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.854628 18317 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.791705 18384 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:35.770104 18268 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:35.791785 18389 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.806833 18379 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.846743 15343 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:35.859570 15343 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:35.784766 18380 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.806131 18188 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.860476 15343 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.867884 15343 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:35.855098 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.859617 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.809636 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
W20260709 13:04:35.862300 18381 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:04:35.862444 18386 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:04:35.832557 18210 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.869518 15269 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:35.845711 18369 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.837796 18287 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.855273 18384 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.840122 18195 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:35.876881 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1360) took 2204 ms. Trace:
I20260709 13:04:35.879200 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.874368 15195 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:35.863755 18379 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:35.844170 18223 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.894274 18385 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.888824 15193 rpcz_store.cc:276] 0709 13:04:33.660926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.661425 (+   499us) service_pool.cc:224] Handling call
0709 13:04:33.712115 (+ 50690us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.731997 (+ 19882us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:33.788841 (+ 56844us) log.cc:844] Serialized 14 byte log entry
0709 13:04:34.961098 (+1172257us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b18003d9900. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:04:35.145033 (+183935us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:35.145447 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.145573 (+   126us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:35.145604 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.145666 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.857907 (+712241us) raft_consensus.cc:1685] finished
0709 13:04:35.865286 (+  7379us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.865445 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77565,"prepare.queue_time_us":56780,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":3076,"raft.queue_time_us":51512,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":51694,"spinlock_wait_cycles":6858496,"thread_start_us":160615,"threads_started":1,"wal-append.queue_time_us":1405860}
I20260709 13:04:35.899981 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.901265 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:35.904960 15269 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:35.905098 15195 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:35.876086 18275 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.906553 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:35.824137 18278 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.856376 18230 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.881481 18356 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.925516 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:35.918264 15197 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:35.918886 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.921480 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:35.930851 15194 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:35.933029 15194 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:35.933660 18328 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:35.935545 18406 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:35.935626 18278 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.838976 18201 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:35.898861 18384 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:35.898066 18339 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.970232 15343 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:35.970336 15190 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:35.971815 18389 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.977397 18268 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:35.970007 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.007063 15269 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:36.008914 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:36.009572 15269 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:35.917201 18357 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:35.981153 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 74673.7us
I20260709 13:04:35.995900 18312 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:35.987319 18397 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.024153 18397 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:35.988962 15342 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:35.922084 18165 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:35.997962 18363 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.011162 15194 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:35.936216 18400 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:35.985775 18406 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:36.042435 18405 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:36.019728 18357 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:36.029922 18402 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:04:36.023486 18403 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:36.002575 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:36.056484 15343 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:36.057812 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.059827 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.007055 18272 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:35.934763 18328 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:35.998417 18391 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:36.010885 18347 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.041873 18383 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:36.042049 18223 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.026837 18313 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.026527 18312 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:35.944134 18356 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.066779 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1797) took 2914 ms. Trace:
I20260709 13:04:35.926270 18385 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.069192 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.020790 15269 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:36.088423 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.087715 15343 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:36.086949 15344 rpcz_store.cc:276] 0709 13:04:33.149416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.149806 (+   390us) service_pool.cc:224] Handling call
0709 13:04:33.150120 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.441178 (+291058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.063239 (+2622061us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400424854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:36.063445 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611455744}
I20260709 13:04:36.130368 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.132014 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.132892 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.133529 15343 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:36.133952 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.137705 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:36.068084 18403 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.084908 18182 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:36.070839 18389 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.070935 18272 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.087505 18312 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:36.072098 18391 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.144054 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.105845 18396 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:36.138331 18287 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.150244 15269 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 4.
I20260709 13:04:36.134630 18188 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.070942 18092 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.043258 18405 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.142076 18369 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:36.140652 18403 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:36.086464 18401 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:36.147094 18230 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.158351 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.043869 18406 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.161051 15269 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:36.150532 18391 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.162981 15341 raft_consensus.cc:2368] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:36.163599 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.164824 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:36.169989 15269 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:36.170624 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:36.153151 18380 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:36.169994 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.172700 18397 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:36.174347 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.120282 18313 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.174875 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:36.144802 18182 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.147414 18272 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.146574 18389 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.170234 18223 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.175746 18188 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:36.184512 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:36.176479 18382 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:04:36.154374 18287 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.152866 18396 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.201232 18259 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:36.066335 18400 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.178738 18325 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.176002 18268 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:36.186079 18209 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:36.183139 18401 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:36.174039 18230 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:04:36.191339 18218 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:04:36.206738 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:36.159288 18369 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.085031 18383 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.213515 18385 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.188573 18377 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:04:36.221581 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:36.180593 18285 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:04:36.213958 18182 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:36.255887 18415 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:04:36.260748 18410 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:04:36.257203 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:36.263190 18268 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:36.191776 18223 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.276041 18223 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:36.277204 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:36.277945 18323 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.281072 18172 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.282907 18272 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.259073 18165 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:36.215472 18325 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:36.285326 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.273363 18385 raft_consensus.cc:2764] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:36.256788 18380 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:36.261529 18357 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:36.288820 15841 connection.cc:256] RPC call timeout handler was delayed by -1.7430875249999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:04:36.269373 18349 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.914s	user 0.005s	sys 0.019s
I20260709 13:04:36.269815 18259 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:36.260784 18409 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.216391 18387 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:36.298642 18405 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.215185 18397 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:04:36.273053 18389 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:36.313078 18092 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.284868 18356 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.218905 18401 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.271950 18268 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:36.300174 18259 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:36.318773 18409 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.317858 18369 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:36.342793 18412 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:04:36.332819 18288 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.351337 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:36.351500 18288 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.326218 18396 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.318974 18379 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.361845 18405 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:36.363488 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1357) took 1077 ms. Trace:
I20260709 13:04:36.369913 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.372831 15346 rpcz_store.cc:276] 0709 13:04:35.286583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.286705 (+   122us) service_pool.cc:224] Handling call
0709 13:04:35.311797 (+ 25092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:35.312279 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:35.312331 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:35.372625 (+ 60294us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.200647 (+828022us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18000ffbe0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:04:36.222317 (+ 21670us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:36.222368 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.222462 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.363192 (+140730us) raft_consensus.cc:1685] finished
0709 13:04:36.363211 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.363424 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14213,"raft.queue_time_us":92,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":36010,"spinlock_wait_cycles":8816384,"thread_start_us":21456,"threads_started":1,"wal-append.queue_time_us":870797}
W20260709 13:04:36.364282 18222 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:04:36.392117 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:36.355166 18356 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.353940 18369 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.393086 18287 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.320211 18387 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.400589 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.407295 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:36.407858 18413 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:04:36.407971 15346 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:04:36.408483 18298 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.409008 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.409621 15346 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:04:36.372785 18405 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:36.393391 18369 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.341486 18268 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.419885 15346 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:36.406380 18325 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.357103 18259 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.414535 18405 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.398592 18222 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.482095 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.430287 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:36.482771 15195 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:36.482957 15189 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:36.423913 15346 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:36.403838 18356 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.485229 15346 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:36.486519 15346 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:36.484082 18218 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.489851 18409 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:36.492067 18153 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.673s	user 0.005s	sys 0.005s
I20260709 13:04:36.492501 18153 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:36.493271 18278 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.000s
I20260709 13:04:36.493602 15188 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:36.489651 18218 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.495498 15345 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:36.496470 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.497372 18222 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.497879 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.481616 18268 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.431394 18379 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:36.429600 18376 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.003s
I20260709 13:04:36.424484 18259 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.487950 18369 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.506045 18114 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:36.508411 18153 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.427291 18365 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.493834 18391 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.429034 18344 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.508620 18356 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:36.424715 18288 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.509760 18114 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:36.510960 18177 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:36.513927 15196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1367) took 2339 ms (client timeout 2023 ms). Trace:
W20260709 13:04:36.517426 15196 rpcz_store.cc:269] 0709 13:04:34.173361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.194565 (+ 21204us) service_pool.cc:224] Handling call
0709 13:04:36.512148 (+2317583us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000f9bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:36.512273 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3164459904}
I20260709 13:04:36.518252 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:36.518525 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.510010 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:36.515802 18218 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.519522 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:36.519537 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.511075 18403 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.520524 15196 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.522116 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.522809 15195 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:36.526309 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1661) took 2397 ms. Trace:
I20260709 13:04:36.526520 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:36.527258 15874 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:36.526768 15272 rpcz_store.cc:276] 0709 13:04:34.128941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.134348 (+  5407us) service_pool.cc:224] Handling call
0709 13:04:34.134686 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.994385 (+859699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.526002 (+1531617us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54001b4c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:36.526216 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859426048}
I20260709 13:04:36.528978 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.431353 18384 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.529668 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:36.531251 17729 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:04:36.527451 15869 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:04:36.532141 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.533627 15344 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:36.534723 18400 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.535591 15272 raft_consensus.cc:2410] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:36.536825 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.537411 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1684) took 1472 ms. Trace:
I20260709 13:04:36.537480 15272 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 3.
I20260709 13:04:36.537626 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1348) took 2277 ms. Trace:
I20260709 13:04:36.534726 18387 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.538143 15338 rpcz_store.cc:276] 0709 13:04:34.260477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.260960 (+   483us) service_pool.cc:224] Handling call
0709 13:04:36.537466 (+2276506us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400176bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:36.537565 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1163153664}
I20260709 13:04:36.537923 15270 rpcz_store.cc:276] 0709 13:04:35.065261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.117480 (+ 52219us) service_pool.cc:224] Handling call
0709 13:04:36.537252 (+1419772us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b54000d5f54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:36.537358 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":864458112}
I20260709 13:04:36.538494 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:36.539434 15272 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.540160 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:36.540367 18114 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.541424 18114 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.541885 18264 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.542441 18345 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.542743 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1684) took 2211 ms. Trace:
I20260709 13:04:36.543111 15270 rpcz_store.cc:276] 0709 13:04:34.330873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.541565 (+2210692us) service_pool.cc:224] Handling call
0709 13:04:36.541832 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.542433 (+   601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.542459 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.542501 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:36.542531 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.542587 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.542694 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.544221 18391 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.544715 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1673) took 2183 ms. Trace:
I20260709 13:04:36.545047 15270 rpcz_store.cc:276] 0709 13:04:34.361358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.543987 (+2182629us) service_pool.cc:224] Handling call
0709 13:04:36.544251 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.544427 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.544450 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.544489 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:36.544516 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.544566 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.544669 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.546955 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1674) took 2185 ms. Trace:
I20260709 13:04:36.528936 18312 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.548388 18403 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.549131 15271 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.549966 18312 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.547595 15270 rpcz_store.cc:276] 0709 13:04:34.361837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.546094 (+2184257us) service_pool.cc:224] Handling call
0709 13:04:36.546479 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.546653 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.546679 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.546719 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:36.546749 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.546802 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.546905 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.552345 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:36.555105 15193 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:36.557832 15272 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:36.558559 15271 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:36.560149 15196 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:36.561285 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.561911 15196 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:36.562726 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.563254 15196 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:36.564033 18384 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:36.509145 18376 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.565754 15197 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:36.564208 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.566680 15196 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:36.569623 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 164) took 3081 ms. Trace:
I20260709 13:04:36.570099 15340 rpcz_store.cc:276] 0709 13:04:33.487778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.502667 (+ 14889us) service_pool.cc:224] Handling call
0709 13:04:33.502916 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.140806 (+1637890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.569324 (+1428518us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b54003df254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:36.569525 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3582479232}
I20260709 13:04:36.572573 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.574092 15196 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:36.579113 18260 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:36.579746 18260 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:36.577677 18392 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.609s	user 0.002s	sys 0.002s
I20260709 13:04:36.583284 18376 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:36.583307 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1858) took 1393 ms. Trace:
W20260709 13:04:36.583842 15263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1699) took 1359 ms (client timeout 1568 ms). Trace:
W20260709 13:04:36.584437 15263 rpcz_store.cc:269] 0709 13:04:35.224757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.565624 (+340867us) service_pool.cc:224] Handling call
0709 13:04:36.583591 (+1017967us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400348d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:36.583776 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315660032}
I20260709 13:04:36.586176 15263 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: [7.4-8.5]
I20260709 13:04:36.586856 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1678) took 1699 ms. Trace:
I20260709 13:04:36.580952 18260 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.589663 18260 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.587783 15263 rpcz_store.cc:276] 0709 13:04:34.887585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.585544 (+1697959us) service_pool.cc:224] Handling call
0709 13:04:36.585913 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:36.586592 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.586792 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.584061 15192 rpcz_store.cc:276] 0709 13:04:35.189579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.598634 (+409055us) service_pool.cc:224] Handling call
0709 13:04:35.598943 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.844813 (+245870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.583075 (+738262us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001e64d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:36.583246 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503712000}
I20260709 13:04:36.591799 15192 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:36.594090 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1687) took 1700 ms. Trace:
I20260709 13:04:36.594511 15263 rpcz_store.cc:276] 0709 13:04:34.893231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.593224 (+1699993us) service_pool.cc:224] Handling call
0709 13:04:36.593551 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.593737 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.593765 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.593812 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:36.593849 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.593918 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.594036 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.590058 18405 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:36.603139 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1689) took 1707 ms. Trace:
I20260709 13:04:36.603580 15265 rpcz_store.cc:276] 0709 13:04:34.895847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.602249 (+1706402us) service_pool.cc:224] Handling call
0709 13:04:36.602607 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.602784 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.602808 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.602849 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:36.602880 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.602935 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.603017 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.605139 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1691) took 1696 ms. Trace:
I20260709 13:04:36.605463 15265 rpcz_store.cc:276] 0709 13:04:34.908922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.604426 (+1695504us) service_pool.cc:224] Handling call
0709 13:04:36.604681 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.604840 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.604863 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.604902 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:36.604931 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.604978 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.605089 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.601472 18405 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:36.629132 18252 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.401s	user 0.002s	sys 0.019s
W20260709 13:04:36.629705 18252 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.402s	user 0.003s	sys 0.020s
I20260709 13:04:36.643560 15195 raft_consensus.cc:2410] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:04:36.661988 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:36.666286 15339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1343) took 2929 ms (client timeout 2023 ms). Trace:
I20260709 13:04:36.666574 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1679) took 1611 ms. Trace:
W20260709 13:04:36.666865 15339 rpcz_store.cc:269] 0709 13:04:33.738822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.739211 (+   389us) service_pool.cc:224] Handling call
0709 13:04:36.666088 (+2926877us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b540005ad54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:36.666223 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846232832}
I20260709 13:04:36.667179 15265 rpcz_store.cc:276] 0709 13:04:35.055663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.616534 (+1560871us) service_pool.cc:224] Handling call
0709 13:04:36.665927 (+ 49393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.666120 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.666158 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.666212 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:36.666256 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.666360 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.666502 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.672518 15265 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:36.674124 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1680) took 1618 ms. Trace:
I20260709 13:04:36.674542 15265 rpcz_store.cc:276] 0709 13:04:35.055924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.669283 (+1613359us) service_pool.cc:224] Handling call
0709 13:04:36.672158 (+  2875us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.673794 (+  1636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.674051 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.679425 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1681) took 1623 ms. Trace:
I20260709 13:04:36.681968 15265 rpcz_store.cc:276] 0709 13:04:35.056147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.675504 (+1619357us) service_pool.cc:224] Handling call
0709 13:04:36.675873 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.678964 (+  3091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.679003 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.679082 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:36.679126 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.679201 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.679348 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.689239 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1678) took 2360 ms. Trace:
I20260709 13:04:36.685197 15265 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:36.695725 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1682) took 1639 ms. Trace:
I20260709 13:04:36.696367 15265 rpcz_store.cc:276] 0709 13:04:35.056396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.684528 (+1628132us) service_pool.cc:224] Handling call
0709 13:04:36.684957 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.695383 (+ 10426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.695646 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.699189 15264 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:04:36.699957 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1695) took 1476 ms. Trace:
I20260709 13:04:36.700270 15264 rpcz_store.cc:276] 0709 13:04:35.223316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.693556 (+1470240us) service_pool.cc:224] Handling call
0709 13:04:36.693888 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.699695 (+  5807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.699905 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.692703 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1682) took 2362 ms. Trace:
I20260709 13:04:36.691812 15268 rpcz_store.cc:276] 0709 13:04:34.329223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.123241 (+794018us) service_pool.cc:224] Handling call
0709 13:04:35.211919 (+ 88678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:35.214076 (+  2157us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:35.214106 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:35.214562 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.383451 (+168889us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:35.383492 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.383561 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.945231 (+561670us) raft_consensus.cc:1685] finished
0709 13:04:35.945267 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.688899 (+743632us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b5400290250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:36.689166 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1149,"raft.queue_time_us":9086,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":46006,"spinlock_wait_cycles":202792704,"thread_start_us":168562,"threads_started":1,"wal-append.queue_time_us":401714}
W20260709 13:04:36.690500 15267 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1688) took 1513 ms (client timeout 1503 ms). Trace:
I20260709 13:04:36.703272 15269 rpcz_store.cc:276] 0709 13:04:34.330321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.177224 (+1846903us) service_pool.cc:224] Handling call
0709 13:04:36.188486 (+ 11262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.202710 (+ 14224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.202757 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.202816 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:36.202863 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.692465 (+489602us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54001b4254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:36.692511 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.692642 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32168192}
W20260709 13:04:36.704119 15267 rpcz_store.cc:269] 0709 13:04:35.177249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.190320 (+ 13071us) service_pool.cc:224] Handling call
0709 13:04:36.690297 (+1499977us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001d92d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:36.690418 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256417152}
I20260709 13:04:36.707808 15267 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:04:36.708307 15267 pending_rounds.cc:85] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 6
I20260709 13:04:36.708571 15267 pending_rounds.cc:107] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:04:36.708833 15267 raft_consensus.cc:2889] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:36.709349 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1691) took 1301 ms. Trace:
I20260709 13:04:36.709762 15264 rpcz_store.cc:276] 0709 13:04:35.408692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.708547 (+1299855us) service_pool.cc:224] Handling call
0709 13:04:36.708835 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.709017 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.709044 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.709090 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:36.709124 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.709175 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.709295 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.713049 15264 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:04:36.713326 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.717339 15269 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:04:36.717870 15269 pending_rounds.cc:85] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 5
I20260709 13:04:36.718199 15269 pending_rounds.cc:107] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:04:36.718497 15269 raft_consensus.cc:2889] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:36.745741 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.746663 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.754501 18250 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.852944 18250 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:36.795547 15269 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:36.857116 18250 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:36.861398 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:36.854313 18318 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:04:36.899295 18293 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:36.901012 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:36.902630 18293 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:36.864384 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.867055 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.973122 15339 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:36.829200 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:36.865917 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.798275 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:36.853320 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.900911 18343 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:04:36.985818 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.982419 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:36.982741 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.989681 15269 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:36.986801 15339 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:36.996291 15194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:36.997087 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.997399 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.753415 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.866961 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:36.999553 15345 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
W20260709 13:04:36.747153 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.981406 15340 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
W20260709 13:04:37.001109 15271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1690) took 2092 ms (client timeout 2138 ms). Trace:
W20260709 13:04:37.001552 15271 rpcz_store.cc:269] 0709 13:04:34.908511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.024618 (+116107us) service_pool.cc:224] Handling call
0709 13:04:37.000933 (+1976315us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400349754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.001055 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3283072896}
I20260709 13:04:37.002905 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:36.999543 15343 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:37.006830 15196 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:04:37.006543 15190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1857) took 1817 ms (client timeout 2050 ms). Trace:
I20260709 13:04:37.006630 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1703) took 1423 ms. Trace:
I20260709 13:04:37.011253 15268 rpcz_store.cc:276] 0709 13:04:35.582788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.710919 (+1128131us) service_pool.cc:224] Handling call
0709 13:04:36.711353 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.711559 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:36.718543 (+  6984us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.006289 (+287746us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.006349 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:37.006390 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.006453 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.006574 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151941,"prepare.queue_time_us":7852,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":268834,"threads_started":1}
I20260709 13:04:37.012842 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.013541 15268 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:37.014300 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:37.007752 15190 rpcz_store.cc:269] 0709 13:04:35.189206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.209023 (+ 19817us) service_pool.cc:224] Handling call
0709 13:04:37.006319 (+1797296us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400409554. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.006463 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796577152}
I20260709 13:04:37.017802 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.018971 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:37.020088 15337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1349) took 2578 ms (client timeout 1780 ms). Trace:
I20260709 13:04:37.020556 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.021278 15268 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:37.023262 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.024583 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.754057 18325 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:37.022285 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.025717 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:37.020787 15337 rpcz_store.cc:269] 0709 13:04:34.441671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.441816 (+   145us) service_pool.cc:224] Handling call
0709 13:04:37.019821 (+2578005us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400271fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.019980 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116229376}
I20260709 13:04:37.030193 15268 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:36.986636 18293 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.031771 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.032339 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.031348 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.033293 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.030238 15189 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:37.042184 15268 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:37.043176 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:37.047268 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.036139 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.037400 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.048218 15271 raft_consensus.cc:2368] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12.
I20260709 13:04:37.048640 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.037324 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:36.991142 18114 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:37.051318 15343 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:37.050621 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.052557 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.056092 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.056370 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.055230 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.002089 18259 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:37.055230 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.056803 15190 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:37.057503 15269 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:37.062837 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.064335 15268 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:37.065912 15268 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:37.066768 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.076665 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.077883 15192 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:37.079365 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.080876 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.081251 15269 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:37.081645 15190 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:37.082639 15269 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:04:37.083554 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 779166us
I20260709 13:04:37.079018 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.082857 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.091447 15190 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:37.055294 18114 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.058004 15337 raft_consensus.cc:2410] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:37.053692 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.109210 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.110920 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.113688 15268 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:37.115304 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:37.116040 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.119776 15269 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:37.117636 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.120887 15268 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:37.123070 15190 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:37.118237 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.045187 18325 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.101234 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.125298 15189 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:37.099294 18252 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:37.119606 18318 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:37.133526 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.135938 15190 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:37.100982 18376 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:04:37.068156 18259 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.144534 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.145251 15271 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:37.149541 15338 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:37.155416 18383 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.155689 18068 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:37.158627 18313 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:37.160145 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.160460 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.154881 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.175424 15266 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:37.175694 15190 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 4.
I20260709 13:04:37.175711 15874 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:04:37.190146 15266 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:37.191623 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:37.198971 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1688) took 2303 ms. Trace:
I20260709 13:04:37.199645 15263 rpcz_store.cc:276] 0709 13:04:34.895097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.595574 (+1700477us) service_pool.cc:224] Handling call
0709 13:04:36.602367 (+  6793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.602533 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:36.700050 (+ 97517us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.198276 (+498226us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.198501 (+   225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.198568 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:37.198629 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.198726 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.198887 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5077,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":589137,"threads_started":2}
I20260709 13:04:37.205847 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.215396 15271 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:37.217850 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:37.220580 15264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.003s
I20260709 13:04:37.220683 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 223) took 1016 ms. Trace:
W20260709 13:04:37.221086 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 135560us
W20260709 13:04:37.221395 15264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.007s	sys 0.003s
I20260709 13:04:37.221921 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.221515 15267 rpcz_store.cc:276] 0709 13:04:36.204505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.714978 (+510473us) service_pool.cc:224] Handling call
0709 13:04:36.716786 (+  1808us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.717431 (+   645us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:37.106091 (+388660us) log.cc:844] Serialized 14 byte log entry
0709 13:04:37.220314 (+114223us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:37.220374 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:37.220420 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.220497 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.220620 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34234,"prepare.queue_time_us":136375,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":105,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":390410,"threads_started":2}
I20260709 13:04:37.138782 18252 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.230501 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.230643 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1359) took 4379 ms. Trace:
I20260709 13:04:37.231319 15191 rpcz_store.cc:276] 0709 13:04:32.849299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.849439 (+   140us) service_pool.cc:224] Handling call
0709 13:04:32.849812 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:32.873891 (+ 24079us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.873939 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:32.891523 (+ 17584us) log.cc:844] Serialized 52 byte log entry
0709 13:04:32.965261 (+ 73738us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:33.081601 (+116340us) log.cc:844] Serialized 14 byte log entry
0709 13:04:33.082230 (+   629us) log.cc:844] Serialized 14 byte log entry
0709 13:04:33.082796 (+   566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.082883 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.384310 (+301427us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b480021c258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:33.407189 (+ 22879us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b18003d98a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:33.864194 (+457005us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b18003d98a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1
0709 13:04:36.727501 (+2863307us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b18003d98a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:37.228965 (+501464us) raft_consensus.cc:1685] finished
0709 13:04:37.228988 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.229127 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13080,"prepare.queue_time_us":147242,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":66,"raft.queue_time_us":41414,"raft.run_cpu_time_us":3368,"raft.run_wall_time_us":313556,"spinlock_wait_cycles":126595712,"thread_start_us":115144,"threads_started":2,"wal-append.queue_time_us":199033}
I20260709 13:04:37.235617 15874 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:37.248060 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1359) took 1393 ms. Trace:
I20260709 13:04:37.248060 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1814) took 1517 ms. Trace:
I20260709 13:04:37.248485 15344 rpcz_store.cc:276] 0709 13:04:35.854516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.133581 (+279065us) service_pool.cc:224] Handling call
0709 13:04:37.247846 (+1114265us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54000979d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.247990 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914733440}
I20260709 13:04:37.248944 15341 rpcz_store.cc:276] 0709 13:04:35.730638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.730968 (+   330us) service_pool.cc:224] Handling call
0709 13:04:37.247886 (+1516918us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400059e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.247989 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988676480}
I20260709 13:04:37.258577 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:37.259620 18438 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:37.260103 18438 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.260493 18438 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:37.269032 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.271513 18242 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.272327 18242 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:37.273986 18120 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:37.275885 18325 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:37.276680 18259 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:37.277251 18259 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:37.277582 18259 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:37.278147 18438 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.246443 18114 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:37.245651 18358 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.242746 18376 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.278417 18259 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.290323 18252 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.297402 18266 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.298517 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.300110 18259 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:37.294229 18293 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.316946 18438 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:37.356817 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 126056us
I20260709 13:04:37.359109 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:37.362540 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:37.365597 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 121887us
I20260709 13:04:37.366195 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:37.370325 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:37.370002 15162 leader_election.cc:400] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
W20260709 13:04:37.388274 15839 leader_election.cc:336] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.538s (SENT)
I20260709 13:04:37.389425 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.397403 18114 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.398156 18252 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.398590 18114 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.399662 18376 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:37.404357 15869 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 10: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:37.406008 18293 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.408622 18438 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:37.372395 15162 leader_election.cc:403] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:37.397505 18406 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.427421 18449 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:37.428723 18449 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.411186 18252 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.411459 18445 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:04:37.415153 18114 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.399681 18343 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:37.429214 18449 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.441717 18406 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:37.449844 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 78104.5us
I20260709 13:04:37.453969 18406 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:37.456338 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 86746.1us
I20260709 13:04:37.459985 18452 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:37.458781 18451 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:37.466084 18451 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.469527 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1894) took 1080 ms. Trace:
I20260709 13:04:37.470084 15196 rpcz_store.cc:276] 0709 13:04:36.388847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.574831 (+185984us) service_pool.cc:224] Handling call
0709 13:04:37.006463 (+431632us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:37.007373 (+   910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.469020 (+461647us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400409550. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.469286 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991991168}
I20260709 13:04:37.477342 18252 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.478367 15194 raft_consensus.cc:606] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.450757 18438 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:37.491953 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1866) took 2019 ms. Trace:
I20260709 13:04:37.492511 15188 rpcz_store.cc:276] 0709 13:04:35.472470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.600511 (+128041us) service_pool.cc:224] Handling call
0709 13:04:35.654590 (+ 54079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.494005 (+839415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.489462 (+995457us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54003e71d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:37.491739 (+  2277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929030912}
I20260709 13:04:37.495532 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1675) took 3121 ms. Trace:
W20260709 13:04:37.498172 15342 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48112 (request call id 160) took 4535 ms (client timeout 1828 ms). Trace:
I20260709 13:04:37.496712 15270 rpcz_store.cc:276] 0709 13:04:34.374158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.551812 (+2177654us) service_pool.cc:224] Handling call
0709 13:04:36.588278 (+ 36466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.588917 (+   639us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:36.597743 (+  8826us) log.cc:844] Serialized 14 byte log entry
0709 13:04:36.795391 (+197648us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:36.795593 (+   202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:36.795806 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.796545 (+   739us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.494941 (+698396us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b5400348d50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.495204 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":166,"prepare.queue_time_us":7589,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":1460,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"spinlock_wait_cycles":83018112,"thread_start_us":196062,"threads_started":1,"wal-append.queue_time_us":464261}
W20260709 13:04:37.498795 15342 rpcz_store.cc:269] 0709 13:04:32.962233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.963945 (+  1712us) service_pool.cc:224] Handling call
0709 13:04:37.497607 (+4533662us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b54001743d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.497867 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6787962752}
I20260709 13:04:37.482825 18451 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.527855 18452 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.528959 18452 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.531282 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.535565 18256 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.533533 15874 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:37.544198 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:37.548544 18419 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 1.205s	user 0.006s	sys 0.005s
I20260709 13:04:37.548710 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.542976 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.551966 18452 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.552021 15342 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:04:37.556711 18436 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.392s	user 0.003s	sys 0.000s
I20260709 13:04:37.558800 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1700) took 2333 ms. Trace:
I20260709 13:04:37.543843 18284 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:37.568399 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.573621 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1886) took 1204 ms. Trace:
I20260709 13:04:37.574177 15195 rpcz_store.cc:276] 0709 13:04:36.369500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.523879 (+154379us) service_pool.cc:224] Handling call
0709 13:04:37.573091 (+1049212us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54000fb4d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.573381 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251588480}
I20260709 13:04:37.574534 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.575398 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.562860 15265 rpcz_store.cc:276] 0709 13:04:35.225610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.697614 (+1472004us) service_pool.cc:224] Handling call
0709 13:04:36.698201 (+   587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:36.711343 (+ 13142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.711402 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:36.719703 (+  8301us) log.cc:844] Serialized 26 byte log entry
0709 13:04:36.987883 (+268180us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:36.987935 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.988006 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:37.554521 (+566515us) spinlock_profiling.cc:243] Waited 35.9 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:37.558290 (+  3769us) raft_consensus.cc:1685] finished
0709 13:04:37.558311 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.558623 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1098,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":9582,"spinlock_wait_cycles":82535680,"thread_start_us":193469,"threads_started":1,"wal-append.queue_time_us":335211}
I20260709 13:04:37.577879 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.578823 15343 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:37.582748 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.554687 18438 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.594107 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.601823 15839 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:37.609004 18252 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:37.609163 15874 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:37.609579 18252 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.610116 18252 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:37.627298 15342 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:37.613847 18363 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.627152 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.628541 17948 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:04:37.630187 18284 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:37.631606 18284 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:37.631990 18284 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:37.632885 15868 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:37.633198 18284 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:37.635434 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.636620 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1869) took 1947 ms. Trace:
I20260709 13:04:37.637280 15197 rpcz_store.cc:276] 0709 13:04:35.689659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.928096 (+238437us) service_pool.cc:224] Handling call
0709 13:04:35.928611 (+   515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.566069 (+637458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.636067 (+1069998us) spinlock_profiling.cc:243] Waited 637 ms on lock 0x7b54000ffd54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:37.636407 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1464819072}
I20260709 13:04:37.640125 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1882) took 1271 ms. Trace:
I20260709 13:04:37.640821 15193 rpcz_store.cc:276] 0709 13:04:36.368324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.370369 (+  2045us) service_pool.cc:224] Handling call
0709 13:04:37.639568 (+1269199us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400226fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:37.639896 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372320640}
I20260709 13:04:37.643818 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.646464 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.647560 17948 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.648407 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.643599 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.636560 18284 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:37.649143 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.654664 15343 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:37.630225 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:37.665200 18088 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.665802 18343 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:37.652740 17948 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:37.667868 15341 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:37.668908 15346 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:37.660275 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:37.673991 15868 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:37.673851 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.674981 15345 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:37.669490 17948 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.677126 18218 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.685204 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.688148 15345 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:37.691591 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.687453 18218 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:37.699983 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 53826.3us
I20260709 13:04:37.704684 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:37.708489 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.711004 15345 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.707978 18298 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:37.712061 18298 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:37.715526 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.696573 18376 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:37.704391 18218 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.718308 18298 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:37.726329 18266 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.727352 18266 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.735244 18266 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:37.738274 18440 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.504s	user 0.005s	sys 0.000s
I20260709 13:04:37.743422 15341 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:37.718716 18376 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:37.745260 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:37.751154 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.766587 15343 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:37.746310 18376 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.774319 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:37.780776 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 150941us
I20260709 13:04:37.782403 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.779489 18445 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.798960 15340 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:37.803712 15346 raft_consensus.cc:2410] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:37.804312 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:37.806006 15342 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:37.816362 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:37.824783 18376 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:37.833024 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.834221 15343 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:04:37.833720 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 113167us
I20260709 13:04:37.798830 18445 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.850911 15342 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:37.852306 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1676) took 2968 ms. Trace:
I20260709 13:04:37.856976 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:37.858698 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 60) took 6634 ms. Trace:
I20260709 13:04:37.862141 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.861006 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.866993 18218 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.881412 18218 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.881618 18256 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.882100 18358 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.882445 18256 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.882915 18358 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:37.886263 18256 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.886385 18358 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:37.870322 17948 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.875111 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:37.893790 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 106373us
I20260709 13:04:37.859669 15093 rpcz_store.cc:276] 0709 13:04:31.126561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.127365 (+   804us) service_pool.cc:224] Handling call
0709 13:04:37.755377 (+6628012us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:36.322432 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:36.323084 (+   652us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:36.323117 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:04:36.323135 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:36.323500 (+   365us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:36.324850 (+  1350us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:36.330658 (+  5808us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:36.366020 (+ 35362us) tablet.cc:701] Row locks acquired
0709 13:04:36.371260 (+  5240us) write_op.cc:260] PREPARE: finished
0709 13:04:36.392926 (+ 21666us) write_op.cc:270] Start()
0709 13:04:36.401599 (+  8673us) write_op.cc:276] Timestamp: P: 1783602276389249 usec, L: 0
0709 13:04:36.406661 (+  5062us) op_driver.cc:348] REPLICATION: starting
0709 13:04:36.496330 (+ 89669us) log.cc:844] Serialized 532 byte log entry
0709 13:04:36.591947 (+ 95617us) op_driver.cc:464] REPLICATION: finished
0709 13:04:36.720309 (+128362us) write_op.cc:301] APPLY: starting
0709 13:04:36.720402 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:36.720507 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:36.720623 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:36.720854 (+   231us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:36.721014 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:36.721059 (+    45us) write_op.cc:312] APPLY: finished
0709 13:04:36.721253 (+   194us) log.cc:844] Serialized 22 byte log entry
0709 13:04:36.721408 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:36.742702 (+ 21294us) write_op.cc:454] Released schema lock
0709 13:04:36.747231 (+  4529us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:36.794368 (+ 47137us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:36.794403 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2537639,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":128119,"apply.run_cpu_time_us":1954,"apply.run_wall_time_us":74047,"num_ops":1,"prepare.queue_time_us":48627,"prepare.run_cpu_time_us":10788,"prepare.run_wall_time_us":198321,"raft.queue_time_us":21734,"raft.run_cpu_time_us":14868,"raft.run_wall_time_us":101722,"replication_time_us":185130,"spinlock_wait_cycles":33024,"thread_start_us":183607,"threads_started":4,"wal-append.queue_time_us":68614,"wal-append.run_cpu_time_us":17906,"wal-append.run_wall_time_us":1161031}]]}
I20260709 13:04:37.900916 15345 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:37.854871 15272 rpcz_store.cc:276] 0709 13:04:34.883946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.559729 (+1675783us) service_pool.cc:224] Handling call
0709 13:04:36.560347 (+   618us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:36.560768 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:36.560796 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:36.564073 (+  3277us) log.cc:844] Serialized 52 byte log entry
0709 13:04:36.715945 (+151872us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:36.743401 (+ 27456us) log.cc:844] Serialized 14 byte log entry
0709 13:04:36.743718 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.743826 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:37.682389 (+938563us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b18002ca6a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1
0709 13:04:37.684744 (+  2355us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b18002ca6a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1
0709 13:04:37.749321 (+ 64577us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b18002ca6a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:37.851820 (+102499us) raft_consensus.cc:1685] finished
0709 13:04:37.851844 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:37.852060 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61131,"prepare.queue_time_us":137713,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":3104,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":31898,"spinlock_wait_cycles":318065408,"thread_start_us":151479,"threads_started":1,"wal-append.queue_time_us":337540}
I20260709 13:04:37.905319 17948 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:37.908571 15268 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:37.911180 15338 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:04:37.916330 18445 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:37.918423 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62312.3us
I20260709 13:04:37.926397 15341 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:37.908808 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:37.928427 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:37.929466 18266 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:37.929710 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:37.929937 18266 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.930341 18266 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.931535 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:37.932626 18358 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:37.933096 18358 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.933454 18358 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:37.934406 15868 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:37.935460 18462 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.935951 18462 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.936322 18462 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.938692 18284 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.939560 18284 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:37.939806 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 90143.5us
I20260709 13:04:37.941032 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:37.939821 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.941829 18284 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.941953 17948 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.897512 18449 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.945204 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.945986 15338 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:37.946101 18449 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:37.950320 15868 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:37.951619 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:37.952940 15272 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:37.953212 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.953763 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:37.954485 15341 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:37.960146 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.961504 15269 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:37.960670 15346 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:37.966080 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:37.966673 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.967118 15272 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:37.965622 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.968881 15269 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:37.970402 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:37.971315 18343 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:37.971722 18343 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.972105 18343 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:37.973956 15095 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 159) took 27454 ms (client timeout 15000 ms). Trace:
W20260709 13:04:37.974368 15095 rpcz_store.cc:269] 0709 13:04:10.519538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.519675 (+   137us) service_pool.cc:224] Handling call
0709 13:04:37.973744 (+27454069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:31.539746 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:31.694428 (+154682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:31.696229 (+  1801us) write_op.cc:435] Acquired schema lock
0709 13:04:31.699280 (+  3051us) tablet.cc:662] Decoding operations
0709 13:04:31.956879 (+257599us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:31.957037 (+   158us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:31.957080 (+    43us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:31.957817 (+   737us) tablet.cc:701] Row locks acquired
0709 13:04:31.957852 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:04:31.958062 (+   210us) write_op.cc:270] Start()
0709 13:04:31.958238 (+   176us) write_op.cc:276] Timestamp: P: 1783602271957998 usec, L: 0
0709 13:04:31.958267 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:04:31.981701 (+ 23434us) log.cc:844] Serialized 2078 byte log entry
0709 13:04:32.572340 (+590639us) op_driver.cc:464] REPLICATION: finished
0709 13:04:32.895871 (+323531us) write_op.cc:301] APPLY: starting
0709 13:04:32.908184 (+ 12313us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:32.917480 (+  9296us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:32.917991 (+   511us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:32.918749 (+   758us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:32.918955 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:04:32.919001 (+    46us) write_op.cc:312] APPLY: finished
0709 13:04:32.919286 (+   285us) log.cc:844] Serialized 46 byte log entry
0709 13:04:32.919464 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:32.919577 (+   113us) write_op.cc:454] Released schema lock
0709 13:04:32.919617 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:32.942089 (+ 22472us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:32.949228 (+  7139us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":281669,"reported_tablets":55,"spinlock_wait_cycles":11136,"child_traces":[["op",{"apply.queue_time_us":288379,"apply.run_cpu_time_us":2986,"apply.run_wall_time_us":43448,"num_ops":5,"prepare.queue_time_us":147846,"prepare.run_cpu_time_us":15409,"prepare.run_wall_time_us":536084,"raft.queue_time_us":122678,"raft.run_cpu_time_us":59668,"raft.run_wall_time_us":230422,"replication_time_us":583051,"thread_start_us":362363,"threads_started":4,"wal-append.queue_time_us":176271,"wal-append.run_cpu_time_us":66527,"wal-append.run_wall_time_us":1932456}]]}
I20260709 13:04:37.980425 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:37.982533 18114 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:37.957582 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:37.991364 15268 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:37.991413 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 52371.1us
I20260709 13:04:37.995106 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:37.997709 18445 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:04:37.999998 18445 consensus_queue.cc:1243] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:38.000855 18445 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:38.001261 18445 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:38.002255 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 59617.5us
I20260709 13:04:38.003245 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.004161 17948 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:38.008330 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.008111 18252 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.009411 18438 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:38.009876 15160 leader_election.cc:400] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12.
I20260709 13:04:38.010249 15160 leader_election.cc:403] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:38.010260 15874 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:38.009905 18438 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:38.015002 18438 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:38.017333 18449 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.017710 18218 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:38.017956 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.021723 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.017812 18449 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.027185 18449 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.027271 18114 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.038138 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.038883 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.038854 15338 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:38.046686 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:38.055613 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.056200 15341 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
W20260709 13:04:38.049968 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 57107.6us
I20260709 13:04:38.040681 18293 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:38.048875 18218 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12.
I20260709 13:04:38.002573 18445 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.062083 18088 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:38.049037 18358 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.069363 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.074574 18343 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.077009 18438 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.078534 18445 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.079167 18293 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.079099 15094 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:38.081882 18293 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.081614 15094 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:04:38.088824 15081 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d785ccef0634edd9f0fbb52fa1c8d27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:38.091077 18462 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.092630 15160 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.095589 18343 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.065532 18266 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:38.094292 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.099012 18266 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.094183 18376 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:38.096834 18242 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:38.093961 18462 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.066025 18284 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:04:38.103427 18298 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:38.104483 18448 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:38.106204 15272 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:38.106477 18242 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:38.106789 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 100169us
I20260709 13:04:38.112021 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.113065 18088 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.107416 18464 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:38.117303 18464 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:38.122867 18464 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.119509 18242 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:38.120954 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71603.7us
I20260709 13:04:38.121155 18438 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.121729 18114 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:38.137581 18266 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:38.138016 18266 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:38.138447 18266 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.132166 18252 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.145465 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.145963 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.146661 15272 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.147948 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.149567 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.133708 18358 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:38.151784 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.154516 15338 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:38.118664 15094 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:38.136497 18343 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:38.160182 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.135861 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.163139 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.165346 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.166160 15268 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.167205 15338 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:38.158012 15094 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 2 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 7 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.159283 18343 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:38.169831 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:38.170109 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 85292.9us
I20260709 13:04:38.170223 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.174391 17948 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:38.174942 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.171898 18343 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:38.176401 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.177268 17948 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:38.177443 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.177857 17948 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:38.178509 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.178822 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.179746 17948 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.188567 15268 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:38.193797 15272 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 5.
I20260709 13:04:38.178526 18088 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:38.176970 18343 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.195451 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.195948 18343 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.187582 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:38.199414 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63673.4us
I20260709 13:04:38.204761 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.171257 18445 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.205516 18242 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:38.211975 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:38.211416 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 149913us
I20260709 13:04:38.212960 18218 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:38.216202 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:38.215845 18393 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:38.224479 18393 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:38.224998 18393 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.211560 18242 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:38.242177 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.245442 15094 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:38.235960 18242 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.258858 18218 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.259613 18471 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.260094 18471 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.260515 18471 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.248538 18284 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:38.269761 18284 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:38.270300 18284 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:38.272235 18464 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.274544 18464 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.240437 18266 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.276650 18266 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.278659 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.263338 15094 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:38.285320 18256 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:38.286091 18256 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:38.286541 18256 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.287372 18462 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.287949 18462 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.291589 18468 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.292174 18468 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:38.293691 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.294377 18468 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.297088 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.249454 18445 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.298324 15268 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:38.298626 18393 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.300112 18445 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.300634 18393 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.290885 18462 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:38.310518 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 103330us
I20260709 13:04:38.301553 18242 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.302434 15094 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:38.302917 18449 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:38.304421 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62331.9us
I20260709 13:04:38.322772 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.304430 18088 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:38.318017 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 114889us
I20260709 13:04:38.326391 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.327278 18449 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.328243 18242 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.333112 18472 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:38.335655 18471 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.337642 18472 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:38.338946 18471 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.344094 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:38.346035 18462 raft_consensus.cc:2764] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:04:38.347378 18242 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.348333 18242 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.349141 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:38.350384 18462 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.355288 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.350926 18242 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.360682 18449 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:38.361084 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:38.361084 18088 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.362195 15869 raft_consensus.cc:2410] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:04:38.365744 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46132.7us
W20260709 13:04:38.366832 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49167.6us
I20260709 13:04:38.369406 17948 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:38.370043 17948 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.370530 17948 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:38.370152 15094 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 6 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 7 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.375340 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.358349 18462 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:38.366668 18472 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.355902 18284 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.378225 15094 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 2 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:38.391703 15162 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.385923 18449 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:04:38.393690 18472 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.394364 18449 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:38.394906 18449 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:38.396215 18472 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.395854 18449 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.397352 18449 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:38.386210 18462 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.400421 18462 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.401288 18445 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:38.402624 18284 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:38.403247 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.407687 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:38.404488 15162 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.415519 15346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:04:38.416416 15346 raft_consensus.cc:606] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.417569 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.418464 15272 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 4.
I20260709 13:04:38.389575 18242 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:04:38.422003 18242 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.422358 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.422712 18242 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:38.423056 15272 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:38.423149 18242 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:38.408480 18476 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:38.423986 18242 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.424846 17948 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.425194 18242 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:38.425915 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:38.426613 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.427768 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:38.429302 18256 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.429714 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.430660 18472 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.417637 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.435715 15268 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:38.438663 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.439292 18393 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:38.439728 18393 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:38.439762 18462 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:38.440274 18393 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:38.440326 18462 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:38.441026 18462 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.447257 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.451287 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.451985 15272 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:38.452698 18445 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:38.453572 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.454453 18464 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.452912 18256 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:38.456148 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:38.436061 18472 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.460914 18472 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.461028 18445 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:38.461985 18445 consensus_queue.cc:1243] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:38.465598 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.465881 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.466370 15265 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:38.454527 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:38.471585 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.474748 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.476123 15272 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.481209 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.484084 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.490442 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:38.492002 15270 raft_consensus.cc:2368] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10.
I20260709 13:04:38.491770 15094 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 5 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:04:38.498745 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44289.9us
I20260709 13:04:38.450186 18462 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.500558 15272 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:38.512411 15094 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:04:38.514276 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48480.7us
I20260709 13:04:38.515380 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:38.517658 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50619.1us
I20260709 13:04:38.499528 18358 raft_consensus.cc:2764] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:04:38.520419 15269 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:38.510883 18284 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:38.534904 15094 catalog_manager.cc:5697] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 5 to 6, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } }
I20260709 13:04:38.524945 18473 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:38.516306 18114 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.531141 18298 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.533710 18472 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:38.541077 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59789.3us
I20260709 13:04:38.540339 18462 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.541730 15094 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 1 to 2, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:38.516180 18448 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.546607 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.546895 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.547478 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.551867 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.551934 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.558697 15188 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:38.563907 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:38.567065 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:38.568533 15190 raft_consensus.cc:2368] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:38.564142 15094 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 6 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 7 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.549454 18473 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:38.565747 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.584385 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:38.582437 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.587628 15192 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:38.588675 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.577766 18298 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:38.592238 18284 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:38.593809 18298 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.594249 18284 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.594342 18298 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:38.596724 18284 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:38.598488 18445 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.599231 18476 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:38.599393 17948 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.599825 18476 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:38.600841 18476 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.601055 18393 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.602283 15312 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:38.603210 17948 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.603611 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.579958 18473 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:38.604363 15191 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:38.605949 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.608821 18393 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.609536 18256 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:38.610078 18256 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.612214 18256 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.613868 15094 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:04:38.619201 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.620882 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.583518 18114 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.622764 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.623660 15190 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:38.624513 17948 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:38.624703 18114 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.593112 15193 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:38.560166 18464 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:04:38.576643 18462 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:04:38.577765 18448 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.593120 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:38.637447 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44411.1us
I20260709 13:04:38.647329 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.649560 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.649760 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.652335 15338 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:38.653369 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.654153 15345 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:38.652092 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.654716 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.651686 15346 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:04:38.658486 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56250.8us
I20260709 13:04:38.659654 18393 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:38.634747 18472 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.656985 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.668123 18088 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:38.643965 18449 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:38.669009 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.676784 15338 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:38.669531 15197 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:38.677033 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.679525 15190 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:38.680838 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.681701 15343 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:38.683382 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.685252 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:38.685405 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.689947 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.691077 15345 raft_consensus.cc:2368] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:38.633419 18448 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.693820 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:38.696223 15874 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:04:38.699330 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.680613 18449 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.680580 18363 raft_consensus.cc:993] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:04:38.708295 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.709543 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.712760 15197 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:04:38.712462 15193 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:04:38.715232 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:38.715948 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:38.698799 18393 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:04:38.712302 18449 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.698726 18445 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.721541 15344 pending_rounds.cc:85] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 4
I20260709 13:04:38.721941 15344 pending_rounds.cc:107] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:04:38.722347 15344 raft_consensus.cc:2889] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:38.721984 18445 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.685207 17948 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:04:38.724206 18445 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:38.725138 18298 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.713145 15197 pending_rounds.cc:85] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 3
I20260709 13:04:38.727460 15197 pending_rounds.cc:107] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:04:38.727839 15197 raft_consensus.cc:2889] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:38.729122 15343 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:38.731278 18438 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:38.731902 18438 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.734006 18438 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.736157 18363 raft_consensus.cc:1081] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:04:38.736474 15269 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:38.738974 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:38.738076 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.741756 15190 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:38.742463 15162 leader_election.cc:400] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:38.742831 15162 leader_election.cc:403] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:38.747905 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.691226 18471 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:04:38.756422 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.745537 18114 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:38.760161 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.760852 15345 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:38.762327 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.765583 15190 raft_consensus.cc:2410] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:04:38.768693 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.759369 18343 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:04:38.773806 18343 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:38.774225 18343 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:38.775375 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:38.754163 18448 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.780593 18448 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.780922 18471 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:38.781047 18448 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.781356 18471 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:38.782281 18471 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.743762 18445 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:38.788278 15343 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:38.779520 18343 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.799664 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.800414 15196 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:38.810086 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:38.813557 15190 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:38.757828 18438 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:38.799250 18088 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:38.791805 18445 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.825393 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:38.762944 18449 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.817358 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.833616 18298 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.839305 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.843737 15196 raft_consensus.cc:2410] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:38.843657 18472 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:38.839491 18473 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.841887 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.846144 18472 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:38.846606 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.847334 15341 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:38.846632 18473 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:38.848246 18473 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:38.828516 18376 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 13:04:38.849758 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.849835 18376 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:38.850530 18376 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:38.849807 18473 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:38.841832 18114 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:38.846742 18472 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:38.822544 18471 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:38.828502 18284 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:38.828083 18445 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:38.861387 15188 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:38.870206 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.871277 15197 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:38.872526 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:38.873137 15193 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.873425 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.874032 15195 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:38.874071 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.862709 18473 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.875310 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.875485 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.877223 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.875479 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:38.874961 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:38.827958 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:38.881201 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53288.9us
I20260709 13:04:38.891431 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.892452 15197 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:38.893131 15195 raft_consensus.cc:2368] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:38.893260 15188 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:38.901039 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.904449 18114 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:38.906711 18242 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:38.907230 18242 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:38.908075 18242 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.909322 15192 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:38.910343 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.910952 15192 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:38.911347 18363 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:38.911841 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.913041 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.913769 15192 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:38.914489 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.916365 18472 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:38.906792 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:38.920576 15193 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:38.854187 18343 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.923703 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.851763 18376 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:38.914959 15192 raft_consensus.cc:2376] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8. Re-sending same reply.
I20260709 13:04:38.926546 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.927977 18363 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:38.931969 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:38.933405 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.934492 15189 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:38.927191 15196 raft_consensus.cc:2376] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10. Re-sending same reply.
I20260709 13:04:38.932458 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.940570 15188 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:38.919366 18284 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:38.945343 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:38.956717 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.957778 15192 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:38.902953 18218 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:04:38.929107 18088 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:04:38.970580 18449 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:38.971424 18363 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:38.973891 18242 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:38.979678 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:38.980712 15192 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:38.974857 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.975869 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:38.983901 15188 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:38.991863 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:38.990636 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 63410.5us
I20260709 13:04:38.994122 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:38.994489 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:38.995620 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:38.996650 15269 raft_consensus.cc:2410] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:38.996832 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:39.000416 15197 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.014864 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:39.015607 15265 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:39.018384 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:39.019088 15265 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.031272 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:39.032150 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.033699 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:39.034731 15272 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:39.043606 15269 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:39.032321 15270 raft_consensus.cc:2376] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9. Re-sending same reply.
I20260709 13:04:39.045754 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.046420 15341 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.981942 18363 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:39.045804 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:39.048132 15268 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.050832 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:39.051771 15272 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.008464 18293 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:39.054558 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 392127us
I20260709 13:04:39.056954 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.058025 15197 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:39.066118 15341 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:39.042678 18376 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.068598 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.072985 15188 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
W20260709 13:04:39.069847 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.072151 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:39.076663 15268 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:39.051774 18363 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:39.089938 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.091325 15197 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:39.062222 18494 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.104130 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:39.101507 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44133.1us
I20260709 13:04:39.071020 18293 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:39.055058 18464 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:04:39.094058 18218 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.099592 18266 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.094748 15272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45862
I20260709 13:04:39.119622 15272 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:04:39.119993 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 90967us
I20260709 13:04:39.120046 15272 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.122784 18266 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.138445 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:39.143151 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:39.143872 15264 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:39.121913 18448 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.164866 15190 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.164978 15263 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:39.166698 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:39.167054 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 59208.6us
W20260709 13:04:39.167636 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.108089 18494 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.170904 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.170879 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.172379 15343 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.172873 15189 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:39.155642 18438 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:39.193416 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.124729 18218 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.192549 15197 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
W20260709 13:04:39.197418 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 125329us
I20260709 13:04:39.195309 15272 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.212419 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.213032 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.214247 15345 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.214387 15338 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:04:39.197460 18493 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:04:39.221195 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.222185 15197 raft_consensus.cc:2376] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8. Re-sending same reply.
I20260709 13:04:39.208470 18438 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:39.236220 15876 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:39.229460 18266 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.238515 15342 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:39.206429 18445 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.244421 15269 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:04:39.247229 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.252365 15272 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.253248 18266 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.261554 18266 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.246897 18298 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.247403 18448 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.259517 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.229049 18490 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.268200 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.275079 15197 raft_consensus.cc:2368] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:39.275132 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.278644 15191 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:39.218478 18472 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:04:39.212222 18473 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:04:39.281114 15192 raft_consensus.cc:2368] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:04:39.283654 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.288415 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.287089 15196 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:39.291759 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.273226 18114 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.209790 18293 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:39.294961 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.295976 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:39.302126 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.313297 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.316236 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.320585 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.321228 15338 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.275833 18298 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:39.313419 18498 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:04:39.301573 18473 consensus_queue.cc:1243] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:39.329756 15342 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:39.332374 15345 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
W20260709 13:04:39.335142 18499 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.161s	user 0.000s	sys 0.002s
I20260709 13:04:39.283269 18490 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.322513 18438 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.337484 18490 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.288589 18448 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:04:39.367501 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.375725 15196 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.378319 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.387321 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.307785 18114 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:39.394184 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.394357 15264 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:39.394879 15345 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.306589 18507 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:04:39.402670 15338 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:39.405580 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.406137 15265 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:39.406358 15192 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:04:39.408398 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.408731 15191 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:39.409246 15338 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.413110 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.413268 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.414492 15195 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.417686 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.417797 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.416878 15344 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.418748 15196 raft_consensus.cc:2410] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:39.428772 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.429620 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.430652 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.431291 15197 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:39.433316 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:39.448678 15345 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:39.459828 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.462589 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.432161 18218 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.434064 18494 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.465330 15345 raft_consensus.cc:2368] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
W20260709 13:04:39.504326 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.622752 15197 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
W20260709 13:04:39.640573 18518 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:04:39.698424 15195 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:39.524132 15343 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:39.518327 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.660308 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:39.568925 18515 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:04:39.583964 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:39.707898 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 115874us
I20260709 13:04:39.705910 15264 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:39.465440 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.442716 18242 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:39.486334 15338 raft_consensus.cc:2410] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:39.711146 15196 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:39.516624 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:39.568806 18343 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.640s	user 0.016s	sys 0.000s
W20260709 13:04:39.730762 15842 leader_election.cc:336] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.905s (SENT)
W20260709 13:04:39.648663 18363 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.549s	user 0.003s	sys 0.010s
W20260709 13:04:39.519146 18504 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:04:39.435124 18376 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.276s
I20260709 13:04:39.459404 18445 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.732018 15194 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:04:39.732846 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.660015 18298 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.734756 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.708680 18266 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.736074 18376 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:39.736723 18376 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:39.737929 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:39.720332 18242 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:39.740808 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.741487 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.647315 18511 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.741592 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:39.738010 18510 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:04:39.744594 18343 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.742475 15338 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:39.771487 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.773478 15338 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:39.770344 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.772743 15189 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:39.774897 15339 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:39.774289 15338 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.776440 15338 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.749650 18507 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.784976 15196 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:04:39.733831 18363 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.794124 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:39.796530 18521 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:04:39.797138 18507 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.801433 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.802234 15341 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:39.802842 18507 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:39.803018 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.804656 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.805374 15193 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:39.808610 15346 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:39.809468 18445 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:39.810205 15238 leader_election.cc:336] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.512s (SENT)
I20260709 13:04:39.810005 18445 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.787667 18343 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:39.812069 15341 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:39.812232 18445 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.813079 18343 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.817059 18525 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:39.818576 18471 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:39.819099 18471 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:39.819960 18525 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:39.820346 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:39.744457 18376 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.820024 18471 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.822737 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:39.825459 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.826826 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.828075 15339 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:39.823603 15270 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:39.832267 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:39.833879 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.836541 15340 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:39.838124 15338 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
W20260709 13:04:39.854178 15842 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.035s (SENT)
I20260709 13:04:39.874930 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.843727 18343 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:39.769955 18242 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.881474 18343 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.891803 18343 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.891894 18448 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.892630 18448 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.893201 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.893831 15338 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:39.894872 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.769614 18511 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:39.895273 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.895565 15343 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:39.910633 18448 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:39.839514 18266 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:39.911186 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:39.911795 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.911816 15345 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:39.895332 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:39.912951 15193 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:39.914451 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:39.915660 18490 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:39.916224 18490 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.916683 18490 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.913213 15339 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:39.919847 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:39.926324 18511 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:39.926642 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.927522 15191 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.928929 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:39.932297 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.932991 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:39.935858 18516 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.451s	user 0.003s	sys 0.001s
I20260709 13:04:39.936718 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:39.938141 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:39.939574 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.940631 15190 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:39.940892 18473 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:39.941648 18473 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:39.942035 18473 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:39.942391 18473 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.908989 18471 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.949570 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:39.950753 18507 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:39.951342 18507 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:39.952481 18507 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:39.957866 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:39.959646 15190 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:39.959733 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:39.960495 15193 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:39.963937 15192 consensus_meta.cc:287] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.531s	user 0.014s	sys 0.000s
I20260709 13:04:39.964454 15192 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:39.975013 15345 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
W20260709 13:04:39.986282 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:39.990522 15195 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:04:39.991802 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 137683us
W20260709 13:04:40.005013 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 85246.3us
W20260709 13:04:40.006392 15238 leader_election.cc:336] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.628s (SENT)
I20260709 13:04:40.009577 15270 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [8.7-10.8]
I20260709 13:04:39.958508 18266 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:40.014264 15842 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.016605 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:40.017570 15268 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:04:40.018272 15238 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.698s (SENT)
W20260709 13:04:40.016541 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47512.3us
I20260709 13:04:40.018919 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:39.990310 18393 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:40.022893 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:40.021840 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:39.994928 18464 raft_consensus.cc:2764] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:40.027238 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.025023 15265 raft_consensus.cc:2368] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:40.030072 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.032310 15268 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:40.011520 18462 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.966252 18511 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:04:40.036294 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.036914 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:40.037281 15189 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:04:40.037782 15189 pending_rounds.cc:85] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 4
I20260709 13:04:40.038043 15189 pending_rounds.cc:107] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:04:40.038334 15189 raft_consensus.cc:2889] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.040132 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.041976 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.044763 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:40.046037 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.046631 15272 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:40.038043 18266 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.047823 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:40.048637 15269 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:40.049440 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.050050 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.020975 18472 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:04:40.051146 18252 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:40.051308 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.051986 18252 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:40.052242 15238 leader_election.cc:336] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.699s (SENT)
I20260709 13:04:40.052726 15271 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:04:40.053845 15238 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.736s (SENT)
I20260709 13:04:40.054123 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.054299 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.055195 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.055398 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.055940 15267 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:40.056450 18514 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:40.056675 15270 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:40.052721 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:40.057427 18517 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:40.058971 18114 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:40.016580 18531 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.056023 15268 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:40.055883 15238 leader_election.cc:336] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.780s (SENT)
I20260709 13:04:40.064023 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.064412 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:40.065083 15265 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.074967 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:04:40.077257 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77271.3us
I20260709 13:04:40.057790 15272 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.084743 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:40.085431 15189 raft_consensus.cc:606] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.085789 15189 raft_consensus.cc:614] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:40.085516 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:40.055202 18464 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.036126 18525 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:40.092522 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50632.2us
I20260709 13:04:40.092589 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:40.114905 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.115168 15265 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:40.091430 18114 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:40.123359 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.076339 18343 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:40.122839 15196 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:40.134110 15272 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:40.125240 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.062855 18462 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.118758 18256 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:40.132483 15269 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:40.132704 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1896) took 1127 ms. Trace:
I20260709 13:04:40.118693 18449 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:40.124715 18114 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:40.085039 18531 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.116636 18393 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:40.139938 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.137279 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.143014 15196 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:40.160763 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 104902us
I20260709 13:04:40.143141 15340 rpcz_store.cc:276] 0709 13:04:39.003441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.003558 (+   117us) service_pool.cc:224] Handling call
0709 13:04:39.046125 (+ 42567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:39.837031 (+790906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.130357 (+293326us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54002729d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:40.130510 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1809469696}
W20260709 13:04:40.161548 15238 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.797s (SENT)
W20260709 13:04:40.135557 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 50149.9us
I20260709 13:04:40.161983 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.156610 15190 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:40.162177 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:40.116142 18464 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:40.163796 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:40.134594 18525 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:40.142586 18511 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:40.143786 18242 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:40.154997 18114 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:40.174073 15190 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:04:40.175469 18540 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:40.176994 15190 pending_rounds.cc:85] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 3
I20260709 13:04:40.179880 18256 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:40.179754 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.181754 15190 pending_rounds.cc:107] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:04:40.182220 15190 raft_consensus.cc:2889] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:40.183220 18526 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:04:40.183931 18502 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:40.184420 18502 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:40.178926 18511 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:40.185542 18502 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.187103 18511 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.188650 18531 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:40.190147 18534 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:40.183132 18539 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:04:40.191093 18471 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:40.191623 18539 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:04:40.191985 18535 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:40.192188 18539 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:40.192930 18343 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:40.193697 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.193450 18539 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:40.195958 18363 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:40.172873 18514 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:40.197027 18514 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:40.197432 18514 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:40.177976 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54765.7us
W20260709 13:04:40.176060 18529 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:04:40.204226 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:40.207404 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70195.7us
I20260709 13:04:40.208580 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.210803 18525 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:04:40.212697 18490 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:40.213877 18523 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.440s	user 0.002s	sys 0.000s
W20260709 13:04:40.210908 18532 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:04:40.212183 18363 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:40.216392 18462 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:40.216555 18363 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.217170 18393 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.220726 15192 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:40.197459 18539 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:40.224602 18445 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:40.227495 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:40.229158 18252 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.229809 18252 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:40.211970 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.233961 18376 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:40.234886 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1448) took 1125 ms. Trace:
I20260709 13:04:40.235248 18490 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:40.221278 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:40.235351 15188 rpcz_store.cc:276] 0709 13:04:39.109428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.114619 (+  5191us) service_pool.cc:224] Handling call
0709 13:04:39.123749 (+  9130us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:39.145171 (+ 21422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.145216 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:39.146113 (+   897us) log.cc:844] Serialized 52 byte log entry
0709 13:04:39.298657 (+152544us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:39.323711 (+ 25054us) log.cc:844] Serialized 14 byte log entry
0709 13:04:39.323922 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:39.324000 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:40.155938 (+831938us) spinlock_profiling.cc:243] Waited 9.83 ms on lock 0x7b1800444ac0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:40.234451 (+ 78513us) raft_consensus.cc:1685] finished
0709 13:04:40.234560 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:40.234824 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11879,"prepare.queue_time_us":25279,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":28477,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":229,"spinlock_wait_cycles":22607616,"thread_start_us":152043,"threads_started":1,"wal-append.queue_time_us":236805}
I20260709 13:04:40.237531 18464 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:40.178263 18449 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:40.174623 18242 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:40.239116 18242 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:40.242625 18256 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:40.243158 15196 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:40.243770 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:40.244284 15197 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:40.245026 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:40.245445 15197 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:40.242472 15188 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:40.245477 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:40.248175 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:40.254019 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:40.254631 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:40.255653 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51704us
I20260709 13:04:40.255966 15160 leader_election.cc:400] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10.
I20260709 13:04:40.256418 15160 leader_election.cc:403] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:40.256795 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.219995 18363 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:40.260000 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.179303 18540 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:40.268847 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.227512 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:40.271777 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.275799 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.277880 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.278717 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.201100 18471 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:40.282135 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:40.283645 15876 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:40.281018 18490 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:40.292961 18490 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:40.293921 18490 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.273440 18449 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10.
I20260709 13:04:40.295214 18445 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.280164 18438 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:40.296823 18540 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.298259 18540 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.279870 18462 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:40.302163 18462 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:40.302582 18462 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.303980 15264 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:40.304148 18252 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:40.312865 15160 leader_election.cc:400] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:04:40.314396 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.283347 18363 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:40.316689 18514 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:40.326598 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48831.1us
I20260709 13:04:40.328065 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.328850 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.337913 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:40.336870 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.282963 18525 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:04:40.315555 18256 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:40.347695 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:40.353473 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:40.334044 18445 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:40.334997 18464 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.331851 18448 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:40.345721 18449 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:40.359117 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 51895.4us
I20260709 13:04:40.313498 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:40.318774 15081 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d785ccef0634edd9f0fbb52fa1c8d27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:40.341965 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.340246 18545 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.371587 18542 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:40.372643 18538 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:40.349273 18256 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:40.403551 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70244.3us
W20260709 13:04:40.409653 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53122.3us
I20260709 13:04:40.411936 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.412573 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.413326 15338 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:40.360684 18445 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:40.408581 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 160475us
I20260709 13:04:40.417527 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.350903 18495 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:40.410158 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68301.6us
I20260709 13:04:40.421015 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.364487 18502 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:40.398746 18449 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.419397 18256 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:40.419531 18445 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:40.426793 18449 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.430354 18284 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:40.431470 18284 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.432349 18284 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:40.432768 18284 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:40.411811 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:40.433825 18284 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.403357 18471 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.362365 18490 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:40.418345 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:40.360760 18494 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:40.422259 18525 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.410430 18538 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:40.410043 15081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 94600.6us
I20260709 13:04:40.403656 18114 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:40.419838 18495 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:40.472879 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54635.8us
W20260709 13:04:40.476020 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 207191us
I20260709 13:04:40.478940 18284 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:40.479441 18545 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:40.422372 18266 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:40.417112 18448 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:40.435580 18542 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:40.544607 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 69070.4us
I20260709 13:04:40.529548 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.537683 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.548271 15272 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:40.480631 18490 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:40.524183 15264 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:40.468605 18494 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.522254 15841 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:40.559000 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.559705 15268 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:40.554605 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:40.534906 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:40.540537 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 119591us
I20260709 13:04:40.541592 15269 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:04:40.543080 15270 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:04:40.517685 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 100220us
I20260709 13:04:40.566470 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.472129 18511 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:40.529109 18545 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:40.516685 18438 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.517099 18495 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.546056 18514 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:40.513346 18525 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:40.529181 18266 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:40.590553 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54671us
I20260709 13:04:40.588501 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:40.606215 15271 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:40.606283 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.569687 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:40.520689 15338 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:40.559162 18464 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.564538 18494 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.589476 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.619684 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:40.619902 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:40.589305 18547 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:40.632728 15269 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:04:40.591400 18545 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:40.642531 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.643144 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.643874 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.642838 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.646374 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.647599 15341 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:40.647449 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.648283 15342 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:40.650740 15344 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:40.655587 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.656812 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.656917 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.659008 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:40.661672 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.661871 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.668262 18514 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:04:40.621290 18473 consensus_meta.cc:287] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.678s	user 0.014s	sys 0.000s
I20260709 13:04:40.616551 18266 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:40.679195 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:40.682526 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.553012 18542 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:40.684772 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 95368.2us
I20260709 13:04:40.619501 18559 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.689308 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.689954 15345 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
W20260709 13:04:40.690636 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 124264us
I20260709 13:04:40.694733 18448 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:40.695366 15238 leader_election.cc:400] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:40.695309 18448 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.695941 18448 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:40.703048 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83213.1us
I20260709 13:04:40.703454 18575 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:40.705078 18448 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.706079 15238 leader_election.cc:403] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:04:40.707809 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:40.708554 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.706039 18575 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:40.713470 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 158955us
I20260709 13:04:40.677435 18566 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:40.719806 18571 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:40.719929 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:40.709728 18578 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:04:40.601812 18438 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:40.723340 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:40.686313 18547 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:40.634871 18538 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:40.733359 18556 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 13:04:40.732460 18558 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:04:40.712154 18559 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:40.693306 18256 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.709847 18448 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:40.693082 18517 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:40.878283 15842 leader_election.cc:336] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.620s (SENT)
I20260709 13:04:40.722590 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:40.974177 18464 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:40.725296 18544 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
W20260709 13:04:40.955721 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 230201us
I20260709 13:04:40.733904 18490 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.690099 18473 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:40.977007 15271 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
W20260709 13:04:40.964093 18563 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.253s	user 0.001s	sys 0.021s
I20260709 13:04:40.965458 18511 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:40.965019 18393 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:04:40.985514 18242 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.746s	user 0.017s	sys 0.004s
W20260709 13:04:40.999667 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 277138us
I20260709 13:04:41.020426 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:40.947431 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 341490us
W20260709 13:04:41.020654 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 312145us
W20260709 13:04:40.998636 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 120400us
W20260709 13:04:41.001214 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 284963us
I20260709 13:04:40.996246 18571 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.017700 15346 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:40.993433 18114 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.024775 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.031764 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.018141 18511 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:41.054648 18565 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:04:41.025226 18242 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.020038 18538 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:41.016624 18517 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:04:41.062381 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:41.067353 18572 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:04:41.119992 15191 consensus_meta.cc:287] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.001s
W20260709 13:04:41.130425 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 108767us
I20260709 13:04:41.055871 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:41.019851 18507 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.103s
W20260709 13:04:41.066674 18540 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.003s
I20260709 13:04:41.035400 15340 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:41.060328 18559 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.062119 18494 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:41.135804 18562 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.420s	user 0.001s	sys 0.000s
I20260709 13:04:41.136089 18567 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:41.137234 15876 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:41.137859 15191 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:41.036175 18464 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:04:41.138477 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:41.135831 15267 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:41.025300 18393 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.027645 18363 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:04:41.068537 18438 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.068347 18537 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:04:41.036556 18571 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:41.136998 18581 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:41.129582 18114 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.067457 18570 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:41.068452 18256 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.128743 18511 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:41.068229 18568 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:04:41.012156 18575 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.055588 18584 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:04:41.144701 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.157754 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.205065 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.310698 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:41.304386 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.264118 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.313099 15272 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:41.176136 18363 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:41.315526 18363 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:41.316636 18363 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.317800 18438 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.317978 18363 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:41.318461 18438 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:41.178761 18242 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:41.298759 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 243001us
W20260709 13:04:41.217420 18539 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.993s	user 0.011s	sys 0.000s
I20260709 13:04:41.321100 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:41.322300 15237 leader_election.cc:400] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:41.322572 15237 leader_election.cc:403] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:04:41.301362 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 271399us
I20260709 13:04:41.326567 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:41.331593 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.326133 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:41.333757 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:41.295545 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 274054us
I20260709 13:04:41.337471 15269 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:41.464624 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:41.465322 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.469090 15269 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:41.158782 18462 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.856s	user 0.014s	sys 0.020s
I20260709 13:04:41.288347 15337 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:41.486289 15345 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:04:41.470131 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 136465us
I20260709 13:04:41.361397 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.489818 15272 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:41.177657 18494 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.496007 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.469295 18569 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:41.496658 15265 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.496768 18114 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:41.240633 18584 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.498258 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.499169 18584 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:41.499622 18266 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.789s	user 0.012s	sys 0.000s
W20260709 13:04:41.173050 18552 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.694s	user 0.014s	sys 0.003s
W20260709 13:04:41.281528 18502 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.810s	user 0.006s	sys 0.003s
I20260709 13:04:41.505111 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:41.272857 18284 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.001s
I20260709 13:04:41.515458 15345 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:04:41.207013 18445 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.000s
I20260709 13:04:41.516916 18445 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:41.309695 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.314198 18545 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.000s
I20260709 13:04:41.519059 18545 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.519721 18445 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.521077 18545 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.521714 18545 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:41.522835 15266 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:41.233487 18566 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:41.533360 15341 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
W20260709 13:04:41.249536 18495 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.644s	user 0.005s	sys 0.004s
W20260709 13:04:41.190395 18449 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.763s	user 0.005s	sys 0.002s
I20260709 13:04:41.535105 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:41.233678 18581 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:41.509479 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 172558us
I20260709 13:04:41.232901 18464 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:41.510133 15338 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:41.511451 15270 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:41.203547 18473 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:41.220072 18393 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:41.561295 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.220261 18567 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:41.233997 18580 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:41.471554 18594 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 13:04:41.513715 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 209386us
I20260709 13:04:41.169694 18571 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.526028 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:41.498915 15267 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:41.536018 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:41.531766 15265 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:41.204584 18525 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.464742 18570 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:41.507107 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.534535 15189 raft_consensus.cc:2410] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:41.503834 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.594717 15272 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.524688 18595 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:41.355211 18242 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:41.215977 18587 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.322s
I20260709 13:04:41.533097 18507 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:04:41.501636 18256 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:41.163170 18577 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:41.157689 18559 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.381s
I20260709 13:04:41.532382 18590 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:41.525103 18589 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:41.167392 18542 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:41.532819 18566 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:41.602226 18571 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:41.536180 18438 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.635383 18583 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:04:41.631891 18589 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:41.637331 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 76132.7us
I20260709 13:04:41.638144 18589 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:41.638200 18554 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:04:41.229111 18511 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:41.508873 18462 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:41.560976 18578 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.514427 18266 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.573231 18284 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.561374 18586 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:41.619958 18256 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.615700 15195 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:41.616331 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:41.145879 18547 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:41.618841 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1727) took 1621 ms. Trace:
I20260709 13:04:41.648336 15197 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:41.648326 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.621261 15272 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:41.570273 18597 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.638907 18571 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:41.696058 18571 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.622216 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.697896 15269 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:41.699754 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1427) took 1051 ms. Trace:
I20260709 13:04:41.700320 15341 rpcz_store.cc:276] 0709 13:04:40.648766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.655219 (+  6453us) service_pool.cc:224] Handling call
0709 13:04:41.699554 (+1044335us) spinlock_profiling.cc:243] Waited 876 ms on lock 0x7b54003ab1d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:41.699677 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2015846656}
I20260709 13:04:41.548302 18449 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.648463 15263 rpcz_store.cc:276] 0709 13:04:39.997863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.999234 (+  1371us) service_pool.cc:224] Handling call
0709 13:04:40.028353 (+ 29119us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:40.133034 (+104681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.133064 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:40.154104 (+ 21040us) log.cc:844] Serialized 52 byte log entry
0709 13:04:40.333689 (+179585us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:40.333753 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.333868 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.172100 (+838232us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:41.605762 (+433662us) raft_consensus.cc:1685] finished
0709 13:04:41.605787 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.618780 (+ 12993us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13581,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":5058816,"thread_start_us":255142,"threads_started":2,"wal-append.queue_time_us":239706}
W20260709 13:04:41.704463 15191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 1922) took 1770 ms (client timeout 1621 ms). Trace:
W20260709 13:04:41.630023 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 491598us
I20260709 13:04:41.705040 18449 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.548224 18495 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.632818 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:41.705786 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:41.706005 15188 raft_consensus.cc:606] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.634222 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:41.617113 18448 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.707156 18495 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:41.707520 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 73378.4us
I20260709 13:04:41.707789 18495 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:41.707337 18448 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:41.708231 18495 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.708650 18495 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.642511 18555 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:41.710321 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.640997 18573 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:41.710860 18555 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:41.642974 18561 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.038s	sys 0.051s
W20260709 13:04:41.711663 18561 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.038s	sys 0.051s
W20260709 13:04:41.643702 18588 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 13:04:41.711354 18573 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.712186 18438 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:41.705096 15191 rpcz_store.cc:269] 0709 13:04:39.928201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.932041 (+  3840us) service_pool.cc:224] Handling call
0709 13:04:41.698852 (+1766811us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54001e73d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:41.699005 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406931200}
I20260709 13:04:41.645792 18590 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:41.713323 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 187) took 1019 ms. Trace:
I20260709 13:04:41.712893 18438 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:41.714402 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.714078 18590 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.715284 18438 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.618592 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:41.655762 18578 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.721916 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.652642 18256 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:41.661249 18266 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.661803 15268 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:41.725099 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48112 (request call id 183) took 1074 ms. Trace:
I20260709 13:04:41.662220 18597 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.664023 18567 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.665747 18581 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.670495 15265 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:41.710333 18448 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.677006 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1914) took 1080 ms. Trace:
I20260709 13:04:41.731168 15340 rpcz_store.cc:276] 0709 13:04:40.596633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.602948 (+  6315us) service_pool.cc:224] Handling call
0709 13:04:40.603337 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.149394 (+546057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.676613 (+527219us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54000b5c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:41.676900 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":984831744}
I20260709 13:04:41.625470 18577 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.732450 18577 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:41.732942 18564 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.683332 18566 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.684927 18540 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:41.734215 18540 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:41.735148 18540 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:41.735519 15081 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d785ccef0634edd9f0fbb52fa1c8d27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:41.626369 18242 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.654101 18586 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.663162 18284 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.690973 15271 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:41.692502 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:41.739737 15876 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:41.639420 18539 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.694432 18593 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:41.741211 15839 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.546s (SENT) [suppressed 49 similar messages]
I20260709 13:04:41.741314 18539 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:41.644582 18511 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:41.741469 18593 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.613626 15192 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:41.717458 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:41.702867 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1760) took 1166 ms. Trace:
I20260709 13:04:41.757287 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.758038 15272 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.757725 15266 rpcz_store.cc:276] 0709 13:04:40.536168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.547563 (+ 11395us) service_pool.cc:224] Handling call
0709 13:04:40.591062 (+ 43499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.523241 (+932179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.702558 (+179317us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b5400349254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:41.702788 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142482816}
I20260709 13:04:41.762187 18539 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.713747 15343 rpcz_store.cc:276] 0709 13:04:40.693923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.695906 (+  1983us) service_pool.cc:224] Handling call
0709 13:04:40.696364 (+   458us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:40.714867 (+ 18503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.714909 (+    42us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:40.732167 (+ 17258us) log.cc:844] Serialized 78 byte log entry
0709 13:04:41.296674 (+564507us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:41.296759 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.296894 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.546992 (+250098us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b48001e0258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:41.713007 (+166015us) raft_consensus.cc:1685] finished
0709 13:04:41.713028 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.713265 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20824,"raft.queue_time_us":25065,"raft.run_cpu_time_us":1556,"raft.run_wall_time_us":823302,"spinlock_wait_cycles":31416576,"thread_start_us":328170,"threads_started":1,"wal-append.queue_time_us":327454}
I20260709 13:04:41.721341 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.767439 15267 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.711403 18494 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:04:41.725024 18560 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:41.770135 18560 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:41.766700 18566 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.758333 18569 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:41.771252 18560 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:41.733513 18564 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.690404 18462 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:41.742096 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1770) took 1185 ms. Trace:
I20260709 13:04:41.778704 15268 rpcz_store.cc:276] 0709 13:04:40.557186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.633165 (+ 75979us) service_pool.cc:224] Handling call
0709 13:04:40.682673 (+ 49508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.725384 (+1042711us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.741829 (+ 16445us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b54000d6954. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:41.742029 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2251377536}
W20260709 13:04:41.704653 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56392.4us
I20260709 13:04:41.801510 18507 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.802145 18507 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.803058 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99208c2982d748dd8e728ff51c224658"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:41.803656 15192 raft_consensus.cc:606] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.803962 15192 raft_consensus.cc:614] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:41.806082 18507 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:41.808887 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.809633 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
W20260709 13:04:41.810478 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 191974us
W20260709 13:04:41.811304 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 104332us
I20260709 13:04:41.812458 15238 leader_election.cc:400] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:41.813663 15238 leader_election.cc:400] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
W20260709 13:04:41.827663 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.725785 15346 rpcz_store.cc:276] 0709 13:04:40.650258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.656676 (+  6418us) service_pool.cc:224] Handling call
0709 13:04:41.724881 (+1068205us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54000974d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:41.725012 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827977600}
I20260709 13:04:41.818651 15269 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:41.829916 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.831130 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.839267 15265 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:04:41.839825 15272 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:41.772778 15095 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 11 to 13, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 13 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:41.840528 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 350029us
I20260709 13:04:41.841760 15272 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:04:41.847091 15270 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:41.848063 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:41.867946 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.869108 15271 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:04:41.871121 15268 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:41.868415 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:41.884388 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70900.7us
I20260709 13:04:41.885166 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:41.880476 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:41.889173 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 59340.5us
I20260709 13:04:41.889902 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.806077 18573 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.830451 18570 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:41.870262 18561 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:41.873446 18555 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.873092 18540 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:41.846230 18511 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:41.846453 18589 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.899549 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.914187 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:41.899989 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.867357 18494 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.859972 15095 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 7 to 11, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:41.901204 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.846227 18587 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.883669 18284 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.940747 18564 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.941577 18242 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.941967 18571 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:41.903708 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.943076 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.899103 18490 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:04:41.903079 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.945556 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.947435 18601 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:41.948019 18601 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:41.948371 18585 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:41.948992 18585 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.948920 18601 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.949699 18585 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:41.950160 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:41.951367 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:41.952319 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:41.952937 15341 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:41.911434 18448 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.953930 18448 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.956254 18448 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.888271 18569 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:41.957049 18569 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.945497 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.894131 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:41.907248 18511 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.960054 18511 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:41.960355 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 66337.8us
I20260709 13:04:41.960435 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:41.961524 18242 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:41.961802 18490 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:41.962410 18490 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:41.901597 18449 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.933784 18599 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:41.960063 18448 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:41.929224 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44131.2us
I20260709 13:04:41.874841 18114 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:41.935189 15197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:41.935524 18363 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:41.936240 18550 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.934612 18494 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.936873 18578 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.937031 18586 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.937100 18587 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:41.937711 18584 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.938457 15876 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:41.938750 18597 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:41.939262 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.949460 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:41.912938 18605 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:41.964046 15266 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:41.934607 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:41.979001 18448 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:41.933534 15095 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:41.965902 15197 raft_consensus.cc:606] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:42.028554 15197 raft_consensus.cc:614] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:41.967178 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:41.975417 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:41.977995 15265 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:41.904973 18393 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:41.982089 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:41.988955 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 99115.7us
I20260709 13:04:41.989471 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:41.963277 18599 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:42.008875 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:41.936908 18589 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.019516 15346 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:04:42.010743 18502 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:04:41.979473 18449 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:04:41.965049 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.026648 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:42.090965 15339 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.025738 18597 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.988837 18575 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:04:41.989394 18561 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:04:42.011453 18363 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:42.022559 18593 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:42.093963 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.093976 15338 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:42.130935 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:42.131758 15338 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:42.028677 18542 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:04:42.026787 18605 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.963306 18490 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.087607 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:42.011227 18473 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:04:41.907909 18555 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.073112 18569 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.136906 15341 raft_consensus.cc:2410] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:04:42.138587 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.144841 15346 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:42.147465 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.080092 18599 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:42.027680 18584 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:42.153970 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 188963us
I20260709 13:04:42.159778 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.072500 18507 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:04:42.004128 18550 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:42.167186 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 425973us
I20260709 13:04:42.134087 18606 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.162469 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 445017us
I20260709 13:04:42.103369 18547 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:42.134294 18445 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:42.139236 18580 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:42.161125 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:42.205013 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43992.3us
I20260709 13:04:42.205968 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.174847 15340 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:42.139045 18573 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.076627 18393 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.254863 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.145721 18242 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.183620 15095 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 7 to 8, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 8 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:42.259884 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54015.9us
I20260709 13:04:42.260739 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.260615 15095 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:42.162618 18569 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.251911 15345 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:42.266008 15345 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:42.212061 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.269115 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.269762 15265 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:42.208421 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 370530us
I20260709 13:04:42.196918 15338 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:42.146574 18605 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.157121 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:42.201514 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.099838 18589 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.104359 18597 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.212677 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.343703 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:42.279623 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 197465us
I20260709 13:04:42.344635 15266 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:42.344833 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:42.158020 18586 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.284411 15338 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:04:42.285625 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:42.287667 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:42.162762 18593 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:04:42.270787 18545 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:42.264686 18473 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:42.203331 18580 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:42.251962 18602 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:42.283628 18462 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:42.384974 18462 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:42.385560 18462 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:42.357654 15341 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:04:42.388168 18393 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:42.388804 18393 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:42.391191 18584 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:42.391911 18584 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:42.368964 18473 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:42.395464 18589 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:42.271322 18242 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.396042 18473 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.398120 18242 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:42.358273 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 279479us
I20260709 13:04:42.212167 18445 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.398939 18494 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:42.400508 18566 consensus_meta.cc:287] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.630s	user 0.006s	sys 0.005s
I20260709 13:04:42.400972 18445 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.365309 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:42.378705 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.289031 18363 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:42.381429 18495 consensus_meta.cc:287] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.000s
I20260709 13:04:42.401156 18566 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:42.379817 18550 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:42.404013 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:42.370606 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.411810 15338 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:42.406754 15271 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:04:42.413213 15271 pending_rounds.cc:85] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 3
I20260709 13:04:42.413507 15271 pending_rounds.cc:107] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:04:42.413900 15271 raft_consensus.cc:2889] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:42.354638 18376 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.208473 18606 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.229017 18547 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:42.284200 18569 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.256752 18448 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.413762 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:42.298346 18573 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.378193 18502 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:42.438858 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.373672 18580 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:42.377698 18602 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:42.362687 18586 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.421681 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:42.461966 15267 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.694s	user 0.013s	sys 0.001s
I20260709 13:04:42.409890 18566 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:42.469961 15267 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:42.473672 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.438480 18393 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:42.499879 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.439826 18587 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.420105 18584 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:04:42.459612 18589 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:42.425472 18550 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:04:42.414135 18585 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.415799 18495 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.465655 18602 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:42.537925 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 338517us
I20260709 13:04:42.425632 18376 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.467221 18502 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:42.542869 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.497514 18566 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:42.505645 18608 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:04:42.474283 18604 raft_consensus.cc:2764] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:42.561043 15270 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
W20260709 13:04:42.561267 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 147551us
I20260709 13:04:42.537678 18626 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:04:42.570281 18502 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:42.573352 18571 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 13:04:42.574334 15266 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:04:42.575181 15266 pending_rounds.cc:85] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 3
I20260709 13:04:42.575465 15266 pending_rounds.cc:107] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:04:42.575706 15266 raft_consensus.cc:2889] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:42.578436 15339 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:42.548051 18555 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:42.580722 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.583827 15344 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:42.548540 18587 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.581423 18256 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.852s	user 0.020s	sys 0.001s
W20260709 13:04:42.579963 18621 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:04:42.612932 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 201687us
W20260709 13:04:42.613126 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 327588us
W20260709 13:04:42.615176 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 203459us
I20260709 13:04:42.615200 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.617161 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.617419 15238 leader_election.cc:400] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:42.615386 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:42.618959 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.583379 18571 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.610546 18577 consensus_meta.cc:287] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.878s	user 0.014s	sys 0.002s
W20260709 13:04:42.630272 18540 consensus_meta.cc:287] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.005s
I20260709 13:04:42.627471 18593 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:42.639878 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93813.9us
I20260709 13:04:42.629807 18629 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.633204 18494 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:42.650115 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.648077 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.658471 15344 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:42.655167 18595 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:42.632951 18242 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.680034 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.637991 18567 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:42.651790 18445 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.686287 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 69214.3us
I20260709 13:04:42.683559 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.624742 18256 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:42.682343 18613 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.239s	user 0.001s	sys 0.001s
I20260709 13:04:42.687812 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.705404 15337 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:42.652076 18597 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.745271 15344 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:42.649299 18593 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:42.675345 18611 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 13:04:42.735121 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116261us
I20260709 13:04:42.670457 18629 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:42.735405 18567 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:42.683935 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68616.2us
I20260709 13:04:42.682744 18601 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:42.745456 15268 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:42.642462 18577 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:42.746268 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 104965us
W20260709 13:04:42.812111 15839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.006s	sys 0.014s
I20260709 13:04:42.729337 18595 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:42.640105 18617 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:04:42.792712 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.685981 18584 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:42.685245 18634 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.806699 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:42.682165 18647 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:42.636039 18571 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:42.812451 15839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.006s	sys 0.014s
I20260709 13:04:42.812863 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:42.641359 18587 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:42.725659 18242 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.731526 18438 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:42.824790 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.826061 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.657450 18462 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.679419 18494 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.837167 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.740893 18622 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:42.805238 18606 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.844156 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:42.845475 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 109140us
I20260709 13:04:42.855441 15265 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
W20260709 13:04:42.856230 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44519.6us
I20260709 13:04:42.856963 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.857937 15265 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:42.805745 18547 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:42.811992 18570 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:42.860458 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:42.865725 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.824380 18569 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.812273 18550 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.754093 18445 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.830991 18586 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.843899 18376 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:42.831156 18647 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.868940 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.827710 18597 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:04:42.897399 15269 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:42.898931 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.899217 15188 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:42.872503 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:42.874887 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.877178 15197 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:42.886543 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:42.871706 15191 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:04:42.888387 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 81776.1us
I20260709 13:04:42.890841 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:42.834815 18584 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:42.889348 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1759) took 1396 ms. Trace:
I20260709 13:04:42.945415 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1767) took 1226 ms. Trace:
W20260709 13:04:42.927383 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.924510 15265 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:42.957378 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:42.944375 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 88062.6us
I20260709 13:04:42.924566 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.965474 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:42.966451 15192 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:42.969920 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:42.970779 15193 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:42.954878 15263 rpcz_store.cc:276] 0709 13:04:41.719121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.720149 (+  1028us) service_pool.cc:224] Handling call
0709 13:04:41.727511 (+  7362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.728154 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.728183 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.728791 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:04:42.160179 (+431388us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:42.504095 (+343916us) log.cc:844] Serialized 14 byte log entry
0709 13:04:42.504908 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.504992 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:42.925879 (+420887us) raft_consensus.cc:1685] finished
0709 13:04:42.925902 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.945317 (+ 19415us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":451799,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":41591,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":8485,"thread_start_us":681350,"threads_started":2,"wal-append.queue_time_us":614146}
I20260709 13:04:42.954748 15264 rpcz_store.cc:276] 0709 13:04:41.493184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.493361 (+   177us) service_pool.cc:224] Handling call
0709 13:04:41.493700 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.829074 (+335374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.829103 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.829941 (+   838us) log.cc:844] Serialized 26 byte log entry
0709 13:04:42.199630 (+369689us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:42.199670 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.199737 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:42.889081 (+689344us) raft_consensus.cc:1685] finished
0709 13:04:42.889104 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.889271 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13705,"raft.queue_time_us":82504,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7342,"thread_start_us":621421,"threads_started":2,"wal-append.queue_time_us":480512}
I20260709 13:04:42.880177 18585 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:42.888871 18615 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 13:04:42.978368 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:42.942489 18620 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.360s	user 0.000s	sys 0.002s
I20260709 13:04:42.854565 18438 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:42.985025 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:42.844336 18634 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.980167 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:42.896694 18586 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:43.000232 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.003288 15196 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [10.10-11.11]
I20260709 13:04:43.019395 15195 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:42.992822 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:42.931126 18393 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:42.940675 18554 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:42.996347 18490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.001s	sys 0.019s
W20260709 13:04:43.016813 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62368.6us
I20260709 13:04:43.043054 15238 leader_election.cc:400] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:04:43.043572 15238 leader_election.cc:403] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:42.911186 18647 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:42.940267 18655 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:42.882992 18550 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:43.042408 18490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.020s
I20260709 13:04:43.023164 18617 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:43.036582 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:43.040800 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.113890 15196 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:43.041662 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:42.882433 18610 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.136s
I20260709 13:04:42.895684 18639 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:04:43.023759 15197 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:43.040063 18586 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:43.021626 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:43.115242 15195 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
W20260709 13:04:43.152159 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109347us
I20260709 13:04:43.042146 18554 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.939600 18595 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:42.882732 18593 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:43.121759 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.111515 15193 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:43.149487 15340 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:43.158967 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.160312 15193 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:43.160836 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:43.161521 15263 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:43.161734 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.111716 18601 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.157512 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:43.042057 18393 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.113374 18617 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:43.183538 18668 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:43.184243 18668 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.185086 18601 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.186585 18494 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.187362 18256 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:43.187533 18601 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.188465 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.189841 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.190762 15193 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:43.157565 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.191931 15196 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:43.164515 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.178198 18654 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:43.178653 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:43.178720 18619 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:04:43.151799 18610 consensus_queue.cc:1243] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:43.156688 18554 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.183991 18617 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.190560 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:43.152837 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:43.140216 18655 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:43.195132 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1778) took 1284 ms. Trace:
I20260709 13:04:43.167740 18571 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.228789 15271 rpcz_store.cc:276] 0709 13:04:41.910489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.536803 (+626314us) service_pool.cc:224] Handling call
0709 13:04:42.553291 (+ 16488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:42.553647 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:42.637005 (+ 83358us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.156452 (+519447us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.194658 (+ 38206us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.194718 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:43.194777 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.194873 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.195053 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77030,"prepare.queue_time_us":105816,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3673,"raft.queue_time_us":75970,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14331,"spinlock_wait_cycles":43660544,"thread_start_us":532648,"threads_started":2,"wal-append.queue_time_us":551719}
I20260709 13:04:43.147068 18376 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:43.231130 18650 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:43.231299 18376 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.231756 18650 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:43.232220 18650 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.232551 18584 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:43.186904 18668 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:43.233542 18637 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
W20260709 13:04:43.235142 18646 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
W20260709 13:04:43.235623 18643 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.376s	user 0.000s	sys 0.002s
I20260709 13:04:43.193074 18593 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.241269 15195 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:04:43.242189 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:43.208415 18601 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:43.217830 18242 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:43.217743 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 60296.9us
W20260709 13:04:43.191092 18511 consensus_meta.cc:287] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.230s	user 0.013s	sys 0.002s
I20260709 13:04:43.237201 15271 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:43.217294 18462 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.249575 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:43.248299 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:43.280917 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:43.303107 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 150331us
I20260709 13:04:43.304071 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:43.279349 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:43.305811 15271 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:43.247161 18622 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.325836 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:43.264264 18567 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.278931 18629 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:43.365700 18636 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.352s	user 0.003s	sys 0.001s
I20260709 13:04:43.318197 18242 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:43.370723 18601 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.371595 15271 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:04:43.448885 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 58173.9us
W20260709 13:04:43.318799 18580 consensus_meta.cc:287] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.850s	user 0.013s	sys 0.000s
W20260709 13:04:43.376621 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 97358.1us
I20260709 13:04:43.278892 18637 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.263265 18584 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:04:43.398901 18550 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:43.223443 18654 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.369493 18674 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.400682 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1922) took 1432 ms. Trace:
W20260709 13:04:43.373464 18630 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.459s	user 0.000s	sys 0.001s
I20260709 13:04:43.267601 18511 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.389735 18284 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.389999 18462 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.247236 18586 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.320753 18597 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:43.462731 18622 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:43.471616 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:43.451391 18242 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.477521 15342 rpcz_store.cc:276] 0709 13:04:41.968212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.007166 (+ 38954us) service_pool.cc:224] Handling call
0709 13:04:42.020019 (+ 12853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:42.289878 (+269859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.289925 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:42.289990 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:42.290026 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.400425 (+1110399us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400244d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:43.400477 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.400619 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620025728}
I20260709 13:04:43.478325 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:43.487057 18665 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:43.442349 18561 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:04:43.487612 18657 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:04:43.464331 18653 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:43.480170 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:43.460958 18580 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.478271 18587 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:43.443516 18655 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.518543 15343 raft_consensus.cc:2368] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
W20260709 13:04:43.743211 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.659292 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 351109us
W20260709 13:04:43.520398 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 75900.8us
W20260709 13:04:43.516743 18679 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:43.749431 15874 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:43.745564 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:43.534997 18599 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.357s	user 0.014s	sys 0.000s
W20260709 13:04:43.535153 18566 consensus_meta.cc:287] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.971s	user 0.013s	sys 0.000s
I20260709 13:04:43.757426 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:43.497539 18660 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.055s	user 0.001s	sys 0.001s
I20260709 13:04:43.682838 18511 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:43.732362 18652 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
W20260709 13:04:43.681548 18682 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:04:43.762265 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.757902 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:43.741370 18242 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.515558 18651 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:43.766834 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:43.534922 18669 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
I20260709 13:04:43.497076 18634 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.741834 18622 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:43.737370 18597 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.518293 18393 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:43.488492 18284 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.737815 18665 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:43.772960 15271 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.495462 18550 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.272s
I20260709 13:04:43.491184 18462 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.765187 18668 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:43.765770 18599 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.812007 18668 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:43.812542 18668 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.812872 18632 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:43.813351 18632 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:43.813627 18599 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:43.782446 18680 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:04:43.746716 18653 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.768591 18566 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:43.816893 15343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1429) took 1869 ms (client timeout 2110 ms). Trace:
I20260709 13:04:43.817108 18566 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:43.783501 18625 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:43.783986 18605 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.445s	user 0.011s	sys 0.004s
W20260709 13:04:43.817497 15343 rpcz_store.cc:269] 0709 13:04:41.947130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.949937 (+  2807us) service_pool.cc:224] Handling call
0709 13:04:43.816645 (+1866708us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54000974d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:43.816813 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3605028096}
I20260709 13:04:43.818121 18605 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.772603 18675 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:43.789703 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:43.789786 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1781) took 1848 ms. Trace:
I20260709 13:04:43.794507 18665 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.817900 18625 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:43.779816 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:43.787680 18511 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:43.828837 15874 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:43.826381 15270 rpcz_store.cc:276] 0709 13:04:41.937784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.938983 (+  1199us) service_pool.cc:224] Handling call
0709 13:04:43.785780 (+1846797us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54001d88d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:43.785914 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246032128}
I20260709 13:04:43.677795 18677 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.388s
I20260709 13:04:43.787791 18637 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:43.841627 18637 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:43.799753 18676 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:04:43.837702 18625 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.849972 18625 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.825555 18675 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.851588 18675 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.839329 18604 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:43.854210 18604 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.856812 18604 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.861343 18580 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:43.863400 18605 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:43.865623 18650 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.003s
W20260709 13:04:43.867544 18554 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.000s
I20260709 13:04:43.865684 18471 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:43.868081 18554 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.868628 18471 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:43.869933 18471 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:04:43.842196 18602 consensus_meta.cc:287] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.287s	user 0.000s	sys 0.010s
I20260709 13:04:43.878572 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:43.879221 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1777) took 1969 ms. Trace:
I20260709 13:04:43.874583 18602 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:43.788564 18622 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:43.790637 18597 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:43.814247 18632 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.893224 15237 leader_election.cc:400] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:43.886688 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 1942) took 1260 ms. Trace:
W20260709 13:04:43.883802 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 104286us
I20260709 13:04:43.885551 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:43.790850 18651 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:43.880267 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:43.866739 18650 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:43.895015 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.900292 15271 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:04:44.116979 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:44.068650 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.879735 15267 rpcz_store.cc:276] 0709 13:04:41.910257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.511683 (+601426us) service_pool.cc:224] Handling call
0709 13:04:42.531184 (+ 19501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:42.531542 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:42.656978 (+125436us) log.cc:844] Serialized 14 byte log entry
0709 13:04:42.999274 (+342296us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:42.999940 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.000125 (+   185us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:43.000179 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.000282 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.878926 (+878644us) raft_consensus.cc:1685] finished
0709 13:04:43.878946 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.879160 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94351,"prepare.queue_time_us":116563,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":150520,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":9148,"thread_start_us":219806,"threads_started":2,"wal-append.queue_time_us":473817}
I20260709 13:04:44.120915 15237 leader_election.cc:403] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:44.127960 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:44.128683 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.129588 15267 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
W20260709 13:04:44.131001 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 238007us
I20260709 13:04:44.134259 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.134882 15340 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:44.118172 15339 rpcz_store.cc:276] 0709 13:04:42.626882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.627097 (+   215us) service_pool.cc:224] Handling call
0709 13:04:42.627582 (+   485us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:42.686215 (+ 58633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.686252 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:42.730332 (+ 44080us) log.cc:844] Serialized 52 byte log entry
0709 13:04:43.155802 (+425470us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:43.366764 (+210962us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.377627 (+ 10863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.377748 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.886484 (+508736us) raft_consensus.cc:1685] finished
0709 13:04:43.886505 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.886631 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149576,"prepare.queue_time_us":41387,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":236670,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":68785,"thread_start_us":448320,"threads_started":2,"wal-append.queue_time_us":502043}
I20260709 13:04:44.135797 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:44.136638 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:43.925016 18647 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.808s	user 0.012s	sys 0.000s
I20260709 13:04:43.832715 18511 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:44.145226 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.145964 15271 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
W20260709 13:04:44.068989 18660 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:04:44.142639 15263 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:44.149502 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:44.126960 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:44.146844 15265 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:43.888154 18637 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.030546 18580 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.148571 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.161116 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:44.124318 18542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.959s	user 0.007s	sys 0.007s
I20260709 13:04:44.092706 18695 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.150068 15267 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:44.143893 18604 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:44.151229 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:44.131127 18593 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.880s	user 0.012s	sys 0.001s
I20260709 13:04:44.162757 18690 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:44.009389 18626 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:44.171988 18626 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:44.172461 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:44.172353 18675 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.172830 18626 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.173812 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.174086 18626 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:44.174561 15346 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:44.039181 18471 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:44.162340 18542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.003s	user 0.007s	sys 0.007s
I20260709 13:04:44.175256 15342 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:44.176251 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:43.908252 18654 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.113710 18462 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:44.097437 18554 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.049796 18585 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.158753 15345 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:43.886690 18589 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:44.160120 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:44.130944 18625 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.140758 18632 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.878652 18284 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.203473 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.204156 15345 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:44.205077 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:44.206189 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.161801 15270 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:44.168131 18393 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:44.179119 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52216.9us
I20260709 13:04:43.911284 18665 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:44.181079 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.148682 18511 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:44.183089 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:44.184301 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.184243 18583 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:04:44.151726 18677 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:44.141870 18550 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:44.224720 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.195854 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:44.186689 18607 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.900s	user 0.000s	sys 0.011s
I20260709 13:04:44.151229 18647 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.201352 15874 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:44.174890 18675 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.186875 18547 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:44.193985 18654 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.198709 18585 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.222239 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.248497 15345 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:44.222600 15346 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 4.
I20260709 13:04:44.165904 18580 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.225734 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:44.225862 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.226415 15868 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:44.224989 18677 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.227468 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.255223 15270 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:44.227769 18602 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.228309 18665 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.215520 18625 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.229899 18650 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.226152 15271 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:44.219689 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:44.245600 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.250352 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.222002 18589 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:44.252487 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.234740 18462 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.277045 18462 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.278661 15191 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:44.279366 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1967) took 1235 ms. Trace:
I20260709 13:04:44.279449 18462 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.279742 15191 rpcz_store.cc:276] 0709 13:04:43.044209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.278168 (+1233959us) service_pool.cc:224] Handling call
0709 13:04:44.278505 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.279111 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.279309 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.182420 18695 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.256807 15876 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:44.258992 18580 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:44.259413 18677 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:44.260684 18604 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:44.289637 18604 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.291090 18517 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:44.266989 15869 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:44.291676 18517 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:44.292232 18604 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.292685 18517 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.293854 18517 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:44.294122 15869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 232) took 1313 ms. Trace:
I20260709 13:04:44.245409 18654 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.270452 15264 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:44.296428 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.297484 18654 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.297683 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.266773 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:44.274533 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:44.298471 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.299386 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.300513 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1773) took 2391 ms. Trace:
W20260709 13:04:44.275314 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55737.2us
I20260709 13:04:44.298424 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 190) took 1429 ms. Trace:
I20260709 13:04:44.301558 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:44.272522 18589 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.302390 18547 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:44.303215 18547 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:44.303666 18547 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:44.303757 18242 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.002s
I20260709 13:04:44.280038 18665 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:44.305517 18242 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.306335 18665 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:44.306574 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.306792 18665 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:44.308075 18242 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.301352 15338 rpcz_store.cc:276] 0709 13:04:42.869012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.869205 (+   193us) service_pool.cc:224] Handling call
0709 13:04:42.869509 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.017547 (+148038us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:43.032626 (+ 15079us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.278212 (+245586us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.305011 (+ 26799us) log.cc:844] Serialized 14 byte log entry
0709 13:04:43.698806 (+393795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:43.698883 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:43.698948 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.297987 (+599039us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540016bf54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:44.298035 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.298338 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7378,"prepare.queue_time_us":55409,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":129,"raft.queue_time_us":271821,"raft.run_cpu_time_us":502,"raft.run_wall_time_us":12287,"spinlock_wait_cycles":339657600,"thread_start_us":620928,"threads_started":3,"wal-append.queue_time_us":154785}
I20260709 13:04:44.310312 15189 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:44.310593 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:44.311012 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1971) took 1260 ms. Trace:
I20260709 13:04:44.311394 15271 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:44.312366 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:44.268430 18585 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.300948 15266 rpcz_store.cc:276] 0709 13:04:41.909291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.366626 (+457335us) service_pool.cc:224] Handling call
0709 13:04:42.414735 (+ 48109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:42.576281 (+161546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.300251 (+1723970us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b54001b4c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:44.300448 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366118784}
I20260709 13:04:44.254038 18622 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.285928 18668 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.286217 18695 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.287436 18651 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:44.288151 18625 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.288409 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1969) took 1243 ms. Trace:
I20260709 13:04:44.302625 18555 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.328171 15188 rpcz_store.cc:276] 0709 13:04:43.044818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.287488 (+1242670us) service_pool.cc:224] Handling call
0709 13:04:44.287860 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.288052 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.288079 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.288123 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:44.288157 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.288217 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.288346 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.291219 15876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 269) took 1265 ms. Trace:
I20260709 13:04:44.329236 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:44.316840 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:44.333554 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.329550 15876 rpcz_store.cc:276] 0709 13:04:43.017393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.017944 (+   551us) service_pool.cc:224] Handling call
0709 13:04:44.256437 (+1238493us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b58001d6498. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:04:44.256676 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.282899 (+ 26223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.283167 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12016896}
I20260709 13:04:44.298458 15264 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
W20260709 13:04:44.253209 18449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.086s	user 0.010s	sys 0.016s
I20260709 13:04:44.341627 15343 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:44.342080 15345 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:44.342535 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1799) took 1755 ms. Trace:
I20260709 13:04:44.342971 15264 rpcz_store.cc:276] 0709 13:04:42.587022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.339177 (+1752155us) service_pool.cc:224] Handling call
0709 13:04:44.342055 (+  2878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.342224 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.342241 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.342271 (+    30us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:44.342291 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.342329 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.342461 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.314812 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1798) took 1728 ms. Trace:
I20260709 13:04:44.294644 15869 rpcz_store.cc:276] 0709 13:04:42.980684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.983468 (+  2784us) service_pool.cc:224] Handling call
0709 13:04:44.293834 (+1310366us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004858d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:44.294026 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559913728}
I20260709 13:04:44.311400 15189 rpcz_store.cc:276] 0709 13:04:43.050566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.309816 (+1259250us) service_pool.cc:224] Handling call
0709 13:04:44.310111 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.310767 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.310956 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.344753 15271 rpcz_store.cc:276] 0709 13:04:42.586778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.313356 (+1726578us) service_pool.cc:224] Handling call
0709 13:04:44.314147 (+   791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.314355 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.314388 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.314444 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:44.314474 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.314534 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.314727 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.322854 15267 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:44.324326 15270 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:44.341061 18449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.179s	user 0.010s	sys 0.016s
I20260709 13:04:44.351152 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1801) took 1012 ms. Trace:
I20260709 13:04:44.352628 15270 rpcz_store.cc:276] 0709 13:04:43.338933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.299099 (+960166us) service_pool.cc:224] Handling call
0709 13:04:44.350987 (+ 51888us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.353792 15267 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:44.349951 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1804) took 1679 ms. Trace:
I20260709 13:04:44.354678 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1808) took 1605 ms. Trace:
I20260709 13:04:44.355141 15267 rpcz_store.cc:276] 0709 13:04:42.749229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.350934 (+1601705us) service_pool.cc:224] Handling call
0709 13:04:44.351341 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.354363 (+  3022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.354618 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.354758 15264 rpcz_store.cc:276] 0709 13:04:42.670914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.348774 (+1677860us) service_pool.cc:224] Handling call
0709 13:04:44.349228 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.349470 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.349512 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.349579 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:44.349643 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.349724 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.349875 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.361793 15264 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:04:44.365233 18495 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.362898 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1811) took 1407 ms. Trace:
I20260709 13:04:44.368559 15264 rpcz_store.cc:276] 0709 13:04:42.955784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.360948 (+1405164us) service_pool.cc:224] Handling call
0709 13:04:44.361396 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:44.362501 (+  1105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.362822 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.370159 15264 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:44.370784 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1812) took 1337 ms. Trace:
I20260709 13:04:44.371170 15264 rpcz_store.cc:276] 0709 13:04:43.033674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.369636 (+1335962us) service_pool.cc:224] Handling call
0709 13:04:44.369975 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.370548 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.370722 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:44.373317 18665 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.375908 18647 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.376482 18665 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.377557 18622 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:44.395107 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 250503us
I20260709 13:04:44.341122 18555 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.411613 18555 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.403602 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:44.413893 18571 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:44.412482 18547 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.414499 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:44.359395 18511 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.434156 18511 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.435328 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:44.438476 15346 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:44.439577 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:44.414418 18571 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:44.442435 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:44.442960 18571 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:44.444098 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.445497 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.446126 15338 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:44.447402 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.447408 18581 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:44.448069 18581 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:44.448403 18581 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:44.448887 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:44.449549 15338 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:44.438138 18585 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:44.452447 18585 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:44.453652 18585 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.456552 18559 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.457073 18559 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:44.458985 18632 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.459760 18632 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:44.460682 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:44.461599 15869 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:44.463757 18632 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:44.439218 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:44.462785 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:44.465883 15874 raft_consensus.cc:2368] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15.
I20260709 13:04:44.462735 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1951) took 1495 ms. Trace:
I20260709 13:04:44.467621 18654 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:44.468116 18654 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:44.467857 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1956) took 1469 ms. Trace:
I20260709 13:04:44.468524 18654 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:44.474086 15337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1431) took 2526 ms (client timeout 1578 ms). Trace:
W20260709 13:04:44.474659 15337 rpcz_store.cc:269] 0709 13:04:41.947775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.951126 (+  3351us) service_pool.cc:224] Handling call
0709 13:04:44.473842 (+2522716us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b5400245254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:44.473977 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607596288}
I20260709 13:04:44.475864 18559 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.465828 15311 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:44.480080 15311 leader_election.cc:400] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15.
I20260709 13:04:44.411751 18668 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:44.481412 15311 leader_election.cc:403] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:44.484436 15081 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d785ccef0634edd9f0fbb52fa1c8d27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:44.484859 18511 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:44.494055 18511 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:44.494793 18511 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:44.483626 18668 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:04:45.511973 15126 debug-util.cc:398] Leaking SignalData structure 0x7b0800218a60 after lost signal to thread 14036
W20260709 13:04:45.512735 15126 debug-util.cc:398] Leaking SignalData structure 0x7b0800039d20 after lost signal to thread 14039
I20260709 13:04:45.716018 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1968) took 2671 ms. Trace:
I20260709 13:04:45.716560 15191 rpcz_store.cc:276] 0709 13:04:43.044540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.280898 (+1236358us) service_pool.cc:224] Handling call
0709 13:04:44.281526 (+   628us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:45.711595 (+1430069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.711627 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:45.712321 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 13:04:45.713390 (+  1069us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:45.713430 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.713499 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.715748 (+  2249us) raft_consensus.cc:1685] finished
0709 13:04:45.715772 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.715949 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1429604,"thread_start_us":679,"threads_started":1,"wal-append.queue_time_us":1034}
W20260709 13:04:45.746796 18585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.253s	user 0.003s	sys 0.014s
W20260709 13:04:45.747493 18585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.003s	sys 0.014s
W20260709 13:04:45.756942 15271 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.316s	user 0.004s	sys 0.012s
W20260709 13:04:45.757819 15271 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.005s	sys 0.013s
I20260709 13:04:45.759604 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1805) took 3088 ms. Trace:
I20260709 13:04:45.760025 15271 rpcz_store.cc:276] 0709 13:04:42.671344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.348925 (+1677581us) service_pool.cc:224] Handling call
0709 13:04:44.356737 (+  7812us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:44.357293 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.357335 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:44.358176 (+   841us) log.cc:844] Serialized 52 byte log entry
0709 13:04:44.440346 (+ 82170us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:45.758240 (+1317894us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.759271 (+  1031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.759350 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.759393 (+    43us) raft_consensus.cc:1685] finished
0709 13:04:45.759403 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.759531 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":70989,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":3169,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":1780,"thread_start_us":1347943,"threads_started":3,"wal-append.queue_time_us":89101,"wal-append.run_cpu_time_us":2098,"wal-append.run_wall_time_us":1003436}
I20260709 13:04:45.762844 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:45.763684 15271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1824) took 1351 ms (client timeout 1686 ms). Trace:
W20260709 13:04:45.764089 15271 rpcz_store.cc:269] 0709 13:04:44.412583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.762425 (+1349842us) service_pool.cc:224] Handling call
0709 13:04:45.763616 (+  1191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.765676 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:45.766284 15271 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:45.766800 15271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1828) took 1314 ms (client timeout 1690 ms). Trace:
W20260709 13:04:45.767051 18654 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.298s	user 0.011s	sys 0.006s
W20260709 13:04:45.767220 15271 rpcz_store.cc:269] 0709 13:04:44.452673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.765420 (+1312747us) service_pool.cc:224] Handling call
0709 13:04:45.766743 (+  1323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.767587 18654 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:45.768342 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:45.769464 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1829) took 1315 ms. Trace:
I20260709 13:04:45.769987 18654 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:45.770118 15271 rpcz_store.cc:276] 0709 13:04:44.453798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.768056 (+1314258us) service_pool.cc:224] Handling call
0709 13:04:45.769412 (+  1356us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.771173 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:45.771795 15271 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:45.772262 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 250) took 1395 ms. Trace:
I20260709 13:04:45.772671 15271 rpcz_store.cc:276] 0709 13:04:44.376769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.770917 (+1394148us) service_pool.cc:224] Handling call
0709 13:04:45.772211 (+  1294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.773444 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:45.774104 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1827) took 1328 ms. Trace:
I20260709 13:04:45.774405 15271 rpcz_store.cc:276] 0709 13:04:44.445376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.773251 (+1327875us) service_pool.cc:224] Handling call
0709 13:04:45.774028 (+   777us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.775269 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:45.775897 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1830) took 1320 ms. Trace:
I20260709 13:04:45.776144 15271 rpcz_store.cc:276] 0709 13:04:44.455068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.775009 (+1319941us) service_pool.cc:224] Handling call
0709 13:04:45.775861 (+   852us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.776927 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:45.778174 15341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1935) took 3578 ms (client timeout 2589 ms). Trace:
W20260709 13:04:45.778563 15341 rpcz_store.cc:269] 0709 13:04:42.199669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.201234 (+  1565us) service_pool.cc:224] Handling call
0709 13:04:45.777943 (+3576709us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b5400424854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:45.778101 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174838656}
I20260709 13:04:45.779805 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:45.780579 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1825) took 1336 ms. Trace:
I20260709 13:04:45.780844 15271 rpcz_store.cc:276] 0709 13:04:44.444679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.776719 (+1332040us) service_pool.cc:224] Handling call
0709 13:04:45.780529 (+  3810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.781594 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:45.782444 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 251) took 1319 ms. Trace:
I20260709 13:04:45.783041 15271 rpcz_store.cc:276] 0709 13:04:44.463159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.781366 (+1318207us) service_pool.cc:224] Handling call
0709 13:04:45.782393 (+  1027us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.783903 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:45.784400 15271 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:45.784839 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1826) took 1339 ms. Trace:
I20260709 13:04:45.785187 15271 rpcz_store.cc:276] 0709 13:04:44.445067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.783699 (+1338632us) service_pool.cc:224] Handling call
0709 13:04:45.784788 (+  1089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.786239 15271 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:45.786710 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 240) took 2327 ms. Trace:
I20260709 13:04:45.786953 15271 rpcz_store.cc:276] 0709 13:04:43.459140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.785819 (+2326679us) service_pool.cc:224] Handling call
0709 13:04:45.786073 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.786508 (+   435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.786675 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.788189 15271 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:45.788811 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 242) took 2326 ms. Trace:
I20260709 13:04:45.789162 15271 rpcz_store.cc:276] 0709 13:04:43.463796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.787755 (+2323959us) service_pool.cc:224] Handling call
0709 13:04:45.788034 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.788629 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.788778 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.790433 15271 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:45.790928 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1806) took 2313 ms. Trace:
I20260709 13:04:45.791242 15271 rpcz_store.cc:276] 0709 13:04:43.478086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.789834 (+2311748us) service_pool.cc:224] Handling call
0709 13:04:45.790142 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.790768 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.790895 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.792361 15271 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:45.793093 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 247) took 1976 ms. Trace:
I20260709 13:04:45.793432 15271 rpcz_store.cc:276] 0709 13:04:43.817156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.791851 (+1974695us) service_pool.cc:224] Handling call
0709 13:04:45.792095 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.792832 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.793036 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.794806 15271 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:45.795374 18590 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:45.795773 18590 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:45.795943 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1813) took 1887 ms. Trace:
I20260709 13:04:45.796487 15271 rpcz_store.cc:276] 0709 13:04:43.908660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.794323 (+1885663us) service_pool.cc:224] Handling call
0709 13:04:45.794612 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.795200 (+   588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.795846 (+   646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.796656 18590 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:45.798082 18590 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:44.468662 15196 rpcz_store.cc:276] 0709 13:04:42.998466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.223319 (+224853us) service_pool.cc:224] Handling call
0709 13:04:43.244178 (+ 20859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.244390 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.244412 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:43.249075 (+  4663us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.313631 (+ 64556us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:43.638350 (+324719us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.467522 (+829172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.467606 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:44.467649 (+    43us) raft_consensus.cc:1685] finished
0709 13:04:44.467661 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.467790 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":901506,"prepare.queue_time_us":184781,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":55,"thread_start_us":253806,"threads_started":2,"wal-append.queue_time_us":232723}
I20260709 13:04:45.798072 15271 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:45.807464 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1814) took 1898 ms. Trace:
I20260709 13:04:45.807904 15271 rpcz_store.cc:276] 0709 13:04:43.908958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.797497 (+1888539us) service_pool.cc:224] Handling call
0709 13:04:45.797889 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.806681 (+  8792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.807394 (+   713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.813375 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1816) took 1903 ms. Trace:
I20260709 13:04:45.814170 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1443) took 1679 ms. Trace:
I20260709 13:04:45.813766 15271 rpcz_store.cc:276] 0709 13:04:43.909514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.809505 (+1899991us) service_pool.cc:224] Handling call
0709 13:04:45.809912 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.810154 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:45.811045 (+   891us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.812591 (+  1546us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.813051 (+   460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.813097 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:45.813138 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.813196 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.813311 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1146,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":162,"raft.queue_time_us":187,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":198,"spinlock_wait_cycles":39808,"thread_start_us":1494,"threads_started":2,"wal-append.queue_time_us":1303}
I20260709 13:04:45.814604 15342 rpcz_store.cc:276] 0709 13:04:44.134478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.134882 (+   404us) service_pool.cc:224] Handling call
0709 13:04:44.135201 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.176836 (+ 41635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.813997 (+1637161us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b5400096fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:45.814126 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91598720}
I20260709 13:04:45.815984 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1817) took 1906 ms. Trace:
I20260709 13:04:45.816416 15271 rpcz_store.cc:276] 0709 13:04:43.909733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.815352 (+1905619us) service_pool.cc:224] Handling call
0709 13:04:45.815612 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.815732 (+   120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.815746 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:45.815771 (+    25us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:45.815798 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.815830 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.815934 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.817528 15271 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:45.818003 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1818) took 1908 ms. Trace:
I20260709 13:04:45.818270 15271 rpcz_store.cc:276] 0709 13:04:43.909950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.817045 (+1907095us) service_pool.cc:224] Handling call
0709 13:04:45.817260 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.817847 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.817968 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.819543 15271 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:45.820217 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1822) took 1909 ms. Trace:
I20260709 13:04:45.820604 15271 rpcz_store.cc:276] 0709 13:04:43.910935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.818907 (+1907972us) service_pool.cc:224] Handling call
0709 13:04:45.819230 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.819931 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.820157 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:45.821607 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1809) took 3021 ms. Trace:
I20260709 13:04:45.822013 15270 rpcz_store.cc:276] 0709 13:04:42.800498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.356131 (+1555633us) service_pool.cc:224] Handling call
0709 13:04:44.428985 (+ 72854us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.429332 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.429375 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.440439 (+ 11064us) log.cc:844] Serialized 26 byte log entry
0709 13:04:45.819240 (+1378801us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:45.819281 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.819360 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.821389 (+  2029us) raft_consensus.cc:1685] finished
0709 13:04:45.821408 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.821553 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":548,"threads_started":1,"wal-append.queue_time_us":1378459}
I20260709 13:04:45.835768 18547 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:45.889544 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:45.890130 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.892664 18547 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.893347 18547 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:45.896214 18547 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:45.917196 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.918185 18654 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:45.918768 18654 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:45.921025 18654 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:45.921139 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1446) took 1785 ms (client timeout 1654 ms). Trace:
W20260709 13:04:45.921609 15340 rpcz_store.cc:269] 0709 13:04:44.135332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.135566 (+   234us) service_pool.cc:224] Handling call
0709 13:04:45.920876 (+1785310us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400245c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:45.921057 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684712704}
I20260709 13:04:45.929677 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 218) took 2912 ms. Trace:
I20260709 13:04:45.933069 18448 raft_consensus.cc:993] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:04:45.930169 15195 rpcz_store.cc:276] 0709 13:04:43.017703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.886610 (+868907us) service_pool.cc:224] Handling call
0709 13:04:43.886937 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.153910 (+266973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.153953 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.154006 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:44.154063 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.929413 (+1775350us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54001a4d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:45.929463 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.929611 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":613503872}
W20260709 13:04:45.936324 18511 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.441s	user 0.009s	sys 0.004s
I20260709 13:04:44.466290 15192 rpcz_store.cc:276] 0709 13:04:42.967824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.967970 (+   146us) service_pool.cc:224] Handling call
0709 13:04:42.968401 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:42.993611 (+ 25210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.993665 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:42.996953 (+  3288us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.222106 (+225153us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:43.455283 (+233177us) log.cc:844] Serialized 14 byte log entry
0709 13:04:44.462104 (+1006821us) spinlock_profiling.cc:243] Waited 874 us on lock 0x7b18002fd760. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:04:44.462314 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.462390 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:44.462437 (+    47us) raft_consensus.cc:1685] finished
0709 13:04:44.462548 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:44.462678 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10156,"prepare.queue_time_us":240886,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1164758,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":2504,"spinlock_wait_cycles":2009984,"thread_start_us":395309,"threads_started":2,"wal-append.queue_time_us":457339}
I20260709 13:04:45.955178 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:45.960492 18473 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:45.963771 15094 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 168) took 27831 ms (client timeout 15000 ms). Trace:
W20260709 13:04:45.964347 15094 rpcz_store.cc:269] 0709 13:04:18.119795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.120221 (+   426us) service_pool.cc:224] Handling call
0709 13:04:19.137196 (+1016975us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5677090 00007f36e5715f3a 00007f36eb4cc1cc 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc 00007f36e9a8a392 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:45.950991 (+26813795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:38.928490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:38.930399 (+  1909us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:38.930466 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:04:38.930489 (+    23us) tablet.cc:662] Decoding operations
0709 13:04:38.964301 (+ 33812us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:38.964390 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:38.964422 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:04:39.108958 (+144536us) tablet.cc:701] Row locks acquired
0709 13:04:39.122477 (+ 13519us) write_op.cc:260] PREPARE: finished
0709 13:04:39.162519 (+ 40042us) write_op.cc:270] Start()
0709 13:04:39.204915 (+ 42396us) write_op.cc:276] Timestamp: P: 1783602279148992 usec, L: 0
0709 13:04:39.207994 (+  3079us) op_driver.cc:348] REPLICATION: starting
0709 13:04:39.293976 (+ 85982us) log.cc:844] Serialized 5977 byte log entry
0709 13:04:39.736829 (+442853us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b
0709 13:04:40.210972 (+474143us) op_driver.cc:464] REPLICATION: finished
0709 13:04:40.324617 (+113645us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e9143ef0
0709 13:04:40.618708 (+294091us) write_op.cc:301] APPLY: starting
0709 13:04:40.638700 (+ 19992us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:40.729402 (+ 90702us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:40.729467 (+    65us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:41.059015 (+329548us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:41.059440 (+   425us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:04:41.059488 (+    48us) write_op.cc:312] APPLY: finished
0709 13:04:41.059955 (+   467us) log.cc:844] Serialized 106 byte log entry
0709 13:04:41.060167 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.060354 (+   187us) write_op.cc:454] Released schema lock
0709 13:04:41.060427 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:41.060836 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:41.060869 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":133361,"reported_tablets":56,"spinlock_wait_cycles":1016090752,"child_traces":[["op",{"apply.queue_time_us":339529,"apply.run_cpu_time_us":16678,"apply.run_wall_time_us":467005,"num_ops":15,"prepare.queue_time_us":164724,"prepare.run_cpu_time_us":38734,"prepare.run_wall_time_us":988326,"raft.queue_time_us":101229,"raft.run_cpu_time_us":13038,"raft.run_wall_time_us":234780,"replication_time_us":969898,"spinlock_wait_cycles":35361408,"thread_start_us":872655,"threads_started":4,"wal-append.queue_time_us":604894,"wal-append.run_cpu_time_us":14721,"wal-append.run_wall_time_us":2146688}]]}
I20260709 13:04:45.971347 18511 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:45.977955 18511 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:45.975755 18623 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:45.983021 18623 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:45.984171 18623 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:45.985257 18623 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:45.973378 18581 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.524s	user 0.018s	sys 0.006s
I20260709 13:04:45.989995 18581 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:45.992136 18564 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:45.997432 18564 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:45.998163 18581 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:46.000502 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.000985 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.001370 18511 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:46.002105 18511 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.003283 18590 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.003382 18656 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.004101 18590 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.004575 18656 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.008680 18550 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:46.009375 18550 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.011914 18656 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:46.011915 18511 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:45.994829 15268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1793) took 4088 ms (client timeout 2043 ms). Trace:
W20260709 13:04:46.016139 15268 rpcz_store.cc:269] 0709 13:04:41.906615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.934281 (+ 27666us) service_pool.cc:224] Handling call
0709 13:04:45.994475 (+4060194us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400328cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:45.994669 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657679616}
I20260709 13:04:45.998544 18564 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.018079 18564 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.022774 18577 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.023562 18597 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.027236 18597 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.028717 18590 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:46.029989 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.032739 18550 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:46.039269 18668 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.533s	user 0.012s	sys 0.008s
W20260709 13:04:46.042344 15266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.609s	user 0.004s	sys 0.004s
I20260709 13:04:46.042764 18668 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15.
I20260709 13:04:46.035249 18644 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:46.039436 18445 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:46.047302 15266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.614s	user 0.006s	sys 0.006s
I20260709 13:04:46.048822 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1807) took 3305 ms. Trace:
I20260709 13:04:46.045707 18644 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.054347 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1450) took 1917 ms. Trace:
I20260709 13:04:46.054796 15345 rpcz_store.cc:276] 0709 13:04:44.137234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.252351 (+115117us) service_pool.cc:224] Handling call
0709 13:04:44.265628 (+ 13277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.342557 (+ 76929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.054104 (+1711547us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b540016d354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:46.054281 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175401856}
I20260709 13:04:46.056020 18644 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.049201 15266 rpcz_store.cc:276] 0709 13:04:42.743504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.349065 (+1605561us) service_pool.cc:224] Handling call
0709 13:04:44.379717 (+ 30652us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.380207 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.380250 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.433288 (+ 53038us) log.cc:844] Serialized 26 byte log entry
0709 13:04:46.048470 (+1615182us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:46.048512 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.048582 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.048621 (+    39us) raft_consensus.cc:1685] finished
0709 13:04:46.048631 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.048766 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5599,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3574,"thread_start_us":1614689,"threads_started":1,"wal-append.queue_time_us":77213,"wal-append.run_cpu_time_us":2109,"wal-append.run_wall_time_us":1003006}
I20260709 13:04:44.466598 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:46.058557 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 1.59195e+06us
I20260709 13:04:46.058686 18581 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:46.059232 18581 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.059636 18581 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:46.062114 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.063431 18376 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.065604 18438 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:46.066145 18585 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:46.068755 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:46.068866 18581 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.069679 18654 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:46.070111 18654 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.070047 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:46.070608 18654 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.073468 18639 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:46.073951 18639 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.074420 18639 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:46.076891 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.077561 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.077850 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.078313 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.078575 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.073937 18581 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.083452 18511 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.084067 18511 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.084992 18639 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.086968 18668 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.087596 18639 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.087495 18668 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.089560 18668 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.092213 18511 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.092912 15192 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:46.093820 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.095227 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1965) took 3090 ms. Trace:
I20260709 13:04:46.095139 15196 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.095729 15194 rpcz_store.cc:276] 0709 13:04:43.004989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.847742 (+842753us) service_pool.cc:224] Handling call
0709 13:04:43.848074 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.848273 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:43.848583 (+   310us) log.cc:844] Serialized 14 byte log entry
0709 13:04:46.094199 (+2245616us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:46.094253 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:46.094291 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.094351 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.095148 (+   797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1963612,"prepare.queue_time_us":48761,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":9446,"thread_start_us":281586,"threads_started":1,"wal-append.queue_time_us":280257,"wal-append.run_cpu_time_us":1168,"wal-append.run_wall_time_us":1001185}
I20260709 13:04:46.098121 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.100939 15192 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:46.101647 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.101835 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.102324 15189 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.104243 15192 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:46.104321 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.104996 15196 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.105871 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.106705 15192 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.108299 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.109395 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.109918 15188 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:46.110232 15189 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:46.110687 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.111110 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.111361 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.111466 15188 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:46.111747 15189 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.112538 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.113313 15188 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:46.114224 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.115525 15188 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.121528 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.123617 15266 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:46.124773 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.125402 18559 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.126911 18559 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:46.127965 18559 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.128178 18617 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.129086 18559 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.126703 15189 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:46.116236 18654 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.130630 18559 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:46.132226 18668 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:46.132571 18654 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.133096 18668 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:46.133363 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58398 (request call id 211) took 2341 ms. Trace:
I20260709 13:04:46.133499 18668 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.133886 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.134610 15189 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:46.135931 15344 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:46.136345 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.134399 18668 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.137447 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.137964 18668 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:46.138392 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:46.138583 15344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 1946) took 3302 ms (client timeout 2065 ms). Trace:
I20260709 13:04:46.139518 18550 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.143100 18656 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:46.144099 18623 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:46.144470 18623 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.138001 15189 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:46.145316 18623 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.133852 15868 rpcz_store.cc:276] 0709 13:04:43.792083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.822118 (+ 30035us) service_pool.cc:224] Handling call
0709 13:04:43.858200 (+ 36082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.257630 (+399430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.133125 (+1875495us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54005479d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:46.133290 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841524096}
I20260709 13:04:46.147580 18473 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.148608 18473 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.148072 15270 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:04:46.114748 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44781.2us
I20260709 13:04:46.125450 15266 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:46.152510 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:46.152801 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.153275 15876 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:46.154182 15189 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
W20260709 13:04:46.156497 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72195.8us
I20260709 13:04:46.158289 15095 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 61) took 8054 ms. Trace:
I20260709 13:04:46.112509 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:46.139024 15344 rpcz_store.cc:269] 0709 13:04:42.836624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.836823 (+   199us) service_pool.cc:224] Handling call
0709 13:04:46.138416 (+3301593us) spinlock_profiling.cc:243] Waited 3.29 s on lock 0x7b540005a354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:46.138518 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7570050304}
I20260709 13:04:46.159332 15192 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:46.159948 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.161971 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.163154 15196 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:46.168031 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.168673 15189 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:46.169688 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.169432 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.170531 18473 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.171144 18473 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:46.171242 18639 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:46.171597 18473 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:46.172000 18639 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.172700 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.174062 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.174635 15266 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:46.177242 18590 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:46.177752 18590 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.177845 18654 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.178268 18590 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.178435 18654 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.178750 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.180081 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.180591 15269 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:46.180893 18571 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.726s	user 0.015s	sys 0.004s
I20260709 13:04:46.180835 18654 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.181452 18571 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.181946 18654 raft_consensus.cc:476] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 13:04:46.182466 15268 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:46.167569 18663 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.183559 18663 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.174639 18639 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.185689 18663 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.186585 18622 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:46.187067 18622 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:46.187492 18622 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.187919 18663 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:46.189314 18663 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:46.172068 18473 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.189714 18663 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:46.190907 18663 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.192250 18663 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.195811 18571 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.197295 18625 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:46.197932 18625 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.198905 18625 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.205144 15269 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:04:46.197021 18640 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.205175 15266 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:46.196858 18723 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.211645 18640 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.212097 18723 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.212579 15189 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:46.211689 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.214203 15269 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 7: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:46.158682 15095 rpcz_store.cc:276] 0709 13:04:38.103782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.104013 (+   231us) service_pool.cc:224] Handling call
0709 13:04:46.158228 (+8054215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:42.804793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:43.002207 (+197414us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:43.007054 (+  4847us) write_op.cc:435] Acquired schema lock
0709 13:04:43.012298 (+  5244us) tablet.cc:662] Decoding operations
0709 13:04:43.233873 (+221575us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:43.233941 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:43.233971 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:04:43.234621 (+   650us) tablet.cc:701] Row locks acquired
0709 13:04:43.234643 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:04:43.234816 (+   173us) write_op.cc:270] Start()
0709 13:04:43.234948 (+   132us) write_op.cc:276] Timestamp: P: 1783602283234759 usec, L: 0
0709 13:04:43.234973 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:04:43.235731 (+   758us) log.cc:844] Serialized 2115 byte log entry
0709 13:04:44.233778 (+998047us) op_driver.cc:464] REPLICATION: finished
0709 13:04:44.367820 (+134042us) write_op.cc:301] APPLY: starting
0709 13:04:44.367936 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:44.368157 (+   221us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:44.368357 (+   200us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:44.369195 (+   838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:44.369507 (+   312us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:04:44.369613 (+   106us) write_op.cc:312] APPLY: finished
0709 13:04:44.369967 (+   354us) log.cc:844] Serialized 46 byte log entry
0709 13:04:44.370209 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:44.370376 (+   167us) write_op.cc:454] Released schema lock
0709 13:04:44.370456 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:44.370899 (+   443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:44.370936 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1628490,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":133719,"apply.run_cpu_time_us":3036,"apply.run_wall_time_us":3043,"num_ops":5,"prepare.queue_time_us":341858,"prepare.run_cpu_time_us":17362,"prepare.run_wall_time_us":589913,"raft.queue_time_us":343161,"raft.run_cpu_time_us":22011,"raft.run_wall_time_us":91783,"replication_time_us":998662,"thread_start_us":563915,"threads_started":4,"wal-append.queue_time_us":230629,"wal-append.run_cpu_time_us":53613,"wal-append.run_wall_time_us":2247918}]]}
I20260709 13:04:46.217836 18571 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.218377 18571 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.202653 18473 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.219398 18723 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.221020 18473 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.221499 18573 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.224722 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.225721 15269 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:46.223057 18571 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.231338 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1799) took 2906 ms. Trace:
I20260709 13:04:46.231993 15264 rpcz_store.cc:276] 0709 13:04:43.324515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.371971 (+1047456us) service_pool.cc:224] Handling call
0709 13:04:44.372279 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.372922 (+   643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.372951 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.373380 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:04:44.436824 (+ 63444us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:44.436861 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.436927 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.230944 (+1794017us) raft_consensus.cc:1685] finished
0709 13:04:46.230974 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.231245 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":63123,"threads_started":1,"wal-append.queue_time_us":121885,"wal-append.run_cpu_time_us":2245,"wal-append.run_wall_time_us":1003053}
W20260709 13:04:46.236413 15126 debug-util.cc:398] Leaking SignalData structure 0x7b080003a020 after lost signal to thread 15129
I20260709 13:04:46.237548 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.239995 15264 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.240871 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.242446 15266 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.242762 15188 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:04:46.246312 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75835.9us
I20260709 13:04:46.255716 18622 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.258108 18622 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:46.258744 15265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1797) took 3374 ms (client timeout 1990 ms). Trace:
I20260709 13:04:46.259804 15266 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:46.264245 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1831) took 1807 ms. Trace:
I20260709 13:04:46.264748 15271 rpcz_store.cc:276] 0709 13:04:44.456445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.821412 (+1364967us) service_pool.cc:224] Handling call
0709 13:04:46.261923 (+440511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.262347 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:46.262380 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:46.262427 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:46.262467 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.262538 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.264045 (+  1507us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54001d9cd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:46.264178 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":192,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":119,"spinlock_wait_cycles":1012265856}
W20260709 13:04:46.259480 15265 rpcz_store.cc:269] 0709 13:04:42.884408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.979867 (+ 95459us) service_pool.cc:224] Handling call
0709 13:04:46.258554 (+3278687us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001d9cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:46.258674 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2601972608}
W20260709 13:04:46.281497 18627 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 3.419s	user 0.006s	sys 0.009s
I20260709 13:04:46.283543 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1786) took 4456 ms. Trace:
I20260709 13:04:46.284071 15267 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:46.284966 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1810) took 3329 ms. Trace:
I20260709 13:04:46.285405 15267 rpcz_store.cc:276] 0709 13:04:42.955465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.361105 (+1405640us) service_pool.cc:224] Handling call
0709 13:04:46.283705 (+1922600us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:04:46.283901 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.284732 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.284911 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33957632}
I20260709 13:04:46.283972 15272 rpcz_store.cc:276] 0709 13:04:41.827496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.867673 (+ 40177us) service_pool.cc:224] Handling call
0709 13:04:41.891649 (+ 23976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:41.903822 (+ 12173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.903854 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:41.962833 (+ 58979us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b180041ed80. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a
0709 13:04:41.983963 (+ 21130us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:04:42.093044 (+109081us) log.cc:844] Serialized 26 byte log entry
0709 13:04:42.508524 (+415480us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:42.508588 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.508676 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.280989 (+3772313us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:46.283303 (+  2314us) raft_consensus.cc:1685] finished
0709 13:04:46.283327 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.283462 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23972,"raft.queue_time_us":12677,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":5371,"spinlock_wait_cycles":22753280,"thread_start_us":358456,"threads_started":1,"wal-append.queue_time_us":629538}
I20260709 13:04:46.287979 15264 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:46.296815 18590 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.299883 18550 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:46.300760 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.300693 18638 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.320734 18638 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.316457 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 1970) took 3271 ms. Trace:
I20260709 13:04:46.323962 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.324266 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.324821 15264 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:46.325064 15272 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:46.325742 15267 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:46.325994 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.326352 18638 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.326730 15265 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
I20260709 13:04:46.327637 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.323410 15197 rpcz_store.cc:276] 0709 13:04:43.050212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.307996 (+1257784us) service_pool.cc:224] Handling call
0709 13:04:44.308365 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.308579 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:44.308909 (+   330us) log.cc:844] Serialized 14 byte log entry
0709 13:04:46.316063 (+2007154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:46.316123 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:46.316179 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.316246 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.316384 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1917175,"prepare.queue_time_us":237,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":2432,"thread_start_us":89530,"threads_started":1,"wal-append.queue_time_us":154348,"wal-append.run_cpu_time_us":1145,"wal-append.run_wall_time_us":1001183}
I20260709 13:04:46.331480 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.333455 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:46.334048 15874 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:46.336969 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:46.340052 15868 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:46.341095 18583 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.344269 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:46.341646 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.345228 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.345023 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.345917 15265 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:46.342834 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.343169 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:46.346033 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.346899 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.347994 18114 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.348745 18114 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.351922 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.349287 18640 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.352908 15271 raft_consensus.cc:2410] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:46.353659 18114 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:46.342033 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.354185 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:04:46.354880 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.355655 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.356313 15272 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:04:46.355046 15874 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
I20260709 13:04:46.357524 18583 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:46.358002 15238 connection.cc:256] RPC call timeout handler was delayed by -1.5347689239998772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 13:04:46.358439 15238 connection.cc:256] RPC call timeout handler was delayed by -1.481668923999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:04:46.358714 15238 connection.cc:256] RPC call timeout handler was delayed by -1.4132689239999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 13:04:46.359612 18585 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:46.359760 18570 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.360217 18585 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.360383 18570 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.360934 18656 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.361508 18656 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.362987 18570 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.363214 18649 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:46.363653 18656 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.363794 18649 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.364277 15267 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:46.363613 18570 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.364674 18502 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.365819 18649 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.366330 18649 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:46.367486 15126 debug-util.cc:398] Leaking SignalData structure 0x7b0800034b20 after lost signal to thread 15221
I20260709 13:04:46.367478 18569 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:46.367998 15126 debug-util.cc:398] Leaking SignalData structure 0x7b0800034b40 after lost signal to thread 15222
I20260709 13:04:46.368155 18569 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.369431 18583 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.370252 18569 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:46.358716 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.365335 18502 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.372921 18448 raft_consensus.cc:1081] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
W20260709 13:04:46.358999 15238 connection.cc:256] RPC call timeout handler was delayed by -1.3457689239999127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 13:04:46.373950 15238 connection.cc:256] RPC call timeout handler was delayed by -1.2413689239999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:04:46.374224 15238 connection.cc:256] RPC call timeout handler was delayed by -1.1567689239999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19390000000000002s for a response
W20260709 13:04:46.374488 15238 connection.cc:256] RPC call timeout handler was delayed by -1.1009689239999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 13:04:46.375370 15238 connection.cc:256] RPC call timeout handler was delayed by -1.0901689239999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 13:04:46.375653 15238 connection.cc:256] RPC call timeout handler was delayed by -1.0856689239999469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 13:04:46.375927 15238 connection.cc:256] RPC call timeout handler was delayed by -1.064299764999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
I20260709 13:04:46.374904 18585 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:46.365304 18570 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.377569 18623 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:46.378628 18570 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.379290 18626 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.379798 18626 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.381801 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1442) took 2247 ms. Trace:
I20260709 13:04:46.386291 18653 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.388543 18573 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.389130 18573 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.391650 18573 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:46.392333 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1796) took 4420 ms. Trace:
I20260709 13:04:46.392469 18583 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.392774 15263 rpcz_store.cc:276] 0709 13:04:41.972292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.221978 (+1249686us) service_pool.cc:224] Handling call
0709 13:04:43.244791 (+ 22813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.149875 (+905084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.392050 (+2242175us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400011654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:46.392233 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2064453888}
I20260709 13:04:46.393087 18583 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.392813 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.366783 18649 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.425711 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:46.426479 15870 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:46.426826 15873 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:46.373080 18502 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.427388 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:46.428444 15868 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:46.428615 18658 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.429129 18658 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.425675 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:46.431190 15238 connection.cc:256] RPC call timeout handler was delayed by -1.0298689239999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 13:04:46.431614 15238 connection.cc:256] RPC call timeout handler was delayed by -1.014799764999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 13:04:46.431964 15238 connection.cc:256] RPC call timeout handler was delayed by -1.0111997649999012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 13:04:46.395365 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.395617 15874 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:46.397758 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.394924 18622 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:46.433097 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.433490 18622 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.433662 15193 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.434031 18622 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:46.398665 15160 connection.cc:256] RPC call timeout handler was delayed by -1.9334270780000224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2524s for a response
W20260709 13:04:46.434774 15160 connection.cc:256] RPC call timeout handler was delayed by -1.487721990999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260709 13:04:46.435164 15160 connection.cc:256] RPC call timeout handler was delayed by -1.3160990730000321s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:04:46.435456 15160 connection.cc:256] RPC call timeout handler was delayed by -1.2602990730000556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 13:04:46.394670 15126 debug-util.cc:398] Leaking SignalData structure 0x7b080033f5e0 after lost signal to thread 15296
W20260709 13:04:46.436591 15126 debug-util.cc:398] Leaking SignalData structure 0x7b080024d720 after lost signal to thread 15297
W20260709 13:04:46.402014 15309 connection.cc:256] RPC call timeout handler was delayed by -1.0181305919999204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:04:46.396436 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.408025 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.408332 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.381821 18626 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.410637 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.412973 18656 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.414043 15345 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:04:46.413671 15344 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.415370 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.415529 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.415815 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.414927 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.417183 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.417490 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.418442 18559 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.382400 15343 rpcz_store.cc:276] 0709 13:04:44.134193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.134341 (+   148us) service_pool.cc:224] Handling call
0709 13:04:44.134672 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.342097 (+207425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.381511 (+2039414us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000965d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:46.381688 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475398528}
I20260709 13:04:46.422906 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:46.423182 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:46.424960 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.452127 15341 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:46.453150 15339 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:04:46.453636 15339 pending_rounds.cc:85] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 6
I20260709 13:04:46.453409 15194 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:46.453896 15339 pending_rounds.cc:107] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:04:46.399466 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.434026 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.454557 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.455123 15188 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.455489 15194 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:46.455963 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.456401 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.456686 18625 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:46.453258 15342 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:46.457187 18625 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.454806 18691 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:04:46.454762 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.458211 18507 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:46.458314 18691 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:46.457687 18625 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.457194 18638 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:04:46.460080 18691 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:46.460520 18691 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:46.461587 18559 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.461583 18691 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.457041 15345 pending_rounds.cc:85] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 4
I20260709 13:04:46.463306 15196 raft_consensus.cc:2376] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10. Re-sending same reply.
I20260709 13:04:46.463816 15345 pending_rounds.cc:107] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:04:46.464148 15345 raft_consensus.cc:2889] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:46.464540 15189 raft_consensus.cc:2376] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9. Re-sending same reply.
I20260709 13:04:46.464102 18559 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.438786 18658 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:46.449707 18649 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.467242 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.465883 18656 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:46.450181 18511 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:46.431917 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.473650 18625 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.474550 15197 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.474915 18691 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:46.457027 15194 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.475555 18511 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.515419 18511 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:46.517486 18625 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:46.521255 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.475960 18656 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:46.464718 15339 raft_consensus.cc:2889] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:46.522110 15269 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:46.523118 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:46.524466 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.477201 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.477377 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.525918 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.525996 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.526707 15192 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.526762 15196 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:46.527786 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.527930 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.528299 15192 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.529145 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.529678 15194 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:04:46.529768 15196 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:46.530083 15269 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:46.530604 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.478479 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:46.530927 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72206.5us
W20260709 13:04:46.421514 15162 connection.cc:256] RPC call timeout handler was delayed by -3.048321986000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 13:04:46.531903 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:46.532469 15162 connection.cc:256] RPC call timeout handler was delayed by -3.0375219860000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15380000000000002s for a response
W20260709 13:04:46.532821 15162 connection.cc:256] RPC call timeout handler was delayed by -2.9574219859999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:04:46.478524 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.480026 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.533049 15343 raft_consensus.cc:2410] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:04:46.534196 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.534379 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.535014 15343 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:46.535225 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:46.534196 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.536460 15189 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:46.530802 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.537185 15196 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:46.537312 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.538101 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.538445 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.538666 15192 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:04:46.539291 15189 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.539602 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.540134 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.480940 15188 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:46.540735 15189 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:46.541189 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.542203 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.543191 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.543645 15188 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.538816 15196 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:46.408684 18583 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.482483 18622 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.483170 18638 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.486565 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:46.487231 18626 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.487432 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.487804 18559 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.488474 18649 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.488787 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.545997 15338 raft_consensus.cc:2410] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:04:46.545969 18649 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.546635 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.546973 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:46.547478 15342 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:46.547523 18622 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.489429 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:46.490096 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.535866 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:46.548295 15267 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.548333 18649 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:46.490811 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.492079 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.549826 15265 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:46.549346 15271 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:46.549331 18559 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.545635 18626 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:46.552024 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 234213us
I20260709 13:04:46.493995 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.494743 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.495105 15340 raft_consensus.cc:2410] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:46.555200 15343 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.556120 18559 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.495529 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.557976 15267 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:46.558089 15266 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:46.495930 15337 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:46.496532 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:46.559835 15341 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:46.561424 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:46.562489 15869 raft_consensus.cc:2410] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:04:46.437796 15126 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3b20 after lost signal to thread 15370
W20260709 13:04:46.533089 15162 connection.cc:256] RPC call timeout handler was delayed by -2.9331219859999464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260709 13:04:46.563305 15162 connection.cc:256] RPC call timeout handler was delayed by -2.8845219859999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 13:04:46.433451 18550 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:46.545270 18638 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.547797 15338 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:04:46.564028 15126 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0d40 after lost signal to thread 15371
I20260709 13:04:46.489122 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.564884 15263 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:46.360105 18590 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.540400 15192 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.565621 18638 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.491427 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.566315 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.554663 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:46.567198 15192 raft_consensus.cc:2368] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
W20260709 13:04:46.563673 15162 connection.cc:256] RPC call timeout handler was delayed by -2.8251219859999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 13:04:46.567862 15162 connection.cc:256] RPC call timeout handler was delayed by -2.6964219860000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 13:04:46.568122 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.548542 15272 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:46.566427 15270 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:46.555158 15264 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:46.571575 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 65243.5us
W20260709 13:04:46.568269 15162 connection.cc:256] RPC call timeout handler was delayed by -2.6964219860000185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
I20260709 13:04:46.572765 15311 leader_election.cc:400] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
W20260709 13:04:46.572908 15162 connection.cc:256] RPC call timeout handler was delayed by -2.6793219859999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 13:04:46.573809 15162 connection.cc:256] RPC call timeout handler was delayed by -2.3444708309999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:04:46.574170 15162 connection.cc:256] RPC call timeout handler was delayed by -2.2617219859999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24s for a response
W20260709 13:04:46.574563 15162 connection.cc:256] RPC call timeout handler was delayed by -2.1546219859999383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2519s for a response
W20260709 13:04:46.574947 15162 connection.cc:256] RPC call timeout handler was delayed by -2.150121985999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2524s for a response
W20260709 13:04:46.575331 15162 connection.cc:256] RPC call timeout handler was delayed by -2.1347708309999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:04:46.575716 15162 connection.cc:256] RPC call timeout handler was delayed by -2.09162198599995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2589s for a response
W20260709 13:04:46.576077 15162 connection.cc:256] RPC call timeout handler was delayed by -1.9727708309999343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
W20260709 13:04:46.576442 15162 connection.cc:256] RPC call timeout handler was delayed by -1.8296708309999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22240000000000004s for a response
W20260709 13:04:46.576817 15162 connection.cc:256] RPC call timeout handler was delayed by -1.3914219859999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3367s for a response
W20260709 13:04:46.577502 15162 connection.cc:256] RPC call timeout handler was delayed by -1.3914219859999548s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3367s for a response
I20260709 13:04:46.577641 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.578347 15264 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:46.578179 18623 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:46.579275 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47605.5us
I20260709 13:04:46.578985 18626 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:46.580552 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 94080.5us
I20260709 13:04:46.581413 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.581468 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:46.582186 15264 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
W20260709 13:04:46.582350 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.582644 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.583824 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:46.565274 15126 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1bc0 after lost signal to thread 15900
I20260709 13:04:46.585973 15193 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:46.587165 15197 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:46.588766 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.591459 15193 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.592602 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:46.568848 15192 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.544951 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.595989 15196 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.599304 15188 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:46.580492 18622 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:46.600915 18622 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.601279 18622 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.597148 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.600553 18691 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:46.597815 15311 leader_election.cc:403] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:04:46.604169 15264 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 11. Current term is 12. Ops: [8.7-11.8]
W20260709 13:04:46.606487 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.605710 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.606346 18550 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.603411 18606 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:04:46.608763 15091 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 6, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.609102 18550 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.609938 18606 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:46.610332 18606 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:46.610477 15091 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 10, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 10 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.611186 18606 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.611825 18691 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.612337 18691 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.592028 18564 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:46.606487 18578 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:04:46.607963 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.619799 15343 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:46.620311 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:46.619155 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.607587 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.621343 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.621922 15194 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:46.623202 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.622071 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.623858 15197 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:46.622519 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.625411 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.625645 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.626057 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.626758 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.629169 15193 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.629102 15189 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:04:46.634858 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.628042 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:46.629896 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.637853 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.624648 18658 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:04:46.624752 18649 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:04:46.643203 18649 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:46.643589 18649 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:46.644465 18649 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.645455 18438 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:46.646232 18573 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:46.646505 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.647440 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.647513 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.648659 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.648988 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.625207 15091 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.644913 18738 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:46.638957 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.645780 18649 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.652638 15190 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.665386 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:46.666294 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 93758.3us
I20260709 13:04:46.666527 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.666993 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.653018 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.654445 18570 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:46.663883 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.674197 15192 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:46.652467 15196 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
W20260709 13:04:46.655386 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 74047.2us
I20260709 13:04:46.676162 15091 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.676918 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:46.676844 15196 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 13:04:46.678561 15196 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:46.655405 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.668339 15189 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.667739 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.660907 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.682040 15189 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:46.682551 15188 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:04:46.683120 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.683319 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.683607 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.684213 15188 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:46.684429 15189 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:46.684717 15197 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:46.685273 15188 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:46.685693 15189 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:46.686509 18495 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.671833 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:46.654074 18738 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.687484 15189 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:46.689054 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.685998 15197 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:46.688869 15091 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 9, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 9 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.666476 18590 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:46.690236 18738 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:46.673669 18570 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:46.691294 15190 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.693775 15188 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:46.689399 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:04:46.668267 18638 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:46.667986 18507 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.696393 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.675354 18668 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.673489 18623 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:46.695441 18114 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:04:46.697758 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.690488 18376 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:04:46.698958 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43681.8us
I20260709 13:04:46.707635 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.709779 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.710933 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.705365 18559 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:46.701767 18438 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:46.714159 15189 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:46.714076 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.700552 15193 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:04:46.653949 18653 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:04:46.675853 18473 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:46.675583 18564 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:46.663525 18585 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:04:46.703372 15091 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 5, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 5 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.698565 18502 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:46.673518 18606 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:46.675730 18737 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:46.706480 18673 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:46.718443 15876 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:46.704841 18590 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.716470 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.715694 15192 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:46.715831 18449 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:46.706243 18638 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.728044 15091 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 8, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.712007 18625 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:46.713646 18578 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:46.714818 18438 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.744351 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.722673 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.745508 15091 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.748044 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.748978 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.749603 15196 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:46.750155 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.750084 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.751135 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.729598 18559 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.749089 15190 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:46.754271 18559 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.730559 18473 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:46.731225 18622 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.752601 18511 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:46.742686 18740 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:04:46.730044 18631 raft_consensus.cc:2764] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:46.723902 18502 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.770381 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.777232 15190 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:46.768040 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.769245 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.778328 15197 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.766889 15091 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.750000 18438 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:46.752456 18564 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:46.780920 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.782191 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.711926 18507 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.763386 18550 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:04:46.787567 18744 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:46.788069 18744 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.788455 18744 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:46.789681 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.791532 15345 raft_consensus.cc:2368] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8.
I20260709 13:04:46.767407 18473 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.784638 15162 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.734145 18737 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.784075 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.786787 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.797263 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.784997 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.802891 15188 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.781594 18502 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.783596 18564 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:46.795710 18735 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 13:04:46.769454 18623 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.808144 15091 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:46.813383 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.810082 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:04:46.790680 18449 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:46.812243 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.799238 18473 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.816284 15188 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:46.815078 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:46.810034 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:46.812963 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 104389us
I20260709 13:04:46.818640 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.733218 18570 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.823807 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.807037 18564 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.820999 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:46.822929 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:46.808374 18559 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:46.826278 15091 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:04:46.836227 18732 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.266s	user 0.005s	sys 0.000s
I20260709 13:04:46.837770 18667 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:46.807397 18578 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:46.860065 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:46.817440 18449 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:46.883333 18449 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.886703 18583 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:46.887260 18583 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:46.887689 18583 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.879658 15192 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:46.889427 15091 catalog_manager.cc:5697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 3 to 9, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 9 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.891317 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.892107 15192 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.812521 18631 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:04:46.872953 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.819620 18376 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:46.839370 18284 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:46.877207 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.858780 18559 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.878593 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.782989 18590 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.879504 18560 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:46.880281 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.922350 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.899881 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.923424 15192 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.923347 15091 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.865959 18667 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:46.911680 15842 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.448s (SENT) [suppressed 37 similar messages]
I20260709 13:04:46.893489 18625 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:46.912467 15189 raft_consensus.cc:2376] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12. Re-sending same reply.
I20260709 13:04:46.918011 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.894032 18570 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:46.922554 15196 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 5: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:46.910868 18631 consensus_queue.cc:1243] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:46.855311 18573 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:46.922960 15195 raft_consensus.cc:2376] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7. Re-sending same reply.
I20260709 13:04:46.924583 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.912313 18284 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:46.890127 18742 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:46.879640 18623 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.930855 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.938692 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.930864 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:46.940179 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.931979 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116977us
I20260709 13:04:46.920023 18559 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.937659 15091 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 8, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.812896 18638 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.943114 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:46.949827 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.958706 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.962375 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:46.970732 15091 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.938163 18284 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:46.935834 18625 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.938793 18742 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.975982 15091 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:46.985473 15091 catalog_manager.cc:5697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.989058 15091 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.991182 18511 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:46.992117 18511 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:46.992637 18511 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:46.993702 18668 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
I20260709 13:04:46.993590 18511 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:46.990799 15091 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.995591 15091 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:47.009780 15091 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 8, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 8 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:47.011960 15091 catalog_manager.cc:5697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } }
I20260709 13:04:47.013329 15091 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:04:47.015182 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 144672us
I20260709 13:04:47.017877 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:47.018235 18640 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:47.018632 18640 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:47.015482 18673 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:46.975947 18743 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 5 to 10, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:47.020129 18673 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:47.020550 18673 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.020901 18673 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:47.021026 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.016112 18733 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.445s	user 0.003s	sys 0.000s
I20260709 13:04:47.019630 18640 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:46.983934 18742 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.018806 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:46.937397 18737 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.024600 18560 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:47.025601 18625 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.027258 18667 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.028517 18667 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.994515 18668 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:04:47.029367 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:47.029552 18668 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:47.035243 18578 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:47.035984 18640 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.036957 18578 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:47.037483 18578 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.037849 18578 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.039646 18738 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.029996 18668 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:47.041083 18668 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.042263 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:46.980914 18622 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.044572 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.045238 15189 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:47.047837 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.048874 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.049554 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.054423 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:47.054579 15191 raft_consensus.cc:2376] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11. Re-sending same reply.
I20260709 13:04:47.054775 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.055096 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:47.055536 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:47.051431 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:47.056161 15193 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:47.053772 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.056536 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:47.056990 15190 raft_consensus.cc:2376] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10. Re-sending same reply.
I20260709 13:04:47.057121 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:47.057196 15264 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
W20260709 13:04:47.055744 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.970118 18564 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.057956 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:47.050576 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.060205 18564 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.060632 15190 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:47.057211 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:47.057938 15192 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:47.063529 18691 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.065037 15876 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:47.047928 18744 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.055217 15196 raft_consensus.cc:2368] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:47.070467 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:47.087508 15264 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.069535 18473 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.091598 18640 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.092677 18640 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.094723 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:47.094843 18640 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.096581 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:47.097200 15270 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:04:47.098331 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:47.099128 18640 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:47.099537 18640 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.099980 18640 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.100297 18438 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.100399 18578 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.102407 18438 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.102588 18578 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.103344 18673 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:47.077565 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.071871 18744 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.105434 18673 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.099368 18449 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.109061 15264 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:47.081413 18583 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.083405 18738 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:47.130815 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.112051 18449 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.112572 15197 raft_consensus.cc:2368] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8.
I20260709 13:04:47.113693 18473 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.042299 18668 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.131168 18691 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.118546 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:47.062462 18502 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.134671 15270 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:47.153079 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.135293 15264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:04:47.136406 18570 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.121919 15189 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:47.155436 15264 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.155857 15264 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:47.159982 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.170959 18559 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:47.173375 18559 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:47.181849 18583 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.202350 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:47.192615 15264 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.086505 18742 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.213155 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:47.168440 18653 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:47.229481 15264 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.168830 18570 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:47.239981 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 284327us
I20260709 13:04:47.232172 18585 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:47.232535 18649 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:47.247071 15839 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.237234 18653 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:47.232899 18284 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:47.262306 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 439418us
I20260709 13:04:47.263473 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:47.248198 18585 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:47.266880 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 428623us
I20260709 13:04:47.270744 15162 leader_election.cc:400] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8.
I20260709 13:04:47.271092 15162 leader_election.cc:403] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:04:47.272835 15081 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1011f7cfdb64b11bff42c90ec444dbe with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:47.265731 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:47.266361 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 354689us
I20260709 13:04:47.293994 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.294839 15188 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:47.294993 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.295989 15197 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:47.297164 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:47.297647 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.298497 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:47.298851 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.299615 15192 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.300110 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:47.306542 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.264043 18649 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:47.269377 18585 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.283856 18449 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8.
I20260709 13:04:47.330436 15189 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:47.335662 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.338486 18622 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.339016 18622 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.339649 15346 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:47.339910 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:47.340821 15339 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:47.341039 15345 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:47.330964 15192 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:47.347103 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.357463 15344 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:04:47.314180 18691 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:47.318526 18638 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:47.270000 18640 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.372979 15344 pending_rounds.cc:85] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 4
I20260709 13:04:47.373394 15344 pending_rounds.cc:107] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:04:47.373710 15344 raft_consensus.cc:2889] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:47.374794 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.367390 18691 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:47.362398 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 126964us
I20260709 13:04:47.366520 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:47.378343 15346 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.367278 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:47.313982 18559 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:47.377346 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 72560.9us
I20260709 13:04:47.379281 15189 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:47.376299 18691 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.381510 15345 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:47.385478 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:47.386399 15345 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:47.393904 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:47.394107 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:47.394630 15341 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:47.394779 15345 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:04:47.396871 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.370222 18638 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.400475 15345 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:47.400164 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:47.401778 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 145994us
I20260709 13:04:47.389640 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:47.425987 15192 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.382555 18502 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.404814 15189 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:47.433041 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44840.9us
I20260709 13:04:47.438995 15192 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:47.435997 15876 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 5 to 10, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:47.329581 18653 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.409658 18638 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.465461 18667 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:47.385001 18590 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:04:47.399266 18242 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:04:47.435474 18559 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:47.443087 18764 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:47.432600 18742 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.397361 18744 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:04:47.510242 15341 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:47.493206 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 193126us
I20260709 13:04:47.498236 18114 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:47.501207 18560 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:47.502377 18631 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:47.402946 18606 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:04:47.430274 18673 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:04:47.527978 18757 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:04:47.513269 18744 consensus_queue.cc:1243] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:04:47.510669 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.510978 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68236.9us
I20260709 13:04:47.460074 18622 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.513978 15842 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:47.524511 18763 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:04:47.527927 18673 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:47.460804 18570 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.533901 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:47.507939 18764 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:47.519753 18578 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:47.549330 18742 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.522138 18759 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:04:47.572609 18640 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.557195 18570 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.549263 18673 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:47.558619 18578 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:47.565145 18768 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:04:47.590551 18769 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:04:47.612998 18754 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:04:47.613798 18673 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.590306 18742 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.607923 18764 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.639876 18764 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.598217 18773 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:47.640805 18773 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:47.641983 18773 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:47.684849 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.707286 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 193383us
I20260709 13:04:47.720168 15874 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:47.720791 15874 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:47.718734 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:47.722330 15874 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.727519 15874 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.557062 18284 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:47.573954 18559 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:47.732980 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 199025us
I20260709 13:04:47.596880 18570 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.739867 18622 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:47.740664 18578 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.742821 18511 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:47.744624 18585 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:47.745675 18744 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.746510 18744 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.750085 18744 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:47.752933 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:47.754375 15870 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 7: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:47.635303 18673 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:47.759058 18768 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.783692 18622 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:47.799399 18788 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
W20260709 13:04:47.800717 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 315259us
W20260709 13:04:47.803771 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.803673 18631 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:47.805073 18114 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:47.805660 18570 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:47.806397 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 301299us
I20260709 13:04:47.807511 18768 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:47.814253 18578 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:47.815689 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:47.828114 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 414646us
W20260709 13:04:47.840607 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.840366 18783 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:47.850303 15346 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:47.850348 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:47.852304 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:47.853842 18284 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:47.854198 18114 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:47.854961 18649 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:47.855892 15869 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:47.857052 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:47.858263 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:47.859993 18622 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:47.860893 18768 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:47.880079 18640 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:47.884215 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 369938us
I20260709 13:04:47.853190 18573 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:47.933990 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.943109 15874 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:04:47.935957 18783 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:47.951583 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.952077 18761 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.453s	user 0.006s	sys 0.006s
I20260709 13:04:47.956844 18783 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:47.957334 18783 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:47.957835 18783 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.939196 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:47.946375 15874 pending_rounds.cc:85] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 11
I20260709 13:04:47.962610 18560 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:47.967016 15873 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
W20260709 13:04:47.967626 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110777us
I20260709 13:04:47.960678 15874 pending_rounds.cc:107] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:04:47.986629 15874 raft_consensus.cc:2889] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:47.967473 18560 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:04:47.992455 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 134403us
W20260709 13:04:47.983637 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 97585.2us
I20260709 13:04:47.997483 18583 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:47.999234 18640 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:47.997557 18638 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:48.001015 18691 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.550s	user 0.018s	sys 0.001s
I20260709 13:04:48.003190 18560 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:47.972051 18449 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:48.003230 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:47.999020 18583 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:47.971210 18790 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.019101 18583 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:48.027796 18790 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.029419 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:48.015938 18640 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.018168 18449 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.044734 15309 leader_election.cc:400] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9.
I20260709 13:04:48.023705 18691 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:48.129096 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74049.5us
I20260709 13:04:48.132149 18673 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:48.132737 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 103603us
I20260709 13:04:48.133411 15343 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:04:48.136260 18732 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:04:48.134737 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.142860 18449 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:48.144805 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 147765us
I20260709 13:04:48.145059 18449 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:48.147326 18583 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.148142 18783 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.148866 18583 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:48.151142 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.152001 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.131158 18376 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:48.126266 18790 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:48.157724 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.151209 18783 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.160518 18801 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.156951 15868 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:04:48.158447 18795 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:04:48.161053 18638 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:48.168929 18801 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.157006 18560 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.185000 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.186622 18691 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:48.187498 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53743.7us
I20260709 13:04:48.192884 18764 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:48.195153 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48362.1us
I20260709 13:04:48.199393 18806 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.199970 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.200577 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:48.201071 18376 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:48.196391 18801 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.200153 18806 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.201728 18376 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.201858 18764 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:48.204351 18764 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.204969 18764 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:48.205415 18376 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.203722 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.198570 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.220662 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:48.221679 18807 raft_consensus.cc:2764] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:48.222594 18808 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:48.223222 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:48.223805 18808 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.222365 18578 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:48.225080 18773 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:48.226819 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47893.7us
I20260709 13:04:48.225107 18808 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.228992 18638 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:48.230846 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:48.237166 18570 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:48.222795 18742 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:48.239723 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:48.242548 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 44107.7us
I20260709 13:04:48.243116 18631 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:48.243227 18807 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.247090 18640 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.248517 18606 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:48.253744 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:48.255589 15192 pending_rounds.cc:85] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 4
I20260709 13:04:48.271754 15192 pending_rounds.cc:107] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:04:48.272233 15192 raft_consensus.cc:2889] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:48.263514 18570 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:48.276530 18570 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.277420 18640 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.278056 18570 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:48.279328 18631 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.281433 18631 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:48.284603 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45057.6us
I20260709 13:04:48.287631 18801 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:48.286927 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.288916 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:48.291422 15873 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:48.216042 18783 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:04:48.294013 15188 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:48.294602 15196 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:48.299882 15195 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:48.301689 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:48.303578 15194 raft_consensus.cc:2410] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:04:48.315214 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 94725us
I20260709 13:04:48.317539 15195 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:04:48.301606 18805 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:04:48.273708 18606 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.264667 18806 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:48.322736 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:48.327127 18550 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:48.327651 18550 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:48.328948 18550 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.330019 18550 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:48.331359 18668 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:48.331980 18668 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:48.332392 18668 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:48.335336 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 81709.8us
I20260709 13:04:48.336256 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:48.336580 15188 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:48.337354 18792 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:48.337648 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:48.338291 18739 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:48.337805 18792 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.339211 18792 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.339406 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:48.340571 18507 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.341228 18507 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.341531 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:48.347102 18507 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:48.347867 15190 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:48.339337 18739 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:48.368764 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:48.368464 18739 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.361438 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:48.369699 15344 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:48.318172 18764 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.370738 18507 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:04:48.371405 15237 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.654s (SENT)
I20260709 13:04:48.371963 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.372520 18507 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:48.375095 18801 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:48.375135 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:48.376199 15873 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:48.387076 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:48.388164 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:48.389075 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 102276us
I20260709 13:04:48.391281 18585 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.365119 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:48.365053 18473 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:48.367112 18783 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:48.369858 18583 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:48.372076 18764 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:48.363348 18756 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:48.390980 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:48.401558 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.432317 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:04:48.440799 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 72178.5us
I20260709 13:04:48.443375 18585 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:48.444989 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:48.445855 15868 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:48.445926 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:48.446772 18806 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:48.446805 18114 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:48.447809 18114 consensus_queue.cc:1243] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:48.447646 18806 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.448742 18114 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:48.449090 18114 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.449383 18114 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:48.449749 18806 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.450301 18806 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:48.450631 18806 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.453496 18564 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.454013 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.463404 15343 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:48.453393 18773 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:48.468786 15873 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
W20260709 13:04:48.474426 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 243713us
I20260709 13:04:48.477526 15341 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:48.471011 18376 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:04:48.455406 18626 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:48.400484 18792 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.454370 18783 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:48.406909 18638 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:04:48.427104 18560 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:48.500491 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:48.425374 18573 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:04:48.519905 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52848.1us
I20260709 13:04:48.501796 18773 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:48.500339 18570 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:48.472695 18564 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.541203 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:48.544117 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 90254.9us
W20260709 13:04:48.549566 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.534018 18764 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.525877 18742 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:04:48.583925 18114 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.589219 15188 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:48.589859 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:48.591123 18438 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:48.593061 18564 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.593248 15264 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:04:48.595398 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:48.596133 15270 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:48.596477 18764 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.597437 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:48.527906 18507 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:04:48.595511 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:48.599905 18114 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:48.600899 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 128021us
W20260709 13:04:48.607900 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.611020 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:48.612035 18606 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.613330 18606 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.614602 18773 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.615576 18585 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:48.616281 18570 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:48.616309 18560 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:48.617244 18560 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.618250 18560 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.619952 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:48.620957 18511 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:48.622150 18550 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:48.622606 18550 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:48.623075 18764 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.624508 18560 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:48.626164 18783 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.598956 18742 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:04:48.634261 18792 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:48.638106 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:48.639777 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:48.638797 18810 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:04:48.641407 18438 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:48.640479 15264 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.622983 18550 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:48.547515 18668 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.665385 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:48.665617 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:48.666054 15873 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:48.677098 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:48.679855 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82495.7us
W20260709 13:04:48.687160 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52719.6us
I20260709 13:04:48.688871 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:48.689424 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:48.689762 18792 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:48.690207 18792 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:48.690346 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:48.690639 18792 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:48.694039 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.695596 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.696559 15268 raft_consensus.cc:2410] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:04:48.698549 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.699280 15271 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:48.700351 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.700870 15342 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:48.700549 18668 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:48.701661 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:48.699862 18792 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.694964 15267 raft_consensus.cc:2410] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:04:48.690358 15272 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 5: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:48.678983 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:48.652206 18764 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.709298 15270 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:48.716724 18585 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:48.717190 18815 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.239s	user 0.000s	sys 0.009s
I20260709 13:04:48.717294 18585 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:48.717957 18626 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:48.719508 18511 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:48.719399 18764 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.719889 18792 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:48.721747 18764 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:48.726349 15873 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:48.718331 18473 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:48.729056 18473 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.729496 18473 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:48.642725 18438 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.736137 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:48.736199 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.740255 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.741215 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.741261 15265 raft_consensus.cc:2410] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:48.713807 18807 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:48.751611 15269 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:48.750365 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.757997 15345 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:48.718415 18585 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.722596 18806 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:48.770285 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.770974 15263 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:48.779544 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:48.779963 15264 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:48.789902 15194 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:48.801122 15271 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
W20260709 13:04:48.803535 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72788.4us
I20260709 13:04:48.807612 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:48.807817 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:48.808399 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.804502 15338 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:04:48.814471 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 124240us
I20260709 13:04:48.830215 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:48.835137 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:48.839751 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:48.840111 18821 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:04:48.803623 18640 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.828581 15263 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:48.855146 18114 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:48.866648 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.868883 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:48.869864 18773 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:48.872962 18822 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:04:48.875780 15263 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:04:48.878625 18807 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:04:48.879966 18831 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:04:48.889894 15270 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:48.889436 15271 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:48.897861 15345 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:48.919201 18114 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:48.923730 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:48.923655 15197 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:48.926342 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:48.930895 15272 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:48.924146 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:48.905854 18626 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:48.934965 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 95389.7us
I20260709 13:04:48.935899 18114 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.933267 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:48.939038 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:48.937635 15195 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:48.857810 18640 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:48.992319 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:48.993049 15271 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:04:48.994925 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62325.7us
I20260709 13:04:49.010639 18114 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.009536 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:49.006210 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73384.1us
I20260709 13:04:49.016191 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:49.023954 18114 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.024670 18114 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:48.988325 18626 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:48.996088 18807 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:49.017176 15193 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
W20260709 13:04:49.051335 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.055131 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 198904us
W20260709 13:04:49.060034 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 49939.3us
I20260709 13:04:49.065569 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.066154 18114 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:49.070394 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.019218 18376 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:49.079928 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 191464us
I20260709 13:04:49.088030 15271 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:49.016968 18550 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.103390 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:49.075340 18626 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.135378 18376 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:04:49.139246 18833 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:04:49.141379 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 124800us
I20260709 13:04:49.079227 18807 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.107801 18585 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:49.146589 15270 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:04:49.156029 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71009.3us
I20260709 13:04:49.143291 18449 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.101732 18830 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.252s
W20260709 13:04:49.162567 18814 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:04:49.150727 18823 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
W20260709 13:04:49.163877 18832 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:04:49.163655 18449 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:49.166141 18449 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:49.178063 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86963.8us
I20260709 13:04:49.179780 15272 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:04:49.181723 18841 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:04:49.188970 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.160081 18585 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:49.160211 18583 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.198269 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:49.192759 18838 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:04:49.171574 18284 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:04:49.155328 18242 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.179s
I20260709 13:04:49.210304 18583 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:49.214116 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.216499 18852 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:49.217900 18852 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:49.216344 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:49.223377 18830 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:49.223492 18638 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:49.223678 18846 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:04:49.224181 18638 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.225351 18807 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.226071 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:49.218359 18852 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:49.237603 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65974.3us
I20260709 13:04:49.236562 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:49.212037 18827 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 13:04:49.222892 18606 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.609s	user 0.003s	sys 0.010s
W20260709 13:04:49.231179 18843 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:04:49.226912 18638 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:49.262383 15195 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:49.239933 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:49.253705 18837 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.324s	user 0.000s	sys 0.004s
I20260709 13:04:49.251297 18852 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:49.237718 18242 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:49.230756 18550 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:49.229918 18473 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:49.302675 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77036.9us
W20260709 13:04:49.303902 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67501.4us
I20260709 13:04:49.285277 18583 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:49.286288 18449 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:49.308012 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.309016 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:49.285816 18242 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:49.291554 18783 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:49.303537 18807 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:49.334717 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.335464 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.356884 15345 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:49.358341 15342 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.317679 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:49.332787 18783 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:49.359139 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:49.295125 18585 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.334297 18640 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.335583 18449 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:49.350147 18570 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.345894 18830 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:49.364729 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60322.9us
I20260709 13:04:49.367846 18570 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.370415 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.371574 18583 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:49.377995 15342 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:49.363150 18764 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.362478 18773 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:49.385555 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:49.385728 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:49.386767 18855 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:49.387166 15337 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.387259 18376 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.391541 18739 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.392096 18739 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:49.363543 18742 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:04:49.399173 15338 raft_consensus.cc:1217] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Deduplicated request from leader. Original: 9.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 13:04:49.399776 15338 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:04:49.400272 18376 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:49.383920 15868 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:49.411994 18773 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:49.403475 18764 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.415226 15311 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:49.401753 18626 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.416505 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.429111 15342 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5.
I20260709 13:04:49.431155 18570 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.432224 18783 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:49.436054 18739 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:49.437283 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:49.380475 18583 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.439306 15873 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:04:49.375651 18449 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:49.418493 18473 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:49.442381 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:49.444914 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.438669 18742 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:49.460742 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.440857 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:49.459360 15841 leader_election.cc:336] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.697s (SENT)
I20260709 13:04:49.363989 18242 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.442564 18583 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.468912 15342 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.447417 18473 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:49.477006 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.471673 18242 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.464710 18742 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:49.481046 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60420.3us
I20260709 13:04:49.477295 18473 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.473421 18829 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:49.487876 18473 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:49.494495 18852 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.495942 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.499022 18829 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:49.499362 18830 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:49.499722 18829 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:49.500923 18830 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:49.500682 18829 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.478277 18764 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.503473 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.504820 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:49.505321 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.506285 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.501294 18830 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:49.511813 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 141572us
W20260709 13:04:49.515206 15081 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d785ccef0634edd9f0fbb52fa1c8d27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:04:49.503355 18852 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.506044 18742 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:49.508311 18564 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:49.508891 18438 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:49.535243 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.539166 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.540164 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.541175 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.541412 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.542155 15343 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.542204 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.543295 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.543941 15344 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:49.544669 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.545190 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.545697 15346 raft_consensus.cc:2410] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:49.546551 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.547308 15340 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.548666 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.548898 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.549551 15342 raft_consensus.cc:2368] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:49.550594 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:49.552047 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:49.508796 18606 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:04:49.552848 15193 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:04:49.553787 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:49.554986 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:49.555141 18606 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.531248 18564 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:49.558350 18564 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:49.560527 18438 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:49.542066 15339 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.576162 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.577682 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.555866 18606 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.561252 18438 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:49.585669 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53794.5us
I20260709 13:04:49.588650 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:49.591811 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.593374 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.593559 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.594172 15344 raft_consensus.cc:2368] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11.
I20260709 13:04:49.595494 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.596499 15342 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.597805 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:49.598536 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.600845 18806 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:49.600001 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:49.600871 18824 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.453s	user 0.000s	sys 0.005s
I20260709 13:04:49.604535 18640 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.605064 18640 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:49.610102 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.611729 15342 raft_consensus.cc:2376] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 5. Re-sending same reply.
I20260709 13:04:49.530001 18673 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:04:49.616895 15345 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:49.627558 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:49.628460 15272 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:49.636189 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:49.632839 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:49.637945 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.638892 15345 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.639014 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:49.640059 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:49.640672 15269 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:49.641392 15341 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:49.643692 15272 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:49.645107 15339 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:49.642542 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:49.657171 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 141218us
I20260709 13:04:49.659993 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.662282 15265 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:04:49.667616 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:49.669454 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:49.670641 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.676424 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:49.660006 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:49.641461 18864 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:49.655444 18570 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.646539 18626 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:49.662407 18783 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.650363 18640 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.682065 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:49.693445 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:49.702674 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.703168 15339 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.684291 18861 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:49.694422 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.698660 15873 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:49.699543 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:49.699620 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 113528us
I20260709 13:04:49.685107 18578 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:49.727636 18114 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:49.728197 18114 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:49.728525 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 104720us
I20260709 13:04:49.728616 18114 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.743009 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.747135 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.748420 15340 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.752651 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.727101 18578 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.726361 18640 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:49.757723 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:49.757815 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56044.2us
I20260709 13:04:49.643461 18830 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.704303 18783 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:49.772092 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.749370 18861 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:49.724330 18570 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.759742 18578 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:49.761931 18573 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.781209 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.778285 18773 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:49.784049 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:49.784690 15195 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:49.790668 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.791402 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.791445 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.793102 15342 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.792395 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.794252 15340 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.795678 15345 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.797737 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:49.799693 18868 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:04:49.800940 18114 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:49.806180 18825 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.992s	user 0.000s	sys 0.006s
W20260709 13:04:49.812079 18871 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:04:49.812914 18870 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:04:49.775678 18560 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.793390 15268 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:49.759131 18583 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:49.826743 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
W20260709 13:04:49.827216 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 76013.5us
I20260709 13:04:49.782977 18606 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.829248 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.830992 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.834440 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.853092 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.859851 18742 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:49.874693 18507 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:49.875694 15344 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10.
I20260709 13:04:49.875348 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:49.878273 15873 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:49.871204 18564 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.885007 18564 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.886193 18114 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.888357 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:49.889972 15270 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
W20260709 13:04:49.890407 15237 leader_election.cc:336] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.541s (SENT)
I20260709 13:04:49.890830 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:49.786315 18573 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.832120 18640 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:49.853992 15841 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.882s (SENT)
I20260709 13:04:49.825173 18560 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.875331 18507 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:49.905637 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:49.890926 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:49.897781 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45063.8us
I20260709 13:04:49.903396 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.903975 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.985076 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:49.904258 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:49.904668 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.906076 15345 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:49.906538 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.905117 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:49.930956 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.900851 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.894966 15189 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:04:49.995426 15189 pending_rounds.cc:85] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 7
I20260709 13:04:49.995569 15343 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:49.995829 15189 pending_rounds.cc:107] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:04:49.996321 15189 raft_consensus.cc:2889] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.000088 15339 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 9. Current term is 10.
I20260709 13:04:50.001549 18114 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:50.002125 18114 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:50.002467 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.003569 15338 raft_consensus.cc:2368] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 7. Current term is 8.
I20260709 13:04:50.005367 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.006083 15342 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.006279 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.002517 18114 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:49.915894 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 79041.2us
I20260709 13:04:49.891497 15267 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.924021 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.011907 15272 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:49.918720 15344 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:50.014184 15269 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:04:50.016278 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.020269 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.025678 18872 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:49.891947 15095 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 7 to 11, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 11 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.026165 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:50.027064 15868 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:49.908787 18560 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.906220 18606 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.028389 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.041078 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:49.897198 18640 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.046957 18640 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:50.029521 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.026039 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:50.052085 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 161730us
I20260709 13:04:49.896941 18573 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.898144 18830 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:50.052961 15237 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.579s (SENT)
I20260709 13:04:50.055877 18573 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.056962 18573 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:50.059140 15340 raft_consensus.cc:2368] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 7. Current term is 8.
I20260709 13:04:50.059504 18564 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.059360 18606 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.059202 18829 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.060349 18564 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.061187 18829 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.061996 18606 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.066087 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.078871 15343 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:50.041265 18284 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.041689 15264 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:50.079963 18284 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.052187 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.082238 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.060366 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:49.913373 18867 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:04:50.063565 18829 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.083036 18284 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.083120 15338 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 9. Current term is 10.
I20260709 13:04:50.086076 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.083775 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.088670 15339 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:50.089821 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.087707 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.092468 18507 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:49.994477 18861 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.092474 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.093629 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 238) took 1310 ms. Trace:
I20260709 13:04:50.094087 15189 rpcz_store.cc:276] 0709 13:04:48.783547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:48.783719 (+   172us) service_pool.cc:224] Handling call
0709 13:04:48.801593 (+ 17874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.008811 (+1207218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.093365 (+ 84554us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000fafd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:50.093537 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2513416960}
I20260709 13:04:50.094861 15338 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:50.077345 15874 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:49.910524 18879 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.136s
W20260709 13:04:50.059206 18473 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:04:49.912972 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:50.084023 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.103603 18473 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:50.077242 18859 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.610s	user 0.002s	sys 0.000s
I20260709 13:04:50.104839 18585 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:50.104839 15340 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:50.105645 18585 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:50.106390 18473 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:50.107913 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:49.890864 18742 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:50.096479 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2084) took 1108 ms. Trace:
I20260709 13:04:50.034817 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:50.110543 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.095477 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.111188 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.112331 15341 raft_consensus.cc:2368] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16.
I20260709 13:04:50.013566 18773 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.113319 15868 raft_consensus.cc:2410] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 16 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:04:49.912782 18570 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.908666 18583 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:49.911983 18783 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:49.891813 18673 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.124091 15346 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:50.126052 15873 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:50.127413 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:50.132953 15338 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:50.134948 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 280962us
I20260709 13:04:50.135835 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:50.113286 15095 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 11 to 12, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 12 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.146171 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.149807 15238 leader_election.cc:400] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:50.150426 15238 leader_election.cc:403] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.152258 15345 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:50.148294 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:49.914928 18438 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.160772 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.167236 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.161505 15337 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:04:50.168134 15272 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
W20260709 13:04:50.166435 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 386011us
I20260709 13:04:50.164275 18114 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.167936 15264 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.109368 18564 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.167934 15337 pending_rounds.cc:85] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 4
I20260709 13:04:50.177331 15337 pending_rounds.cc:107] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:04:50.177665 15337 raft_consensus.cc:2889] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.122740 18631 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.173692 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:50.181460 15841 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.008s (SENT)
I20260709 13:04:50.177130 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.179512 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.182245 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:50.167555 15237 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.703s (SENT)
I20260709 13:04:50.183251 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:50.184221 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.180394 15346 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:50.107213 18872 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:04:50.124015 18848 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 13:04:50.274762 15268 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:50.276266 18872 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:50.257421 18114 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.172253 18806 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:50.172098 18852 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.166740 18829 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:50.278469 18829 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.182801 15269 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:50.278951 18829 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.176987 18773 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:50.282277 18773 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:50.158313 18284 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:50.282466 18852 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:50.287348 15267 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:50.288622 15869 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:50.114498 15196 rpcz_store.cc:276] 0709 13:04:48.988477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.185162 (+196685us) service_pool.cc:224] Handling call
0709 13:04:49.185671 (+   509us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:49.186313 (+   642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:49.186361 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:49.227372 (+ 41011us) log.cc:844] Serialized 78 byte log entry
0709 13:04:49.347324 (+119952us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:49.506925 (+159601us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.507324 (+   399us) log.cc:844] Serialized 14 byte log entry
0709 13:04:49.507499 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:49.507572 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:49.519629 (+ 12057us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b18003f1060. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1
0709 13:04:49.520140 (+   511us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b18003f1060. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:50.078672 (+558532us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b18003f1060. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:50.096260 (+ 17588us) raft_consensus.cc:1685] finished
0709 13:04:50.096280 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.096421 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9448,"prepare.queue_time_us":71825,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":9793,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":9446,"spinlock_wait_cycles":28471680,"thread_start_us":209308,"threads_started":2,"wal-append.queue_time_us":161097}
I20260709 13:04:50.224555 15271 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:50.283419 18573 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:50.291916 18852 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:50.277781 18806 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.292743 18806 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.224139 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.293553 15342 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:50.172722 18673 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.293947 15337 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:04:50.501937 15337 pending_rounds.cc:85] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 9
I20260709 13:04:50.502449 15337 pending_rounds.cc:107] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:04:50.540613 18114 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.364346 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.541219 18114 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:50.294039 15341 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:50.313602 15269 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
W20260709 13:04:50.303400 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.457612 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.509485 15264 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
W20260709 13:04:50.364842 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 244019us
W20260709 13:04:50.545548 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 378004us
I20260709 13:04:50.364256 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:50.546679 15237 leader_election.cc:336] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.731s (SENT)
I20260709 13:04:50.500448 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.542881 15337 raft_consensus.cc:2889] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.365927 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.364722 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.553253 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.554649 15264 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:50.555559 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.226212 18864 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:50.556123 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:50.560386 18114 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:50.330037 18888 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:04:50.548906 18573 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:04:50.577492 18573 consensus_queue.cc:1243] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:50.549122 18570 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.563545 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.564169 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.564353 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.563387 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:50.567523 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.580078 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:50.568282 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:50.569932 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:50.570292 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.581293 15868 raft_consensus.cc:1813] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:50.581894 15868 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:50.570708 15238 leader_election.cc:400] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8.
I20260709 13:04:50.365957 18866 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.592725 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.329128 18284 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:50.599725 18114 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.601187 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:50.601670 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.605871 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 431458us
W20260709 13:04:50.610495 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54591.4us
I20260709 13:04:50.612442 18114 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.575603 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.576112 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:50.577019 15237 leader_election.cc:336] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.780s (SENT)
I20260709 13:04:50.625718 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:50.585219 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.585965 15339 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:50.626550 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.579407 18570 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.625524 15337 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:50.587009 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:50.590184 18884 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:04:50.569312 18242 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.500687 18874 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9.
I20260709 13:04:50.625527 15342 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:50.632382 15346 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.634256 15268 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:50.634338 15874 raft_consensus.cc:1217] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.6->[8.7-12.9]   Dedup: 8.7->[10.8-12.9]
I20260709 13:04:50.582307 18773 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:50.663005 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:50.664143 15268 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:50.500869 18873 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:50.666442 15264 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:50.668009 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:50.669042 15871 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:50.635332 15841 leader_election.cc:336] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.054s (SENT)
W20260709 13:04:50.673373 15841 leader_election.cc:336] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.148s (SENT)
I20260709 13:04:50.674028 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:50.653371 15874 pending_rounds.cc:85] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 7
I20260709 13:04:50.675521 15874 pending_rounds.cc:107] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:04:50.675809 15874 raft_consensus.cc:2889] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.676028 15263 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:04:50.676566 15263 pending_rounds.cc:85] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 5
W20260709 13:04:50.635823 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.676921 15263 pending_rounds.cc:107] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:04:50.677294 15263 raft_consensus.cc:2889] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.677336 15269 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:50.636493 15197 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.595829 18573 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:50.609736 18881 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 13:04:50.389143 18631 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.685133 18573 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:50.690414 18830 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.637s	user 0.007s	sys 0.000s
I20260709 13:04:50.691264 15195 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:50.691576 18284 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.695415 18114 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.704255 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:50.705188 18673 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.705456 15272 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:50.652304 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.655164 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.676937 15190 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:50.661216 15267 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:50.608346 18866 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.679396 18438 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.680186 18570 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.586225 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.717588 15267 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:04:50.717716 15266 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:50.717578 15311 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:50.719610 18114 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:50.725879 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.712136 15346 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:50.728065 18242 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:50.718068 15267 pending_rounds.cc:85] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 6
I20260709 13:04:50.738122 15267 pending_rounds.cc:107] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:04:50.733884 15341 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:50.738610 15267 raft_consensus.cc:2889] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:50.734728 15197 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:04:50.730554 15263 raft_consensus.cc:2368] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
I20260709 13:04:50.728631 15873 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:50.709688 18578 consensus_meta.cc:287] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.930s	user 0.012s	sys 0.002s
W20260709 13:04:50.734237 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 157240us
I20260709 13:04:50.712942 18874 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:50.750131 15237 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.008s (SENT)
I20260709 13:04:50.710354 18830 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:50.767081 15267 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:04:50.768679 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:50.733531 18883 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:50.772970 15190 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:50.774171 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 100820us
I20260709 13:04:50.776320 18570 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:50.783149 18242 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:50.789182 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47155.1us
I20260709 13:04:50.733939 18893 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:50.793715 15188 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:50.748452 18564 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:50.731817 18673 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:04:50.793309 18806 consensus_meta.cc:287] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.500s	user 0.011s	sys 0.000s
I20260709 13:04:50.749764 18578 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.817039 18573 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:50.819892 18640 consensus_meta.cc:287] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.001s
I20260709 13:04:50.797911 18883 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:50.824717 15871 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:04:50.846642 18885 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:04:50.776809 18742 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:04:50.848552 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:50.788141 18829 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.852253 15263 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:50.796685 18830 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.861985 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:50.863250 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.825372 18806 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.869189 15197 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:50.856885 18673 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.867358 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:04:50.874217 15839 leader_election.cc:336] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.643s (SENT)
W20260709 13:04:50.867461 15196 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.018s	sys 0.024s
I20260709 13:04:50.876636 15190 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:50.879601 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:50.879889 15196 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.018s	sys 0.024s
I20260709 13:04:50.858927 18242 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.860076 18550 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:50.847508 18640 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:50.861075 18578 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:50.853358 18874 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:04:50.907904 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.880527 18570 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.908545 15263 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.909138 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:50.860548 18473 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:04:50.880533 18893 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:50.934793 15265 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:50.935570 18773 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:50.936952 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:50.937602 15197 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:50.938511 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:50.939885 18585 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:50.941450 18626 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:50.941390 18773 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:50.863924 18742 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 13:04:50.943177 15340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.033s	sys 0.022s
I20260709 13:04:50.942689 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:50.943548 15868 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:50.938812 15197 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:50.891409 18861 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:50.902652 18864 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:50.948091 15340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.033s	sys 0.022s
I20260709 13:04:50.877944 18889 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:50.959604 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:50.947397 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 236130us
I20260709 13:04:50.910293 18550 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:50.959134 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.982074 15266 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.987788 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:50.988627 15269 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:50.989684 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.948596 18874 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:51.002548 15265 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:50.891198 18673 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:50.944669 18866 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:50.997323 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:50.998108 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:50.998798 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.000003 15192 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:51.000082 15338 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:50.913971 18583 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:04:50.913800 18570 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.013548 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.023088 15269 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:50.913534 18242 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.013335 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.026268 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.023468 15343 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:51.014308 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.013266 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:51.033838 15346 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:51.015969 15195 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:04:51.048265 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 133245us
I20260709 13:04:51.049098 18904 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:51.049515 18904 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:51.050467 18904 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.051991 18904 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.011013 18792 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:51.014308 18889 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:51.076601 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:51.078684 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 142207us
I20260709 13:04:51.057044 18901 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:51.083214 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.035068 18874 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:51.083690 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 75038.5us
I20260709 13:04:50.989615 18864 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.067196 18742 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:51.028986 18578 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:04:51.062552 18792 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:50.950127 18883 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:51.105928 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.107187 15269 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.070403 18473 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.108906 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.117585 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.118393 15264 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:51.013677 18284 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:04:51.069152 18852 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:51.084535 18585 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:51.129046 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.099078 18874 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:51.123590 15272 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:04:51.098129 18829 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.140271 18640 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:51.140439 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.102298 18742 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:51.137284 15269 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:51.161553 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.164539 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.165354 15267 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.163736 15269 raft_consensus.cc:2376] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12. Re-sending same reply.
I20260709 13:04:51.125759 18861 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:51.129107 18806 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:51.177522 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 161677us
W20260709 13:04:51.177817 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68960.8us
I20260709 13:04:51.098793 18550 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:51.122061 18473 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.103770 18889 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.103600 18901 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.191599 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.203823 15267 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:51.215653 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:51.215737 15264 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:51.141215 18585 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.190450 18852 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.192452 18284 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:51.243341 18922 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:51.245430 18922 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.245360 18585 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:51.245916 18908 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:51.246045 18922 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:51.245391 18912 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:04:51.232239 18874 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.248317 18874 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:51.243709 18242 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.244061 18570 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.251489 18852 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.207474 18926 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:51.252532 18861 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:51.253260 18926 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.253530 18284 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.254467 18284 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.177536 18640 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:04:51.255825 18906 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:04:51.237766 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.212942 18806 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:04:51.258155 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.241473 18923 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:51.242615 18917 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:51.258988 18923 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.259305 18917 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:51.255012 18898 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:04:51.259958 18917 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:51.259500 18923 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.254487 18926 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.262815 18864 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.263206 18926 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:51.255833 18284 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.258981 18806 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.267318 18242 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:51.268426 18242 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:51.268885 18902 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:04:51.207365 18907 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.269867 18242 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.270475 18907 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.280620 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.281001 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.282483 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:51.287417 15338 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.304229 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.304944 15343 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:51.305513 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:51.315843 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.316140 15263 raft_consensus.cc:2410] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:04:51.317976 15345 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:51.318087 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.318583 15264 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:51.166234 18792 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.319483 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.325747 15267 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
W20260709 13:04:51.243785 18911 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:51.324810 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:51.244761 18914 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:04:51.331707 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.332167 15267 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:51.338840 15267 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:51.337512 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:51.337021 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:51.343696 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:51.346272 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.347065 15263 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.347153 15269 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:51.359845 15263 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:51.361522 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:51.362179 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.362411 15345 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:51.363579 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.366735 15263 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:51.368860 18916 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.369306 18927 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.369421 18916 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.369904 18927 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.371764 15270 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:51.371877 18916 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:51.372121 18927 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:51.372928 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.373579 15270 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:51.374392 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.374478 15263 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:51.375433 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.375471 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.376137 15263 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:51.376235 15268 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:51.368826 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 430350us
I20260709 13:04:51.377488 15268 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:51.377849 15268 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:51.377947 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.378574 15263 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:51.364590 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.378979 18919 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:51.339697 15267 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.314898 15266 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:51.380131 15263 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:51.380182 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.380834 15267 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.381291 15266 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.376049 18922 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.383842 18922 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.384579 18864 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:51.388331 18792 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:51.391503 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.391677 18852 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.391898 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2097) took 1097 ms. Trace:
I20260709 13:04:51.392438 15263 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:51.392319 15191 rpcz_store.cc:276] 0709 13:04:50.294671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.294790 (+   119us) service_pool.cc:224] Handling call
0709 13:04:50.582960 (+288170us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:04:50.583266 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.770761 (+187495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.770797 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:50.770841 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:50.770871 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.391668 (+620797us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000c17d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:51.391719 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.391840 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553406464}
I20260709 13:04:51.393568 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.394181 15263 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:51.395071 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.386031 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.398479 18901 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.355320 18742 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.403786 18907 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.404103 15264 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:51.407675 18913 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:04:51.413112 15267 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:51.417382 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:51.395841 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.417547 15267 pending_rounds.cc:85] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 6
I20260709 13:04:51.417888 15269 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:51.418362 15266 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:51.418533 15267 pending_rounds.cc:107] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:51.414697 15270 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:51.418970 15267 raft_consensus.cc:2889] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.417552 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2020) took 1363 ms. Trace:
I20260709 13:04:51.419016 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.413851 15263 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:04:51.380097 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:51.421675 15269 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.424289 15345 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:51.378630 15268 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:51.425663 15267 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:51.425800 15268 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.427865 15267 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:51.430179 15267 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:51.431869 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 110679us
I20260709 13:04:51.437487 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.443650 18907 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:51.443663 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:51.444182 18907 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:51.444545 15341 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:51.444567 18907 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:51.446746 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.448541 18626 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:51.449565 18904 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:51.452353 18928 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:51.452646 18907 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.453436 18564 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:51.464864 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.467990 15343 raft_consensus.cc:2376] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10. Re-sending same reply.
I20260709 13:04:51.420024 15340 rpcz_store.cc:276] 0709 13:04:50.048008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.106754 (+ 58746us) service_pool.cc:224] Handling call
0709 13:04:50.107121 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.143355 (+ 36234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.143408 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.177339 (+ 33931us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.948800 (+771461us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:50.948854 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.948919 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.411625 (+462706us) raft_consensus.cc:1685] finished
0709 13:04:51.411653 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.411831 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62081,"raft.queue_time_us":40357,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":19772,"thread_start_us":572416,"threads_started":1,"wal-append.queue_time_us":1092967}
I20260709 13:04:51.471484 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.472635 15272 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:51.459010 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:51.459380 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.462446 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.464841 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.454649 18114 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:51.473793 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.477876 15270 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:51.461390 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.481046 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.485859 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.487491 15869 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.489965 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.491057 15340 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:51.492853 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.493803 15263 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:04:51.494959 15341 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:04:51.497735 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:51.497908 15340 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:51.500257 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.483780 15162 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.455596 18438 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:51.504467 15162 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.505919 18918 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.506295 18933 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:51.506701 18933 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:51.506531 18918 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:51.509280 18918 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:51.511575 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 125646us
I20260709 13:04:51.462029 18626 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:51.507114 18933 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:51.485587 18864 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:51.545836 15196 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:51.545868 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.519479 15269 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:51.520457 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:51.542012 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44434.6us
I20260709 13:04:51.496485 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:51.485174 18901 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.541220 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.551819 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.548731 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.495396 18640 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.547708 15270 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:51.502314 18893 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.553315 15272 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:51.554133 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.558542 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:51.558743 15191 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:51.560438 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:51.560992 15196 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 5.
I20260709 13:04:51.545250 18438 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.554296 18739 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:04:51.564344 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51599.4us
I20260709 13:04:51.565050 15192 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:51.577104 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.573431 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:51.555409 18852 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:51.585758 18852 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.585983 18930 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.557719 18242 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:51.586987 18242 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.585951 18626 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.587880 18922 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:51.587976 18242 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.588726 18626 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.589838 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:51.562427 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.591096 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:51.591624 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.592480 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.593232 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.594687 18920 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:51.595402 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:51.596186 18585 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.576511 18739 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:51.596973 18585 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:51.597405 18739 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.586280 18852 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.595562 18920 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:51.598969 15237 leader_election.cc:400] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10.
I20260709 13:04:51.609895 15237 leader_election.cc:403] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:51.604221 15265 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:51.584997 18926 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.598799 18739 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:51.584745 18924 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:51.588405 18922 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:51.614990 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 114827us
I20260709 13:04:51.510754 18917 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.626210 18919 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:04:51.617456 18926 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.637630 18926 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.568111 18901 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:51.641091 18901 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:51.624928 18924 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.627400 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.645982 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:51.647362 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.623684 18922 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:51.655234 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 101168us
I20260709 13:04:51.562748 18938 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 13:04:51.654425 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:51.657395 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109615us
I20260709 13:04:51.657418 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:51.660122 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.662822 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.651382 18919 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:51.671010 18941 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:51.651147 18901 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.657078 18926 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:51.669433 18938 consensus_queue.cc:1243] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:51.618788 18930 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10.
I20260709 13:04:51.672225 18918 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:51.715514 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.717506 15268 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:04:51.701293 18947 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.702296 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:51.702962 18606 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:51.704135 18806 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.705976 18933 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.708299 18930 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.682816 18901 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.709919 18907 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.642858 18924 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.716774 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:51.719432 15346 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:51.721849 15268 pending_rounds.cc:85] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 7
I20260709 13:04:51.736627 15268 pending_rounds.cc:107] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:04:51.736933 15268 raft_consensus.cc:2889] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.691660 15344 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:51.709308 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.743433 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:51.745014 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 84133.2us
I20260709 13:04:51.729420 18947 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.740864 18918 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:51.764751 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.730903 18852 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.722944 18948 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:51.751392 18284 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:51.765643 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.754032 18806 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:51.770442 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.773402 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:51.774374 18927 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:51.774938 18927 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.775321 18927 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.768414 18284 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:51.778661 18284 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.774385 18946 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:04:51.774642 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:51.782311 15191 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:51.765869 18942 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:04:51.768548 18792 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:51.784175 18946 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:51.784582 18792 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.784689 18946 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:51.785073 18792 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:51.785506 18920 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:51.785682 18946 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.765733 18606 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:04:51.787853 18933 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.736318 18930 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.789955 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1873) took 1179 ms. Trace:
I20260709 13:04:51.790311 18930 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.767904 18917 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:51.791051 18927 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.791646 18947 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.799530 15191 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:51.806588 15194 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:51.772035 18806 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:51.790344 15271 rpcz_store.cc:276] 0709 13:04:50.610143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.610354 (+   211us) service_pool.cc:224] Handling call
0709 13:04:50.610690 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:50.628640 (+ 17950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.628671 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:50.703503 (+ 74832us) log.cc:844] Serialized 52 byte log entry
0709 13:04:50.947616 (+244113us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:50.987231 (+ 39615us) log.cc:844] Serialized 14 byte log entry
0709 13:04:51.000634 (+ 13403us) log.cc:844] Serialized 14 byte log entry
0709 13:04:51.789405 (+788771us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b180041ede0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:04:51.789525 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.789593 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.789729 (+   136us) raft_consensus.cc:1685] finished
0709 13:04:51.789747 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:51.789878 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":73087,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":397877,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":48155,"spinlock_wait_cycles":33876864,"thread_start_us":327390,"threads_started":2,"wal-append.queue_time_us":379763}
I20260709 13:04:51.766918 18926 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.793229 18927 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:51.811751 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:51.811769 18606 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.817847 18926 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.818361 18852 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:51.823961 18923 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 13:04:51.838657 18923 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.840889 18923 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.825909 18284 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:51.841995 18949 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:04:51.842528 18631 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.843106 18284 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:51.812352 18806 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:51.843433 18807 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:51.843852 18807 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.827993 18901 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.835462 15192 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.835911 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:51.848423 18922 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.844610 18807 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.861966 15192 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:51.871289 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:51.896545 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.911725 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:51.845467 18673 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.911422 18848 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:51.931353 18929 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:51.931965 18929 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:51.932431 18929 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:51.935393 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 278029us
I20260709 13:04:51.954430 18922 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:51.954493 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:51.924084 18942 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.957278 18942 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:51.958227 18942 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.847013 18792 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:51.960037 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:51.959532 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.016866 15196 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:51.970813 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:51.922550 18917 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:51.960294 18848 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:51.978153 18918 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.093423 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.106525 15196 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:51.928212 18807 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:52.145591 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.105285 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:52.148722 15192 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10.
I20260709 13:04:52.148598 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:52.145056 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:52.153616 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.142266 18917 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:52.155294 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:52.157053 15874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58400 (request call id 250) took 1549 ms. Trace:
I20260709 13:04:52.114995 18848 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.157509 15874 rpcz_store.cc:276] 0709 13:04:50.602749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.602890 (+   141us) service_pool.cc:224] Handling call
0709 13:04:50.634138 (+ 31248us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:50.716037 (+ 81899us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:50.716066 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:50.716601 (+   535us) log.cc:844] Serialized 52 byte log entry
0709 13:04:50.983985 (+267384us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:50.984056 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.984165 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:51.849842 (+865677us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b2400323498. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265efb0 00007f36e52d5488 00007f36e52d5be8 00007f36e52ad398 00007f36e52a876a 00007f36e52a7bb6
0709 13:04:52.103243 (+253401us) raft_consensus.cc:1685] finished
0709 13:04:52.103261 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.151969 (+ 48708us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39476,"raft.queue_time_us":40270,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7563,"spinlock_wait_cycles":76757888,"thread_start_us":229731,"threads_started":1,"wal-append.queue_time_us":402609}
I20260709 13:04:52.159632 18917 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.131417 18901 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.164863 18901 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:52.181298 15197 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:52.185093 15188 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:52.188412 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.190079 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:52.190975 15192 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.191320 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.138244 18792 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:52.192790 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.186877 18901 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:52.152221 18918 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.204777 15266 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.205077 18806 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:52.208376 15309 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.516s (SENT) [suppressed 47 similar messages]
I20260709 13:04:52.209461 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.208995 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.210641 15269 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:52.210963 18376 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:52.211432 18376 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:52.212352 18376 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.213290 18376 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.210880 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.217509 15268 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:52.205955 18918 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.218986 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.220142 15269 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:52.224057 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.227615 15196 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:52.214437 18929 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.230161 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:52.239241 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.240794 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.241458 18901 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:52.241628 18889 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:52.241899 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.242033 18901 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:52.244215 18901 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:52.245159 18929 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.250202 15268 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:52.252080 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.252820 15191 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:52.256107 15266 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.261324 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.272552 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.274518 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:52.277801 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:52.278733 15191 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:52.280465 15192 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:52.236377 18806 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:52.289526 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.286473 15197 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:04:52.285478 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.269335 18889 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.296778 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:52.307981 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 99633.4us
I20260709 13:04:52.308439 15192 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:52.298439 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.301548 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.315663 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.316864 15196 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:52.319526 15192 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 10. Ops: [8.6-8.6]
I20260709 13:04:52.312079 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:52.328809 15192 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:52.330644 15192 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:52.332634 15188 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 12. Ops: [10.7-10.7]
I20260709 13:04:52.336427 15191 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:04:52.307564 18864 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:52.339296 15196 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:04:52.337785 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:52.342975 15309 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.570s (SENT)
I20260709 13:04:52.343672 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.351409 15196 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:52.355556 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.323352 18889 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:52.347754 18917 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:52.350382 18866 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:52.350231 18877 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:52.349622 18570 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.344710 18864 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:52.375804 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.379613 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.395854 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.396205 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.398350 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.400969 15340 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 12. Ops: []
I20260709 13:04:52.402436 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.403180 15340 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:52.399236 15339 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
W20260709 13:04:52.400578 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54989.7us
I20260709 13:04:52.409062 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.410303 15340 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:52.411441 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.412286 15346 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:52.367833 18917 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:52.413566 18917 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.408752 18918 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.419772 18918 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.421877 18739 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:52.378880 18877 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:52.430608 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.431493 15343 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:52.432991 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.401073 18942 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:52.378290 18570 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:52.440560 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77249.4us
I20260709 13:04:52.450697 15341 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:52.451309 15341 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:52.441457 18874 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:52.454373 15341 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.457271 15341 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:52.458222 18570 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:52.460317 18971 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:04:52.460242 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.464442 18864 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.466085 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.452162 18917 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.458981 18742 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:52.445394 18942 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.481729 15341 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:52.484530 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2054) took 1193 ms. Trace:
I20260709 13:04:52.485276 15341 rpcz_store.cc:276] 0709 13:04:51.290949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.499416 (+208467us) service_pool.cc:224] Handling call
0709 13:04:51.499747 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.450548 (+950801us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400010520. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5684dc0 00007f36e570f1c0 00007f36e5710231 00007f36e570cd8f 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c
0709 13:04:52.484081 (+ 33533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.484434 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453363968}
W20260709 13:04:52.489259 18934 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.905s	user 0.002s	sys 0.013s
I20260709 13:04:52.490325 18917 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:52.491307 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2046) took 1211 ms. Trace:
I20260709 13:04:52.491747 15342 rpcz_store.cc:276] 0709 13:04:51.279919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.280053 (+   134us) service_pool.cc:224] Handling call
0709 13:04:51.280495 (+   442us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:51.331746 (+ 51251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.331784 (+    38us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:51.337269 (+  5485us) log.cc:844] Serialized 78 byte log entry
0709 13:04:51.457029 (+119760us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:51.457072 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.457150 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:52.465505 (+1008355us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:52.490959 (+ 25454us) raft_consensus.cc:1685] finished
0709 13:04:52.490989 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.491245 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2507,"raft.queue_time_us":32894,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"spinlock_wait_cycles":61292288,"thread_start_us":114117,"threads_started":1,"wal-append.queue_time_us":210728}
I20260709 13:04:52.456251 18874 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.502636 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.503608 15191 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
W20260709 13:04:52.509131 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 111269us
I20260709 13:04:52.510674 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.512173 15191 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:52.512288 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.517109 18473 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:52.520845 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.521559 15194 raft_consensus.cc:2376] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10. Re-sending same reply.
I20260709 13:04:52.512305 18981 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:52.522845 15188 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:52.478621 18877 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.507869 18889 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:52.528326 18917 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:52.532493 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:52.522439 18981 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:52.527967 18942 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:52.534518 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:52.535341 15870 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:52.544162 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.544806 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.545390 18939 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:04:52.546608 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.548702 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:52.549481 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.545480 15194 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:04:52.545670 18889 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:52.553890 18438 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.556903 15192 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:52.554939 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58398 (request call id 222) took 1940 ms. Trace:
I20260709 13:04:52.557422 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:52.557734 15868 rpcz_store.cc:276] 0709 13:04:50.614219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.614513 (+   294us) service_pool.cc:224] Handling call
0709 13:04:50.640130 (+ 25617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.949415 (+309285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.554731 (+1605316us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54005dd4d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:52.554884 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630634368}
I20260709 13:04:52.555527 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.539179 18874 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.560338 18873 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:52.561328 18873 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:52.545506 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.563805 18880 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:52.564241 18880 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:52.564793 18376 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:52.565476 18473 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:52.566119 18376 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:52.566469 18807 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:52.567298 18376 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.569023 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:52.566010 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.571336 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:52.565104 18880 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:52.576758 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.577545 15340 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:04:52.579253 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:52.579967 15340 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.570451 18981 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.575023 15345 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:52.583218 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.574265 15344 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:52.590615 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.591060 18880 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:52.594894 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.596575 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:52.597599 15345 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.572721 15341 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:52.599290 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.598783 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.620639 15343 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.612414 15338 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:52.566160 18830 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.562433 18873 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.657541 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:52.620033 18916 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:04:52.657480 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:52.624158 18979 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:04:52.666812 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:52.625561 18893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.017s	sys 0.015s
I20260709 13:04:52.599155 18977 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:52.676688 15345 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.609802 18807 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:52.679152 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:52.680505 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:52.593997 18874 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:04:52.609402 18917 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 13:04:52.678079 18893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.017s	sys 0.016s
I20260709 13:04:52.674243 18570 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.676404 18978 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.673894 18864 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:52.693996 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.677492 18889 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:52.698020 15343 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:52.622886 18877 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:04:52.692289 18893 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:52.681550 18473 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:04:52.706099 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 106902us
I20260709 13:04:52.739282 15309 leader_election.cc:400] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8.
I20260709 13:04:52.681685 18873 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.706748 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:52.720031 18864 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.710520 18978 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.703426 15191 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:52.712862 18943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:04:52.687846 18807 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.705277 18570 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.760620 15191 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:52.765179 18982 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
I20260709 13:04:52.765897 18864 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.767637 18570 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.768288 18978 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.768537 18947 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.769042 18947 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.771138 18947 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.709931 18866 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:52.686555 18977 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.779371 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.780078 15263 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:52.780476 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.780913 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.781087 15271 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:52.781903 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:52.772933 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.783371 15267 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:52.784614 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.785472 15267 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.787740 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.788659 15265 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.773659 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.790511 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:52.781451 15263 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:52.792311 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.792766 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.793435 15264 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.792848 15263 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:52.782478 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:04:52.796159 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.796984 15271 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:52.796298 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:52.798602 18963 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:52.799504 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.800565 15269 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:04:52.802630 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 106290us
I20260709 13:04:52.808422 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.814075 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.814918 15268 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:52.816929 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:52.818483 15263 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:04:52.759521 18889 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:04:52.800313 18626 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:52.821188 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.823434 15267 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.765170 18893 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:52.802987 18963 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.827441 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.827989 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.823418 18806 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:04:52.813638 18673 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:52.834561 18673 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:52.835443 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.836012 15268 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.835597 18673 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.838110 18963 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:52.816586 18979 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:52.832389 18987 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:04:52.833052 18883 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.831398 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:52.830791 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:52.842204 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.825542 15264 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.826506 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:52.848192 15268 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:52.853998 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.851121 15340 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:52.853060 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.855789 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.860306 15267 raft_consensus.cc:2368] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7.
I20260709 13:04:52.860481 15264 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.864090 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:52.825467 18626 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:52.860338 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:52.831686 18376 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:52.871451 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:52.885980 15264 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.889074 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.889746 15267 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.890874 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.860839 18947 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:52.892722 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:52.830722 18901 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:04:52.859411 18992 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.861510 18887 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:52.865021 18511 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:04:52.899784 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.916715 15268 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.893832 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:52.859762 18979 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:52.902680 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:52.865582 18943 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:04:52.905771 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.883644 18978 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.907445 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:52.906853 18806 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:52.911710 18977 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.899338 18550 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:52.885802 18376 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.919333 15267 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:04:52.939940 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47304.4us
I20260709 13:04:52.948251 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:52.958614 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 94822.9us
I20260709 13:04:52.961707 15268 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:52.918326 18994 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:52.974884 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:52.976406 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 119298us
W20260709 13:04:52.988137 18990 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:04:52.990501 15868 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:52.992676 18874 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:53.003171 18942 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:53.003718 18942 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:53.004132 18942 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.952251 18979 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:53.009455 18979 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:52.951820 18376 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.948179 18947 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 13:04:53.012017 18953 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:04:53.014532 18936 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.428s	user 0.004s	sys 0.006s
W20260709 13:04:53.016132 18985 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 13:04:52.919850 18992 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:52.946316 18928 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:53.017218 18807 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:52.985328 18626 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.018375 18992 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:52.945212 18806 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:53.023123 18806 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.028589 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:53.039304 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:53.040350 15267 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:53.042141 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:53.043370 15267 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:53.048359 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:53.051972 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 69986.3us
I20260709 13:04:53.050633 18873 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:52.977530 18994 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:52.943418 18978 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.070315 15265 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:53.074294 18963 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.076762 18963 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.080901 15264 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:53.082196 18114 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:53.037667 18550 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:04:53.050894 18943 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:04:53.098223 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1567) took 1002 ms. Trace:
I20260709 13:04:53.037221 18880 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:04:53.091241 18570 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.095364 18874 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.096009 18773 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:53.063887 18994 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.082765 18992 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.064370 18873 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:53.111866 15268 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:53.098743 15192 rpcz_store.cc:276] 0709 13:04:52.096040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.331681 (+235641us) service_pool.cc:224] Handling call
0709 13:04:52.556706 (+225025us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.557376 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.097940 (+540564us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001a4d50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:53.098152 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516793088}
W20260709 13:04:53.122004 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 198553us
I20260709 13:04:53.149587 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:53.150135 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 121993us
I20260709 13:04:53.119189 15311 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:53.153862 18829 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:53.154464 18829 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:53.154978 18829 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:53.160616 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.151278 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:53.168367 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:53.175221 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.173411 18473 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:53.177522 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:53.085101 18963 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:04:53.123750 18773 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:53.194759 15270 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:53.192826 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74893.5us
I20260709 13:04:53.165331 18939 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:53.198690 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 117731us
I20260709 13:04:53.198506 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:53.206228 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:53.207383 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:53.213696 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:53.217639 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.218389 15337 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:04:53.220896 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:53.221654 15344 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:53.146903 18874 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.146922 18570 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:53.291553 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77960.7us
I20260709 13:04:53.291277 18773 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.227576 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.165337 18992 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.184399 18511 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:04:53.291746 18830 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:53.292964 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:53.289731 15270 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:53.205636 18928 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:53.185437 18942 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.301417 15344 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:04:53.209642 18939 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.197412 18473 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:53.287910 18242 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:53.304946 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:53.339370 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.301146 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:53.227759 18578 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:53.198522 19005 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:53.208978 18977 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:53.277653 18550 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.200927 18917 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:53.223853 18944 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:53.339529 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46641.6us
I20260709 13:04:53.368923 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:53.317670 18773 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:53.355253 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.372274 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.374004 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.375347 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:53.356082 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55034.2us
I20260709 13:04:53.359006 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.377214 15337 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 6: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:53.360325 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.342226 18939 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:53.345361 19005 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.388136 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.389885 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.400072 15344 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:53.404886 15270 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:53.406829 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.318584 18955 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:04:53.355504 19012 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:53.375474 18830 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:53.369831 18917 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:53.376441 18578 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:53.416960 15270 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:53.394598 18978 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.398741 18673 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:53.395112 19005 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.354250 18977 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.414739 18830 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.444928 18928 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.405649 18829 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.445039 18978 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:53.447355 18978 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.418520 18917 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:53.445663 18830 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:53.451833 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 82979.9us
W20260709 13:04:53.456143 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 245103us
I20260709 13:04:53.457232 15238 leader_election.cc:400] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10.
I20260709 13:04:53.457535 15238 leader_election.cc:403] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:53.458465 15160 leader_election.cc:400] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7.
I20260709 13:04:53.458832 15160 leader_election.cc:403] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:53.460552 18570 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:53.463721 19010 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:04:53.467687 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:53.455543 19002 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:04:53.473831 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.470943 18673 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7.
W20260709 13:04:53.485818 18996 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 13:04:53.486228 19006 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:04:53.486655 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1569) took 1390 ms. Trace:
I20260709 13:04:53.489070 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:53.489519 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:53.488502 15188 rpcz_store.cc:276] 0709 13:04:52.096499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.333671 (+237172us) service_pool.cc:224] Handling call
0709 13:04:52.522567 (+188896us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.523337 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.486381 (+963044us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540024ca50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:53.486528 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407518080}
W20260709 13:04:53.485849 15266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 1889) took 2095 ms (client timeout 2072 ms). Trace:
I20260709 13:04:53.425362 18473 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:53.491570 15266 rpcz_store.cc:269] 0709 13:04:51.389755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.423742 (+ 33987us) service_pool.cc:224] Handling call
0709 13:04:53.485276 (+2061534us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400348854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:53.485422 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659462016}
I20260709 13:04:53.497285 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.472700 18922 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:53.499599 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.490301 18992 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.492522 18673 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:53.514642 19020 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:04:53.492801 18570 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:04:53.504613 19003 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 13:04:53.510573 19024 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10.
I20260709 13:04:53.511994 18922 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:53.512544 19023 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:53.512574 19025 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:53.512791 19004 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:53.517539 18829 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.510628 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.500974 19012 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:53.515692 18918 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.539902 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.479271 18578 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.588126 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.604422 15344 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:53.528002 18992 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:53.547782 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:53.607889 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 97440.6us
I20260709 13:04:53.523082 18873 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:53.609705 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.530230 18673 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:53.618247 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:53.602770 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.615026 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:53.591434 18376 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.003s
I20260709 13:04:53.616664 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:53.588192 19003 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:53.535820 19025 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:53.549261 18864 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:53.618394 19023 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:53.553067 18978 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.569756 19004 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:53.528187 18570 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.606052 18942 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:53.645509 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.648003 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.648819 15341 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:04:53.613407 18918 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:53.619069 19000 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.649885 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:53.653141 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.639146 18550 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:53.638944 18376 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.673637 18376 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.641295 18829 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:53.675411 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.609736 18939 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:53.663203 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.641960 18864 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:53.614656 18830 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.679396 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.646481 18992 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:53.641358 19025 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.676499 15341 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:53.680686 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:53.682216 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.716289 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:53.710772 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.717880 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:53.675932 18942 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.722421 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.680269 18550 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:53.715704 19003 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:53.682607 19023 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:53.680424 18829 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:53.710381 18873 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:53.732345 18830 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.734081 19005 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:53.735877 18954 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.023s	user 0.009s	sys 0.004s
I20260709 13:04:53.737272 15341 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:53.717136 18992 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:53.731252 18864 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:53.741137 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.741906 18550 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.879124 18550 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:53.873359 18946 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:53.880936 18773 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:53.881948 18640 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:53.884081 18879 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:53.885808 18879 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:53.754223 19022 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:53.742184 18673 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.889814 15268 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:04:53.756011 18994 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 13:04:53.891018 18994 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:53.893150 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:53.894078 18994 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.743517 18829 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:53.875864 18874 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.876191 18992 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:53.899312 15869 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:53.876571 18864 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:53.743407 19024 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:04:53.663471 18922 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.751803 18939 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:53.763517 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2148) took 1142 ms. Trace:
W20260709 13:04:53.877228 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 136207us
I20260709 13:04:53.725015 18918 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:53.741199 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:53.913635 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 172543us
I20260709 13:04:53.864748 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2088) took 1136 ms. Trace:
I20260709 13:04:53.915037 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.724900 19027 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:53.676239 19000 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:53.774946 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:53.752017 19029 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:53.779150 18893 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.730201 18942 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.794764 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:53.940461 15188 raft_consensus.cc:2368] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:04:53.796751 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:53.798434 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:53.941756 15268 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:53.798594 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:53.803465 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:53.805119 18570 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.805788 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:53.770361 19004 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.806928 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:53.809330 18626 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:53.812016 18977 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.821470 18376 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:53.824270 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.830936 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:04:53.833740 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.950747 15270 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:53.836896 18917 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.840446 18873 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.841301 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:53.995452 15271 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:53.997449 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:53.841984 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:53.999372 15264 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:53.842952 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:53.843292 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.000113 15263 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:53.844270 18967 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.567s	user 0.006s	sys 0.000s
I20260709 13:04:53.847965 19005 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:53.849821 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2098) took 3519 ms. Trace:
I20260709 13:04:53.918573 18874 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:04:54.064512 18874 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.065557 18874 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:53.857786 18564 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:53.860895 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:53.860954 18807 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:53.908640 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:54.073652 15269 raft_consensus.cc:2376] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11. Re-sending same reply.
I20260709 13:04:53.904835 15190 rpcz_store.cc:276] 0709 13:04:52.621365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.709791 (+ 88426us) service_pool.cc:224] Handling call
0709 13:04:52.727825 (+ 18034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.794613 (+ 66788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.794644 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:52.794683 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:52.794717 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.763246 (+968529us) spinlock_profiling.cc:243] Waited 66.6 ms on lock 0x7b54000f9bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:53.763294 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.763444 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153097600}
I20260709 13:04:53.912352 15095 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 62) took 7532 ms. Trace:
I20260709 13:04:53.918146 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:53.914386 15343 rpcz_store.cc:276] 0709 13:04:52.728704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.728825 (+   121us) service_pool.cc:224] Handling call
0709 13:04:52.729113 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:52.760177 (+ 31064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.760207 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:52.760650 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:04:52.865637 (+104987us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:52.865689 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.863732 (+998043us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54001761d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:53.863795 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:53.863973 (+   178us) raft_consensus.cc:1685] finished
0709 13:04:53.863992 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.864666 (+   674us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1004,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":9206,"spinlock_wait_cycles":70495104,"thread_start_us":93067,"threads_started":1,"wal-append.queue_time_us":189000}
I20260709 13:04:53.921859 15870 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:53.922356 18114 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:53.922773 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2084) took 1230 ms. Trace:
I20260709 13:04:53.840380 19025 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:54.075242 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 157192us
I20260709 13:04:53.952907 15874 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:54.075433 18114 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.921615 18929 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.919731 18830 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:53.921021 18773 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:53.927897 19022 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:54.084148 18917 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:53.992331 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:53.934295 19029 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.001197 15272 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:54.089103 19029 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.996222 18376 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:53.842900 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.091535 18830 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:54.092439 15266 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:54.078262 19041 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:54.093422 18376 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:54.093557 19041 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:54.093987 18830 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:54.015743 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 184878us
I20260709 13:04:54.016820 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.094601 19041 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.095486 15271 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10.
I20260709 13:04:53.850473 18952 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:54.021359 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:54.025346 18901 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:54.027877 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:54.030279 18942 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:53.990952 18877 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.018137 18742 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:54.034953 18994 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:54.143797 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:53.950743 18947 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.057252 19000 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.058100 18626 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:53.933868 18507 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
I20260709 13:04:54.158726 18507 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:54.159158 18507 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:54.159346 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.160140 15269 raft_consensus.cc:2376] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10. Re-sending same reply.
I20260709 13:04:54.160188 18507 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.162138 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.067410 18977 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:53.943382 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.163641 15268 raft_consensus.cc:2376] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11. Re-sending same reply.
I20260709 13:04:54.075565 15342 rpcz_store.cc:276] 0709 13:04:52.692119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.692415 (+   296us) service_pool.cc:224] Handling call
0709 13:04:52.692943 (+   528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:52.820151 (+127208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:52.820182 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:52.820225 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:52.820253 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.922531 (+1102278us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400246154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:53.922575 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.922717 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2291,"raft.queue_time_us":2679,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3471,"spinlock_wait_cycles":286390528}
I20260709 13:04:54.071795 18640 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:53.946422 18893 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.126459 18904 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:54.082273 18929 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.096760 15191 raft_consensus.cc:2410] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:04:54.098299 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 106076us
I20260709 13:04:54.162866 18977 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:04:54.099020 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77750.8us
I20260709 13:04:54.102425 15272 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:54.199540 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.200564 15268 raft_consensus.cc:2368] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11.
I20260709 13:04:54.105999 15341 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:54.107267 15188 raft_consensus.cc:2376] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8. Re-sending same reply.
I20260709 13:04:54.099452 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:54.108588 15266 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:54.109346 15870 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
W20260709 13:04:54.213431 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 114036us
I20260709 13:04:54.131220 18114 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.133435 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:54.153400 18963 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.142496 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:54.258230 15338 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:54.143639 18901 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.144328 15345 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:04:54.050661 15263 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:04:54.018425 15193 rpcz_store.cc:276] 0709 13:04:50.330331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.365361 (+ 35030us) service_pool.cc:224] Handling call
0709 13:04:50.558100 (+192739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.558317 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:50.894069 (+335752us) log.cc:844] Serialized 14 byte log entry
0709 13:04:52.131704 (+1237635us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18003f1000. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b
0709 13:04:52.771937 (+640233us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b18003f1000. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e95e158f 00007f36e2620571 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd
0709 13:04:53.849097 (+1077160us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18003f1000. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:04:53.849197 (+   100us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:53.849243 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:53.849283 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.849357 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:53.849717 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31960,"prepare.queue_time_us":484689,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":61595,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":22636,"spinlock_wait_cycles":36447616,"thread_start_us":490329,"threads_started":3,"wal-append.queue_time_us":226814,"wal-append.run_cpu_time_us":2233,"wal-append.run_wall_time_us":1139605}
I20260709 13:04:54.143765 18994 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.157313 18626 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.162298 18507 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:53.854060 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.267266 18570 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.174772 15264 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:54.294600 18570 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.296128 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.296965 15264 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:54.297341 18570 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.298079 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.253921 18550 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:04:54.081704 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:54.018338 18873 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.098577 19024 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:54.195290 15346 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:54.104503 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.254451 15868 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:54.152897 18438 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:04:54.259145 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59436.8us
I20260709 13:04:54.259370 18114 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:54.264904 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55511.9us
I20260709 13:04:54.312409 15309 leader_election.cc:400] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10.
I20260709 13:04:54.312803 15309 leader_election.cc:403] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:54.269248 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.126143 19005 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:04:54.314041 15266 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:54.152158 18877 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.317243 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.308349 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:54.129673 18917 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:54.274809 15192 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 6.
I20260709 13:04:54.275502 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.194398 18640 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.277149 15870 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:54.278231 15196 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:54.287623 18893 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.288358 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.259789 19022 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.260712 18773 raft_consensus.cc:2764] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:54.132829 15344 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:54.302423 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.298929 15264 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:54.183954 18947 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.171391 18742 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.257465 18992 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.271387 18963 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.318949 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:54.556137 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 243860us
I20260709 13:04:54.556893 18861 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10.
I20260709 13:04:54.560307 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.561295 15191 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:54.533428 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.387712 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.564852 15338 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:54.074626 15095 rpcz_store.cc:276] 0709 13:04:46.379990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.380196 (+   206us) service_pool.cc:224] Handling call
0709 13:04:53.912234 (+7532038us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:50.696280 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:50.697159 (+   879us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:50.697227 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:04:50.697270 (+    43us) tablet.cc:662] Decoding operations
0709 13:04:50.697906 (+   636us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:50.698023 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:50.698063 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:50.698575 (+   512us) tablet.cc:701] Row locks acquired
0709 13:04:50.698637 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:04:50.698858 (+   221us) write_op.cc:270] Start()
0709 13:04:50.707073 (+  8215us) write_op.cc:276] Timestamp: P: 1783602290698783 usec, L: 0
0709 13:04:50.710218 (+  3145us) op_driver.cc:348] REPLICATION: starting
0709 13:04:50.826995 (+116777us) log.cc:844] Serialized 974 byte log entry
0709 13:04:51.583428 (+756433us) op_driver.cc:464] REPLICATION: finished
0709 13:04:51.786792 (+203364us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e9143ef0
0709 13:04:51.913834 (+127042us) write_op.cc:301] APPLY: starting
0709 13:04:51.913938 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:51.914093 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:51.914123 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:51.914569 (+   446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:51.914819 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:04:51.914884 (+    65us) write_op.cc:312] APPLY: finished
0709 13:04:51.915160 (+   276us) log.cc:844] Serialized 28 byte log entry
0709 13:04:51.915380 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.915491 (+   111us) write_op.cc:454] Released schema lock
0709 13:04:51.915551 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:51.916025 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.916065 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2034768,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":330075,"apply.run_cpu_time_us":2156,"apply.run_wall_time_us":2157,"num_ops":2,"prepare.queue_time_us":374307,"prepare.run_cpu_time_us":17185,"prepare.run_wall_time_us":349310,"raft.queue_time_us":164001,"raft.run_cpu_time_us":29727,"raft.run_wall_time_us":291263,"replication_time_us":862503,"spinlock_wait_cycles":63159040,"thread_start_us":813337,"threads_started":4,"wal-append.queue_time_us":278120,"wal-append.run_cpu_time_us":81489,"wal-append.run_wall_time_us":1801232}]]}
W20260709 13:04:54.567878 15842 leader_election.cc:336] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.589s (SENT)
I20260709 13:04:54.568799 15269 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:54.568899 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:54.342960 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.319669 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:54.572832 15345 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:54.477073 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.486392 15193 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:54.579696 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.580767 15270 raft_consensus.cc:2368] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11.
I20260709 13:04:54.494848 15197 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:54.581465 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:54.586714 15344 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:54.531834 15265 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:54.592067 18873 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.592693 18873 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.593183 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.579715 15311 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:54.593129 18873 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:54.593927 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.299500 19023 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.539637 18946 consensus_meta.cc:287] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.660s	user 0.007s	sys 0.005s
I20260709 13:04:54.601737 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.611958 15197 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:54.613125 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.613927 15197 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
W20260709 13:04:54.539462 18864 consensus_meta.cc:287] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.002s
I20260709 13:04:54.606889 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.309731 18570 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.319146 18978 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:54.475179 18901 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.618726 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.315717 18918 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.620959 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.628010 15266 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:54.481175 18959 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:54.632337 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.637797 15345 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:54.640571 15346 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:54.641637 15265 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:54.537207 18916 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:54.410908 18944 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:54.700369 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.653091 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:54.650682 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.480827 18626 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:54.571771 19000 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:54.654167 15264 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:54.449379 19024 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:54.320488 18904 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:54.655529 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.449177 19004 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:54.653846 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:54.410727 19028 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:54.652339 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:54.478289 18952 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:54.736464 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.738600 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.410614 18438 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.741966 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.492080 18848 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.710317 15190 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:04:54.713080 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.710048 18959 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:54.752193 15266 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:54.713691 15269 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:54.714160 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.309221 18829 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.714377 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.714920 19021 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.717849 19024 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.718676 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:54.767284 15264 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:54.719349 18904 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:54.720539 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 62865.3us
W20260709 13:04:54.775660 15195 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1548) took 2808 ms (client timeout 1916 ms). Trace:
I20260709 13:04:54.775876 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:54.703984 18879 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 13:04:54.720882 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67105.6us
I20260709 13:04:54.721334 18114 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:54.778934 18114 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:54.721817 19043 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.407s	user 0.001s	sys 0.000s
I20260709 13:04:54.725302 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.726146 18929 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.707227 18578 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:04:54.726926 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:54.727777 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74766.5us
I20260709 13:04:54.727857 18583 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:54.728021 18963 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.730218 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.731353 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.787228 15268 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:54.732234 15309 leader_election.cc:400] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11.
I20260709 13:04:54.784158 18114 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:54.788779 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56705us
I20260709 13:04:54.789907 15189 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:54.790174 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:54.732620 18943 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.733114 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.792553 15272 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:54.716686 15196 raft_consensus.cc:2376] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10. Re-sending same reply.
I20260709 13:04:54.702612 18852 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:04:54.656912 18922 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:54.675045 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.654044 18965 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:54.656257 18773 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:54.702745 18640 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.652897 18880 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.817292 18887 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.643792 18939 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:54.819327 18939 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.820601 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.821741 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.821938 18939 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:54.748734 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.739084 18944 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.746634 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:54.757568 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:54.652830 18893 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:04:54.742377 19004 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.739951 18952 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:54.716917 18874 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.760891 15265 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:04:54.765110 15271 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:54.759778 18848 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.639515 19023 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:54.776124 15195 rpcz_store.cc:269] 0709 13:04:51.955768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.959788 (+  4020us) service_pool.cc:224] Handling call
0709 13:04:54.763702 (+2803914us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54001e69d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:54.763887 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4909041536}
I20260709 13:04:54.779631 15266 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:54.704293 18978 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.778038 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.664466 18570 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.785570 15194 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:54.795589 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70386.8us
I20260709 13:04:54.915583 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:54.917657 15238 leader_election.cc:400] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:04:54.918115 15238 leader_election.cc:403] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:54.796340 15345 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:54.800954 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:54.808000 15264 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:54.767544 19025 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.809811 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.922266 15190 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:54.717439 18918 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.738363 18916 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.595880 19022 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.940318 19022 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.922186 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.941210 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:54.941954 15264 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:54.941998 18929 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:54.942086 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:54.942692 18929 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:54.853543 18965 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:54.943279 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:54.943601 18929 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.944136 19011 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:54.944308 18965 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:54.944604 19004 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:54.826754 19029 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.736s	user 0.009s	sys 0.003s
I20260709 13:04:54.822949 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.953279 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.849507 15269 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:04:54.849856 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 507099us
I20260709 13:04:54.823817 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.912132 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.913540 15341 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:54.919715 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 118811us
I20260709 13:04:54.956038 15191 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:54.856154 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.809829 18861 raft_consensus.cc:2764] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:54.810781 18830 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:54.965297 15192 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:54.966264 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2157) took 1040 ms. Trace:
I20260709 13:04:54.925954 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.826921 18873 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.968575 15195 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:54.825189 18438 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.828948 19024 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:54.969142 15263 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:04:54.819322 19045 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:04:54.926939 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.914255 18874 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.927662 18578 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:54.927877 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 149959us
I20260709 13:04:54.813004 18942 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 13:04:54.931120 18963 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:54.987625 18963 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:54.932188 18829 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.989517 18829 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:54.989928 18829 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:54.990008 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:54.968636 18893 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:54.990759 18829 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.991477 18893 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.991895 18893 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:54.991945 18829 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:54.992398 18626 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:54.992658 19023 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.809473 18550 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:04:54.993994 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1925) took 1139 ms. Trace:
I20260709 13:04:54.994342 15269 rpcz_store.cc:276] 0709 13:04:53.854677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.754958 (+900281us) service_pool.cc:224] Handling call
0709 13:04:54.849296 (+ 94338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.954195 (+104899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.993773 (+ 39578us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54002a94d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:54.993920 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206906240}
I20260709 13:04:54.933466 15345 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:54.788762 18926 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:04:54.935114 18918 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:54.936031 19046 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.341s	user 0.001s	sys 0.003s
I20260709 13:04:55.058965 15193 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:54.937924 18916 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:54.940690 18944 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.945772 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:54.946382 15271 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:54.818048 18880 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.946970 15270 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:54.449967 18977 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.933504 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:54.956779 15309 leader_election.cc:400] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11.
I20260709 13:04:55.088318 15190 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:04:55.088375 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 131748us
W20260709 13:04:54.957592 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 101576us
W20260709 13:04:55.089973 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.959738 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:54.960716 15265 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:04:55.091568 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1931) took 1228 ms. Trace:
I20260709 13:04:54.961831 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:54.776237 19021 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.966679 15192 rpcz_store.cc:276] 0709 13:04:53.925465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.964485 (+1039020us) service_pool.cc:224] Handling call
0709 13:04:54.964915 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.965929 (+  1014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.966185 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.969197 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2160) took 1023 ms. Trace:
I20260709 13:04:54.964258 18573 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:54.826556 18742 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:54.974086 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47247.8us
I20260709 13:04:54.927560 18852 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:54.965334 15194 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:04:54.850164 18992 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.946084 18938 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:54.932577 18956 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:55.000722 18848 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.001216 18994 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.002314 18640 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:55.131575 18640 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:55.126677 18573 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:55.132761 18640 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:55.134009 18640 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:55.133723 18573 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.004635 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2152) took 1080 ms. Trace:
I20260709 13:04:54.964671 18830 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:55.135396 18830 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.006405 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:54.968590 18564 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:54.955703 18864 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:04:54.964078 18877 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:55.007936 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:55.142354 15196 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:55.008675 18570 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.010403 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1923) took 1156 ms. Trace:
I20260709 13:04:55.143401 15263 rpcz_store.cc:276] 0709 13:04:53.854177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.275147 (+420970us) service_pool.cc:224] Handling call
0709 13:04:55.010236 (+735089us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400329bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:55.010342 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936985472}
I20260709 13:04:55.145263 15263 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:55.145965 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1934) took 1263 ms. Trace:
I20260709 13:04:55.012004 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 218) took 1108 ms. Trace:
I20260709 13:04:55.147222 15337 rpcz_store.cc:276] 0709 13:04:53.903865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.907125 (+  3260us) service_pool.cc:224] Handling call
0709 13:04:53.907553 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.917085 (+  9532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.917114 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.927571 (+ 10457us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.262695 (+335124us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:54.262738 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.262808 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.011795 (+748987us) raft_consensus.cc:1685] finished
0709 13:04:55.011816 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.011945 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68277,"raft.queue_time_us":10446,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":15660,"thread_start_us":272056,"threads_started":1,"wal-append.queue_time_us":592612}
I20260709 13:04:55.013515 18978 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.810703 18943 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.151870 18943 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:54.848801 19005 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:04:54.970105 18947 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:54.851948 18922 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.155589 18922 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:55.079243 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 133526us
I20260709 13:04:55.156764 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:55.157830 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:54.983414 19024 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:55.160656 15343 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:55.138655 18564 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:55.162362 18564 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:55.166929 18852 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:55.135224 15189 rpcz_store.cc:276] 0709 13:04:53.924044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.200420 (+276376us) service_pool.cc:224] Handling call
0709 13:04:54.273474 (+ 73054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.790287 (+516813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.004318 (+214031us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54002116d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:55.004559 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187314560}
I20260709 13:04:55.146358 15263 rpcz_store.cc:276] 0709 13:04:53.882270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.144606 (+1262336us) service_pool.cc:224] Handling call
0709 13:04:55.144980 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.145668 (+   688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.145894 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.175014 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.188899 15263 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 5.
I20260709 13:04:55.190570 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.091892 15265 rpcz_store.cc:276] 0709 13:04:53.863569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.914092 (+1050523us) service_pool.cc:224] Handling call
0709 13:04:54.960450 (+ 46358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.091325 (+130875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.091518 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.240795 15265 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:55.241525 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1935) took 1357 ms. Trace:
I20260709 13:04:55.241914 15265 rpcz_store.cc:276] 0709 13:04:53.884480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.239951 (+1355471us) service_pool.cc:224] Handling call
0709 13:04:55.240373 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.241237 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.241462 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.099102 15874 raft_consensus.cc:2393] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:04:55.098978 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.099481 15195 rpcz_store.cc:276] 0709 13:04:53.945903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.967876 (+1021973us) service_pool.cc:224] Handling call
0709 13:04:54.968264 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.968950 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.969147 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:55.245911 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.246822 15195 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:55.100131 15192 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:04:55.110918 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.249768 15196 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:55.060388 19023 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:54.847878 18959 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:54.962992 19029 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.121390 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:55.080322 18511 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.125057 15193 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:55.083628 18901 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:55.127164 18918 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.128769 19021 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:55.015115 18874 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.072333 18946 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:04:55.200150 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.096621 15270 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:55.125943 18938 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.130270 18956 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:55.209707 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2159) took 1282 ms. Trace:
I20260709 13:04:55.176458 18947 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:55.177748 18944 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:55.227351 18507 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.938s	user 0.012s	sys 0.001s
W20260709 13:04:55.272496 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 462843us
I20260709 13:04:55.543206 15188 raft_consensus.cc:606] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:55.425999 15271 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:04:55.553342 15162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.003s
W20260709 13:04:55.575786 15162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.007s	sys 0.003s
W20260709 13:04:55.576287 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 590348us
I20260709 13:04:55.376703 15267 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:04:55.522338 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 433141us
W20260709 13:04:55.574705 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.334848 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2161) took 1346 ms. Trace:
I20260709 13:04:55.592576 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:55.592810 15193 rpcz_store.cc:276] 0709 13:04:53.988633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.089629 (+1100996us) service_pool.cc:224] Handling call
0709 13:04:55.124900 (+ 35271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.334454 (+209554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.334767 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:55.373994 15346 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.016s	sys 0.016s
W20260709 13:04:55.565879 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 444525us
W20260709 13:04:55.593925 15346 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.038s	sys 0.024s
I20260709 13:04:55.576001 15197 rpcz_store.cc:276] 0709 13:04:53.927220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.964946 (+1037726us) service_pool.cc:224] Handling call
0709 13:04:54.965227 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.159281 (+194054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.159324 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.159381 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:55.159423 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.209377 (+ 49954us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54000f96d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:55.209441 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.209627 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445741824}
I20260709 13:04:55.594340 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:55.559743 15192 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:55.599185 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:55.601697 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.543598 18952 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.001s
I20260709 13:04:55.605762 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:55.610325 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:55.489179 15081 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2a3d3cf7ed3b453ebeccda54becdb6e1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:55.612075 15081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 122960us
W20260709 13:04:55.601946 18929 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.002s	sys 0.010s
W20260709 13:04:55.613000 18929 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.002s	sys 0.010s
W20260709 13:04:55.578744 18999 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.018s	sys 0.003s
W20260709 13:04:55.572778 18904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.009s	sys 0.005s
I20260709 13:04:55.525836 18959 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:55.286088 18922 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.579456 18946 consensus_queue.cc:1243] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:55.416168 18861 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.621919 15311 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:55.429425 18887 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.581173 18938 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:55.627545 18904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.010s	sys 0.005s
I20260709 13:04:55.628123 18570 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.628271 18807 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:55.628577 18864 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:55.332007 18511 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.374330 18852 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.598181 18978 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.693562 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:55.693914 18978 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.696154 18978 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.617832 18952 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.698181 18952 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.286556 18626 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.343s
I20260709 13:04:55.543761 19029 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:55.600630 19011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.008s
W20260709 13:04:55.699404 19011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.004s	sys 0.008s
I20260709 13:04:55.701529 19025 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:55.702015 19025 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:55.703683 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1943) took 1862 ms. Trace:
I20260709 13:04:55.702978 19025 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.639197 15263 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:55.704066 15267 rpcz_store.cc:276] 0709 13:04:53.841182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.841303 (+   121us) service_pool.cc:224] Handling call
0709 13:04:53.841607 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.598257 (+1756650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.703449 (+105192us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001d92d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:55.703628 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3529742720}
I20260709 13:04:55.578461 18901 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:55.640300 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:55.705013 18874 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.705276 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.705890 15267 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:55.705427 18901 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:55.706671 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.718487 18877 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:55.718843 18916 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:55.719127 18626 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:55.719416 18877 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:55.719941 18877 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:55.720844 18877 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.722579 18877 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:55.639827 18507 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:04:55.730738 18916 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:55.731176 18916 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:55.732095 18916 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.733057 18916 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:55.733875 15092 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:55.735821 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:55.736744 15092 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 8 to 11, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:55.737751 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:55.738817 15192 raft_consensus.cc:2410] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:55.599699 18944 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:55.740028 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2103) took 1610 ms (client timeout 2029 ms). Trace:
W20260709 13:04:55.740434 15340 rpcz_store.cc:269] 0709 13:04:54.129760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.133157 (+  3397us) service_pool.cc:224] Handling call
0709 13:04:55.739832 (+1606675us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54001757d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:55.739956 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3501752576}
I20260709 13:04:55.740474 18944 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:55.646270 15339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.002s
I20260709 13:04:55.620694 18994 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:55.743378 18994 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.743758 18994 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:55.744993 15091 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 172) took 24017 ms (client timeout 15000 ms). Trace:
I20260709 13:04:55.607836 18947 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:04:55.748274 15190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.002s	sys 0.018s
I20260709 13:04:55.747857 18947 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:55.748610 15190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.002s	sys 0.018s
W20260709 13:04:55.638693 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44453.8us
I20260709 13:04:55.646714 18880 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:55.625603 18550 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:55.284555 19052 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:55.501989 18830 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.750317 18550 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:55.750780 18550 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.751230 15196 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:55.751766 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:55.752153 15267 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:55.753513 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.754601 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.284104 19023 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.756220 18830 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:55.756829 15342 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.001s	sys 0.006s
W20260709 13:04:55.759325 15342 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.002s	sys 0.006s
W20260709 13:04:55.647013 18114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.006s
I20260709 13:04:55.422295 18879 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:55.668396 15264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.008s	sys 0.004s
I20260709 13:04:55.673525 18511 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:55.653535 18742 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:04:55.648150 18887 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.674714 18376 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.738574 15092 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 5 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 7 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:55.648393 18956 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.808036 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:55.648787 18564 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:55.640221 18922 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:55.625330 18578 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:04:55.677083 18640 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.003s
W20260709 13:04:55.667552 18893 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.675s	user 0.005s	sys 0.006s
I20260709 13:04:55.680159 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1940) took 1769 ms. Trace:
I20260709 13:04:55.681488 18977 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.645298 18861 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:55.622725 18999 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.018s	sys 0.003s
I20260709 13:04:55.716811 15197 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:55.807745 18773 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.724136 19021 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:55.724852 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1929) took 1865 ms. Trace:
I20260709 13:04:55.727378 19005 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:55.728042 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 112411us
I20260709 13:04:55.739063 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.853051 15263 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:55.854395 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:55.761018 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:55.855980 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.645649 15344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.008s	sys 0.004s
W20260709 13:04:55.856813 15344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.009s	sys 0.004s
I20260709 13:04:55.857839 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2115) took 1279 ms. Trace:
W20260709 13:04:55.762461 18114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.005s	sys 0.006s
W20260709 13:04:55.763690 15264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.008s	sys 0.004s
W20260709 13:04:55.766127 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.758478 15269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.005s	sys 0.017s
I20260709 13:04:55.581769 18918 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.790838 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2117) took 1211 ms. Trace:
I20260709 13:04:55.862552 15342 rpcz_store.cc:276] 0709 13:04:54.579174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.615718 (+ 36544us) service_pool.cc:224] Handling call
0709 13:04:54.616120 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.616404 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:55.074252 (+457848us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.790109 (+715857us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.790352 (+   243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.790412 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:55.790480 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.790592 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.790757 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":132594,"prepare.queue_time_us":637182,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":55792,"spinlock_wait_cycles":16196224,"thread_start_us":1036016,"threads_started":2,"wal-append.queue_time_us":674318}
I20260709 13:04:55.760231 15267 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:55.864089 15263 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.865846 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:55.866732 15267 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:55.867635 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:55.868629 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:55.801699 15339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.010s	sys 0.003s
W20260709 13:04:55.869156 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 113348us
I20260709 13:04:55.750753 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2162) took 1757 ms. Trace:
I20260709 13:04:55.820783 18511 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:55.805913 15272 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.016s	sys 0.018s
W20260709 13:04:55.887501 15272 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.016s	sys 0.018s
I20260709 13:04:55.675809 18570 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:55.921099 18570 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:55.811111 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:55.807207 18879 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:55.921962 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110976us
I20260709 13:04:55.922904 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:55.758659 18965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.004s	sys 0.017s
W20260709 13:04:55.923609 18965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.004s	sys 0.017s
I20260709 13:04:55.810047 18376 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:55.758543 18242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.005s	sys 0.017s
I20260709 13:04:55.821127 15092 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 8 to 9, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 9 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:55.924449 18242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.005s	sys 0.017s
I20260709 13:04:55.923628 18879 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.925554 18376 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.926033 18564 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:55.885721 19073 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:04:55.925877 15092 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 9 to 12, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 12 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:55.886586 18773 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:55.927631 15092 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 7 to 8, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 8 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:04:55.930315 18773 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:55.827452 15266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.014s	sys 0.025s
W20260709 13:04:55.931231 15266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.014s	sys 0.026s
I20260709 13:04:55.932482 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1930) took 2072 ms. Trace:
I20260709 13:04:55.932817 15266 rpcz_store.cc:276] 0709 13:04:53.859761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.920308 (+1060547us) service_pool.cc:224] Handling call
0709 13:04:54.920637 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.949072 (+ 28435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.949108 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:54.949542 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.931631 (+982089us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:55.931949 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.932170 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.932251 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.932289 (+    38us) raft_consensus.cc:1685] finished
0709 13:04:55.932300 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.932429 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32303,"raft.queue_time_us":28081,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10080,"thread_start_us":915773,"threads_started":1,"wal-append.queue_time_us":923487}
I20260709 13:04:55.846606 18893 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:55.937016 18963 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:55.820068 15194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.014s	sys 0.023s
I20260709 13:04:55.937463 18963 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.828454 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:55.829097 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 213457us
I20260709 13:04:55.779851 19052 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:55.827184 15270 rpcz_store.cc:276] 0709 13:04:53.910880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.604046 (+693166us) service_pool.cc:224] Handling call
0709 13:04:55.679943 (+1075897us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54002a8ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:55.680085 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531253504}
I20260709 13:04:55.806993 18830 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.845943 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:55.722488 18626 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:55.847083 15196 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:55.848387 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.984396 18963 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:55.848435 15271 rpcz_store.cc:276] 0709 13:04:53.859367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.911787 (+1052420us) service_pool.cc:224] Handling call
0709 13:04:54.912111 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.575681 (+663570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.724601 (+148920us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b54000d6e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:55.724791 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78479744}
I20260709 13:04:55.987470 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1939) took 2077 ms. Trace:
I20260709 13:04:55.988130 15271 rpcz_store.cc:276] 0709 13:04:53.910551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.986009 (+2075458us) service_pool.cc:224] Handling call
0709 13:04:55.986322 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.986556 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.986594 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.986650 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:55.987077 (+   427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.987210 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.987378 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:55.862149 15269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.005s	sys 0.017s
W20260709 13:04:55.745365 15091 rpcz_store.cc:269] 0709 13:04:31.727008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.780313 (+ 53305us) service_pool.cc:224] Handling call
0709 13:04:32.760836 (+980523us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5677090 00007f36e5715f3a 00007f36eb4cc1cc 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc 00007f36e9a8a392 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:55.744230 (+22983394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:47.406791 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:47.568208 (+161417us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:47.570428 (+  2220us) write_op.cc:435] Acquired schema lock
0709 13:04:47.572199 (+  1771us) tablet.cc:662] Decoding operations
0709 13:04:47.605879 (+ 33680us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:47.605984 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:47.606034 (+    50us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:04:47.637833 (+ 31799us) tablet.cc:701] Row locks acquired
0709 13:04:47.637855 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:04:47.638255 (+   400us) write_op.cc:270] Start()
0709 13:04:47.638550 (+   295us) write_op.cc:276] Timestamp: P: 1783602287638129 usec, L: 0
0709 13:04:47.638640 (+    90us) op_driver.cc:348] REPLICATION: starting
0709 13:04:47.639877 (+  1237us) log.cc:844] Serialized 8999 byte log entry
0709 13:04:47.958006 (+318129us) op_driver.cc:464] REPLICATION: finished
0709 13:04:48.113999 (+155993us) write_op.cc:301] APPLY: starting
0709 13:04:48.139560 (+ 25561us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:48.163816 (+ 24256us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:48.163974 (+   158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:48.170673 (+  6699us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:48.219045 (+ 48372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:04:48.219101 (+    56us) write_op.cc:312] APPLY: finished
0709 13:04:48.219776 (+   675us) log.cc:844] Serialized 157 byte log entry
0709 13:04:48.220025 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:48.278750 (+ 58725us) write_op.cc:454] Released schema lock
0709 13:04:48.278839 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:48.316640 (+ 37801us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:48.316684 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1259907,"reported_tablets":57,"spinlock_wait_cycles":190566144,"child_traces":[["op",{"apply.queue_time_us":85114,"apply.run_cpu_time_us":8677,"apply.run_wall_time_us":264827,"num_ops":23,"prepare.queue_time_us":295092,"prepare.run_cpu_time_us":20361,"prepare.run_wall_time_us":371344,"raft.queue_time_us":124526,"raft.run_cpu_time_us":29317,"raft.run_wall_time_us":58178,"replication_time_us":319087,"thread_start_us":476329,"threads_started":4,"wal-append.queue_time_us":9608,"wal-append.run_cpu_time_us":32884,"wal-append.run_wall_time_us":1571667}]]}
W20260709 13:04:55.877781 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116873us
W20260709 13:04:55.992928 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 382661us
I20260709 13:04:55.994038 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:55.807600 18880 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:55.875224 15190 rpcz_store.cc:276] 0709 13:04:53.993483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.099813 (+1106330us) service_pool.cc:224] Handling call
0709 13:04:55.125570 (+ 25757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.125735 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:55.177119 (+ 51384us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.749924 (+572805us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.750426 (+   502us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.750477 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:55.750519 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.750581 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.750701 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51809,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":256,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"spinlock_wait_cycles":36096,"thread_start_us":571551,"threads_started":1,"wal-append.queue_time_us":570069}
I20260709 13:04:55.890900 18918 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.899848 18550 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.857743 18792 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:55.901809 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1932) took 2020 ms. Trace:
I20260709 13:04:55.819110 19041 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:04:55.822499 18904 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:04:55.908998 18922 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:55.850946 18640 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:55.913036 18887 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:55.915640 18861 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:55.809283 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1927) took 1953 ms. Trace:
I20260709 13:04:56.064638 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2120) took 1439 ms. Trace:
I20260709 13:04:55.937252 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:55.937863 18114 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:04:55.997205 15270 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:56.066040 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 272) took 2148 ms. Trace:
I20260709 13:04:56.067605 15270 rpcz_store.cc:276] 0709 13:04:53.917307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.996383 (+2079076us) service_pool.cc:224] Handling call
0709 13:04:55.996787 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.065732 (+ 68945us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.065975 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.938494 15874 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:04:55.939591 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.999272 15266 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:55.937816 15194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.015s	sys 0.023s
I20260709 13:04:56.000100 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:55.930394 15092 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 7 to 10, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 10 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.070400 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1938) took 2160 ms. Trace:
I20260709 13:04:56.003580 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:56.005894 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:55.994827 15263 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:04:56.014537 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:56.073197 15271 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:56.000576 15264 rpcz_store.cc:276] 0709 13:04:53.881541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.942745 (+1061204us) service_pool.cc:224] Handling call
0709 13:04:54.943074 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.963585 (+ 20511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.963640 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:54.980495 (+ 16855us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.159117 (+178622us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b4800061a58. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:04:55.860037 (+700920us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:55.901182 (+ 41145us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.901395 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.901480 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.901517 (+    37us) raft_consensus.cc:1685] finished
0709 13:04:55.901617 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.901752 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46574,"prepare.queue_time_us":64484,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":14872,"raft.run_cpu_time_us":3219,"raft.run_wall_time_us":195892,"spinlock_wait_cycles":16455424,"thread_start_us":775536,"threads_started":1,"wal-append.queue_time_us":640417}
I20260709 13:04:56.008955 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2107) took 1861 ms. Trace:
I20260709 13:04:55.937415 18893 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:55.802975 18938 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:56.055274 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 433403us
I20260709 13:04:56.022236 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:56.058409 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:56.070915 15266 rpcz_store.cc:276] 0709 13:04:53.910156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.998731 (+2088575us) service_pool.cc:224] Handling call
0709 13:04:55.999106 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.070090 (+ 70984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.070332 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:56.074868 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.090749 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:55.992126 18942 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:56.075387 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:56.075973 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 61528.2us
I20260709 13:04:56.092303 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:56.076452 15192 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:56.065092 15346 rpcz_store.cc:276] 0709 13:04:54.625136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.761419 (+136283us) service_pool.cc:224] Handling call
0709 13:04:54.761713 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.761955 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:55.594463 (+832508us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.064251 (+469788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.064306 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.064365 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.064438 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.064578 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62022,"prepare.queue_time_us":477845,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":1214627,"threads_started":2}
I20260709 13:04:55.887388 18511 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:56.081624 15263 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:56.081997 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:56.001011 18952 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:56.097496 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 160302us
I20260709 13:04:56.087081 15270 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:56.063503 15268 rpcz_store.cc:276] 0709 13:04:53.858434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.797299 (+938865us) service_pool.cc:224] Handling call
0709 13:04:54.797685 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.811159 (+ 13474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.811198 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:54.811668 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.233900 (+422232us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:55.646785 (+412885us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.671968 (+ 25183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.672066 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.713230 (+ 41164us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18004a73a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:55.761632 (+ 48402us) raft_consensus.cc:1685] finished
0709 13:04:55.808593 (+ 46961us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.808969 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1389,"prepare.queue_time_us":510088,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":25096,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":12305,"spinlock_wait_cycles":7238912,"thread_start_us":643113,"threads_started":2,"wal-append.queue_time_us":852731}
I20260709 13:04:56.098505 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1943) took 2165 ms. Trace:
I20260709 13:04:56.100953 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1942) took 2168 ms. Trace:
I20260709 13:04:56.101193 15263 rpcz_store.cc:276] 0709 13:04:53.932726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.081057 (+2148331us) service_pool.cc:224] Handling call
0709 13:04:56.081387 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.098242 (+ 16855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.098448 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.001735 18946 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.102396 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:56.102995 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80587.7us
I20260709 13:04:56.074416 15339 rpcz_store.cc:276] 0709 13:04:54.147627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.148015 (+   388us) service_pool.cc:224] Handling call
0709 13:04:54.148744 (+   729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.639023 (+490279us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:55.060838 (+421815us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.872495 (+811657us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.876672 (+  4177us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.936223 (+ 59551us) spinlock_profiling.cc:243] Waited 43 ms on lock 0x7b180024c1c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:04:55.936371 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.936417 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:55.936464 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.937337 (+   873us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b180024c1c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:56.008585 (+ 71248us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54001766d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:56.008692 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.008878 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196277,"prepare.queue_time_us":605935,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":71,"raft.queue_time_us":94737,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":205,"spinlock_wait_cycles":1421723392,"thread_start_us":1116160,"threads_started":2,"wal-append.queue_time_us":765567}
I20260709 13:04:56.022513 18918 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:56.101287 15270 rpcz_store.cc:276] 0709 13:04:53.932448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.086215 (+2153767us) service_pool.cc:224] Handling call
0709 13:04:56.086630 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.100689 (+ 14059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.100898 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.093971 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:56.107542 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 107559us
I20260709 13:04:56.108458 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:56.100142 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:56.108752 15092 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 4 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.097810 15197 pending_rounds.cc:85] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 7
I20260709 13:04:56.117807 15197 pending_rounds.cc:107] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:04:56.118278 15197 raft_consensus.cc:2889] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.075073 18773 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.089351 19052 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:56.017372 18792 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.089491 18570 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.128434 15190 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:56.104138 19076 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:04:56.096962 19023 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:56.134430 15339 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:04:56.108394 19021 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.103212 18893 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:56.133023 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.130148 15340 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:56.138736 15339 pending_rounds.cc:85] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 5
I20260709 13:04:56.132095 18861 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:56.134532 15264 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:56.007091 18830 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.102856 19029 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.102823 18952 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.158488 15092 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 10 to 12, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 12 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.191844 15339 pending_rounds.cc:107] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:04:56.199529 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1944) took 2266 ms. Trace:
I20260709 13:04:56.199957 15339 raft_consensus.cc:2889] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.130786 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.200044 15264 rpcz_store.cc:276] 0709 13:04:53.932981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.107225 (+2174244us) service_pool.cc:224] Handling call
0709 13:04:56.134271 (+ 27046us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.199181 (+ 64910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.199455 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.200708 15338 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:04:56.110960 18573 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.156740 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:56.227355 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.119472 18918 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:56.111657 19027 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.197016 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:56.231732 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.226562 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.111148 18978 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:56.275194 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.227696 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 84230.2us
I20260709 13:04:56.106995 18946 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.128945 18959 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:56.128736 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:56.144815 18829 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:56.349462 15870 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:56.305837 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:56.351670 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.132016 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 271) took 2225 ms. Trace:
I20260709 13:04:56.366163 15267 rpcz_store.cc:276] 0709 13:04:53.906960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.885756 (+1978796us) service_pool.cc:224] Handling call
0709 13:04:55.886075 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.886290 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:55.987387 (+101097us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.127632 (+140245us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.130543 (+  2911us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:56.131512 (+   969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.131853 (+   341us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.131962 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54575,"prepare.queue_time_us":114851,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":23924,"spinlock_wait_cycles":10738432,"thread_start_us":122348,"threads_started":1,"wal-append.queue_time_us":262004}
I20260709 13:04:56.360920 15195 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:56.133800 19052 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.279775 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.201700 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:56.280803 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 180741us
I20260709 13:04:56.375526 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:56.375655 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:56.134011 19069 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.383801 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.384909 15342 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:04:56.386791 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:56.299798 18918 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:56.279800 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:56.226754 18861 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:56.428110 18861 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:56.428272 18963 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.226934 18952 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:56.241441 18573 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.186075 18965 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:56.186542 18511 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.433663 15339 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:04:56.423149 18901 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.004s
I20260709 13:04:56.359006 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.388017 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:56.473496 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 85574.9us
I20260709 13:04:56.475196 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:56.391438 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:56.328510 18848 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:56.185833 18742 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:04:56.395486 18947 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:56.395998 19069 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.378854 19052 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:56.135175 18773 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.226922 18893 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.180967 19021 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.399009 18946 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:56.399516 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:56.496801 19069 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:56.496943 18963 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:56.401366 19078 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:04:56.500599 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1598) took 1925 ms. Trace:
I20260709 13:04:56.500993 15194 rpcz_store.cc:276] 0709 13:04:54.574806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.123305 (+548499us) service_pool.cc:224] Handling call
0709 13:04:55.123614 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.165633 (+ 42019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.165677 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.166330 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.070268 (+903938us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:56.095356 (+ 25088us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.113934 (+ 18578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.114023 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.500404 (+386381us) raft_consensus.cc:1685] finished
0709 13:04:56.500424 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.500544 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59889,"prepare.queue_time_us":32235,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":84284,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":22260,"spinlock_wait_cycles":7845120,"thread_start_us":903555,"threads_started":1,"wal-append.queue_time_us":940873}
I20260709 13:04:56.405165 18550 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:56.379511 15871 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:56.362957 18959 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:56.409309 19095 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:56.411482 18830 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:56.413900 18956 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:56.415298 19090 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.416375 18938 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:56.187242 18570 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:56.416980 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53828.6us
I20260709 13:04:56.418658 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:56.420065 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 311661us
W20260709 13:04:56.404178 18977 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.001s
I20260709 13:04:56.364876 18829 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:56.438774 18511 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:56.440742 15092 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.442229 19097 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:56.443835 19084 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:56.361227 19027 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:55.858371 15344 rpcz_store.cc:276] 0709 13:04:54.578695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.587755 (+  9060us) service_pool.cc:224] Handling call
0709 13:04:54.588065 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.588323 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:54.975275 (+386952us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.857334 (+882059us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.857408 (+    74us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:55.857476 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.857594 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.857767 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69034,"prepare.queue_time_us":650709,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":2389,"thread_start_us":1133879,"threads_started":2,"wal-append.queue_time_us":719787}
I20260709 13:04:56.607227 15344 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:56.589776 18944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.003s	sys 0.033s
I20260709 13:04:56.590972 18564 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:56.608175 18944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.007s	sys 0.033s
W20260709 13:04:56.608505 19089 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:04:56.608462 19090 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.609872 19027 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:56.610479 15189 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:56.456089 19025 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:56.614418 19099 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:04:56.304804 18916 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.183s
W20260709 13:04:56.468475 18994 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
I20260709 13:04:56.468789 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1941) took 2557 ms. Trace:
I20260709 13:04:56.469319 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1936) took 2584 ms. Trace:
I20260709 13:04:56.381609 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:56.485630 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 94283.3us
I20260709 13:04:56.280383 19029 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.618009 15265 rpcz_store.cc:276] 0709 13:04:53.884962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.242768 (+1357806us) service_pool.cc:224] Handling call
0709 13:04:55.313799 (+ 71031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.560391 (+246592us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:55.846300 (+285909us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.112087 (+265787us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.112882 (+   795us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.113078 (+   196us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:56.119260 (+  6182us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.468995 (+349735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.469089 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.469131 (+    42us) raft_consensus.cc:1685] finished
0709 13:04:56.469148 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.469265 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53717,"prepare.queue_time_us":183907,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":267074,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":28407,"spinlock_wait_cycles":114045184,"thread_start_us":835754,"threads_started":3,"wal-append.queue_time_us":341304}
I20260709 13:04:56.490556 19004 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:56.487900 18578 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:56.491220 18376 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:56.652779 15269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.009s	sys 0.035s
I20260709 13:04:56.492187 18773 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:56.492323 15340 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:56.508771 15345 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:04:56.502993 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:56.519600 18114 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:56.656342 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:56.592012 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:56.591657 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 364431us
I20260709 13:04:56.431805 18573 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.484876 18947 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:56.617861 15271 rpcz_store.cc:276] 0709 13:04:53.932098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.989441 (+2057343us) service_pool.cc:224] Handling call
0709 13:04:56.073020 (+ 83579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.073578 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.468526 (+394948us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b5400349c50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:56.468710 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191202176}
I20260709 13:04:56.484885 18874 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:56.648509 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1955) took 2702 ms. Trace:
I20260709 13:04:56.658200 15271 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:56.656997 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:56.661983 15265 rpcz_store.cc:276] 0709 13:04:53.945747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.647751 (+2702004us) service_pool.cc:224] Handling call
0709 13:04:56.648051 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.648218 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.648242 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.648285 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.648315 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.648363 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.648459 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.663744 15340 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:04:56.664547 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1950) took 2104 ms. Trace:
I20260709 13:04:56.568161 18640 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:56.656476 18114 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.486187 18848 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:56.669359 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:56.662437 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1948) took 2453 ms. Trace:
I20260709 13:04:56.671020 15271 rpcz_store.cc:276] 0709 13:04:54.209115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.657619 (+2448504us) service_pool.cc:224] Handling call
0709 13:04:56.657875 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.662219 (+  4344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.662386 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.672137 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:56.672710 15271 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:56.567994 19021 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:56.664896 15266 rpcz_store.cc:276] 0709 13:04:54.559734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.663881 (+2104147us) service_pool.cc:224] Handling call
0709 13:04:56.664126 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.664290 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.664313 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.664350 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.664377 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.664423 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.664503 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.677505 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1958) took 2053 ms. Trace:
I20260709 13:04:56.677842 15266 rpcz_store.cc:276] 0709 13:04:54.623892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.676775 (+2052883us) service_pool.cc:224] Handling call
0709 13:04:56.677023 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.677192 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.677220 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.677257 (+    37us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:56.677291 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.677343 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.677437 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.679407 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1959) took 2055 ms. Trace:
I20260709 13:04:56.659795 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2174) took 1855 ms. Trace:
I20260709 13:04:56.680351 15195 rpcz_store.cc:276] 0709 13:04:54.804747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.247769 (+443022us) service_pool.cc:224] Handling call
0709 13:04:55.558662 (+310893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.367902 (+809240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.659573 (+291671us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54001f7cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:56.659741 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844548352}
W20260709 13:04:56.666170 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.659650 15269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.010s	sys 0.036s
I20260709 13:04:56.647491 18944 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.611358 19090 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:56.605846 18893 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:56.607061 18963 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.605486 19024 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.674131 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "685539345e364189892668dfd1ff7309"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:56.469038 18965 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.715351 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2179) took 1894 ms. Trace:
I20260709 13:04:56.715905 15188 rpcz_store.cc:276] 0709 13:04:54.820899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.694574 (+873675us) service_pool.cc:224] Handling call
0709 13:04:55.694903 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.938213 (+243310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.938246 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.984426 (+ 46180us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.109749 (+125323us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:56.109788 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.705220 (+595432us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400236ed4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:56.705267 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.705310 (+    43us) raft_consensus.cc:1685] finished
0709 13:04:56.705324 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.715272 (+  9948us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13770,"raft.queue_time_us":67176,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":15630,"spinlock_wait_cycles":527054080,"thread_start_us":124888,"threads_started":1,"wal-append.queue_time_us":153519}
I20260709 13:04:56.675628 15340 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:56.679867 15266 rpcz_store.cc:276] 0709 13:04:54.624160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.678707 (+2054547us) service_pool.cc:224] Handling call
0709 13:04:56.678937 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.679114 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.679140 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.679178 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.679207 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.679254 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.679354 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.706728 15092 catalog_manager.cc:5697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.707531 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2171) took 2057 ms. Trace:
I20260709 13:04:56.720906 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1962) took 2096 ms. Trace:
I20260709 13:04:56.720733 15189 rpcz_store.cc:276] 0709 13:04:54.649840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.192959 (+543119us) service_pool.cc:224] Handling call
0709 13:04:55.225445 (+ 32486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.610856 (+1385411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.707331 (+ 96475us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001a5254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:56.707477 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3184899456}
I20260709 13:04:56.721385 15266 rpcz_store.cc:276] 0709 13:04:54.624916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.720187 (+2095271us) service_pool.cc:224] Handling call
0709 13:04:56.720428 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.720614 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.720648 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.720689 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.720718 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.720770 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.720860 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.712909 15194 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:56.688155 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:56.662832 18947 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:56.658107 18376 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.675105 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1957) took 2051 ms. Trace:
I20260709 13:04:56.661271 18959 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:56.725237 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.732498 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.733043 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.647264 18578 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:56.486258 18901 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.727823 15271 rpcz_store.cc:276] 0709 13:04:54.623609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.672005 (+2048396us) service_pool.cc:224] Handling call
0709 13:04:56.672298 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.673162 (+   864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.675013 (+  1851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.674047 18848 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:56.652740 18550 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:04:56.736325 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.674558 19069 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:56.674700 18626 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:56.666462 19004 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:56.673987 18583 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.748750 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1964) took 2103 ms. Trace:
I20260709 13:04:56.776476 15271 rpcz_store.cc:276] 0709 13:04:54.645159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.747890 (+2102731us) service_pool.cc:224] Handling call
0709 13:04:56.748191 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.748380 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.748405 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.748468 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:56.748506 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.748576 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.748698 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.778409 15271 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:56.779126 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1966) took 2133 ms. Trace:
I20260709 13:04:56.757141 18114 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:56.647114 18994 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.781895 15868 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:56.772755 15092 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 3 to 7, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.734714 18376 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:56.728307 18792 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:56.779513 15271 rpcz_store.cc:276] 0709 13:04:54.645662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.777630 (+2131968us) service_pool.cc:224] Handling call
0709 13:04:56.778014 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.778799 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.779050 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.701071 18904 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:04:56.787740 15191 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:56.750152 18578 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:56.791966 15271 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:56.706382 18944 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.725813 19024 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.748678 18959 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:56.797559 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1968) took 2151 ms. Trace:
I20260709 13:04:56.748416 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:56.725553 18963 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.775640 19021 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.820313 15271 rpcz_store.cc:276] 0709 13:04:54.646138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.791207 (+2145069us) service_pool.cc:224] Handling call
0709 13:04:56.791587 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.797051 (+  5464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.797441 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.748507 18918 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.801523 19066 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.709765 18829 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.775250 19069 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.785754 18626 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:56.896142 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 244554us
I20260709 13:04:56.812345 18742 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.635427 19097 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.788904 18583 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.823954 18904 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:04:56.627803 19084 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.904225 15271 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:56.882542 19085 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:56.793253 18640 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:56.880183 18959 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:56.902099 19004 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:57.001272 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 330596us
W20260709 13:04:57.043617 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 317562us
I20260709 13:04:57.205930 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1969) took 2559 ms. Trace:
I20260709 13:04:57.067147 15263 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:04:57.249756 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.019s	sys 0.013s
W20260709 13:04:57.250217 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.019s	sys 0.013s
I20260709 13:04:57.244210 15271 rpcz_store.cc:276] 0709 13:04:54.647120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.903448 (+2256328us) service_pool.cc:224] Handling call
0709 13:04:56.903818 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.205596 (+301778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.205856 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.091493 18573 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.255133 18904 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:57.067260 19052 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.004s
W20260709 13:04:57.118125 19025 consensus_meta.cc:287] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
W20260709 13:04:57.066128 19104 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.173s	user 0.004s	sys 0.000s
W20260709 13:04:57.245985 19107 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.175s	user 0.000s	sys 0.009s
W20260709 13:04:57.297255 15194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.000s	sys 0.012s
W20260709 13:04:57.390688 15194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.013s
W20260709 13:04:57.297706 15344 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.010s	sys 0.014s
W20260709 13:04:57.256485 19105 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.189s	user 0.001s	sys 0.003s
I20260709 13:04:57.401242 15189 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:04:56.936570 18570 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:56.936177 19029 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.385951 15193 raft_consensus.cc:2410] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:57.293632 18901 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.381927 18944 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:57.241163 18893 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:04:57.391788 15344 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.010s	sys 0.015s
I20260709 13:04:57.464570 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2145) took 1279 ms. Trace:
I20260709 13:04:57.465188 15344 rpcz_store.cc:276] 0709 13:04:56.185597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.650250 (+464653us) service_pool.cc:224] Handling call
0709 13:04:56.650528 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.464070 (+813542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.464119 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.464181 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:57.464219 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.464308 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.464496 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25243,"raft.queue_time_us":56356,"spinlock_wait_cycles":8160640,"thread_start_us":787841,"threads_started":1}
I20260709 13:04:57.467530 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:57.426817 18848 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.002s
I20260709 13:04:56.914877 19021 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:57.453106 15197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.054s	sys 0.073s
I20260709 13:04:57.244617 18742 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:57.424147 18965 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.295313 19052 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.205109 19085 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:57.475504 15197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.054s	sys 0.073s
I20260709 13:04:57.553443 18904 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:57.472958 18916 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:57.554593 18916 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:57.556391 19111 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.500s	user 0.000s	sys 0.001s
I20260709 13:04:57.559270 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2133) took 1376 ms. Trace:
I20260709 13:04:57.559794 15341 rpcz_store.cc:276] 0709 13:04:56.182524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.187630 (+  5106us) service_pool.cc:224] Handling call
0709 13:04:56.187968 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:56.305541 (+117573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.305569 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:56.306152 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 13:04:56.706693 (+400541us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:56.706732 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.706795 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.558977 (+852182us) raft_consensus.cc:1685] finished
0709 13:04:57.559004 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.559197 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161449,"raft.queue_time_us":140796,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4536,"thread_start_us":311991,"threads_started":1,"wal-append.queue_time_us":447404}
I20260709 13:04:57.562067 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.564284 18583 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.515087 18893 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:57.582717 18861 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.153s	user 0.010s	sys 0.006s
W20260709 13:04:57.601356 18952 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.117s	user 0.001s	sys 0.010s
W20260709 13:04:57.607419 18578 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.793s	user 0.012s	sys 0.000s
W20260709 13:04:57.609299 18956 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.005s	user 0.011s	sys 0.003s
I20260709 13:04:57.610635 18626 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.256078 19066 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:57.562778 15341 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:57.619692 18893 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.635018 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1954) took 3689 ms. Trace:
I20260709 13:04:57.636435 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1951) took 2903 ms. Trace:
W20260709 13:04:57.635650 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.641662 15874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 315) took 2035 ms. Trace:
I20260709 13:04:57.645373 15271 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:57.475396 19060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.010s	sys 0.006s
I20260709 13:04:57.736315 15874 rpcz_store.cc:276] 0709 13:04:55.606271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.606386 (+   115us) service_pool.cc:224] Handling call
0709 13:04:55.606681 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.069587 (+462906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.641422 (+1571835us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54005e1ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:57.641606 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":762464512}
W20260709 13:04:57.649381 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 405634us
I20260709 13:04:57.658666 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.704025 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2189) took 1975 ms. Trace:
I20260709 13:04:57.736323 15267 rpcz_store.cc:276] 0709 13:04:53.945451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.379837 (+2434386us) service_pool.cc:224] Handling call
0709 13:04:56.380204 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.380455 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.380494 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.380957 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.627694 (+246737us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:56.627748 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.627837 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.634823 (+1006986us) raft_consensus.cc:1685] finished
0709 13:04:57.634841 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.634963 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":246449,"threads_started":1,"wal-append.queue_time_us":449028}
I20260709 13:04:57.526959 18848 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.741598 15197 rpcz_store.cc:276] 0709 13:04:55.728128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.097023 (+368895us) service_pool.cc:224] Handling call
0709 13:04:56.097549 (+   526us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:56.226573 (+129024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.226603 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:56.447749 (+221146us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:04:56.448767 (+  1018us) log.cc:844] Serialized 78 byte log entry
0709 13:04:56.732357 (+283590us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:57.534895 (+802538us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.648981 (+114086us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.649175 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.649250 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.703714 (+ 54464us) raft_consensus.cc:1685] finished
0709 13:04:57.703751 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.703948 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":170842,"raft.queue_time_us":149872,"spinlock_wait_cycles":105495680,"thread_start_us":1036311,"threads_started":2,"wal-append.queue_time_us":452066}
I20260709 13:04:57.641671 18918 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:57.649750 18376 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.852s	user 0.006s	sys 0.006s
I20260709 13:04:57.736141 15263 rpcz_store.cc:276] 0709 13:04:54.733274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.066465 (+2333191us) service_pool.cc:224] Handling call
0709 13:04:57.066786 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.245124 (+178338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.636376 (+391252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.758814 15263 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:57.759552 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1971) took 2588 ms. Trace:
I20260709 13:04:57.759889 15263 rpcz_store.cc:276] 0709 13:04:55.171917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.758212 (+2586295us) service_pool.cc:224] Handling call
0709 13:04:57.758500 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.759298 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.759493 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:57.760751 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.699889 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:57.761742 15345 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:57.743846 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.762197 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:57.631642 19052 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.636547 18994 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.745729 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1952) took 3012 ms. Trace:
W20260709 13:04:57.746771 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 504033us
I20260709 13:04:57.745023 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1953) took 3011 ms. Trace:
I20260709 13:04:57.792529 15271 rpcz_store.cc:276] 0709 13:04:54.733539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.644847 (+2911308us) service_pool.cc:224] Handling call
0709 13:04:57.645178 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.737518 (+ 92340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.745587 (+  8069us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.793062 15267 rpcz_store.cc:276] 0709 13:04:54.733815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.744265 (+3010450us) service_pool.cc:224] Handling call
0709 13:04:57.744570 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.744740 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.744763 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.744804 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:57.744830 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.744877 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.744974 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.763180 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.641170 18573 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.761122 15263 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:57.798095 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1974) took 2624 ms. Trace:
I20260709 13:04:57.742730 18901 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.803174 15267 rpcz_store.cc:276] 0709 13:04:55.173203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.794643 (+2621440us) service_pool.cc:224] Handling call
0709 13:04:57.797439 (+  2796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.797686 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.797723 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.797778 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:57.797822 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.797887 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.798026 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.754729 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:57.741078 19060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.010s	sys 0.007s
I20260709 13:04:57.754652 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.809751 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:57.810468 15197 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:57.771903 19111 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:04:57.659307 18947 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.922s	user 0.012s	sys 0.000s
W20260709 13:04:57.761268 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.649006 18861 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:57.815246 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.805681 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.811290 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.817597 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1973) took 2644 ms. Trace:
I20260709 13:04:57.818038 15271 rpcz_store.cc:276] 0709 13:04:55.172920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.793855 (+2620935us) service_pool.cc:224] Handling call
0709 13:04:57.817081 (+ 23226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.817283 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.817310 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.817352 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:57.817390 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.817444 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.817550 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.819907 15271 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:57.819943 15345 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:57.820639 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1984) took 2209 ms. Trace:
I20260709 13:04:57.821055 15271 rpcz_store.cc:276] 0709 13:04:55.611354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.819025 (+2207671us) service_pool.cc:224] Handling call
0709 13:04:57.819594 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.820384 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.820587 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.823632 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.824581 15344 raft_consensus.cc:2410] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:04:57.806313 18511 consensus_meta.cc:287] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.188s	user 0.015s	sys 0.000s
I20260709 13:04:57.826095 19123 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:57.811408 18901 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.826982 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.811583 18742 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:57.827937 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:57.746925 18880 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:04:57.836385 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:04:57.813812 15312 connection.cc:256] RPC call timeout handler was delayed by -1.0538541650000752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
I20260709 13:04:57.650934 18952 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.837132 15344 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:57.831948 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 89810us
I20260709 13:04:57.802542 18893 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:57.833760 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.783187 18376 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:57.678833 18578 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:57.840868 15346 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:57.830765 19069 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:57.843114 15341 raft_consensus.cc:2410] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:57.834998 15263 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:04:57.840225 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:57.851789 15263 pending_rounds.cc:85] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 5
I20260709 13:04:57.852231 15263 pending_rounds.cc:107] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:57.852543 15263 raft_consensus.cc:2889] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:57.846407 15343 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:57.854074 15188 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:57.854871 15190 raft_consensus.cc:606] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:57.855391 15190 raft_consensus.cc:614] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:57.743018 19126 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 13:04:57.858630 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.863252 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1972) took 2691 ms. Trace:
I20260709 13:04:57.863692 15263 rpcz_store.cc:276] 0709 13:04:55.172274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.760725 (+2588451us) service_pool.cc:224] Handling call
0709 13:04:57.761003 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.862971 (+101968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.863192 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.850843 15197 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:04:57.866396 15344 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:57.866333 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.846999 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.867337 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:57.868664 18994 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.837792 19113 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.875197 15195 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 12. Ops: []
I20260709 13:04:57.876770 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:57.828739 18947 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.848752 19084 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.881803 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:57.882454 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.832120 19122 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:57.887100 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.888000 15341 raft_consensus.cc:2410] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:04:57.891607 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.893006 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.744416 19085 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.901618 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.899657 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:57.904069 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.904857 15197 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:04:57.906440 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.907845 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.909027 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.910545 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:57.872828 18956 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.912607 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.878161 19123 consensus_queue.cc:1243] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:57.844367 19119 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:04:57.917398 15197 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:57.922349 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2203) took 1450 ms. Trace:
I20260709 13:04:57.922230 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:57.923067 15197 rpcz_store.cc:276] 0709 13:04:56.472364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.916963 (+1444599us) service_pool.cc:224] Handling call
0709 13:04:57.917237 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.922091 (+  4854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.922293 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.927438 19136 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:57.927774 19122 consensus_queue.cc:1243] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:04:57.929751 19117 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:04:57.893942 19125 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:57.925788 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 85644.2us
I20260709 13:04:57.926802 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.933135 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:57.916597 18511 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.916811 19084 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:57.938736 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.921388 18893 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:57.941236 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.941741 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:04:57.942798 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:57.882550 19113 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.943411 15197 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:57.933609 19125 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:57.938215 18573 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:57.921094 18956 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:57.958467 18848 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.959507 18861 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.961006 18947 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.943696 18893 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:04:57.964318 18956 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:57.969739 18946 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:57.970301 18946 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:57.971323 18946 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.971876 19113 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.972447 18946 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.976220 18952 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:57.943187 19066 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:57.966650 19121 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:04:57.978214 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2142) took 1793 ms. Trace:
I20260709 13:04:57.979643 18376 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:57.981972 19021 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.983296 18893 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:57.943511 18511 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.978554 15342 rpcz_store.cc:276] 0709 13:04:56.184874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.592298 (+407424us) service_pool.cc:224] Handling call
0709 13:04:56.592669 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:56.647554 (+ 54885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.647586 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:56.667782 (+ 20196us) log.cc:844] Serialized 52 byte log entry
0709 13:04:57.001729 (+333947us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:57.001786 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.001883 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.977992 (+976109us) raft_consensus.cc:1685] finished
0709 13:04:57.978012 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.978157 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71895,"raft.queue_time_us":60825,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":6357,"thread_start_us":269337,"threads_started":1,"wal-append.queue_time_us":935123}
I20260709 13:04:57.987743 18864 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:57.988476 18578 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:04:57.990166 15312 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.782s (SENT) [suppressed 26 similar messages]
I20260709 13:04:57.988013 19125 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:57.991505 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2158) took 1365 ms. Trace:
I20260709 13:04:57.991722 19125 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.991961 15337 rpcz_store.cc:276] 0709 13:04:56.626342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.739363 (+113021us) service_pool.cc:224] Handling call
0709 13:04:56.739856 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.760738 (+ 20882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.760782 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.760841 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.760887 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.991222 (+1230335us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5400244854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:57.991279 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.991430 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47351168}
W20260709 13:04:57.995584 19131 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:04:57.995759 18916 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.996713 18507 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:57.996759 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2146) took 1810 ms. Trace:
I20260709 13:04:57.997232 18507 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:57.998435 18511 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:57.997328 15338 rpcz_store.cc:276] 0709 13:04:56.185852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.662065 (+476213us) service_pool.cc:224] Handling call
0709 13:04:56.662385 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.051847 (+389462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.051917 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:57.642419 (+590502us) log.cc:844] Serialized 26 byte log entry
0709 13:04:57.789771 (+147352us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:57.789812 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.789883 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.996556 (+206673us) raft_consensus.cc:1685] finished
0709 13:04:57.996575 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.996704 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25419,"raft.queue_time_us":71181,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":15884,"thread_start_us":365998,"threads_started":2,"wal-append.queue_time_us":194505}
I20260709 13:04:58.000090 18742 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:58.000473 18742 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:58.001892 18742 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:57.998368 18507 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.010979 18959 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:58.013320 19024 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:58.017876 19135 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
W20260709 13:04:58.025382 19102 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.206s	user 0.005s	sys 0.018s
I20260709 13:04:58.029769 18742 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.029359 18507 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.087949 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2201) took 1617 ms. Trace:
W20260709 13:04:58.088488 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.087971 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2191) took 2359 ms. Trace:
I20260709 13:04:58.090781 15192 rpcz_store.cc:276] 0709 13:04:55.728640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.116895 (+388255us) service_pool.cc:224] Handling call
0709 13:04:56.117180 (+   285us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:56.144343 (+ 27163us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:56.144374 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:56.144897 (+   523us) log.cc:844] Serialized 52 byte log entry
0709 13:04:56.519387 (+374490us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.519443 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.520619 (+  1176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.024642 (+1504023us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:58.086382 (+ 61740us) raft_consensus.cc:1685] finished
0709 13:04:58.086472 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.087773 (+  1301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33619,"raft.queue_time_us":132129,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":49045,"spinlock_wait_cycles":10722176,"thread_start_us":156361,"threads_started":1,"wal-append.queue_time_us":421929}
I20260709 13:04:58.095763 18807 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:58.097756 18807 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:58.098405 18807 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:58.100481 18807 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.102654 18807 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.088995 15194 rpcz_store.cc:276] 0709 13:04:56.470093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.722548 (+252455us) service_pool.cc:224] Handling call
0709 13:04:56.722817 (+   269us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:57.391318 (+668501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.391364 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:57.646103 (+254739us) log.cc:844] Serialized 52 byte log entry
0709 13:04:57.878803 (+232700us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:57.936183 (+ 57380us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.943400 (+  7217us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.943671 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.943778 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.017490 (+ 73712us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b2400114ed8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265f09d 00007f36e529110e 00007f36e52a888c 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221
0709 13:04:58.087050 (+ 69560us) raft_consensus.cc:1685] finished
0709 13:04:58.087110 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.087604 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11862,"prepare.queue_time_us":49674,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":64176,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":7685,"spinlock_wait_cycles":12044928,"thread_start_us":810374,"threads_started":3,"wal-append.queue_time_us":224735}
W20260709 13:04:58.084812 15081 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 9d785ccef0634edd9f0fbb52fa1c8d27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:04:58.119750 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 1.52641e+06us
I20260709 13:04:58.123238 18874 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:58.124397 18874 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.123457 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.127017 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:04:58.131382 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2167) took 3566 ms. Trace:
I20260709 13:04:58.132205 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1928) took 4273 ms. Trace:
W20260709 13:04:58.133704 15193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2185) took 2571 ms (client timeout 1782 ms). Trace:
I20260709 13:04:58.134150 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1987) took 2361 ms. Trace:
I20260709 13:04:58.134914 18874 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:04:58.134859 15081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 50546.4us
I20260709 13:04:58.128002 19060 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.135730 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2197) took 2200 ms. Trace:
W20260709 13:04:58.129179 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.143271 15188 rpcz_store.cc:276] 0709 13:04:55.935716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.718045 (+782329us) service_pool.cc:224] Handling call
0709 13:04:56.751907 (+ 33862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.854649 (+1102742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.135086 (+280437us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003e67d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.135538 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2534040832}
I20260709 13:04:58.130525 18893 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:58.145576 19060 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.146524 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.149052 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 252) took 2382 ms. Trace:
I20260709 13:04:58.150056 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:58.137234 15191 rpcz_store.cc:276] 0709 13:04:54.564490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.100676 (+536186us) service_pool.cc:224] Handling call
0709 13:04:55.127173 (+ 26497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.794218 (+1667045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.130620 (+1336402us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001e82d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.131138 (+   518us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3818515840}
I20260709 13:04:58.152129 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.153175 15197 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:04:58.153268 15191 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:58.138242 15193 rpcz_store.cc:269] 0709 13:04:55.562424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.623617 (+ 61193us) service_pool.cc:224] Handling call
0709 13:04:58.133130 (+2509513us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400409554. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:58.133452 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3864362240}
I20260709 13:04:58.149139 19060 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:58.110661 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 120359us
I20260709 13:04:58.138661 15263 rpcz_store.cc:276] 0709 13:04:55.772490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.864501 (+2092011us) service_pool.cc:224] Handling call
0709 13:04:57.864798 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.133360 (+268562us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:58.133430 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:58.133507 (+    77us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:58.133550 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.133669 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.133919 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267712}
W20260709 13:04:58.166427 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.149703 15195 rpcz_store.cc:276] 0709 13:04:55.766084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.681371 (+915287us) service_pool.cc:224] Handling call
0709 13:04:56.681619 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.879757 (+1198138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.148467 (+268710us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000fafd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.148855 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2744497920}
I20260709 13:04:58.137748 15272 rpcz_store.cc:276] 0709 13:04:53.858984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.801808 (+942824us) service_pool.cc:224] Handling call
0709 13:04:54.802108 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.802460 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:55.013745 (+211285us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800279b20. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf 00007f36e5727038
0709 13:04:55.887870 (+874125us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.127493 (+239623us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.132585 (+  5092us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.132715 (+   130us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:56.193891 (+ 61176us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.131161 (+1937270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.131350 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.131556 (+   206us) raft_consensus.cc:1685] finished
0709 13:04:58.131581 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.131836 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3801709,"prepare.queue_time_us":1004718,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":28384,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":53825,"spinlock_wait_cycles":24520448,"thread_start_us":1094099,"threads_started":2,"wal-append.queue_time_us":598547,"wal-append.run_cpu_time_us":2577,"wal-append.run_wall_time_us":1023831}
I20260709 13:04:58.190858 18570 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.191545 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1985) took 2579 ms. Trace:
I20260709 13:04:58.191922 18570 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.192078 15271 rpcz_store.cc:276] 0709 13:04:55.611615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.821810 (+2210195us) service_pool.cc:224] Handling call
0709 13:04:57.822074 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.187661 (+365587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.187711 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:58.187770 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:58.187845 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.191047 (+  3202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.191331 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":364816}
W20260709 13:04:58.193655 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.194442 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 258247us
I20260709 13:04:58.194739 18918 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:58.196705 15194 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:58.200065 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.218549 19101 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.219818 19101 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.230293 15192 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:58.234495 15237 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:58.235335 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44623.9us
I20260709 13:04:58.236096 18977 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:58.237453 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.237610 19098 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.238703 19098 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.239111 18963 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.233031 18874 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.240370 18874 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.246636 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1982) took 2635 ms. Trace:
W20260709 13:04:58.248898 19112 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.373s	user 0.000s	sys 0.023s
I20260709 13:04:58.257208 18570 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.228935 18893 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:58.260409 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.261337 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.261706 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2200) took 1799 ms. Trace:
I20260709 13:04:58.262145 15189 rpcz_store.cc:276] 0709 13:04:56.462563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.721707 (+259144us) service_pool.cc:224] Handling call
0709 13:04:56.721972 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.418711 (+696739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.261125 (+842414us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54002265d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.261550 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561439616}
I20260709 13:04:58.264164 18874 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.264982 18901 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.266945 15272 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:58.267867 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1990) took 2484 ms. Trace:
W20260709 13:04:58.268074 15343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2130) took 2135 ms (client timeout 1846 ms). Trace:
I20260709 13:04:58.268592 15874 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:58.268823 15343 rpcz_store.cc:269] 0709 13:04:56.132575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.132700 (+   125us) service_pool.cc:224] Handling call
0709 13:04:58.267533 (+2134833us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400423e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:58.267787 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3409564032}
I20260709 13:04:58.270802 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2139) took 2086 ms. Trace:
I20260709 13:04:58.271330 15339 rpcz_store.cc:276] 0709 13:04:56.184088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.439736 (+255648us) service_pool.cc:224] Handling call
0709 13:04:56.440090 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.451141 (+ 11051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.451184 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.453174 (+  1990us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.646766 (+193592us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:56.646810 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.646888 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.247577 (+1600689us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:58.270198 (+ 22621us) raft_consensus.cc:1685] finished
0709 13:04:58.270220 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.270591 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10630,"raft.queue_time_us":12265,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":121,"spinlock_wait_cycles":16499584,"thread_start_us":173352,"threads_started":1,"wal-append.queue_time_us":321400}
I20260709 13:04:58.272954 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1963) took 3628 ms. Trace:
I20260709 13:04:58.273427 15266 rpcz_store.cc:276] 0709 13:04:54.644859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.722213 (+2077354us) service_pool.cc:224] Handling call
0709 13:04:56.722469 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.091676 (+1369207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:58.091729 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.093013 (+  1284us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.144389 (+ 51376us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:58.144448 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.144597 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.272613 (+128016us) raft_consensus.cc:1685] finished
0709 13:04:58.272633 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.272785 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1342351,"raft.queue_time_us":1445183,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":50774,"threads_started":1,"wal-append.queue_time_us":137484}
I20260709 13:04:58.281010 19027 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:58.281828 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46386 (request call id 24) took 1798 ms. Trace:
I20260709 13:04:58.281909 19027 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.282527 15190 rpcz_store.cc:276] 0709 13:04:56.483310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.674018 (+190708us) service_pool.cc:224] Handling call
0709 13:04:58.281269 (+1607251us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003e67d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5707853 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691 00007f36e3c5b60c 00007f36e3c5a8c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:58.281507 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2640309504}
I20260709 13:04:58.288355 19098 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.266993 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2195) took 2537 ms. Trace:
I20260709 13:04:58.286792 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 316) took 2178 ms. Trace:
I20260709 13:04:58.261134 15345 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:58.268401 15272 rpcz_store.cc:276] 0709 13:04:55.783898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.182782 (+2398884us) service_pool.cc:224] Handling call
0709 13:04:58.231624 (+ 48842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:58.267469 (+ 35845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.267764 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:58.230794 19101 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.289263 15868 rpcz_store.cc:276] 0709 13:04:56.108170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.110230 (+  2060us) service_pool.cc:224] Handling call
0709 13:04:56.130736 (+ 20506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.787271 (+656535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.285914 (+1498643us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54005e0e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.286472 (+   558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1496841472}
I20260709 13:04:58.282780 19027 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:58.298884 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.301510 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.309692 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2157) took 1684 ms. Trace:
I20260709 13:04:58.310146 15346 rpcz_store.cc:276] 0709 13:04:56.625662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.745444 (+119782us) service_pool.cc:224] Handling call
0709 13:04:56.745833 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.851212 (+1105379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.309237 (+458025us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400424d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.309534 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508461312}
I20260709 13:04:58.247220 15267 rpcz_store.cc:276] 0709 13:04:55.610790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.804270 (+2193480us) service_pool.cc:224] Handling call
0709 13:04:57.804677 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.104253 (+299576us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.104321 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.105499 (+  1178us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.176869 (+ 71370us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:58.176913 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.189818 (+ 12905us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.246193 (+ 56375us) raft_consensus.cc:1685] finished
0709 13:04:58.246220 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.246425 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":298653,"raft.queue_time_us":389293,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":128,"thread_start_us":70619,"threads_started":1,"wal-append.queue_time_us":137807}
I20260709 13:04:58.289176 15196 rpcz_store.cc:276] 0709 13:04:55.729660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.466172 (+736512us) service_pool.cc:224] Handling call
0709 13:04:56.466614 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.506220 (+ 39606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.506247 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.574990 (+ 68743us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.881472 (+306482us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:56.881533 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.266202 (+1384669us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b54003e5dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.266297 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.266367 (+    70us) raft_consensus.cc:1685] finished
0709 13:04:58.266383 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.266793 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":460,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":52394,"spinlock_wait_cycles":90295680,"thread_start_us":226418,"threads_started":1,"wal-append.queue_time_us":457614,"wal-append.run_cpu_time_us":1943,"wal-append.run_wall_time_us":1045576}
W20260709 13:04:58.321379 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 84238.7us
I20260709 13:04:58.325480 19041 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:58.326592 18963 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:58.327482 19041 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:58.326815 19085 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.327991 19041 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:58.331774 18829 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.334959 19097 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.337438 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:58.338800 19101 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:58.325695 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:58.339372 19101 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.340029 19101 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.340374 18830 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:58.341044 18830 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:58.344136 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:58.345018 15195 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.345055 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.346139 15190 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:58.346499 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:58.342312 18830 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.351498 19005 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:04:58.353013 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.296090 15237 connection.cc:256] RPC call timeout handler was delayed by -1.9309819349999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:04:58.358044 15237 connection.cc:256] RPC call timeout handler was delayed by -1.7572819349999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
I20260709 13:04:58.339166 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:04:58.358487 15237 connection.cc:256] RPC call timeout handler was delayed by -1.723081934999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1761s for a response
W20260709 13:04:58.358806 15237 connection.cc:256] RPC call timeout handler was delayed by -1.5786410209999531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:04:58.357426 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72648.7us
W20260709 13:04:58.382540 15237 connection.cc:256] RPC call timeout handler was delayed by -1.5358819349999067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 13:04:58.383088 15237 connection.cc:256] RPC call timeout handler was delayed by -1.394589830999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29510000000000003s for a response
W20260709 13:04:58.392053 15237 connection.cc:256] RPC call timeout handler was delayed by -1.3819819349998852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260709 13:04:58.393136 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.394456 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:58.398604 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91964.8us
I20260709 13:04:58.407378 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:58.408288 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 69338.6us
I20260709 13:04:58.409188 18564 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:58.409375 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.409919 18564 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.410108 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.411275 19098 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:58.412637 18904 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:58.413209 19052 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:58.414178 18965 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:58.339289 19041 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.415544 18965 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:58.407474 18570 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:58.415902 19041 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.416107 18965 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:58.417199 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:58.417493 18965 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:58.419169 19005 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:58.421216 19060 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.422008 19060 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.424288 19060 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:58.435137 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.435333 18963 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.427273 18570 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.427562 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:58.439253 18904 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:58.439908 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:58.440435 18880 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:58.441035 18880 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.440816 18626 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:58.441530 18880 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:58.441567 19125 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:58.430990 19029 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.431346 19100 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.431527 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.432094 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.432377 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.443673 15195 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:58.433022 18977 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:58.434134 15311 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:58.425132 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.435967 15267 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:58.439369 19122 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:58.429317 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:58.449895 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 93347.9us
I20260709 13:04:58.452508 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1988) took 2672 ms. Trace:
I20260709 13:04:58.460371 15190 raft_consensus.cc:2410] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:04:58.458616 15271 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:04:58.451328 18874 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:58.464896 18938 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:58.452862 19100 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.465731 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.466943 18773 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.453166 19097 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.470285 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.471163 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.471383 19024 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:58.471230 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.472033 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.452651 19029 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.473091 19113 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:58.473685 18877 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.474435 18507 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:58.474685 18946 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:58.475884 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.436043 18963 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.477478 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:58.477880 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1960) took 3853 ms. Trace:
I20260709 13:04:58.466552 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.466464 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.454734 18965 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:58.495894 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 75048.3us
I20260709 13:04:58.456575 15263 rpcz_store.cc:276] 0709 13:04:55.772824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.183182 (+2410358us) service_pool.cc:224] Handling call
0709 13:04:58.184122 (+   940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.223711 (+ 39589us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:58.223770 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.224717 (+   947us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.391636 (+166919us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:58.391669 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.391725 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.444602 (+ 52877us) raft_consensus.cc:1685] finished
0709 13:04:58.444653 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.444816 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38448,"raft.queue_time_us":45450,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":11230,"thread_start_us":166379,"threads_started":1,"wal-append.queue_time_us":207979}
I20260709 13:04:58.471928 18959 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:58.487576 19098 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:58.527594 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.485906 18938 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.552456 18938 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.553365 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:58.554662 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1953) took 4540 ms. Trace:
I20260709 13:04:58.537758 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 1933) took 4577 ms. Trace:
I20260709 13:04:58.556103 19024 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:58.548696 18773 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.557483 19024 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.560506 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.561723 18570 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:58.562538 15267 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:58.500777 18942 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:04:58.563580 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.564240 15267 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.478302 19125 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:04:58.539160 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.567248 18877 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.567747 15343 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:04:58.526361 19097 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:04:58.568912 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 102547us
W20260709 13:04:58.571635 19157 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:58.535200 15268 rpcz_store.cc:276] 0709 13:04:54.624437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.704297 (+2079860us) service_pool.cc:224] Handling call
0709 13:04:56.704614 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:58.231672 (+1527058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.233763 (+  2091us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:58.248820 (+ 15057us) log.cc:844] Serialized 52 byte log entry
0709 13:04:58.359346 (+110526us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:58.455984 (+ 96638us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.456233 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.462366 (+  6133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.477445 (+ 15079us) raft_consensus.cc:1685] finished
0709 13:04:58.477471 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.477657 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1506876,"prepare.queue_time_us":81623,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":1492162,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":3228,"spinlock_wait_cycles":197888,"thread_start_us":110012,"threads_started":1,"wal-append.queue_time_us":186149}
I20260709 13:04:58.577319 15345 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
W20260709 13:04:58.635681 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.549675 18959 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:58.582176 19060 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:58.690017 18942 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:58.689906 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:58.690941 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.581674 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.555670 15269 rpcz_store.cc:276] 0709 13:04:53.881948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.094267 (+1212319us) service_pool.cc:224] Handling call
0709 13:04:55.125105 (+ 30838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.125524 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:55.990517 (+864993us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.203493 (+2212976us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.204609 (+  1116us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.381729 (+177120us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:58.450371 (+ 68642us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.450707 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.450818 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.450868 (+    50us) raft_consensus.cc:1685] finished
0709 13:04:58.450886 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.459532 (+  8646us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1514147,"prepare.queue_time_us":693492,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":1521912,"raft.run_cpu_time_us":551,"raft.run_wall_time_us":24964,"thread_start_us":1648339,"threads_started":3,"wal-append.queue_time_us":1134899,"wal-append.run_cpu_time_us":1874,"wal-append.run_wall_time_us":1223066}
I20260709 13:04:58.700630 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.701347 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.707271 15271 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:58.708489 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.708711 18564 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.709427 15271 raft_consensus.cc:2410] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:58.710428 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:58.713020 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.714655 18507 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:58.715104 18507 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.715484 18507 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:58.535521 18977 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:58.716966 18773 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.718268 18946 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.555068 15264 rpcz_store.cc:276] 0709 13:04:53.937853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.201193 (+2263340us) service_pool.cc:224] Handling call
0709 13:04:56.328337 (+127144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.135166 (+1806829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.135226 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.136053 (+   827us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.227899 (+ 91846us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:58.227934 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.425129 (+197195us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54001da1d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:58.425187 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.478114 (+ 52927us) raft_consensus.cc:1685] finished
0709 13:04:58.478136 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.478440 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1491101,"raft.queue_time_us":1552111,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":240,"spinlock_wait_cycles":724151168,"thread_start_us":91209,"threads_started":1,"wal-append.queue_time_us":250872}
W20260709 13:04:58.700243 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 222921us
I20260709 13:04:58.688031 18570 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:58.593295 19097 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:58.727236 19023 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.727936 18963 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.728869 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1952) took 4791 ms. Trace:
W20260709 13:04:58.731330 18742 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.693s	user 0.015s	sys 0.009s
I20260709 13:04:58.743597 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:58.744566 15345 raft_consensus.cc:2368] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:58.731175 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:58.745987 19156 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:04:58.733680 19029 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.741173 19113 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:58.693121 19060 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:04:58.742352 19162 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
I20260709 13:04:58.693351 18942 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:58.760146 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.762696 18773 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:58.771075 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 284423us
I20260709 13:04:58.763859 18942 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.772707 18942 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.764639 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2152) took 2435 ms. Trace:
I20260709 13:04:58.764880 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:58.775328 19129 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:58.775631 19127 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:58.777064 19129 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:58.777789 18904 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:58.778281 18904 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.778656 18904 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:58.766752 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.767118 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.768014 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.778753 18511 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:58.786583 18511 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:58.786091 19027 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:58.788334 18959 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.789256 18511 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:58.789690 18511 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:58.790004 18959 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.757476 19113 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:58.791353 19021 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:58.791759 19021 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:58.739639 15270 rpcz_store.cc:276] 0709 13:04:53.937625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.116494 (+2178869us) service_pool.cc:224] Handling call
0709 13:04:56.116780 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.116967 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:56.137224 (+ 20257us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.706776 (+569552us) spinlock_profiling.cc:243] Waited 55.7 ms on lock 0x7b180049e520. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:04:58.408657 (+1701881us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.577995 (+169338us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.582401 (+  4406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:58.688750 (+106349us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:58.693224 (+  4474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.724875 (+ 31651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.728666 (+  3791us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1201965,"prepare.queue_time_us":220569,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":8834,"raft.queue_time_us":1154665,"raft.run_cpu_time_us":554,"raft.run_wall_time_us":3267,"spinlock_wait_cycles":128224000,"thread_start_us":600646,"threads_started":3,"wal-append.queue_time_us":1654577}
I20260709 13:04:58.792784 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.792668 19021 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.793411 15270 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:58.794045 19021 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.794432 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.795169 19101 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.779546 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.796729 15269 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:58.797197 19101 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.797712 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.798309 15269 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:04:58.759229 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:58.799666 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.757099 19023 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:58.801462 15344 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:58.803254 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.804072 15269 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:04:58.804394 18564 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.805018 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.805651 15269 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:58.806700 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.807374 15269 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:58.808187 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.808789 15269 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.809964 19060 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:58.790542 18511 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.811286 19060 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.812273 18511 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:58.815055 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.799710 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.816370 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.816702 15268 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:58.816908 15271 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:04:58.817600 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.818089 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.818221 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:58.818763 15271 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.775480 15340 rpcz_store.cc:276] 0709 13:04:56.328916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.719119 (+390203us) service_pool.cc:224] Handling call
0709 13:04:56.719482 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.726486 (+  7004us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:56.760578 (+ 34092us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.964373 (+1203795us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18003668e0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:04:58.156481 (+192108us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b18003668e0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:04:58.420485 (+264004us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.472389 (+ 51904us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b2c00136ac8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:04:58.472969 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.473184 (+   215us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:58.473220 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.473360 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.745156 (+271796us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:04:58.764285 (+ 19129us) raft_consensus.cc:1685] finished
0709 13:04:58.764306 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.764453 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67057,"prepare.queue_time_us":32471,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":4434,"raft.queue_time_us":171320,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":8432,"spinlock_wait_cycles":182232960,"thread_start_us":75911,"threads_started":1,"wal-append.queue_time_us":1725098}
I20260709 13:04:58.822296 19027 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:58.760797 15264 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:58.816882 15269 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:58.718813 18977 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:58.690703 18893 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:04:58.784353 18626 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:04:58.825666 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 137690us
I20260709 13:04:58.828840 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 1956) took 4205 ms. Trace:
W20260709 13:04:58.824520 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45585.3us
I20260709 13:04:58.827595 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.827752 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:58.830385 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55392.6us
W20260709 13:04:58.831097 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 68652.7us
I20260709 13:04:58.831662 15263 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:58.832691 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.718904 18946 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.835173 15271 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:04:58.835386 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:58.841578 15341 raft_consensus.cc:2410] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:58.841691 15345 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:58.836755 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.842417 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:58.843552 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 265004us
I20260709 13:04:58.846939 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.847621 15270 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:04:58.820575 18880 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:58.777351 19127 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:04:58.829229 15265 rpcz_store.cc:276] 0709 13:04:54.623291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.664255 (+2040964us) service_pool.cc:224] Handling call
0709 13:04:56.664647 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.117726 (+1453079us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:58.173350 (+ 55624us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.399071 (+225721us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.491635 (+ 92564us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.491805 (+   170us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:58.491857 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.498972 (+  7115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:58.823131 (+324159us) raft_consensus.cc:1685] finished
0709 13:04:58.823151 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:58.828672 (+  5521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1425669,"prepare.queue_time_us":205418,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":1544403,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":321,"thread_start_us":218305,"threads_started":2,"wal-append.queue_time_us":258485}
I20260709 13:04:58.848436 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.854164 15270 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:58.866357 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.871887 15269 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:04:58.825672 19097 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:04:58.881922 15267 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:04:58.884232 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.871132 19027 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:58.886014 19041 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:58.888144 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.883494 19101 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:58.891522 19101 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.868014 18977 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.894164 19101 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.897115 15265 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:58.893975 18977 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.896750 18904 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.901085 15263 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:58.901988 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.907207 15267 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:58.898871 18880 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:58.911805 18938 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.912860 18963 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:58.915397 15269 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:04:58.924048 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:58.928942 15270 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:58.931994 15343 raft_consensus.cc:2368] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:04:58.939131 18626 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:58.939747 18626 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:58.942627 18626 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:58.943497 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:58.944293 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.942785 18938 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:58.946009 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:58.947680 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:58.949585 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:58.951735 15188 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:58.956139 15195 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:58.961892 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.964392 15196 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.967185 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.970839 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.974123 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.937862 19100 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:58.925731 18901 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:04:58.995860 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:58.997681 15268 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.992872 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.999204 15269 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:04:59.003619 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.004448 15267 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 6.
I20260709 13:04:59.007447 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.957885 18507 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:59.008597 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 238095us
I20260709 13:04:58.990435 19022 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:59.011020 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 105025us
I20260709 13:04:59.013412 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.014127 15267 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:59.017103 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:58.995054 18938 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:04:59.027511 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:04:59.026531 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.028723 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.029292 15267 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:04:59.030351 15346 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:59.030519 15269 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:59.034438 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:59.035061 15188 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:59.045276 19163 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.483s	user 0.000s	sys 0.002s
I20260709 13:04:59.032675 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:59.058209 15195 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:04:59.060223 15196 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:59.064178 15188 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:04:59.067798 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47273.3us
W20260709 13:04:59.066145 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47337.5us
I20260709 13:04:59.069092 18893 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:59.070024 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44864.2us
W20260709 13:04:59.071372 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.075345 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.076627 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.076825 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.077381 15270 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:59.077761 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.078223 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.078522 15188 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:59.079376 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.079566 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.083379 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:59.084188 15192 raft_consensus.cc:2410] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:59.086410 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.087925 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.088181 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.070143 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:59.088780 15194 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:04:59.089628 19022 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:59.090024 19022 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:59.090396 19022 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:59.096700 15268 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:59.070624 19005 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:59.098351 19005 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:59.099346 19005 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.102949 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.104548 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:59.105437 19100 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:59.105815 15237 leader_election.cc:400] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:59.106146 19100 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:59.106629 19100 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.106971 19100 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.107652 18946 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:59.109798 18829 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:59.031705 18626 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:59.111177 19129 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:59.111541 18626 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:59.111626 19129 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:59.112630 18626 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.112633 19129 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.114256 18626 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:59.088814 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.116478 19113 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:59.119411 18507 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:59.120849 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:59.121335 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 92841.3us
I20260709 13:04:59.106174 15237 leader_election.cc:403] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:59.122520 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.127605 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.128065 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.130244 15344 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:04:59.019748 19097 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:04:59.131500 15268 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:59.137991 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.139755 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.141875 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.146078 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:59.146981 15345 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:04:59.065387 18904 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:04:59.150375 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.151217 15268 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:59.152036 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.152875 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:59.139528 19022 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.121999 18977 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:59.158185 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:59.163707 15189 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:59.168745 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.171576 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.144093 19024 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 6. Current term is 7.
I20260709 13:04:59.169632 15266 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:04:59.168255 19027 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:59.200940 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:59.200970 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.199904 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:04:59.189977 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.200146 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.188827 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:59.210054 15188 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:04:59.210315 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.215473 15192 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:59.222376 15266 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:59.226027 15268 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:59.228986 15869 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:59.229846 15196 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:59.228775 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.232558 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.233579 15268 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:59.234150 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.212302 19027 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:59.247701 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.248942 15188 raft_consensus.cc:2368] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:04:59.256060 19022 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:04:59.187459 18977 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:04:59.257364 18977 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:59.257824 18977 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:04:59.262562 15268 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:59.281270 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.291471 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:04:59.291858 19169 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:59.291985 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:59.292707 15265 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.295250 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.296066 15188 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:04:59.297246 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.297739 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.298581 15197 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:59.299682 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.299592 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.300923 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:04:59.301671 15192 raft_consensus.cc:606] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:59.302016 15192 raft_consensus.cc:614] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:59.303054 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.303843 15189 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:04:59.304654 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:59.311691 18977 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:59.313038 18626 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.313421 18977 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.313710 18626 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:04:59.313825 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.315236 18904 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.315917 18904 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.318607 18904 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:59.319716 19170 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:04:59.320631 15271 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:59.321633 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:59.322608 15271 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:59.323382 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.324029 15266 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:04:59.324240 15271 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:59.325809 15271 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:04:59.327793 19097 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:59.328191 19097 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:59.328558 19097 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:59.328742 15265 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:04:59.331434 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:59.332029 15191 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:59.337638 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:59.339418 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:59.341835 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:59.342666 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:59.244206 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:59.259395 19027 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.353296 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:59.363644 15344 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:59.334695 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:59.363847 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.376147 15341 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:04:59.363143 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:59.381340 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.382091 15268 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:04:59.315840 18626 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:04:59.384776 15338 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:04:59.362929 15872 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:59.375411 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:04:59.394853 18507 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:59.395431 18507 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:59.337524 19023 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:04:59.396523 18507 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:59.398998 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.399703 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:04:59.395342 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:04:59.400592 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.401437 15268 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:04:59.385017 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:59.403352 19021 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:59.404047 19021 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:59.405232 19021 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.376200 18773 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:59.407711 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44283.3us
I20260709 13:04:59.408596 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:59.409015 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.402680 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.409686 15268 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:59.410238 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.410641 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.411825 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.412611 15268 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:04:59.413800 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:04:59.416149 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.429767 15340 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:04:59.431756 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.384086 18965 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:59.429145 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:59.441283 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77508.7us
I20260709 13:04:59.450897 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.451122 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.452677 15263 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:04:59.457453 15191 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
W20260709 13:04:59.462046 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.453186 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.490520 15266 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:04:59.525272 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82169.8us
I20260709 13:04:59.526304 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.530625 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.531489 15263 raft_consensus.cc:2376] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12. Re-sending same reply.
I20260709 13:04:59.536926 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.536443 19023 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:59.553198 18938 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.570386 18938 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.458757 18965 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:04:59.574632 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:59.543330 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1959) took 1103 ms. Trace:
I20260709 13:04:59.575357 15272 rpcz_store.cc:276] 0709 13:04:58.429703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.458419 (+ 28716us) service_pool.cc:224] Handling call
0709 13:04:59.532751 (+1074332us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b5400088754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:04:59.532894 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213055360}
I20260709 13:04:59.557054 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.555787 19005 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:04:59.576848 15263 raft_consensus.cc:2376] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12. Re-sending same reply.
W20260709 13:04:59.556308 19060 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.002s
I20260709 13:04:59.574131 19022 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:59.553100 18904 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:59.606387 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.572207 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:04:59.623283 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:04:59.625180 15263 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:59.629362 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 214571us
W20260709 13:04:59.578621 18893 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.040s
W20260709 13:04:59.638038 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 101179us
I20260709 13:04:59.640002 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.664036 15272 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:04:59.638767 18893 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.013s	sys 0.040s
I20260709 13:04:59.683274 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:04:59.676453 19180 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:04:59.679782 19100 consensus_meta.cc:287] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
W20260709 13:04:59.693198 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 295144us
I20260709 13:04:59.690953 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:59.695276 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55396.4us
W20260709 13:04:59.696466 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 375007us
I20260709 13:04:59.706238 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.725683 18904 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:59.729707 19113 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:59.726459 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:59.733069 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:59.734643 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:04:59.735527 15270 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:04:59.734823 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:04:59.730680 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51709.1us
I20260709 13:04:59.705785 19100 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.687078 19023 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:59.725720 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:04:59.691121 18807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.013s	sys 0.017s
I20260709 13:04:59.750644 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:59.686702 18893 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:04:59.753885 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:59.694425 18773 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:59.739296 19185 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.780586 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:59.762981 15263 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:59.696851 18965 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:04:59.779785 18807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.014s	sys 0.017s
W20260709 13:04:59.786981 19178 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:04:59.787741 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:04:59.787983 18893 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:04:59.791247 18959 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:59.791714 18959 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:59.792058 18959 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.786711 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:59.785086 18963 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:59.798898 15339 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:04:59.801206 15269 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:04:59.762562 19005 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:59.755268 19126 raft_consensus.cc:2764] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:04:59.784984 15872 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
W20260709 13:04:59.821619 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.760035 19181 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
W20260709 13:04:59.819562 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.793776 19185 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:04:59.800266 18963 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.820473 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:04:59.828255 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.797322 19183 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:59.835553 15264 raft_consensus.cc:2376] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14. Re-sending same reply.
I20260709 13:04:59.838449 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 1982) took 1044 ms. Trace:
I20260709 13:04:59.838789 15264 rpcz_store.cc:276] 0709 13:04:58.793875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.827438 (+ 33563us) service_pool.cc:224] Handling call
0709 13:04:59.830271 (+1002833us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5400011ea8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4ea924 00007f36ea6d3227 00007f36ea6d2ab8 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6
0709 13:04:59.838392 (+  8121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15799168}
I20260709 13:04:59.836161 15871 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:59.841382 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:04:59.850586 15869 consensus_meta.cc:287] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.003s
I20260709 13:04:59.851119 15869 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:04:59.854919 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:59.830147 18904 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:59.860179 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 451647us
I20260709 13:04:59.834985 18963 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:59.861841 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:59.863610 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77021.6us
I20260709 13:04:59.863488 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:59.880970 18944 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:59.854244 19005 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:04:59.884881 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:59.886034 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:04:59.887305 15341 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:04:59.884428 18922 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:59.957197 19191 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:59.959497 19184 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 13:04:59.840296 19041 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:04:59.890854 18511 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.955610 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:59.888818 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:04:59.957739 19191 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:04:59.863137 18904 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:04:59.963894 15339 raft_consensus.cc:2410] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:04:59.853991 19126 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:04:59.841406 18901 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:04:59.967836 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.972079 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:04:59.980149 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 95344us
I20260709 13:04:59.981065 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:04:59.983326 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 287301us
W20260709 13:04:59.985220 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 194653us
I20260709 13:04:59.986161 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:59.993142 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:04:59.993883 15190 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.955665 18938 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:04:59.997620 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.994066 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:04:59.971599 18946 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:00.006381 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:04:59.972383 18904 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.967996 19191 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:59.994814 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:04:59.889245 19189 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.119s
I20260709 13:05:00.019987 15339 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:00.024416 15196 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:59.984138 19120 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:00.017488 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.036497 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:04:59.994213 18922 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:00.037338 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:04:59.969777 18511 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.040324 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:00.042713 15196 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:00.009238 18946 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.044886 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.012363 19021 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:00.048519 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 320694us
I20260709 13:05:00.035717 18564 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.056777 15237 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:00.037781 18938 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:00.057456 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:00.036979 18944 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.062055 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68078.2us
W20260709 13:05:00.062206 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 198825us
I20260709 13:05:00.049507 19023 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:00.065002 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47527.9us
I20260709 13:05:00.075266 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.069535 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.077747 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:00.078226 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:00.053960 19021 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:00.053717 18946 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:00.053828 18877 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.037632 19120 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.066371 19060 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:00.084307 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47063.6us
I20260709 13:05:00.060498 18938 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:00.060724 19100 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.093617 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:00.080354 19027 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.685s	user 0.002s	sys 0.009s
W20260709 13:05:00.100822 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.085501 19021 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:00.102723 18938 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:00.070508 19205 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:00.103539 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:00.081527 19185 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.067827 18564 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:00.122125 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.122205 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:00.116791 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 78066.1us
I20260709 13:05:00.106124 18877 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.114070 18922 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.125334 19196 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:00.128695 19060 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:00.129148 19060 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.129488 19060 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:00.131292 19207 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:00.131794 19207 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:00.132054 18511 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.058494 19005 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.133178 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:00.134485 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.135411 19113 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:00.135598 15337 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:05:00.136083 15337 pending_rounds.cc:85] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 4
I20260709 13:05:00.136370 15337 pending_rounds.cc:107] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:05:00.136440 15345 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:00.136731 15337 raft_consensus.cc:2889] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:00.132153 19207 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:00.137283 18977 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.005s
I20260709 13:05:00.096673 18959 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.135938 19113 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:00.125159 18877 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:00.106561 19167 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 1.212s	user 0.007s	sys 0.000s
I20260709 13:05:00.142112 15190 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:00.104645 18626 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.117321 19188 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.279s	user 0.000s	sys 0.002s
I20260709 13:05:00.158608 15162 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.078928 18944 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.163455 15196 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:05:00.155414 18626 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.170867 19024 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:00.171411 15268 raft_consensus.cc:2376] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7. Re-sending same reply.
I20260709 13:05:00.174460 15188 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:00.176828 18564 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.178164 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2019) took 1103 ms. Trace:
I20260709 13:05:00.200466 15269 rpcz_store.cc:276] 0709 13:04:59.074870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.331312 (+256442us) service_pool.cc:224] Handling call
0709 13:04:59.331599 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:59.801660 (+470061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.177862 (+376202us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b5400327dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:00.178097 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079316352}
I20260709 13:05:00.139644 19023 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:00.121807 19181 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:00.202186 15341 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:00.203073 19181 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:00.204392 19181 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.206008 19181 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:00.201092 15272 raft_consensus.cc:2955] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 5 to 10, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:00.146442 19100 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:00.146216 19113 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:00.198561 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 64158.1us
I20260709 13:05:00.146342 18511 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:00.202364 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:00.186959 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 85328.8us
I20260709 13:05:00.146534 18893 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:00.216564 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.164855 19185 raft_consensus.cc:2764] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:05:00.114879 19027 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.249365 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:00.254148 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 95612.9us
W20260709 13:05:00.255970 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 162474us
I20260709 13:05:00.256469 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2024) took 1064 ms. Trace:
I20260709 13:05:00.256758 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:00.221673 19097 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.893s	user 0.009s	sys 0.005s
I20260709 13:05:00.256858 15263 rpcz_store.cc:276] 0709 13:04:59.191694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.791787 (+600093us) service_pool.cc:224] Handling call
0709 13:04:59.792231 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:00.075621 (+283390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.075651 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:00.082967 (+  7316us) log.cc:844] Serialized 52 byte log entry
0709 13:05:00.220347 (+137380us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:00.255920 (+ 35573us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.256156 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.256229 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:00.256267 (+    38us) raft_consensus.cc:1685] finished
0709 13:05:00.256278 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.256414 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47065,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":20899,"thread_start_us":379073,"threads_started":2,"wal-append.queue_time_us":138417}
I20260709 13:05:00.255573 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:00.121815 19205 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.262701 15341 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:00.219498 19023 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:00.220562 18901 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.253041 19186 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:00.258133 19197 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:05:00.258909 19041 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:05:00.281800 15871 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:00.282084 19041 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:00.282482 19041 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:00.278340 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1d89f71244148538087b141a709ec50"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:00.280891 19027 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:00.293238 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.283375 18959 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.283375 19041 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.263196 19198 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:00.273598 19185 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:00.303347 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.284459 19195 raft_consensus.cc:2764] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:05:00.300278 19190 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 13:05:00.299749 19215 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:00.272980 18511 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:05:00.299661 19200 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.203s	user 0.001s	sys 0.001s
I20260709 13:05:00.317488 19185 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.300402 19209 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:00.332090 15196 raft_consensus.cc:606] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.265817 19097 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.299911 19217 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:00.339736 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:00.327931 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 321) took 1860 ms. Trace:
W20260709 13:05:00.341682 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47215.4us
I20260709 13:05:00.349747 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.283984 18901 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.329342 19041 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:00.317706 19027 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:00.325611 18965 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:00.352929 15342 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:05:00.325960 19198 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:00.301102 19021 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.361208 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:00.347056 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:00.347720 15868 rpcz_store.cc:276] 0709 13:04:58.463492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.465358 (+  1866us) service_pool.cc:224] Handling call
0709 13:04:58.465788 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.466217 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:58.466252 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.466784 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.687525 (+220741us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:58.687573 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.687647 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:59.993199 (+1305552us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:00.323216 (+330017us) raft_consensus.cc:1685] finished
0709 13:05:00.323241 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.323465 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10486528,"thread_start_us":202246,"threads_started":1,"wal-append.queue_time_us":394799}
I20260709 13:05:00.362287 15344 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:00.344028 19185 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.341862 19120 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.341264 18877 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:00.363006 19196 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:00.383126 19027 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.384070 18946 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.386301 19027 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.366216 15874 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:00.387329 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:00.280954 19023 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.391188 18901 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.396198 19129 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:00.396436 19021 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.357913 18965 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.397785 18965 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:00.399322 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:00.399982 15269 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:00.400949 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:00.369495 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2018) took 1294 ms. Trace:
I20260709 13:05:00.371289 19208 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:00.371394 18626 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.375905 19223 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.377574 18944 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:00.431672 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:00.439800 19218 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:05:00.443399 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 103733us
I20260709 13:05:00.444905 18904 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.444329 18965 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:00.368717 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:00.447791 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 79168.3us
I20260709 13:05:00.402242 15265 rpcz_store.cc:276] 0709 13:04:59.074604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.329567 (+254963us) service_pool.cc:224] Handling call
0709 13:04:59.329984 (+   417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:59.363369 (+ 33385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:59.363411 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:59.385697 (+ 22286us) log.cc:844] Serialized 52 byte log entry
0709 13:04:59.704709 (+319012us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:59.968485 (+263776us) log.cc:844] Serialized 14 byte log entry
0709 13:04:59.969054 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:59.969307 (+   253us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:00.369255 (+399948us) raft_consensus.cc:1685] finished
0709 13:05:00.369276 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.369429 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14165,"prepare.queue_time_us":333106,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5233,"raft.queue_time_us":59286,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":21835,"thread_start_us":482391,"threads_started":2,"wal-append.queue_time_us":460009}
I20260709 13:05:00.449348 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:00.450600 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:00.410449 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51668.3us
I20260709 13:05:00.451306 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:00.452095 15269 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:00.452159 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.453099 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:00.453898 15269 raft_consensus.cc:2410] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:00.453936 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.454205 19097 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.393502 19191 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.455709 15238 leader_election.cc:400] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:00.456007 15238 leader_election.cc:403] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:00.456620 18773 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:00.456753 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:00.457360 18773 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:00.400048 19205 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.458012 18773 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:00.458137 19100 raft_consensus.cc:2764] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:05:00.458681 15265 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:05:00.461876 19177 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.724s	user 0.001s	sys 0.002s
I20260709 13:05:00.386566 18946 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.463907 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2026) took 1034 ms. Trace:
I20260709 13:05:00.464401 18944 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:00.464321 15268 rpcz_store.cc:276] 0709 13:04:59.429319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.450479 (+ 21160us) service_pool.cc:224] Handling call
0709 13:05:00.463743 (+1013264us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b5400349254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:00.463849 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650261888}
I20260709 13:05:00.464869 18944 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.464954 18901 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:00.465263 18944 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:00.466734 15268 pending_rounds.cc:85] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 4
I20260709 13:05:00.363698 18807 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:05:00.471302 15197 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:05:00.471786 19201 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:05:00.426800 18938 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.473878 18938 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.427662 19223 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:00.402988 18963 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.521s	user 0.004s	sys 0.006s
I20260709 13:05:00.451738 19198 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:00.457577 19191 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.471642 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.475066 15340 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:05:00.424276 19226 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:00.444300 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.409464 18507 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:00.410781 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:00.481104 15269 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:05:00.499858 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2027) took 1056 ms. Trace:
I20260709 13:05:00.500391 15269 rpcz_store.cc:276] 0709 13:04:59.443254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.454572 (+1011318us) service_pool.cc:224] Handling call
0709 13:05:00.454910 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.499511 (+ 44601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.499791 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:00.481012 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:00.483716 15268 pending_rounds.cc:107] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:00.489555 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:00.413815 19206 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 13:05:00.501811 15268 raft_consensus.cc:2889] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:00.503849 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2017) took 1429 ms. Trace:
I20260709 13:05:00.503976 19217 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:00.504313 18965 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:00.504244 15271 rpcz_store.cc:276] 0709 13:04:59.074304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.326515 (+252211us) service_pool.cc:224] Handling call
0709 13:04:59.326844 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:59.327609 (+   765us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:59.746255 (+418646us) log.cc:844] Serialized 14 byte log entry
0709 13:04:59.992073 (+245818us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.177121 (+185048us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:00.177563 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.177716 (+   153us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:00.177960 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.178122 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.178189 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:00.503659 (+325470us) raft_consensus.cc:1685] finished
0709 13:05:00.503679 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.503792 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21837,"prepare.queue_time_us":684450,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":75,"raft.queue_time_us":30879,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":7033,"spinlock_wait_cycles":117847424,"thread_start_us":652261,"threads_started":2,"wal-append.queue_time_us":348868}
I20260709 13:05:00.505661 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:00.388351 15871 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:00.498486 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 286) took 1330 ms. Trace:
I20260709 13:05:00.513672 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.514295 15272 rpcz_store.cc:276] 0709 13:04:59.173499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.665121 (+491622us) service_pool.cc:224] Handling call
0709 13:04:59.685218 (+ 20097us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:00.043191 (+357973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.043226 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:00.074348 (+ 31122us) log.cc:844] Serialized 520 byte log entry
0709 13:05:00.192275 (+117927us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:00.484084 (+291809us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.497968 (+ 13884us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.498227 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.498285 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:00.498320 (+    35us) raft_consensus.cc:1685] finished
0709 13:05:00.498330 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.498434 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13326,"raft.queue_time_us":120041,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":24808,"thread_start_us":432029,"threads_started":2,"wal-append.queue_time_us":252676}
I20260709 13:05:00.474772 19027 raft_consensus.cc:2764] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:05:00.520812 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49267.5us
W20260709 13:05:00.528208 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83994.3us
W20260709 13:05:00.532264 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 183155us
W20260709 13:05:00.557231 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43627.1us
I20260709 13:05:00.560935 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:00.561331 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:00.512089 19189 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:00.562166 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2006) took 1193 ms. Trace:
I20260709 13:05:00.562539 15266 rpcz_store.cc:276] 0709 13:04:59.369130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.529186 (+160056us) service_pool.cc:224] Handling call
0709 13:05:00.561194 (+1032008us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:05:00.562108 (+   914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672000}
I20260709 13:05:00.512949 19217 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:00.568989 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47166.4us
I20260709 13:05:00.518721 19041 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:00.574712 15342 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
W20260709 13:05:00.576781 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 321312us
I20260709 13:05:00.495980 18963 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.526552 18904 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:00.530089 18938 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:00.537256 18922 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:00.527472 19100 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:00.530407 18507 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:00.588258 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.601661 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:00.616086 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47957us
I20260709 13:05:00.578716 19041 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.627108 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.628321 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:00.625640 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:00.630539 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.632674 15193 raft_consensus.cc:2368] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13.
I20260709 13:05:00.596460 19205 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:00.637850 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.637190 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.638584 15339 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:00.638934 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.619467 18807 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:00.642509 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:00.641583 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:00.644012 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.645936 15272 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:00.650024 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:00.650368 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62208.9us
I20260709 13:05:00.632450 19041 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.633250 19021 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:00.657155 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.637614 18829 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:00.668664 15339 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:00.623899 19100 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.678781 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.679147 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:00.644953 18807 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:00.679772 15272 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:00.690062 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:00.692081 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:00.676201 15095 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 13 to 16, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:00.653400 18938 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:00.709525 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:00.689173 19207 consensus_meta.cc:287] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.006s
I20260709 13:05:00.677155 19021 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:00.687466 18807 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:00.710690 15191 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:00.711054 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.648594 19205 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.712206 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.712407 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:00.714596 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:00.647140 19189 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:05:00.718331 15272 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:00.689857 19120 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:00.723248 19249 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.007s
I20260709 13:05:00.691241 18829 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:00.773370 18829 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.725955 15197 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:00.766153 19203 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.309s	user 0.001s	sys 0.001s
I20260709 13:05:00.780673 19232 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:00.781354 19232 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:00.720443 19207 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.785571 15868 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:00.787895 19100 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:00.768167 19237 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:05:00.789917 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:00.790203 18963 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.790835 19234 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.793020 19005 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:00.799229 19113 consensus_meta.cc:287] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.000s
W20260709 13:05:00.795176 19241 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:05:00.767150 19244 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:05:00.709573 19227 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:00.793948 19247 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.824800 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:00.804879 19122 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:00.934031 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 136954us
I20260709 13:05:00.704022 18507 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.810885 18830 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:00.825918 18773 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.822492 18511 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:00.856086 19023 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.858544 18963 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.975643 18511 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:00.979852 18511 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:00.825958 19217 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:00.904404 19223 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:00.990345 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 290237us
I20260709 13:05:00.985400 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2190) took 1025 ms. Trace:
W20260709 13:05:00.982234 19060 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.852s	user 0.011s	sys 0.003s
I20260709 13:05:00.999238 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:01.008035 19246 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:00.830300 19113 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.964365 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:00.822278 19185 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.975119 18830 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:00.824043 19234 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.942157 19247 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:00.977260 19021 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.070173 19207 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:00.984902 18773 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:01.101876 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 103021us
I20260709 13:05:01.050282 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2187) took 1091 ms. Trace:
I20260709 13:05:00.967618 19227 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.104182 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:01.074841 18511 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:00.997323 19097 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:01.038029 18959 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.988900 18963 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:01.043149 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 218415us
I20260709 13:05:01.102912 15338 rpcz_store.cc:276] 0709 13:04:59.958716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.374733 (+416017us) service_pool.cc:224] Handling call
0709 13:05:00.430579 (+ 55846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.431309 (+   730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.431340 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.431848 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.556278 (+124430us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:00.557527 (+  1249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.557623 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.049993 (+492370us) raft_consensus.cc:1685] finished
0709 13:05:01.050021 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.050205 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":405376,"thread_start_us":123617,"threads_started":1,"wal-append.queue_time_us":220614}
I20260709 13:05:01.146328 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:01.038359 18877 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:00.995429 15343 rpcz_store.cc:276] 0709 13:04:59.959597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.462288 (+502691us) service_pool.cc:224] Handling call
0709 13:05:00.462591 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.462864 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:00.576588 (+113724us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.984681 (+408093us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:00.985091 (+   410us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:00.985148 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.985217 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.985342 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19929,"prepare.queue_time_us":135106,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":33616,"thread_start_us":390771,"threads_started":2}
I20260709 13:05:01.149166 15265 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:00.994987 19217 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.151849 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:01.147596 15871 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:00.990422 19023 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:01.160992 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:01.147351 19129 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:01.166002 18511 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:01.108676 19198 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:05:01.169395 19248 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:05:01.170457 18773 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.171201 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2185) took 1213 ms. Trace:
I20260709 13:05:01.171746 15346 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:01.172165 19263 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 13:05:01.173280 19254 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:05:01.171608 15337 rpcz_store.cc:276] 0709 13:04:59.958192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.137760 (+179568us) service_pool.cc:224] Handling call
0709 13:05:00.138113 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.334297 (+196184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:00.516359 (+182062us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.695245 (+178886us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.695708 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.695834 (+   126us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:00.695866 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.695927 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.170932 (+475005us) raft_consensus.cc:1685] finished
0709 13:05:01.170953 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.171126 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14062,"prepare.queue_time_us":233183,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3203,"raft.queue_time_us":115397,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":2937,"thread_start_us":460230,"threads_started":3,"wal-append.queue_time_us":248913}
W20260709 13:05:01.174206 19262 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:05:01.175233 19251 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:05:01.176499 15870 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 268) took 1839 ms (client timeout 2230 ms). Trace:
W20260709 13:05:01.177055 15870 rpcz_store.cc:269] 0709 13:04:59.336994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.339056 (+  2062us) service_pool.cc:224] Handling call
0709 13:05:01.176165 (+1837109us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54005479d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:01.176376 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660536192}
I20260709 13:05:01.177644 15266 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:01.178025 19227 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.019924 19060 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.157789 18877 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:01.115558 19120 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:05:01.160244 19268 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.269531 15265 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
W20260709 13:05:01.195767 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44035.4us
W20260709 13:05:01.226977 18944 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.761s	user 0.014s	sys 0.000s
I20260709 13:05:01.228600 19247 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:01.226421 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.230470 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:01.166369 19255 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:01.230796 19220 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.775s	user 0.004s	sys 0.000s
I20260709 13:05:01.227413 15195 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:01.224162 19023 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:01.230175 19235 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.768s	user 0.000s	sys 0.009s
I20260709 13:05:01.182624 19205 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.229374 19207 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:01.197012 18877 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:01.234014 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2041) took 1035 ms. Trace:
I20260709 13:05:01.294910 15272 rpcz_store.cc:276] 0709 13:05:00.198488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.763743 (+565255us) service_pool.cc:224] Handling call
0709 13:05:00.809875 (+ 46132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.822967 (+ 13092us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.823000 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.836743 (+ 13743us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.095811 (+259068us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:01.145685 (+ 49874us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.152841 (+  7156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.152945 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.233772 (+ 80827us) raft_consensus.cc:1685] finished
0709 13:05:01.233798 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.233949 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20023,"prepare.queue_time_us":53039,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":39911,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":74952,"thread_start_us":116996,"threads_started":1,"wal-append.queue_time_us":226204}
I20260709 13:05:01.150981 18830 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.233232 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2042) took 1022 ms. Trace:
I20260709 13:05:01.151631 18959 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.153231 19097 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:01.226282 19129 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:01.275264 19262 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:01.307629 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:01.300997 15271 rpcz_store.cc:276] 0709 13:05:00.210830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.791681 (+580851us) service_pool.cc:224] Handling call
0709 13:05:00.792332 (+   651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.792623 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:00.813253 (+ 20630us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.232678 (+419425us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b1800424f00. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a
0709 13:05:01.232854 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.232906 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:01.232961 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.233043 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.233159 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20437,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":70986,"raft.queue_time_us":342,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9210,"spinlock_wait_cycles":31980416,"thread_start_us":122866,"threads_started":1,"wal-append.queue_time_us":196394}
I20260709 13:05:01.306378 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:01.313115 15271 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:01.315116 15193 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:01.298710 19255 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:01.320247 15271 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:01.283466 18944 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.274736 19268 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.317852 19189 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:01.340843 19247 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:01.341452 19247 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.341918 19268 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.343519 19247 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.338004 15271 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:05:01.351613 19260 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
W20260709 13:05:01.344169 19257 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:05:01.356024 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2023) took 2164 ms. Trace:
I20260709 13:05:01.356956 15188 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:01.359001 15871 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:05:01.360183 19022 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:01.366876 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2186) took 1408 ms. Trace:
W20260709 13:05:01.367630 19219 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.927s	user 0.003s	sys 0.000s
I20260709 13:05:01.369164 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2025) took 2177 ms. Trace:
I20260709 13:05:01.369621 19232 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.375663 19217 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.376533 19185 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:01.378103 19234 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:01.378804 15874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58400 (request call id 272) took 1557 ms. Trace:
I20260709 13:05:01.379096 15194 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:01.379215 15874 rpcz_store.cc:276] 0709 13:04:59.821060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.825002 (+  3942us) service_pool.cc:224] Handling call
0709 13:04:59.825306 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.387804 (+562498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.378564 (+990760us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54000e51d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:01.378746 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237787904}
I20260709 13:05:01.380084 18944 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.345577 19113 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:01.383198 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2022) took 2195 ms. Trace:
I20260709 13:05:01.383596 15270 rpcz_store.cc:276] 0709 13:04:59.187990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.736341 (+548351us) service_pool.cc:224] Handling call
0709 13:04:59.736746 (+   405us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:59.810606 (+ 73860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:59.810647 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:59.835592 (+ 24945us) log.cc:844] Serialized 52 byte log entry
0709 13:05:00.047297 (+211705us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:00.161964 (+114667us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.163271 (+  1307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.382797 (+1219526us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b54000d5f54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:01.382843 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.382887 (+    44us) raft_consensus.cc:1685] finished
0709 13:05:01.382971 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.383143 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39511,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":78580,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":77856,"spinlock_wait_cycles":160810752,"thread_start_us":252981,"threads_started":2,"wal-append.queue_time_us":270677,"wal-append.run_cpu_time_us":3742,"wal-append.run_wall_time_us":1208181}
I20260709 13:05:01.385388 19129 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:01.386857 18807 consensus_meta.cc:287] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.000s
I20260709 13:05:01.345831 19189 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.387526 19189 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:01.387307 18807 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.388432 15197 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:01.389420 18807 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:01.391180 19041 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.001s
I20260709 13:05:01.391593 19041 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.392676 19255 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:01.393687 19041 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:01.395408 19208 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.971s	user 0.000s	sys 0.011s
I20260709 13:05:01.395818 19208 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:01.396103 19060 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:01.367339 15341 rpcz_store.cc:276] 0709 13:04:59.958458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.204571 (+246113us) service_pool.cc:224] Handling call
0709 13:05:00.205489 (+   918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.264119 (+ 58630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.366612 (+1102493us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b540005ad54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:01.366809 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118594816}
I20260709 13:05:01.369660 15264 rpcz_store.cc:276] 0709 13:04:59.191945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.839848 (+647903us) service_pool.cc:224] Handling call
0709 13:04:59.861868 (+ 22020us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:59.889549 (+ 27681us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:59.889582 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:59.973002 (+ 83420us) log.cc:844] Serialized 52 byte log entry
0709 13:05:00.085414 (+112412us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:00.085454 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.085522 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.205275 (+1119753us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:01.368727 (+163452us) raft_consensus.cc:1685] finished
0709 13:05:01.368761 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.369088 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82868,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":20173,"spinlock_wait_cycles":79752576,"thread_start_us":33707,"threads_started":1,"wal-append.queue_time_us":391085}
I20260709 13:05:01.356504 15267 rpcz_store.cc:276] 0709 13:04:59.191399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.779133 (+587734us) service_pool.cc:224] Handling call
0709 13:04:59.794676 (+ 15543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:59.806000 (+ 11324us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:00.030049 (+224049us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.214273 (+1184224us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:01.355458 (+141185us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b1800390c40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:05:01.355653 (+   195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:01.355711 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:01.355760 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.355840 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.355961 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3669,"prepare.queue_time_us":272391,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":43982,"spinlock_wait_cycles":129150080,"thread_start_us":267851,"threads_started":3,"wal-append.queue_time_us":418163}
I20260709 13:05:01.398459 19209 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:01.399519 19209 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:01.399857 19209 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:01.400683 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46386 (request call id 26) took 1122 ms. Trace:
I20260709 13:05:01.400828 19209 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:01.401216 15196 rpcz_store.cc:276] 0709 13:05:00.278009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.278198 (+   189us) service_pool.cc:224] Handling call
0709 13:05:01.400513 (+1122315us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b54001e82d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5707853 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691 00007f36e3c5b60c 00007f36e3c5a8c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:01.400599 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107308032}
I20260709 13:05:01.401762 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:01.402272 19209 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:01.403296 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 63496.1us
I20260709 13:05:01.412667 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:01.414060 15271 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:01.413380 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 182981us
I20260709 13:05:01.399765 19195 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:01.440409 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:01.441264 15270 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:01.413242 19268 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.444062 19265 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:01.465862 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 152795us
I20260709 13:05:01.460532 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:01.481209 15270 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:01.461428 19268 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.504855 15343 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:01.506338 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:01.506541 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:01.507109 15343 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:01.507994 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:01.508304 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.467111 19265 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.508720 15337 raft_consensus.cc:1813] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Handling vote request from an unknown peer 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:01.519236 15337 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:01.482831 19208 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.488690 15871 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:01.510674 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:01.529461 15270 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.531858 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:01.535348 15337 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:05:01.484246 18877 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.540743 15264 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:01.541267 15271 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:01.547560 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:01.548509 15271 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:01.520066 18959 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:01.488087 19210 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:05:01.550168 15869 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:01.487933 19196 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:05:01.552093 15343 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:01.510352 18807 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:05:01.525568 19097 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.565834 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2200) took 1275 ms. Trace:
I20260709 13:05:01.525473 18944 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:05:01.566335 15344 rpcz_store.cc:276] 0709 13:05:00.290476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.048915 (+758439us) service_pool.cc:224] Handling call
0709 13:05:01.049349 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.060404 (+ 11055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.060443 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.115466 (+ 55023us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.465153 (+349687us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:01.465204 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.465313 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.565607 (+100294us) raft_consensus.cc:1685] finished
0709 13:05:01.565627 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.565769 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":277642,"threads_started":1,"wal-append.queue_time_us":395935}
I20260709 13:05:01.568994 18877 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:01.556859 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:01.570200 15873 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.557439 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:01.558007 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2046) took 1346 ms. Trace:
I20260709 13:05:01.572355 15266 rpcz_store.cc:276] 0709 13:05:00.211925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.178395 (+966470us) service_pool.cc:224] Handling call
0709 13:05:01.178744 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:01.179123 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.179154 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:01.180698 (+  1544us) log.cc:844] Serialized 52 byte log entry
0709 13:05:01.311304 (+130606us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:01.406613 (+ 95309us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.444026 (+ 37413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.444101 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.557766 (+113665us) raft_consensus.cc:1685] finished
0709 13:05:01.557786 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.557947 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37160,"prepare.queue_time_us":101011,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":39995,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8865,"spinlock_wait_cycles":9104128,"thread_start_us":129852,"threads_started":1,"wal-append.queue_time_us":284440}
W20260709 13:05:01.560247 19271 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:05:01.556128 15343 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:01.519410 19204 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.009s	sys 0.009s
I20260709 13:05:01.579193 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:01.594988 15270 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:01.524590 19208 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:01.601521 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71938.5us
W20260709 13:05:01.585605 19204 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.119s	user 0.010s	sys 0.009s
I20260709 13:05:01.602447 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:01.606392 19255 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.608223 19255 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.610224 19255 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.613600 19129 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:01.613699 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 73137.8us
I20260709 13:05:01.615206 19210 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:01.615636 19210 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:01.615891 19278 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:01.616601 19210 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.618192 19210 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:01.620846 19097 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:01.621438 19097 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:01.623709 19097 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.627460 15337 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:01.627774 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2048) took 1415 ms. Trace:
I20260709 13:05:01.630245 19211 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:01.642915 19211 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:01.643981 19211 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.615231 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:01.647128 15265 rpcz_store.cc:276] 0709 13:05:00.212413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.276355 (+1063942us) service_pool.cc:224] Handling call
0709 13:05:01.276676 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.317225 (+ 40549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.317268 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.330096 (+ 12828us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.393166 (+ 63070us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b4800061a58. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:05:01.504030 (+110864us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:01.504174 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.508122 (+  3948us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.627399 (+119277us) raft_consensus.cc:1685] finished
0709 13:05:01.627431 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.627696 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75086,"raft.queue_time_us":27288,"raft.run_cpu_time_us":2322,"raft.run_wall_time_us":72339,"spinlock_wait_cycles":5379840,"thread_start_us":89545,"threads_started":1,"wal-append.queue_time_us":281558}
I20260709 13:05:01.646375 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:01.651024 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:01.653882 15338 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:01.655248 15265 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:01.661154 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:01.659534 19129 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:01.664072 19129 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:01.661804 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:01.596433 19120 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:05:01.646250 18963 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.687835 15271 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:01.688175 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:01.688860 15337 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.662271 18829 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:01.695416 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:01.696060 15189 raft_consensus.cc:606] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:01.696810 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:01.701355 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:01.701907 15341 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:05:01.702080 15197 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:05:01.705858 19129 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.735400 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:01.689345 19255 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:01.736182 15343 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.759981 15338 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:01.760200 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:01.760808 15265 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:01.761909 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:01.762629 15265 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:01.687642 19189 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.767334 15337 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:01.822731 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.823262 15341 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:01.830232 15873 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:01.836603 19283 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:05:01.837886 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:01.818776 19265 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.844460 19189 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.822958 19255 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:01.850255 19255 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.853468 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:01.855976 15341 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:05:01.823447 19268 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.861752 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:01.856793 19097 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.869459 19097 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:01.871368 15264 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:01.878639 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 430435us
I20260709 13:05:01.878983 19273 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:01.879369 19097 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:01.892985 15337 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:01.900077 15343 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:01.887961 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2044) took 1667 ms. Trace:
I20260709 13:05:01.906086 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2192) took 1905 ms. Trace:
I20260709 13:05:01.906652 15340 rpcz_store.cc:276] 0709 13:05:00.000469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.467463 (+466994us) service_pool.cc:224] Handling call
0709 13:05:00.467784 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.492897 (+ 25113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.905706 (+1412809us) spinlock_profiling.cc:243] Waited 6.99 ms on lock 0x7b5400424854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:01.906009 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16067328}
I20260709 13:05:01.901794 15268 rpcz_store.cc:276] 0709 13:05:00.211457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.962289 (+750832us) service_pool.cc:224] Handling call
0709 13:05:00.964004 (+  1715us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:01.031545 (+ 67541us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:01.114968 (+ 83423us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.172798 (+ 57830us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003907c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e95e158f 00007f36e2620571 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd
0709 13:05:01.321216 (+148418us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:01.339998 (+ 18782us) log.cc:844] Serialized 52 byte log entry
0709 13:05:01.340131 (+   133us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:01.412735 (+ 72604us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.624138 (+211403us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b18003907c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:01.878306 (+254168us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18003907c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:05:01.878587 (+   281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.878699 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.878755 (+    56us) raft_consensus.cc:1685] finished
0709 13:05:01.878775 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.878953 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128024,"prepare.queue_time_us":333762,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":599304,"raft.run_cpu_time_us":484,"raft.run_wall_time_us":41162,"spinlock_wait_cycles":24939776,"thread_start_us":179644,"threads_started":2,"wal-append.queue_time_us":285206}
I20260709 13:05:01.919536 15311 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:01.964008 19293 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:01.965024 19293 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:01.965343 19293 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:01.966148 19293 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:01.982230 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2047) took 1770 ms. Trace:
I20260709 13:05:01.982702 15269 rpcz_store.cc:276] 0709 13:05:00.212191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.197744 (+985553us) service_pool.cc:224] Handling call
0709 13:05:01.277787 (+ 80043us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:01.303845 (+ 26058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.303906 (+    61us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:01.311446 (+  7540us) log.cc:844] Serialized 52 byte log entry
0709 13:05:01.486973 (+175527us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:01.521160 (+ 34187us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.885307 (+364147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.885415 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.978310 (+ 92895us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18003906a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:01.981921 (+  3611us) raft_consensus.cc:1685] finished
0709 13:05:01.982021 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.982164 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":389383,"prepare.queue_time_us":34346,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":3200,"raft.queue_time_us":393640,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":11225,"spinlock_wait_cycles":9231232,"thread_start_us":141606,"threads_started":1,"wal-append.queue_time_us":211479}
W20260709 13:05:02.018242 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 56272us
W20260709 13:05:01.963167 19275 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:02.027351 18564 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:02.018208 19041 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.017498 19126 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:05:02.039678 15264 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:05:02.046504 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 331) took 1616 ms. Trace:
I20260709 13:05:02.046975 15868 rpcz_store.cc:276] 0709 13:05:00.429795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.429964 (+   169us) service_pool.cc:224] Handling call
0709 13:05:00.430290 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.802880 (+372590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.046243 (+1243363us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54005e01d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:02.046436 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":816394624}
W20260709 13:05:02.051245 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.055135 15195 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:05:02.055492 19027 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.055347 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:02.056247 19268 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:02.055338 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:02.056181 19027 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:02.056900 19268 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.057585 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:02.058224 15263 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:05:02.058605 19027 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:02.041486 19041 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.058362 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.059863 19268 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:02.059839 15238 leader_election.cc:400] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:02.060755 15238 leader_election.cc:403] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:05:02.060712 19041 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.062207 15237 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:02.069572 19232 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:02.072062 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2049) took 1859 ms. Trace:
I20260709 13:05:02.072489 15272 rpcz_store.cc:276] 0709 13:05:00.212655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.296828 (+1084173us) service_pool.cc:224] Handling call
0709 13:05:01.309821 (+ 12993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.342708 (+ 32887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.342938 (+   230us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.343439 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.483979 (+140540us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:01.484035 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.071669 (+587634us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b5400011b54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:02.071713 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.071755 (+    42us) raft_consensus.cc:1685] finished
0709 13:05:02.071767 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.071998 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"spinlock_wait_cycles":74662272,"thread_start_us":140098,"threads_started":1,"wal-append.queue_time_us":206087}
I20260709 13:05:02.078742 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:02.079929 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.033875 19293 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:02.089738 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44428.5us
I20260709 13:05:02.092566 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:02.097589 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.098618 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.098790 19268 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:02.099195 19268 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.099555 19268 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.099334 19204 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:02.099970 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:02.101338 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.103286 18830 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:02.103781 15263 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:02.105114 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.106207 18773 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:02.106336 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46626us
I20260709 13:05:02.106739 18773 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.107254 19023 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:02.109011 18773 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.109707 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.097141 19208 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:02.117244 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.118019 19255 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:02.123188 15196 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:02.119685 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.124173 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.124984 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.130363 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.094777 19027 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:02.096024 19265 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:02.130810 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.133630 18773 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:02.134117 19204 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:02.135000 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.114188 19186 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:02.043547 19126 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
W20260709 13:05:02.157917 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 102672us
W20260709 13:05:02.161489 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 105996us
I20260709 13:05:02.142316 19204 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:02.146806 19097 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:02.178735 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:02.183018 19209 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:02.183573 19209 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.183943 19209 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.145318 19027 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.161036 19309 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:02.178958 19097 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:02.188328 19097 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:02.188887 19277 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:02.144821 18773 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.144750 19265 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.144723 19005 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:05:02.169034 19186 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:02.205448 19311 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:05:02.251322 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 1.09032e+06us
W20260709 13:05:02.252077 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 1.02361e+06us
I20260709 13:05:02.253082 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:02.253552 15312 leader_election.cc:400] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13.
I20260709 13:05:02.253993 15312 leader_election.cc:403] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:02.254487 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:02.255607 19253 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:02.255635 19021 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13.
I20260709 13:05:02.265887 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2199) took 1975 ms. Trace:
I20260709 13:05:02.267515 18511 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:02.270598 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 92050.2us
I20260709 13:05:02.271648 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:02.268072 15339 rpcz_store.cc:276] 0709 13:05:00.290209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.677846 (+387637us) service_pool.cc:224] Handling call
0709 13:05:00.680252 (+  2406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.680453 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:00.700958 (+ 20505us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.919092 (+1218134us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b180034f600. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a
0709 13:05:02.265527 (+346435us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.265595 (+    68us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:02.265637 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.265707 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.265825 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":347945,"prepare.queue_time_us":27285,"prepare.run_cpu_time_us":8322,"prepare.run_wall_time_us":35064,"spinlock_wait_cycles":7547776,"thread_start_us":107939,"threads_started":1,"wal-append.queue_time_us":293116,"wal-append.run_cpu_time_us":1797,"wal-append.run_wall_time_us":1168464}
I20260709 13:05:02.236850 19209 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:02.421415 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 164053us
I20260709 13:05:02.422493 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:02.411919 18938 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:02.424530 19310 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:05:02.424366 18938 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.212416 19204 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:02.426337 19312 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:05:02.427351 19315 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:05:02.264729 19217 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.427189 19186 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.428056 19217 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.430341 19217 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.266832 19230 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:02.262447 19309 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:05:02.422791 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 211226us
W20260709 13:05:02.439512 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 276186us
I20260709 13:05:02.412639 18829 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:02.421900 19227 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:02.481653 15237 leader_election.cc:336] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.578s (SENT)
I20260709 13:05:02.426743 19265 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:02.413111 19023 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:02.414434 18807 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:05:02.468658 19217 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:02.527733 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 105313us
W20260709 13:05:02.490022 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76323.7us
I20260709 13:05:02.567698 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2193) took 2530 ms. Trace:
I20260709 13:05:02.544293 15869 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:05:02.652508 18511 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:02.480749 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2196) took 2191 ms. Trace:
I20260709 13:05:02.654837 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:02.433590 19230 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:02.548471 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 294029us
I20260709 13:05:02.657560 18511 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:02.614683 15191 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:05:02.661549 18511 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:02.662227 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:02.490718 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 571247us
I20260709 13:05:02.592195 15095 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 4 to 8, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:02.665984 15193 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:02.666852 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:02.434722 19024 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.676000 19230 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:02.676195 19024 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.677277 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:02.656581 19265 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.678293 19265 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.426779 18938 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:02.484571 18829 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.680346 19265 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.680430 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.681165 19265 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:02.681070 19208 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:02.682013 19208 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.653594 15342 rpcz_store.cc:276] 0709 13:05:00.289061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.584665 (+295604us) service_pool.cc:224] Handling call
0709 13:05:00.617351 (+ 32686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.642114 (+ 24763us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:00.678123 (+ 36009us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.372027 (+693904us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b180042ac60. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a
0709 13:05:02.255503 (+883476us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.480318 (+224815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.480385 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:02.480440 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.480526 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.480674 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":915320,"prepare.queue_time_us":31137,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":1334,"raft.queue_time_us":951104,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":37045,"spinlock_wait_cycles":3945728,"thread_start_us":201692,"threads_started":2,"wal-append.queue_time_us":512456,"wal-append.run_cpu_time_us":1639,"wal-append.run_wall_time_us":1190095}
I20260709 13:05:02.674608 18511 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.683338 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:02.683629 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:02.682963 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.687812 15195 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:02.561633 19253 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:02.630071 19198 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:02.630538 19330 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.543826 18904 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:02.700188 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:02.703974 18904 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.704572 18904 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.705922 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:02.491649 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:02.652833 15345 rpcz_store.cc:276] 0709 13:05:00.037093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.473617 (+436524us) service_pool.cc:224] Handling call
0709 13:05:00.473943 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.474245 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:00.968339 (+494094us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.250483 (+1282144us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.567334 (+316851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.567399 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:02.567444 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.567507 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.567636 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1247174,"prepare.queue_time_us":128800,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":71,"raft.queue_time_us":1250887,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":3876,"thread_start_us":814647,"threads_started":3,"wal-append.queue_time_us":527683,"wal-append.run_cpu_time_us":1281,"wal-append.run_wall_time_us":1005994}
I20260709 13:05:02.543990 19319 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.694021 18511 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.527267 18626 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:02.683115 18829 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.698221 19230 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.716527 19230 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.718189 18773 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.718634 19230 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:02.700150 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2217) took 1099 ms. Trace:
I20260709 13:05:02.719208 15344 rpcz_store.cc:276] 0709 13:05:01.600480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.600607 (+   127us) service_pool.cc:224] Handling call
0709 13:05:01.601010 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:02.259411 (+658401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.259441 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:02.259897 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:05:02.611626 (+351729us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:02.611675 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.611749 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.699942 (+ 88193us) raft_consensus.cc:1685] finished
0709 13:05:02.699961 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.700092 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":657804,"raft.queue_time_us":660283,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":1277,"thread_start_us":349977,"threads_started":1,"wal-append.queue_time_us":433509}
W20260709 13:05:02.700302 19232 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.630s	user 0.014s	sys 0.000s
I20260709 13:05:02.701535 18959 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:02.721125 18959 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:02.721520 18959 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:02.722985 19208 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.710314 19060 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:02.726572 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.712702 19255 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:05:02.727169 19199 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.662460 19023 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.727852 19199 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:02.728932 19329 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:05:02.730010 19023 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.662752 19227 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:02.732107 19326 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:05:02.732527 19227 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.733417 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2209) took 1211 ms. Trace:
I20260709 13:05:02.733861 15346 rpcz_store.cc:276] 0709 13:05:01.521695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.526164 (+  4469us) service_pool.cc:224] Handling call
0709 13:05:01.547000 (+ 20836us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:02.258974 (+711974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.259009 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:02.259562 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:05:02.420571 (+161009us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:02.420705 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.421528 (+   823us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.731505 (+309977us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:02.733070 (+  1565us) raft_consensus.cc:1685] finished
0709 13:05:02.733096 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.733349 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":709127,"raft.queue_time_us":711559,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"spinlock_wait_cycles":79261056,"thread_start_us":160415,"threads_started":1,"wal-append.queue_time_us":361553}
I20260709 13:05:02.670845 19217 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.746744 19204 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:02.693852 19198 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:02.747577 19024 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:02.747574 19217 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.669732 18877 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:05:02.748502 19198 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.750379 19198 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.751307 19189 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:02.751706 19189 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:02.752378 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46519.2us
I20260709 13:05:02.752637 19189 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.753605 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.754356 15346 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:02.754657 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.754930 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:02.755331 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.755966 15339 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:02.756050 15344 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
W20260709 13:05:02.756551 15190 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1641) took 2064 ms (client timeout 2013 ms). Trace:
W20260709 13:05:02.756927 15190 rpcz_store.cc:269] 0709 13:05:00.691762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.691864 (+   102us) service_pool.cc:224] Handling call
0709 13:05:02.756302 (+2064438us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54000f96d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:02.756450 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468116352}
I20260709 13:05:02.757455 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.758106 15344 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
W20260709 13:05:02.758462 19097 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.001s
I20260709 13:05:02.754134 19189 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:02.758900 19097 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.761708 19309 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.755296 15342 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:02.713905 18938 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:05:02.766414 18938 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:02.766777 18938 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:02.767570 18938 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.768606 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.768854 18938 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.769443 15344 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:02.702841 19330 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.508219 18507 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.182s
I20260709 13:05:02.706986 19113 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:02.579634 19268 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:02.779256 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70786.7us
I20260709 13:05:02.780650 18830 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:02.692529 19253 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.806535 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.813612 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:02.814327 15344 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:02.824453 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.831297 15345 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:02.831786 15264 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:05:02.833490 19217 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:02.833879 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:02.834055 19217 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.834619 15346 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:02.833913 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:02.835865 15342 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:02.836174 19217 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.836402 19255 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.824533 19330 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.811695 19253 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.836975 19255 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.838085 19183 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:02.838598 19183 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.838951 18830 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.839147 19255 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:02.839622 18830 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.840646 19183 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.841033 18959 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.841655 18830 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.841853 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.843384 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:02.843890 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:02.844025 15190 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:02.844440 15197 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:02.848027 15342 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:02.848656 15263 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:02.849970 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:02.850595 15265 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:02.851567 15197 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:05:02.853446 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:02.854557 19207 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:02.855116 19207 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.855571 19207 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:02.856606 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:02.857779 19277 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:02.858292 19277 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:02.859203 19277 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:02.861033 19320 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.196s	user 0.000s	sys 0.002s
I20260709 13:05:02.861668 18830 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:02.862203 18830 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:02.864823 18830 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.868315 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.869547 15342 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:02.870396 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:02.871238 15264 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.795310 19319 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:02.883126 15270 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:05:02.893070 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.894039 15342 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:02.868563 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:02.906224 15264 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:02.899721 18830 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:02.917732 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:02.933674 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.922955 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46386 (request call id 27) took 1236 ms. Trace:
I20260709 13:05:02.911016 19217 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:05:02.934684 15189 rpcz_store.cc:276] 0709 13:05:01.686640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.686783 (+   143us) service_pool.cc:224] Handling call
0709 13:05:02.922715 (+1235932us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b4c0001a240. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e39d9a20 00007f36e39eaa29 00007f36e39b0644 00007f36e39d7f2d 00007f36e39d7b93 00007f36e5707c92 00007f36e570784a 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691
0709 13:05:02.922875 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169665920}
I20260709 13:05:02.924510 19097 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.925587 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.936873 19319 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:02.925647 18959 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:02.912391 19183 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:05:02.953850 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:02.924582 15196 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:02.925447 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:02.919720 18807 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:05:02.948807 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 467403us
I20260709 13:05:02.921830 19278 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:05:02.937124 19330 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:02.960408 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:02.987154 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:02.952189 18830 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:03.007844 15264 raft_consensus.cc:2410] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:05:03.013893 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:02.979688 19196 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.373s	user 0.010s	sys 0.028s
I20260709 13:05:03.015653 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.024111 18922 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:03.024209 18830 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.024971 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:02.946816 19024 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:05:03.009415 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:03.037966 15874 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:05:03.033977 18564 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.032238 19120 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:05:03.039422 19278 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:03.039937 19278 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.040290 19278 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.040892 19199 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:03.043303 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:02.993232 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.790s (SENT) [suppressed 38 similar messages]
I20260709 13:05:03.033012 15264 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:05:02.980243 19318 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.987182 19189 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:03.056414 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 63223.4us
I20260709 13:05:03.057248 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.045993 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:02.999289 19022 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.066649 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.067487 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:03.055512 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:03.034439 19196 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.431s	user 0.016s	sys 0.029s
I20260709 13:05:03.067489 15338 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:03.070395 15344 raft_consensus.cc:2410] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:03.058384 15264 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:05:03.072908 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.074041 15342 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.078845 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:03.080554 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.083117 15264 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:03.087406 15344 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:03.091215 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:03.035081 19332 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.035169 19268 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:03.068856 15346 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:05:03.098863 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.039474 18564 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.107550 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.112908 15342 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.108487 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.070327 19024 consensus_queue.cc:1243] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:03.117452 15346 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.091022 19005 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:03.093523 19127 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:03.100333 19196 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:02.981056 19253 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.101745 19129 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.079334 19022 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.070749 19189 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.070076 19250 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:05:03.067358 19318 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.149468 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.152848 15346 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:03.140897 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.154340 15342 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.131482 19196 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.125738 19127 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:03.137574 19129 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:03.159010 19196 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:03.106240 19332 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.139796 19005 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:03.144245 18807 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.162060 19129 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.126847 19207 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.160625 19127 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:03.169934 18829 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.191331 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.192837 15342 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.171358 18922 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:03.219869 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.221942 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:03.224315 19199 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.225126 19199 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.225591 18959 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.230666 15872 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:05:03.237318 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.237927 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.238655 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.239729 18511 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.240281 18511 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.247623 15343 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:03.248488 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.249351 15337 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:03.226315 18959 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.252118 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.258498 15345 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:03.253501 15344 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:03.261368 15344 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:05:03.263548 15344 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:03.265775 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.266887 15342 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:05:03.209851 18922 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:03.236647 19186 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.182003 18807 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.242933 18877 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.255712 19234 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.308003 15337 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:05:03.309899 15343 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:03.298604 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.313942 15344 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.264997 19330 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.266410 19024 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:03.301985 18904 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.003s
I20260709 13:05:03.304057 19331 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.318650 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.288416 19300 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.338140 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.341734 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.348280 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.312951 19022 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.318140 19234 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:03.337930 19198 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.005s
I20260709 13:05:03.381469 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.385318 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.386137 15342 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:05:03.308586 19186 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.390969 19027 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.392751 15343 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:03.376315 19199 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:03.395637 18807 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:03.396503 18807 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:03.397511 19189 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.390621 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.318017 18877 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.392827 19186 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.422303 15344 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:03.359552 19041 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:03.339630 18904 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.298103 19005 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.424206 15342 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:03.335191 19024 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.370893 19234 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:03.399209 19334 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.249s	user 0.001s	sys 0.001s
I20260709 13:05:03.332602 19330 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.352564 19300 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.345000 19331 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.397040 18807 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:03.474825 19342 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:05:03.442467 19253 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:03.492172 15339 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:03.353806 18922 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.493731 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.543664 15342 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:05:03.500685 19325 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.844s	user 0.000s	sys 0.004s
W20260709 13:05:03.511193 19350 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:03.516425 19300 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:03.521004 19278 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.451218 19041 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:03.523559 19337 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 13:05:03.492592 19336 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 13:05:03.558725 15267 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:05:03.526855 18938 consensus_meta.cc:287] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.758s	user 0.012s	sys 0.000s
I20260709 13:05:03.491325 19318 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.532433 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:03.565316 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:03.527590 19207 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.522948 18904 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:03.568358 15874 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.533708 19024 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.531234 18959 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:03.530256 19330 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.531922 18807 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.528622 18877 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:03.579056 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:03.593189 15868 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:03.586038 18564 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.587111 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:03.582798 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.588080 19278 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.607568 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:03.608659 15267 raft_consensus.cc:2368] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14.
I20260709 13:05:03.609371 15342 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.674135 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.676136 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:03.677047 15267 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:03.678855 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.689327 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.690346 15270 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:03.693522 15268 raft_consensus.cc:2410] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:05:03.641345 19330 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.703413 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.704387 15270 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:03.716614 15267 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:05:03.717656 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.795666 15342 raft_consensus.cc:2410] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:03.727921 15874 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:03.800668 15311 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:03.739471 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:03.807274 15270 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.741459 15345 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
W20260709 13:05:03.742291 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 52632.2us
I20260709 13:05:03.705797 19207 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:03.747674 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:03.746968 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:03.747795 15194 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:03.812136 15197 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:03.749480 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:03.750222 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:03.752251 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.813292 15340 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:03.756919 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.694756 18904 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.814342 15268 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:03.691599 19193 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:05:03.697909 18901 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:05:03.814254 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.724706 19330 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.819545 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.825528 15268 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:03.819495 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.829001 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.820839 15309 leader_election.cc:400] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14.
I20260709 13:05:03.831321 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.833384 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.832058 15309 leader_election.cc:403] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:03.811439 18959 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:03.839876 15341 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.840592 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.849426 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:03.851748 15267 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.842878 15270 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:03.855211 18877 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14.
I20260709 13:05:03.857270 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:03.858896 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:03.859794 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.842044 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.867208 15340 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:03.838114 19331 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.863183 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:03.863921 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.861900 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.868873 15270 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:03.869843 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.822041 19207 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.875141 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:03.876437 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:03.820298 19234 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:03.879690 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.880456 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.830506 18904 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:03.885598 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.886714 15267 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:03.889207 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:03.852113 19186 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:05:03.894989 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:03.893929 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:03.897534 19005 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.878597 19041 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.898243 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:03.898370 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:03.874279 18959 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:03.881579 18938 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.899008 15194 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.905118 15342 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:05:03.901793 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.903569 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.883149 19253 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:03.905906 15266 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:03.906144 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.906754 15345 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:03.906766 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:03.908300 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:03.939587 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.909484 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.942054 15340 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:03.944147 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.892684 18877 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:03.943295 15270 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:03.947721 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:03.953785 15191 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:03.895206 19199 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:03.958434 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:03.907979 19352 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:05:03.962622 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.963689 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.891530 19193 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:05:03.967849 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.975802 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:03.976091 19330 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.977419 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.978528 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.972438 15340 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:03.979629 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.980739 15340 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.972604 15194 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:03.902860 19207 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:03.908768 18938 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:03.979688 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.904628 19353 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.969938 15341 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:05:03.954757 19358 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.978613 15191 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:03.966832 19186 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:03.983150 15345 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:05:03.983805 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83053.8us
I20260709 13:05:03.981788 19253 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:03.998798 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:03.988008 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:03.995229 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.995445 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:03.908672 19360 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:05:04.001614 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:04.015759 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:04.017086 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:04.002849 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:04.019106 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:03.902508 19005 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.002904 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:04.031917 15346 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:03.991607 19333 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.990477 18938 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.060796 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.034983 15340 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:04.037123 19332 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:04.037559 15341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
W20260709 13:05:04.058785 19129 consensus_meta.cc:287] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.873s	user 0.004s	sys 0.008s
I20260709 13:05:04.062913 15341 raft_consensus.cc:606] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:04.062969 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:04.038928 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.064105 15268 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.035651 19250 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:05:04.039646 19369 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:05:04.066821 19333 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.041033 19005 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:04.041319 18904 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:04.042095 19193 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:03.996856 19186 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:04.069411 19255 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:04.069536 19193 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.069840 19255 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:04.070041 19193 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.070080 19186 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:04.047868 19360 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:04.031309 18959 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:04.051594 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.072821 15270 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:04.069177 19333 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:04.054841 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.056704 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:04.053504 19359 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:05:04.057245 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:04.001351 19358 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:04.063565 15341 raft_consensus.cc:614] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:04.038208 19373 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:04.065057 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:04.072634 19250 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:04.101361 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.111476 19250 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.112218 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.100764 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:04.113423 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:04.113971 15340 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:04.114187 15338 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:04.035753 19253 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:04.115214 19253 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.116168 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.073932 19129 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.118185 19358 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:04.118366 19368 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:05:04.119773 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.041370 19185 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:04.162242 19185 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.162693 19185 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.168416 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1604) took 1241 ms. Trace:
I20260709 13:05:04.168871 15339 rpcz_store.cc:276] 0709 13:05:02.927216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.927403 (+   187us) service_pool.cc:224] Handling call
0709 13:05:04.168117 (+1240714us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400246654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:04.168308 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1282061184}
I20260709 13:05:04.170537 15339 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:04.176339 19217 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:04.072036 15346 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:05:04.057363 19196 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.883s	user 0.006s	sys 0.005s
W20260709 13:05:04.120339 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 55378.1us
I20260709 13:05:04.185338 19196 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.120409 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:04.188235 15188 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:04.188380 15341 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.189073 19196 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:04.120997 19348 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:04.127388 19286 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:04.195225 19286 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:04.196117 19286 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.129614 19193 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.198704 19193 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:03.993690 19353 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.199429 19353 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.080132 15270 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:04.133580 19356 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:04.201211 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.201983 15270 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:04.136595 19364 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:05:04.203328 18944 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:05:04.137501 19321 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 1.465s	user 0.000s	sys 0.002s
I20260709 13:05:04.203860 18944 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:04.204480 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2098) took 1217 ms. Trace:
I20260709 13:05:04.204663 18944 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.205714 18944 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.204917 15265 rpcz_store.cc:276] 0709 13:05:02.987137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.395162 (+408025us) service_pool.cc:224] Handling call
0709 13:05:03.395524 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:03.395893 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:03.395925 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:03.396408 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:05:03.790812 (+394404us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:03.790887 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.791945 (+  1058us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:04.136009 (+344064us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:04.204181 (+ 68172us) raft_consensus.cc:1685] finished
0709 13:05:04.204203 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.204419 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5506,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":12399,"spinlock_wait_cycles":8470784,"thread_start_us":392264,"threads_started":1,"wal-append.queue_time_us":435565}
I20260709 13:05:04.143375 15344 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:04.143653 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:04.210040 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:04.210620 15344 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:04.211313 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:04.145358 19234 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:04.211692 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.070673 19255 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:04.212157 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.071197 19360 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.212568 19360 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.120551 19186 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.149169 15268 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:04.151165 15342 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:04.151909 15338 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:04.229451 15338 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:04.152757 15196 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2271) took 1487 ms (client timeout 1856 ms). Trace:
W20260709 13:05:04.230034 15196 rpcz_store.cc:269] 0709 13:05:02.664947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.666443 (+  1496us) service_pool.cc:224] Handling call
0709 13:05:04.152585 (+1486142us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54001a5754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:04.152699 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266002304}
I20260709 13:05:04.158645 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.231848 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.232589 15268 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:04.159811 15267 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.170421 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.177960 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.234762 15269 raft_consensus.cc:2410] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:05:04.051752 19127 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.003s
I20260709 13:05:04.202700 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.236066 15270 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.237026 15340 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:04.200834 19356 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:04.208724 18904 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:04.206805 19293 raft_consensus.cc:993] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:04.144057 19209 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:04.206898 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.225757 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.036628 19207 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:04.239588 15341 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:04.240213 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:04.243511 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 346913us
I20260709 13:05:04.242689 15095 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 11 to 12, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 12 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:04.211701 15344 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:04.275067 19356 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.241911 15338 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:04.546190 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 197649us
I20260709 13:05:04.555140 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:04.276383 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:04.556910 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:04.304584 15270 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:04.566036 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2258) took 1007 ms. Trace:
I20260709 13:05:04.566798 15340 rpcz_store.cc:276] 0709 13:05:03.558466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.115587 (+557121us) service_pool.cc:224] Handling call
0709 13:05:04.236547 (+120960us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:05:04.236733 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.237385 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.565941 (+328556us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10454912}
I20260709 13:05:04.569964 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.570788 15268 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:04.572072 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.572844 15268 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:04.573909 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.574554 15268 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
W20260709 13:05:04.318979 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.576844 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:04.577710 15874 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:04.380263 18511 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:04.176810 19217 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:04.580451 19217 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.582324 19217 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:04.361018 15267 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:04.584148 15265 raft_consensus.cc:2410] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:05:04.281934 19127 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.584263 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.586220 15193 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:04.586493 15268 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:05:04.588346 19127 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:04.278256 15841 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.510s (SENT)
W20260709 13:05:04.589979 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 311739us
I20260709 13:05:04.591614 15271 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:04.601459 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.604257 15338 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.605932 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.606735 15265 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.603684 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:04.243438 19198 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:04.613502 18511 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:04.489454 19348 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:04.443315 19358 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.521267 19234 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:04.634794 15343 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.012s
W20260709 13:05:04.637692 15343 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.008s	sys 0.012s
I20260709 13:05:04.348438 19211 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.282s
I20260709 13:05:04.596732 19129 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:04.534545 19332 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:04.569386 19286 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.631819 19293 raft_consensus.cc:1081] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:04.628497 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:04.615867 18938 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.541s	user 0.004s	sys 0.007s
W20260709 13:05:04.632340 15264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.001s	sys 0.017s
W20260709 13:05:04.666712 15264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.001s	sys 0.018s
I20260709 13:05:04.621688 19198 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.636595 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:04.603705 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.684063 15267 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:04.685326 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.686306 15267 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.623845 19356 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.606920 19204 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:05:04.708575 15267 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:04.712004 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.648458 15095 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 3 to 6, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:04.651237 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.720456 15267 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:04.720794 15270 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:04.722123 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.629586 19318 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.745402 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:04.669705 15195 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.000s	sys 0.015s
I20260709 13:05:04.664340 15268 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:04.640875 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2245) took 1368 ms. Trace:
I20260709 13:05:04.746376 15267 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:04.722879 15270 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:04.747421 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.748075 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:04.748769 15267 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.748092 15268 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:04.746912 15343 rpcz_store.cc:276] 0709 13:05:03.272522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.393886 (+121364us) service_pool.cc:224] Handling call
0709 13:05:03.394155 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:03.394383 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:04.129734 (+735351us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b180038bb40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf
0709 13:05:04.129878 (+   144us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.640529 (+510651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.640579 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:04.640627 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.640692 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.640817 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":358966,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":53703424,"thread_start_us":904195,"threads_started":2}
W20260709 13:05:04.650977 19268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.015s
I20260709 13:05:04.602631 19207 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:04.639138 19277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.776s	user 0.038s	sys 0.064s
W20260709 13:05:04.759300 19277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.896s	user 0.038s	sys 0.064s
I20260709 13:05:04.760092 15872 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.764305 15873 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:04.746758 15195 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.015s
I20260709 13:05:04.758807 19207 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:04.640403 19370 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:04.771943 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:04.637574 19358 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:04.743661 19250 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.006s	sys 0.024s
I20260709 13:05:04.777014 15268 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:04.780848 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2283) took 1036 ms. Trace:
I20260709 13:05:04.787912 15193 rpcz_store.cc:276] 0709 13:05:03.744517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.747875 (+  3358us) service_pool.cc:224] Handling call
0709 13:05:03.748145 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.586667 (+838522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.780421 (+193754us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b5400236ed4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:04.780749 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927008000}
I20260709 13:05:04.782645 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.683142 19209 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:04.741484 19198 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.791750 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:04.793370 15267 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
W20260709 13:05:04.772552 19268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.006s	sys 0.015s
I20260709 13:05:04.640838 19234 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.682962 19375 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:05:04.787413 19250 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.006s	sys 0.025s
I20260709 13:05:04.665444 19332 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.804013 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2107) took 1787 ms. Trace:
I20260709 13:05:04.819250 15268 rpcz_store.cc:276] 0709 13:05:03.016402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.802994 (+1786592us) service_pool.cc:224] Handling call
0709 13:05:04.803379 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.803614 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.803650 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.803705 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:04.803749 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.803817 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.803942 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.805760 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2106) took 1789 ms. Trace:
I20260709 13:05:04.821844 15267 rpcz_store.cc:276] 0709 13:05:03.016154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.804744 (+1788590us) service_pool.cc:224] Handling call
0709 13:05:04.805112 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.805344 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.805382 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.805439 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:04.805484 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.805554 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.805689 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:04.784631 18959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.010s	sys 0.008s
I20260709 13:05:04.808987 15873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 334) took 1324 ms. Trace:
I20260709 13:05:04.741096 18938 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.793128 19209 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.788117 19370 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:04.816056 15271 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:04.789664 18829 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:04.824036 15873 rpcz_store.cc:276] 0709 13:05:03.484454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.484657 (+   203us) service_pool.cc:224] Handling call
0709 13:05:03.498264 (+ 13607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.765020 (+1266756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.808724 (+ 43704us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54004858d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:04.808926 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911211264}
I20260709 13:05:04.769079 19318 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:04.840224 19209 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.863446 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2046) took 1060 ms. Trace:
I20260709 13:05:04.863976 15271 rpcz_store.cc:276] 0709 13:05:03.802609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.225533 (+422924us) service_pool.cc:224] Handling call
0709 13:05:04.863378 (+637845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.838850 15270 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:05:04.854092 18944 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.005s
I20260709 13:05:04.871594 15342 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.868981 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 296) took 1536 ms. Trace:
I20260709 13:05:04.878381 15270 rpcz_store.cc:276] 0709 13:05:03.332704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.838115 (+1505411us) service_pool.cc:224] Handling call
0709 13:05:04.838534 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.868717 (+ 30183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.868923 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.880371 15270 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:04.881275 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2019) took 1283 ms. Trace:
I20260709 13:05:04.897858 19375 raft_consensus.cc:2764] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
W20260709 13:05:04.902493 19376 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.095s	user 0.001s	sys 0.002s
I20260709 13:05:04.906965 15272 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:05.008203 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2020) took 1410 ms. Trace:
I20260709 13:05:04.913138 15872 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:05:05.008716 15272 rpcz_store.cc:276] 0709 13:05:03.597823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.906293 (+1308470us) service_pool.cc:224] Handling call
0709 13:05:04.906723 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.007852 (+101129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.008126 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.012109 15272 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [7.7-11.8]
I20260709 13:05:05.013083 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2029) took 1316 ms. Trace:
I20260709 13:05:05.014286 15272 rpcz_store.cc:276] 0709 13:05:03.696384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.011400 (+1315016us) service_pool.cc:224] Handling call
0709 13:05:05.011825 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:05.012674 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.012930 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.914595 15265 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
W20260709 13:05:04.830019 18959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.011s	sys 0.008s
I20260709 13:05:04.852828 19234 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:04.951221 19318 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:04.952536 19186 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.684s	user 0.008s	sys 0.000s
W20260709 13:05:04.856945 19185 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.694s	user 0.002s	sys 0.006s
I20260709 13:05:05.032497 19185 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:05.033115 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2278) took 1302 ms. Trace:
I20260709 13:05:05.033494 15195 rpcz_store.cc:276] 0709 13:05:03.730954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.731256 (+   302us) service_pool.cc:224] Handling call
0709 13:05:03.757702 (+ 26446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:03.765043 (+  7341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:03.787675 (+ 22632us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:04.144998 (+357323us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:04.145397 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:05:04.768099 (+622702us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:04.768158 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.768254 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.032795 (+264541us) raft_consensus.cc:1685] finished
0709 13:05:05.032819 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.033056 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25686,"raft.queue_time_us":207,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":24015,"spinlock_wait_cycles":2734848,"thread_start_us":622271,"threads_started":1,"wal-append.queue_time_us":814328}
I20260709 13:05:04.964160 15263 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:05:04.972589 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 415701us
I20260709 13:05:04.982585 15266 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:04.979285 15095 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 5 to 10, term changed from 11 to 12, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4), VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 12 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:04.978106 19353 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.006s
W20260709 13:05:04.996737 19253 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.006s	sys 0.015s
W20260709 13:05:04.992429 15339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.010s	sys 0.009s
I20260709 13:05:04.962900 18938 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:04.986726 19360 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.774s	user 0.009s	sys 0.006s
I20260709 13:05:04.999970 15270 rpcz_store.cc:276] 0709 13:05:03.597569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.879541 (+1281972us) service_pool.cc:224] Handling call
0709 13:05:04.879926 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.880947 (+  1021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.881208 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.041146 19360 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.005999 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.020918 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.044099 15339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.867s	user 0.010s	sys 0.009s
I20260709 13:05:04.996227 19207 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:05:05.036254 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:05.037901 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2028) took 1348 ms. Trace:
I20260709 13:05:05.048259 15266 rpcz_store.cc:276] 0709 13:05:03.689950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.976725 (+1286775us) service_pool.cc:224] Handling call
0709 13:05:04.977251 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.037627 (+ 60376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.037850 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.051746 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.021306 15265 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:05.053171 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2038) took 1321 ms. Trace:
I20260709 13:05:05.053679 15265 rpcz_store.cc:276] 0709 13:05:03.731452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.020431 (+1288979us) service_pool.cc:224] Handling call
0709 13:05:05.020838 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.052851 (+ 32013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.053103 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.012172 19358 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:05.043943 19253 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.007s	sys 0.016s
I20260709 13:05:05.055819 19370 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.066017 15263 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:05.074254 15266 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:05.035308 19332 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.037405 19185 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:05.096597 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44951.9us
I20260709 13:05:05.043823 19360 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.110446 19268 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.044380 19353 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.028854 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 788663us
W20260709 13:05:05.046180 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.128710 15872 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:05.137645 15266 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:05:05.154084 15266 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:05.139871 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2024) took 1541 ms. Trace:
I20260709 13:05:05.153868 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.135486 18938 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:05.159749 15266 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
W20260709 13:05:05.142376 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 538739us
I20260709 13:05:05.156242 15263 rpcz_store.cc:276] 0709 13:05:03.598901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.955764 (+1356863us) service_pool.cc:224] Handling call
0709 13:05:04.964000 (+  8236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.139510 (+175510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.139798 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:05.146063 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.141958 19358 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.135213 19375 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.168545 15345 raft_consensus.cc:2368] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
W20260709 13:05:05.157675 19378 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:05:05.167793 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.157470 19250 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.175510 15265 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:05.142961 19209 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.172518 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.012s
W20260709 13:05:05.200816 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.009s	sys 0.012s
W20260709 13:05:05.201428 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.201838 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.205848 15841 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.009s	sys 0.017s
W20260709 13:05:05.206523 15841 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.009s	sys 0.017s
I20260709 13:05:05.167104 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:05.206861 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 616037us
W20260709 13:05:05.172813 19300 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.020s
W20260709 13:05:05.209383 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.190583 15264 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.016s	sys 0.043s
I20260709 13:05:05.195103 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.195909 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:05.210656 15264 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.016s	sys 0.043s
I20260709 13:05:05.211508 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2097) took 2232 ms. Trace:
W20260709 13:05:05.199147 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51216.3us
I20260709 13:05:05.219208 15264 rpcz_store.cc:276] 0709 13:05:02.979575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.108856 (+129281us) service_pool.cc:224] Handling call
0709 13:05:03.109797 (+   941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:03.110011 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:03.322407 (+212396us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.131246 (+808839us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b18004a7b80. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:05:05.211022 (+1079776us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.211123 (+   101us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:05.211187 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.211275 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.211437 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":225005,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":477541,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":6201,"spinlock_wait_cycles":2431360,"thread_start_us":1291522,"threads_started":3,"wal-append.queue_time_us":1557003}
I20260709 13:05:05.239280 15263 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:05:05.243309 15337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.000s	sys 0.031s
W20260709 13:05:05.243849 15337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.000s	sys 0.031s
I20260709 13:05:05.243629 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:05.244532 15196 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.168352 19388 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.155730 19268 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.243253 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 76261.1us
W20260709 13:05:05.248227 15338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.015s	sys 0.017s
I20260709 13:05:05.163956 19253 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
W20260709 13:05:05.251513 15338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.015s	sys 0.018s
I20260709 13:05:05.254428 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 249) took 1461 ms. Trace:
I20260709 13:05:05.254906 15338 rpcz_store.cc:276] 0709 13:05:03.792660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.151527 (+358867us) service_pool.cc:224] Handling call
0709 13:05:04.151785 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.254039 (+1102254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.254070 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.254117 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:05.254148 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.254232 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.254366 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":404627,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7920,"thread_start_us":622352,"threads_started":1}
W20260709 13:05:05.256268 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48647.3us
I20260709 13:05:05.263681 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:05.266607 15195 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:05.177345 18938 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.193926 19332 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.168521 19358 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.200421 18959 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:05.168995 19193 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:05:05.275135 18511 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:05.289022 18511 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.290059 18511 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.291363 18511 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:05.249780 19127 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:05:05.273959 19382 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
W20260709 13:05:05.266682 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70878.9us
I20260709 13:05:05.208667 19186 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:05:05.208209 19300 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.000s	sys 0.021s
I20260709 13:05:05.299491 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:05.313277 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:05.209833 19250 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.303373 15340 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:05:05.246233 19395 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:05.305015 15196 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:05.302384 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1629) took 1786 ms. Trace:
I20260709 13:05:05.350423 15345 rpcz_store.cc:276] 0709 13:05:03.516373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.998484 (+482111us) service_pool.cc:224] Handling call
0709 13:05:05.302101 (+1303617us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400059e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:05.302303 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2687593856}
I20260709 13:05:05.363669 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:05.417655 15873 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:05.342468 15266 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:05.363639 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:05.409271 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:05.413399 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2031) took 1716 ms. Trace:
I20260709 13:05:05.279896 19404 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:05.424110 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 229101us
I20260709 13:05:05.290910 19318 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
W20260709 13:05:05.415086 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 127119us
I20260709 13:05:05.295228 19375 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:05.436854 15272 rpcz_store.cc:276] 0709 13:05:03.697128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.015527 (+1318399us) service_pool.cc:224] Handling call
0709 13:05:05.015960 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.016252 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:05.017065 (+   813us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.400924 (+383859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.413104 (+ 12180us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:05.413152 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.413219 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.413339 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36077,"prepare.queue_time_us":256,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":346302,"threads_started":1}
W20260709 13:05:05.400830 19217 consensus_meta.cc:287] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.818s	user 0.016s	sys 0.000s
I20260709 13:05:05.364169 18959 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:05.285214 19332 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.446151 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.461637 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2275) took 1397 ms. Trace:
W20260709 13:05:05.463266 15841 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.650s (SENT)
I20260709 13:05:05.463743 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.462409 15341 rpcz_store.cc:276] 0709 13:05:04.064314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.557505 (+493191us) service_pool.cc:224] Handling call
0709 13:05:04.558783 (+  1278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.558985 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:04.623104 (+ 64119us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.992237 (+369133us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.460873 (+468636us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.461011 (+   138us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:05.461129 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.461261 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.461510 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7721,"prepare.queue_time_us":65803,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":524213,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3910,"spinlock_wait_cycles":12368640,"thread_start_us":824231,"threads_started":2}
W20260709 13:05:05.446903 15271 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.001s	sys 0.013s
W20260709 13:05:05.447831 15310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.007s	sys 0.015s
W20260709 13:05:05.466682 15271 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.002s	sys 0.013s
I20260709 13:05:05.414077 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2041) took 1673 ms. Trace:
I20260709 13:05:05.415247 19386 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.466428 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:05.476127 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:05.476612 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 249556us
I20260709 13:05:05.478173 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.468454 15270 rpcz_store.cc:276] 0709 13:05:03.740383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.041449 (+1301066us) service_pool.cc:224] Handling call
0709 13:05:05.041842 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.042110 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:05.043080 (+   970us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.413733 (+370653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.413784 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:05.413828 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.413900 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.414010 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":345,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"thread_start_us":370183,"threads_started":1}
I20260709 13:05:05.470752 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:05.472466 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:05.436710 19204 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:05:05.480646 15272 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:05.490212 15841 leader_election.cc:336] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.923s (SENT)
I20260709 13:05:05.498214 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2276) took 1290 ms. Trace:
I20260709 13:05:05.473317 19207 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:05.498715 15340 rpcz_store.cc:276] 0709 13:05:04.207690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.568241 (+360551us) service_pool.cc:224] Handling call
0709 13:05:05.303069 (+734828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.338808 (+ 35739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.497989 (+159181us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400059e50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:05.498154 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1688967424}
I20260709 13:05:05.460994 19395 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:05.509611 15841 leader_election.cc:336] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.122s (SENT)
I20260709 13:05:05.515973 15841 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:05.513329 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.473361 19393 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
W20260709 13:05:05.523698 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 74053.9us
W20260709 13:05:05.530326 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52398.6us
I20260709 13:05:05.533046 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.535352 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.478914 19127 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:05.523605 19405 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:05:05.464048 19253 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:05:05.480626 19388 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:05:05.582791 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.585312 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2278) took 1377 ms. Trace:
I20260709 13:05:05.589073 18511 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:05.525628 19353 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:05.449657 18938 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.593937 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 58748.5us
I20260709 13:05:05.607671 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.607825 19255 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.610379 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:05.611210 19261 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:05.611644 19261 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:05.612011 19261 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:05.587265 19286 consensus_meta.cc:287] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.892s	user 0.008s	sys 0.005s
I20260709 13:05:05.613938 19286 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:05.614419 19286 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:05.615286 19286 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.616734 19390 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 13:05:05.617594 19394 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:05:05.620174 18922 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:05.622377 19209 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.622716 19261 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.624828 19261 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.625479 18829 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:05.626295 19358 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.626071 18829 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.626128 15095 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:05.595652 19370 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.627754 15095 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:05.630507 18829 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.547281 19183 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:05.605360 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.599735 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55044.7us
I20260709 13:05:05.499292 19386 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.587391 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 64337.2us
I20260709 13:05:05.648619 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:05.648816 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:05.604784 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2105) took 2588 ms. Trace:
I20260709 13:05:05.646559 15344 rpcz_store.cc:276] 0709 13:05:04.208212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.627216 (+419004us) service_pool.cc:224] Handling call
0709 13:05:04.639211 (+ 11995us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.639433 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:04.654119 (+ 14686us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.558369 (+904250us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b1800367240. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:05:05.584854 (+ 26485us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.584923 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:05.584982 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.585082 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.585240 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15435,"prepare.queue_time_us":14441,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":58369,"raft.queue_time_us":390433,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":24411,"spinlock_wait_cycles":43049216,"thread_start_us":409015,"threads_started":1}
I20260709 13:05:05.675062 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:05.674626 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:05.593091 19409 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.746976 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:05.749358 15874 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.753800 15869 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:05.598284 19186 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:05.744168 15269 rpcz_store.cc:276] 0709 13:05:03.015890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.801875 (+1785985us) service_pool.cc:224] Handling call
0709 13:05:04.802195 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.802392 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:05.294922 (+492530us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.604093 (+309171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.604226 (+   133us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:05.604300 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.604471 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.604679 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":89260,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":12182,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":783338,"threads_started":2}
W20260709 13:05:05.745332 15237 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.020s	sys 0.000s
W20260709 13:05:05.762080 15237 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.020s	sys 0.000s
W20260709 13:05:05.762537 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 715749us
W20260709 13:05:05.649948 19405 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:05.764384 19404 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:05.765168 19404 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.765571 19120 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:05.766106 19120 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:05.766377 19414 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.766901 19414 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.767105 19120 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.766134 19404 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.769515 18904 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.770607 19404 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:05.770820 18904 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.771904 19332 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.772966 18807 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.773106 18904 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:05.773506 18807 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:05.644835 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:05.767417 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:05.774969 15342 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
W20260709 13:05:05.775837 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 131118us
I20260709 13:05:05.715327 19356 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.776616 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.776813 19356 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.775930 19185 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:05.745754 15341 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:05.780575 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:05.764581 15237 leader_election.cc:336] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.074s (SENT)
I20260709 13:05:05.783248 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:05.807546 15237 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.245s (SENT)
W20260709 13:05:05.808673 15237 connection.cc:256] RPC call timeout handler was delayed by -1.3594127650000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:05:05.810192 15237 connection.cc:256] RPC call timeout handler was delayed by -1.3191421249999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2605s for a response
W20260709 13:05:05.811286 15237 connection.cc:256] RPC call timeout handler was delayed by -1.1062487829999554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 13:05:05.813000 15237 connection.cc:256] RPC call timeout handler was delayed by -1.061258673999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1805s for a response
W20260709 13:05:05.816061 15237 connection.cc:256] RPC call timeout handler was delayed by -1.0378586739999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 13:05:05.817485 15237 connection.cc:256] RPC call timeout handler was delayed by -1.004558674000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:05:05.806777 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 297186us
I20260709 13:05:05.769677 19414 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:05.641438 19183 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:05.717415 19402 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:05.755587 19353 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:05.747553 18959 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.696557 19261 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.127s
I20260709 13:05:05.864096 15874 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:05.864820 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54816.7us
I20260709 13:05:05.867475 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:05.827797 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 349674us
I20260709 13:05:05.779325 19333 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:05.828307 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 69390.3us
I20260709 13:05:05.877038 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.779718 19185 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:05.778990 19356 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.805512 19209 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:05.871594 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 297) took 2381 ms. Trace:
W20260709 13:05:05.814973 19410 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.089s	user 0.003s	sys 0.001s
I20260709 13:05:05.829219 15341 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:05.805797 19193 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:05.875762 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:05.881031 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.892202 15271 rpcz_store.cc:276] 0709 13:05:03.490432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.865353 (+1374921us) service_pool.cc:224] Handling call
0709 13:05:04.865666 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.865878 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:05.468018 (+602140us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.871237 (+403219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.871289 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:05.871343 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.871412 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.871536 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2687,"prepare.queue_time_us":25987,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":31,"raft.queue_time_us":2792,"thread_start_us":1001277,"threads_started":2}
I20260709 13:05:05.885891 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:05.814311 19318 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:05.895689 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.897178 19391 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:05.897889 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2271) took 1836 ms. Trace:
I20260709 13:05:05.898015 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.898343 15337 rpcz_store.cc:276] 0709 13:05:04.061626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.212649 (+151023us) service_pool.cc:224] Handling call
0709 13:05:04.212932 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:04.213295 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.213324 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:04.213819 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.244290 (+1030471us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:05.244358 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.246728 (+  2370us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.897667 (+650939us) raft_consensus.cc:1685] finished
0709 13:05:05.897683 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.897834 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":996,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":51853,"thread_start_us":1030071,"threads_started":1,"wal-append.queue_time_us":1378574}
I20260709 13:05:05.833930 19395 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.899923 19389 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:05.900367 19395 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.902364 19353 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:05.868997 19183 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:05.903069 19353 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.904167 19193 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:05.904304 19353 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.906384 19193 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:05.816498 19268 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.899309 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.800251 19186 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:05.909749 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:05.911388 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.863729 19402 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.913174 18511 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.868849 19409 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.869128 19253 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:05.921146 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:05.922832 15238 leader_election.cc:336] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.013s (SENT)
I20260709 13:05:05.926095 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:05.871097 19413 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:05.934779 18511 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.928257 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52607.4us
I20260709 13:05:05.897943 19391 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:05.935757 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:05.893846 18807 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.908034 19250 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:05.911252 19186 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:05.945281 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.953038 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2109) took 2800 ms. Trace:
I20260709 13:05:05.953464 15267 rpcz_store.cc:276] 0709 13:05:03.152295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.839552 (+1687257us) service_pool.cc:224] Handling call
0709 13:05:04.877887 (+ 38335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.235592 (+357705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.235631 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.244739 (+  9108us) log.cc:844] Serialized 26 byte log entry
0709 13:05:05.597505 (+352766us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:05.597595 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.601431 (+  3836us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.952817 (+351386us) raft_consensus.cc:1685] finished
0709 13:05:05.952839 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.952975 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":286376,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":2563,"thread_start_us":657965,"threads_started":2,"wal-append.queue_time_us":445369}
I20260709 13:05:05.951481 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.956904 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:05.939687 18944 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:05.947471 19389 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:05.958035 19207 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.958446 19389 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:05.959587 19389 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.958700 19207 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:05.961427 19120 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.963330 19207 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:05.967873 19416 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:05:05.968879 19412 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.140s	user 0.000s	sys 0.003s
I20260709 13:05:05.977712 18959 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.725203 19127 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:05.941970 19318 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:05.988154 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49883.5us
W20260709 13:05:06.012918 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77383.7us
I20260709 13:05:05.917188 19268 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:06.015120 15195 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:06.017856 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:05.931052 19402 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:05.935791 19234 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.948295 19332 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.021001 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.021617 19332 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:05.953433 19198 consensus_meta.cc:287] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.150s	user 0.005s	sys 0.010s
I20260709 13:05:06.023806 19198 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.029469 19332 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:06.033380 19261 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:06.038218 15193 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:06.042204 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:06.026664 19198 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:06.051395 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 94619.5us
I20260709 13:05:06.053431 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.948623 19408 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:06.054975 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.964098 19392 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:05.951933 19411 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:05.975695 19428 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.982944 19430 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.959872 19403 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:06.060618 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:06.005594 18944 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:05.933844 19253 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:06.083359 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55368.3us
I20260709 13:05:06.088400 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.088806 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.089322 15190 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:06.068277 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.945195 19413 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.099001 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:05.937749 19409 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.119530 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.121340 15190 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
W20260709 13:05:06.120437 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 78591us
I20260709 13:05:06.123574 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.123593 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.125268 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.126278 15188 raft_consensus.cc:2368] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 13.
I20260709 13:05:06.057014 19391 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:05:06.129572 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.151538 15194 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:06.129673 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.151871 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.152701 15271 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.130741 19253 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:06.153584 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.154160 15194 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:06.130403 18944 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.131232 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.132782 19413 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:06.061965 19268 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:05.971330 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:06.135632 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:06.136518 15341 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:05:06.139549 15344 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:06.171563 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.172343 15264 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:05.948724 19398 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 13:05:06.176689 15264 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:06.141644 19217 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.119740 19411 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:06.148243 19430 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:06.068596 19332 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.149937 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.064903 19392 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.130252 19386 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:06.154453 15237 connection.cc:256] RPC call timeout handler was delayed by -1.5496377929999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
I20260709 13:05:06.158386 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.198912 15269 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:06.159260 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.160056 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.165197 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.199932 15270 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:06.167364 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.075143 19417 raft_consensus.cc:2764] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:05:06.167881 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:06.169617 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 71092.7us
I20260709 13:05:06.135419 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.150410 19234 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:05:06.178709 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.179765 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.181077 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.182123 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.184624 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.215046 15266 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:06.216421 15189 raft_consensus.cc:2368] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 13.
I20260709 13:05:06.218392 15264 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:05:06.218977 15263 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.005s
W20260709 13:05:06.202495 19255 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.005s
I20260709 13:05:06.052855 19185 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:06.205432 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.092656 19400 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:05:06.205528 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:06.227845 15341 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:06.206292 15237 connection.cc:256] RPC call timeout handler was delayed by -1.4391993899999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
I20260709 13:05:06.175457 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.229338 15195 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
W20260709 13:05:06.230290 15237 connection.cc:256] RPC call timeout handler was delayed by -1.435599389999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:05:06.233208 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.212258 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.236987 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.238101 15190 raft_consensus.cc:2368] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
W20260709 13:05:06.219553 15263 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.006s	sys 0.006s
I20260709 13:05:06.220588 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.194267 15271 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:06.084733 19428 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.226133 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.239346 15337 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:06.198628 19392 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.241767 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:06.243371 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.243738 15188 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 13:05:06.245105 15237 connection.cc:256] RPC call timeout handler was delayed by -1.3608993899999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 13:05:06.245597 15237 connection.cc:256] RPC call timeout handler was delayed by -1.3518993899999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 13:05:06.185281 19207 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
W20260709 13:05:06.221660 19388 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.009s	sys 0.012s
I20260709 13:05:06.247625 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.253720 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.258163 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:06.258769 15337 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:06.254444 15237 connection.cc:256] RPC call timeout handler was delayed by -1.2636993899999425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 13:05:06.259434 15237 connection.cc:256] RPC call timeout handler was delayed by -1.2526377929999626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
W20260709 13:05:06.259781 15237 connection.cc:256] RPC call timeout handler was delayed by -1.2384993900000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 13:05:06.260064 15237 connection.cc:256] RPC call timeout handler was delayed by -1.196199389999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 13:05:06.260447 15237 connection.cc:256] RPC call timeout handler was delayed by -1.1061993900000289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21600000000000003s for a response
I20260709 13:05:06.226774 18922 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.267880 18511 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.206338 19427 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:05:06.206143 19426 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
W20260709 13:05:06.256142 19388 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.009s	sys 0.013s
I20260709 13:05:06.296540 15237 leader_election.cc:400] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:06.297902 19424 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:06.298666 15237 leader_election.cc:400] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:06.298997 15237 leader_election.cc:403] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:05:06.269461 19353 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.303709 19353 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.306015 19353 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:06.274686 18922 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.308032 15190 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
W20260709 13:05:06.308759 19425 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:05:06.311208 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2108) took 3241 ms. Trace:
I20260709 13:05:06.275701 15341 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:06.280036 19428 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:06.248587 19404 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.311738 15268 rpcz_store.cc:276] 0709 13:05:03.069623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.821547 (+1751924us) service_pool.cc:224] Handling call
0709 13:05:04.953696 (+132149us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:05.425483 (+471787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.425524 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:05.449196 (+ 23672us) log.cc:844] Serialized 52 byte log entry
0709 13:05:05.631988 (+182792us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:05.725516 (+ 93528us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.725934 (+   418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.726063 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.775740 (+ 49677us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b18004249c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:06.310797 (+535057us) raft_consensus.cc:1685] finished
0709 13:05:06.310932 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:06.311128 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53051,"prepare.queue_time_us":114422,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":65,"raft.queue_time_us":315805,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":26239,"spinlock_wait_cycles":13311360,"thread_start_us":603238,"threads_started":2,"wal-append.queue_time_us":525790}
I20260709 13:05:06.285682 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.314100 19404 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.314970 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.316144 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:06.316789 15343 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:06.316828 19404 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:06.319100 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.287290 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:06.251187 18938 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.251448 19391 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.268443 18511 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.189445 19318 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.278026 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.292979 15337 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:06.313298 19417 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.340878 19391 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.346585 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.347424 15189 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:06.347577 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.348222 15194 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:06.348675 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.349076 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:06.349598 15189 raft_consensus.cc:2368] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:06.349939 15194 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:05:06.276616 19439 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.324463 15271 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:05:06.322057 15237 leader_election.cc:336] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.790s (SENT)
I20260709 13:05:06.334502 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.350764 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.350803 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.386948 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.387144 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.385507 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.387481 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.387460 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.388556 15264 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:06.389242 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67211.2us
I20260709 13:05:06.391124 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.391531 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.405992 15270 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:06.351912 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.407191 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.392187 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:06.402730 15237 leader_election.cc:336] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.013s (SENT)
I20260709 13:05:06.408623 15271 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.408667 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.365115 18511 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:06.433840 15343 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:05:06.437265 15237 leader_election.cc:336] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.160s (SENT)
I20260709 13:05:06.438694 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.446290 15343 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:06.447863 15339 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:06.461683 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.462791 15268 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:05:06.476286 15264 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:06.478154 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.493825 15266 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:06.478897 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:06.479194 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.321950 19186 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.431478 19386 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:06.440307 19332 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.495111 15191 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:05:06.496830 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.461939 15343 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:05:06.500718 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.513993 18511 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:06.341598 18938 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.534600 18511 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.477488 15263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:05:06.540611 15263 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.541031 15263 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.487910 19408 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:06.541669 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.543241 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.544546 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.536849 15271 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:06.549443 15196 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:06.546908 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.551613 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:06.549664 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 112424us
W20260709 13:05:06.565759 15237 leader_election.cc:336] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 3.374s (SENT)
I20260709 13:05:06.566740 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.583652 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.618052 18511 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:06.627658 19409 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:06.461441 19439 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.532477 19386 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:06.777486 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:06.755682 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 189990us
W20260709 13:05:06.756441 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.513713 19395 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.757076 15873 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:06.551605 15271 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:06.789873 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:06.790596 15271 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:06.759626 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 425265us
I20260709 13:05:06.769944 15266 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:06.792085 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.793022 15266 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:06.787207 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.787616 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.795472 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.797003 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.774091 15263 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:06.815766 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.816347 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:06.759075 19408 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:06.817495 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.823551 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.804847 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:06.844843 15271 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:06.846268 15270 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:06.847437 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.893296 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.860991 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:06.803064 19402 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.784s	user 0.006s	sys 0.013s
I20260709 13:05:06.887704 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:06.799297 19120 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.837s	user 0.015s	sys 0.010s
I20260709 13:05:06.895141 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.785658 19332 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:06.881295 19444 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.229s	user 0.007s	sys 0.000s
I20260709 13:05:06.907387 15191 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:05:06.890185 15263 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:06.797922 19397 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:06.906394 15345 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:06.941375 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.941972 15345 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:06.836513 19389 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.925969 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:06.928778 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 158567us
I20260709 13:05:06.953991 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:06.894816 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.955708 15271 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:06.954934 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.956879 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:06.957861 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.881103 19447 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.275s	user 0.003s	sys 0.004s
W20260709 13:05:06.870463 19410 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:06.885011 19318 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:06.969202 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 164467us
I20260709 13:05:06.803913 19395 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:06.976087 15238 leader_election.cc:400] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 13.
I20260709 13:05:06.980278 15238 leader_election.cc:403] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:06.978199 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.940814 19408 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.982278 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.982815 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:06.940380 19397 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:06.984081 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:06.983117 15263 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
W20260709 13:05:06.967785 19183 consensus_meta.cc:287] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.064s	user 0.012s	sys 0.000s
I20260709 13:05:07.023291 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2305) took 1002 ms. Trace:
I20260709 13:05:07.025678 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:06.972981 19426 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:07.045116 15346 raft_consensus.cc:2410] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:05:06.977208 19422 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:06.918546 19402 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:07.049857 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 232477us
I20260709 13:05:07.049284 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.045626 15197 rpcz_store.cc:276] 0709 13:05:06.020567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.025401 (+  4834us) service_pool.cc:224] Handling call
0709 13:05:06.025828 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.026075 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.026110 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.026645 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.335209 (+308564us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:06.335264 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.335360 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.023050 (+687690us) raft_consensus.cc:1685] finished
0709 13:05:07.023072 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.023225 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":308152,"threads_started":1,"wal-append.queue_time_us":478559}
I20260709 13:05:06.967217 19461 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:07.054909 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:06.963591 19389 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.062736 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:07.068127 15271 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:07.065708 15343 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:07.064734 15263 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:06.983078 19466 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:06.977460 19318 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.070950 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.074998 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:07.066800 19445 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.440s	user 0.001s	sys 0.001s
I20260709 13:05:07.077672 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:07.050930 19426 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:07.079115 15340 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:07.053392 19422 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:07.082522 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:07.087360 15263 raft_consensus.cc:2410] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:05:07.083848 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.064312 18829 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.087987 15191 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:07.084592 19426 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:07.091500 19448 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:05:07.072691 19186 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.094678 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:07.072189 18938 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.065142 19183 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:07.084836 19450 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.271s	user 0.004s	sys 0.003s
I20260709 13:05:07.101562 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:07.098344 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.007476 19408 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.092458 19332 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:07.101014 19217 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.917s	user 0.013s	sys 0.001s
I20260709 13:05:07.122519 18938 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.096664 19466 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:07.149487 19466 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.145583 19217 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:07.128427 19452 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.342s	user 0.002s	sys 0.000s
I20260709 13:05:07.148799 19439 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.148488 18938 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.149951 19466 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.076973 19397 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.159833 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.125849 19461 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:07.122866 19413 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:07.143627 15192 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:07.179379 19186 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.096453 18829 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.175339 19332 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 13.
I20260709 13:05:07.200544 19408 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.201395 18922 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:07.202122 19469 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:05:07.203297 19475 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:07.196619 15268 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:07.204339 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:07.144214 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 81557.3us
I20260709 13:05:07.211434 19217 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:07.197660 19468 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
I20260709 13:05:07.154196 19386 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:07.195988 19388 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:07.207904 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 223898us
I20260709 13:05:07.236615 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.319227 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:07.240875 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:07.292215 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.217892 19397 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:07.240839 19417 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.898s	user 0.006s	sys 0.006s
I20260709 13:05:07.326349 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:07.337235 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 100675us
I20260709 13:05:07.340576 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.338353 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:07.316836 19457 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:07.233318 19475 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.346278 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:07.350037 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:07.151513 19422 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.363680 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:07.359549 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.311676 18829 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:07.366114 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2303) took 1231 ms. Trace:
I20260709 13:05:07.344136 19457 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.367308 15238 leader_election.cc:400] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:07.369478 15264 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:05:07.355258 19453 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:05:07.366612 15341 rpcz_store.cc:276] 0709 13:05:06.137146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.353967 (+216821us) service_pool.cc:224] Handling call
0709 13:05:06.354346 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.354793 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.354834 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.384123 (+ 29289us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.754604 (+370481us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:06.754652 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.754737 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.365851 (+611114us) raft_consensus.cc:1685] finished
0709 13:05:07.365873 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.366047 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":227117,"threads_started":1,"wal-append.queue_time_us":447307}
I20260709 13:05:07.373656 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2288) took 1553 ms. Trace:
I20260709 13:05:07.374231 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:07.344534 19217 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:07.349617 19386 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:07.353226 19332 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:07.349210 19417 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:07.379824 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:07.355989 19475 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.375520 15238 leader_election.cc:403] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:07.214198 19186 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.382369 15344 rpcz_store.cc:276] 0709 13:05:05.820629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.820750 (+   121us) service_pool.cc:224] Handling call
0709 13:05:05.869671 (+ 48921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.171360 (+301689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.373399 (+1202039us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000b6154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:07.373585 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619506048}
I20260709 13:05:07.351246 19395 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:07.381646 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.387619 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:07.367112 18904 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:07.361680 19476 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:07.389020 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2294) took 1304 ms. Trace:
I20260709 13:05:07.336295 19388 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.360875 19318 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:07.383512 19462 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 13:05:07.395435 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:07.395850 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:07.406940 15869 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:07.393664 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.374706 19478 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:07.401681 15873 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:07.401774 15338 rpcz_store.cc:276] 0709 13:05:06.085231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.085539 (+   308us) service_pool.cc:224] Handling call
0709 13:05:06.085923 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.131688 (+ 45765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.131721 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:06.131767 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:06.131799 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.388777 (+1256978us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54001770d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:07.388829 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.388963 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104732544}
I20260709 13:05:07.400619 19454 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:05:07.409832 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2158) took 1017 ms. Trace:
I20260709 13:05:07.380035 18829 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.410241 15270 rpcz_store.cc:276] 0709 13:05:06.392715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.406833 (+ 14118us) service_pool.cc:224] Handling call
0709 13:05:07.409678 (+1002845us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400013bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:07.409776 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007942912}
W20260709 13:05:07.411336 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.369596 19408 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:07.411695 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:07.407359 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:07.381342 19183 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.386008 19332 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.408819 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.380784 19402 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.380779 19403 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:07.384456 19217 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.388298 18959 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:07.413923 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:07.416251 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:07.429962 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:07.412541 15270 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:07.403363 19460 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:05:07.431463 19456 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:07.417832 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.431891 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:07.419221 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:07.420250 15338 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:05:07.432729 15269 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 6.
I20260709 13:05:07.433393 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.434104 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1701) took 1154 ms. Trace:
I20260709 13:05:07.400245 18904 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:07.361083 19466 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.410669 18829 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.404944 19389 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.408775 19120 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.422660 15346 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:07.435551 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:07.422122 19332 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.450479 15269 raft_consensus.cc:2410] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:07.434870 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:07.444237 19464 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 13:05:07.435365 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2164) took 1032 ms. Trace:
I20260709 13:05:07.427670 19217 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:07.445338 19268 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.266s	user 0.007s	sys 0.007s
I20260709 13:05:07.454706 19268 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:07.455359 19391 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.455997 19391 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.456480 19391 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.459614 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.460593 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1697) took 1182 ms. Trace:
I20260709 13:05:07.460865 19388 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.460922 15195 rpcz_store.cc:276] 0709 13:05:06.278679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.459275 (+1180596us) service_pool.cc:224] Handling call
0709 13:05:07.460517 (+  1242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.461555 19422 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.462301 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.463176 15272 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.464848 19186 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:07.468276 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.469223 15343 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:07.470178 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.472043 19457 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:07.452284 19120 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.474547 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.476183 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.477500 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.478266 15343 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:05:07.478514 15272 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:07.428838 18959 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.448606 15266 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:07.434480 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.432480 15270 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:07.451970 15344 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:05:07.419678 19430 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:07.434470 15193 rpcz_store.cc:276] 0709 13:05:06.280026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.411403 (+1131377us) service_pool.cc:224] Handling call
0709 13:05:07.434049 (+ 22646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.480185 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1700) took 1200 ms. Trace:
I20260709 13:05:07.452819 15265 rpcz_store.cc:276] 0709 13:05:06.403474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.122702 (+719228us) service_pool.cc:224] Handling call
0709 13:05:07.123173 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.137038 (+ 13865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.139441 (+  2403us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:07.146008 (+  6567us) log.cc:844] Serialized 26 byte log entry
0709 13:05:07.358448 (+212440us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:07.358500 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.358578 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.435173 (+ 76595us) raft_consensus.cc:1685] finished
0709 13:05:07.435192 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.435312 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5152,"raft.queue_time_us":97766,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":83453,"spinlock_wait_cycles":43904,"thread_start_us":151160,"threads_started":1,"wal-append.queue_time_us":240528}
I20260709 13:05:07.496809 15195 rpcz_store.cc:276] 0709 13:05:06.279745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.462021 (+1182276us) service_pool.cc:224] Handling call
0709 13:05:07.480124 (+ 18103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.497666 15338 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:05:07.498178 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2165) took 1094 ms. Trace:
I20260709 13:05:07.442965 19183 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:07.482892 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.484072 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:07.484695 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2302) took 1350 ms. Trace:
I20260709 13:05:07.487648 19466 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.452450 19395 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:07.502818 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.498553 15265 rpcz_store.cc:276] 0709 13:05:06.403771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.497422 (+1093651us) service_pool.cc:224] Handling call
0709 13:05:07.497706 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.497888 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.497911 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.497949 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:07.497978 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.498025 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.498127 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.499644 19430 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.505779 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.506177 19430 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:07.506786 19458 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:05:07.506954 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2311) took 1055 ms. Trace:
I20260709 13:05:07.500029 18959 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.507557 15193 rpcz_store.cc:276] 0709 13:05:06.451846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.503958 (+1052112us) service_pool.cc:224] Handling call
0709 13:05:07.506873 (+  2915us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.499853 19183 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.498831 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.500445 15269 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:07.509006 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.509176 19183 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.509810 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2308) took 1113 ms. Trace:
I20260709 13:05:07.500408 15337 rpcz_store.cc:276] 0709 13:05:06.134481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.339597 (+205116us) service_pool.cc:224] Handling call
0709 13:05:06.339981 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.340421 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.340458 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:06.340968 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.930480 (+589512us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b1800367600. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:07.241161 (+310681us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:07.241219 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.241314 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.484358 (+243044us) raft_consensus.cc:1685] finished
0709 13:05:07.484381 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.484627 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1525,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":36162432,"thread_start_us":310458,"threads_started":1,"wal-append.queue_time_us":1058592}
I20260709 13:05:07.511695 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.449466 19402 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.527340 15338 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:07.544813 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.546059 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 277) took 1263 ms. Trace:
I20260709 13:05:07.493382 19120 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.512477 15337 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:07.510165 15193 rpcz_store.cc:276] 0709 13:05:06.396598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.508660 (+1112062us) service_pool.cc:224] Handling call
0709 13:05:07.509751 (+  1091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.502802 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.570776 15270 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:07.572674 15270 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:05:07.573547 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2061) took 1007 ms. Trace:
I20260709 13:05:07.573971 15270 rpcz_store.cc:276] 0709 13:05:06.566219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.571784 (+1005565us) service_pool.cc:224] Handling call
0709 13:05:07.572198 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.573191 (+   993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.573461 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.570956 15341 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:07.546497 15195 rpcz_store.cc:276] 0709 13:05:06.282165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.497733 (+1215568us) service_pool.cc:224] Handling call
0709 13:05:07.545977 (+ 48244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.577740 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1659) took 1031 ms. Trace:
I20260709 13:05:07.578508 15341 rpcz_store.cc:276] 0709 13:05:06.545880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.452983 (+907103us) service_pool.cc:224] Handling call
0709 13:05:07.577653 (+124670us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29440}
I20260709 13:05:07.598944 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1651) took 1055 ms. Trace:
I20260709 13:05:07.599431 15337 rpcz_store.cc:276] 0709 13:05:06.543330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.511459 (+968129us) service_pool.cc:224] Handling call
0709 13:05:07.598881 (+ 87422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.618659 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1649) took 1076 ms. Trace:
I20260709 13:05:07.624558 15344 rpcz_store.cc:276] 0709 13:05:06.542621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.499456 (+956835us) service_pool.cc:224] Handling call
0709 13:05:07.618565 (+119109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12544}
W20260709 13:05:07.630056 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 183210us
I20260709 13:05:07.632294 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.633086 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2309) took 1200 ms. Trace:
I20260709 13:05:07.633458 15195 rpcz_store.cc:276] 0709 13:05:06.432900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.578335 (+1145435us) service_pool.cc:224] Handling call
0709 13:05:07.633011 (+ 54676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.634430 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.635632 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.514691 18829 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.474707 19426 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.640633 15195 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:07.641186 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:07.637620 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:07.644481 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 214624us
I20260709 13:05:07.644719 15341 raft_consensus.cc:2368] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:07.644490 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1683) took 1496 ms. Trace:
I20260709 13:05:07.645372 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:07.645772 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1661) took 1099 ms. Trace:
I20260709 13:05:07.645524 15193 rpcz_store.cc:276] 0709 13:05:06.148388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.635406 (+1487018us) service_pool.cc:224] Handling call
0709 13:05:07.644431 (+  9025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.646261 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1677) took 1544 ms. Trace:
I20260709 13:05:07.646515 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:07.646974 15195 rpcz_store.cc:276] 0709 13:05:06.101957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.634175 (+1532218us) service_pool.cc:224] Handling call
0709 13:05:07.646201 (+ 12026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.646534 15341 rpcz_store.cc:276] 0709 13:05:06.546504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.630935 (+1084431us) service_pool.cc:224] Handling call
0709 13:05:07.645662 (+ 14727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.648828 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:07.650094 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.652204 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.652962 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:07.653625 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.654193 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.655406 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:07.631613 19217 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.654919 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:07.525683 18904 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.631198 19402 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.645337 19395 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.650986 19457 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:07.653468 19424 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:07.657884 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.649739 18829 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:07.649756 19404 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:07.667955 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.661855 19318 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:07.677942 19426 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.679430 18904 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.655893 19422 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:07.660998 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:07.732577 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 74785.8us
I20260709 13:05:07.733227 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:07.734118 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.682775 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.681799 19457 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.693640 19217 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.689553 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:07.728454 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2316) took 1587 ms. Trace:
W20260709 13:05:07.730405 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2280) took 2082 ms (client timeout 2596 ms). Trace:
I20260709 13:05:07.687937 15188 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:05:07.662154 19454 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:07.651502 19433 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:05:07.737766 15339 rpcz_store.cc:276] 0709 13:05:06.140953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.454135 (+313182us) service_pool.cc:224] Handling call
0709 13:05:06.454661 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.838719 (+384058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.838768 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:06.838833 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:06.838879 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.728183 (+889304us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400246154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:07.728233 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.728389 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880738560}
I20260709 13:05:07.740315 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:07.740443 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:07.737941 15340 rpcz_store.cc:269] 0709 13:05:05.647829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.648611 (+   782us) service_pool.cc:224] Handling call
0709 13:05:07.730211 (+2081600us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400271fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:07.730345 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3064860416}
I20260709 13:05:07.738116 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1665) took 1648 ms. Trace:
I20260709 13:05:07.742027 15188 rpcz_store.cc:276] 0709 13:05:06.089209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.667670 (+1578461us) service_pool.cc:224] Handling call
0709 13:05:07.738063 (+ 70393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.742197 15341 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:07.740799 15339 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
W20260709 13:05:07.743953 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54519us
I20260709 13:05:07.687762 19395 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:07.749513 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.758064 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.730968 19234 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.766319 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.760849 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:07.763309 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.737082 19422 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.737353 19456 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:07.738868 19457 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.734953 19318 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:07.861086 15841 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.040s (SENT)
W20260709 13:05:07.862787 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 104863us
I20260709 13:05:07.866668 15339 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:05:07.762387 19120 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:07.737450 18829 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:07.738276 19454 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:07.868114 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110092us
I20260709 13:05:07.869067 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.877029 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.761142 19484 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:07.881292 15841 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.053s (SENT)
I20260709 13:05:07.888021 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:07.883908 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 280) took 1587 ms. Trace:
I20260709 13:05:07.888886 15188 rpcz_store.cc:276] 0709 13:05:06.296345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.862918 (+1566573us) service_pool.cc:224] Handling call
0709 13:05:07.883828 (+ 20910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.863024 19433 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:07.890159 15271 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:07.902987 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2307) took 1507 ms. Trace:
I20260709 13:05:07.903568 15195 rpcz_store.cc:276] 0709 13:05:06.395844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.865940 (+1470096us) service_pool.cc:224] Handling call
0709 13:05:07.902923 (+ 36983us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.862582 19456 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:07.869668 19392 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.607s	user 0.007s	sys 0.007s
I20260709 13:05:07.863874 19422 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.876662 19454 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.905678 15271 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:07.908493 15272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2149) took 1523 ms (client timeout 1806 ms). Trace:
I20260709 13:05:07.908484 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 275) took 1627 ms. Trace:
W20260709 13:05:07.922503 15272 rpcz_store.cc:269] 0709 13:05:06.384673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.386713 (+  2040us) service_pool.cc:224] Handling call
0709 13:05:07.908261 (+1521548us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002a8fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:07.908405 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473051392}
I20260709 13:05:07.923323 19392 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:07.926342 19487 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:05:07.927194 19392 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:07.927927 15267 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:07.867352 19397 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:05:07.901877 19433 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:07.930213 19433 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:07.862062 19234 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.886824 19484 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:07.935999 15268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2157) took 1543 ms (client timeout 1682 ms). Trace:
W20260709 13:05:07.922706 19475 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.007s
W20260709 13:05:07.937819 15268 rpcz_store.cc:269] 0709 13:05:06.392403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.463641 (+ 71238us) service_pool.cc:224] Handling call
0709 13:05:07.935820 (+1472179us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54001d83d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:07.935938 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523065088}
I20260709 13:05:07.922972 15189 rpcz_store.cc:276] 0709 13:05:06.281404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.907274 (+1625870us) service_pool.cc:224] Handling call
0709 13:05:07.907781 (+   507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.908030 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.908067 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.908145 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:07.908196 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.908266 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.908409 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:07.939316 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2304) took 1919 ms. Trace:
I20260709 13:05:07.914505 19456 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:07.941473 15196 rpcz_store.cc:276] 0709 13:05:06.020252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.020538 (+   286us) service_pool.cc:224] Handling call
0709 13:05:06.020784 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.549966 (+529182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.939078 (+1389112us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400225bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:07.939249 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215358848}
I20260709 13:05:07.942977 19318 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.938787 19387 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:07.944731 18829 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:07.949096 19496 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:07.955082 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 258) took 1138 ms. Trace:
I20260709 13:05:07.998019 15344 rpcz_store.cc:276] 0709 13:05:06.816477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.627677 (+811200us) service_pool.cc:224] Handling call
0709 13:05:07.628152 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.628633 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.628676 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:07.629176 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:05:07.738107 (+108931us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:07.738146 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.738225 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.954831 (+216606us) raft_consensus.cc:1685] finished
0709 13:05:07.954855 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.954998 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3663,"thread_start_us":108643,"threads_started":1,"wal-append.queue_time_us":251052}
I20260709 13:05:07.956360 19402 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:07.958178 19183 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:07.960132 19234 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:07.963616 19494 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:07.965416 19437 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.699s	user 0.007s	sys 0.009s
I20260709 13:05:07.974558 15189 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:05:07.966034 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 94643.6us
I20260709 13:05:07.997185 19387 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:08.001785 15196 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:08.005985 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2312) took 1538 ms. Trace:
I20260709 13:05:08.006628 15189 rpcz_store.cc:276] 0709 13:05:06.467778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.973406 (+1505628us) service_pool.cc:224] Handling call
0709 13:05:07.973833 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:08.005680 (+ 31847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.005908 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:08.008376 15189 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:08.009518 15196 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:08.011257 15196 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:07.953197 19430 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:07.940451 19484 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:08.040813 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.038754 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 272) took 1758 ms. Trace:
I20260709 13:05:08.041469 15195 rpcz_store.cc:276] 0709 13:05:06.280330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.904397 (+1624067us) service_pool.cc:224] Handling call
0709 13:05:07.904753 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:08.037369 (+132616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.037413 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:08.037475 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:08.037519 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.037614 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.038674 (+  1060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20614,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":132103,"threads_started":1}
W20260709 13:05:08.039953 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.004290 19395 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.048527 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:07.997813 19496 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:08.049918 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 172946us
I20260709 13:05:08.050359 15268 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:08.024396 19120 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:07.942620 19475 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.052996 15343 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:08.045439 19234 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.036319 19402 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.056967 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:07.997462 19457 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.035383 19494 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.070235 15268 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:05:08.060643 18959 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.002s
I20260709 13:05:08.084777 19457 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.072050 19497 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:08.084518 18959 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.088071 19501 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:08.088533 19501 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.088933 19501 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.089771 18959 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.055855 19496 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.060979 19395 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:08.088092 19497 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.091863 19395 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:08.092525 19395 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:08.093684 19395 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.092092 19497 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:08.081162 19402 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.096740 19502 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:08.085999 19494 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.099063 15270 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:05:08.049310 19250 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:05:08.086696 19387 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:08.105834 19387 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.105409 19120 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.108333 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:08.094929 19395 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:08.122525 15264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2154) took 1731 ms (client timeout 1812 ms). Trace:
W20260709 13:05:08.124176 15264 rpcz_store.cc:269] 0709 13:05:06.391478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.495917 (+104439us) service_pool.cc:224] Handling call
0709 13:05:08.122359 (+1626442us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54004164d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:08.122469 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921921792}
I20260709 13:05:08.125311 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.126451 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:08.129779 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:08.130168 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.131575 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.132225 15264 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:08.130630 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:08.118877 19454 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.134080 19494 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.134418 19475 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:08.133127 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.080145 19234 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.118230 19497 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.119203 19422 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.109988 19457 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:05:08.146735 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.149032 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:08.134619 19494 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.150878 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.134639 19183 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:08.134429 19402 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.153455 15264 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:08.157861 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.158360 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.158716 15268 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:08.159942 15264 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:08.149797 19332 consensus_meta.cc:287] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.666s	user 0.011s	sys 0.000s
I20260709 13:05:08.143858 19502 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.164685 15264 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:05:08.176299 19494 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.148393 19504 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.148291 19427 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.160698 19454 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.166064 19457 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:08.213521 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.214300 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1641) took 1674 ms. Trace:
I20260709 13:05:08.214560 15338 rpcz_store.cc:276] 0709 13:05:06.539966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.213234 (+1673268us) service_pool.cc:224] Handling call
0709 13:05:08.214250 (+  1016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:08.203783 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2301) took 2069 ms. Trace:
I20260709 13:05:08.215461 15342 rpcz_store.cc:276] 0709 13:05:06.134200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.337405 (+203205us) service_pool.cc:224] Handling call
0709 13:05:06.337723 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.765686 (+427963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.765726 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:06.765767 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:06.765798 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.203510 (+1437712us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400424354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:08.203564 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.203716 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627769088}
I20260709 13:05:08.167678 19332 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:08.228138 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 148811us
I20260709 13:05:08.212870 19457 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:08.234861 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.236763 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.195587 19502 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.197021 19504 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:08.208066 19456 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.204625 19427 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.221864 19430 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.240231 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:08.301046 19497 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:08.303855 19428 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:08.302081 19457 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.304626 19428 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.305226 19428 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:08.305490 19457 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:08.305590 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:08.306327 15338 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.308210 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.308830 15344 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
W20260709 13:05:08.309656 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69466.8us
I20260709 13:05:08.309653 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:08.311815 15344 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:08.310611 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:08.324241 15338 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:08.325186 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1654) took 1780 ms. Trace:
I20260709 13:05:08.325870 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.327659 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:08.329248 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:08.325732 15343 rpcz_store.cc:276] 0709 13:05:06.544278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.479115 (+934837us) service_pool.cc:224] Handling call
0709 13:05:08.324924 (+845809us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540005a854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:08.325104 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271002496}
I20260709 13:05:08.331612 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.333791 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.337821 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.339082 15344 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:08.235773 19454 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.341041 19496 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.235335 18944 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:05:08.303956 19501 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:08.458477 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 147868us
W20260709 13:05:08.444175 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 212894us
I20260709 13:05:08.461131 15268 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:08.465178 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:08.459856 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.345181 15343 raft_consensus.cc:2410] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:08.468035 15339 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:08.458344 15338 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.443507 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:08.470371 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2173) took 1336 ms. Trace:
I20260709 13:05:08.475216 15268 rpcz_store.cc:276] 0709 13:05:07.134475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.160566 (+1026091us) service_pool.cc:224] Handling call
0709 13:05:08.167078 (+  6512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:08.462082 (+295004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.469977 (+  7895us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400088754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:08.470276 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674659712}
W20260709 13:05:08.458463 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.482792 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.485383 15337 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:05:08.473184 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2303) took 2453 ms. Trace:
I20260709 13:05:08.472040 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:08.485864 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2064) took 1708 ms. Trace:
I20260709 13:05:08.469450 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.485869 15192 rpcz_store.cc:276] 0709 13:05:06.019896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.020044 (+   148us) service_pool.cc:224] Handling call
0709 13:05:06.020365 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.213308 (+1192943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.472434 (+1259126us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000c08d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:08.472840 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2569538432}
I20260709 13:05:08.488334 15343 raft_consensus.cc:1813] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Handling vote request from an unknown peer 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:08.489379 15343 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:08.491504 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:08.492486 15339 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:08.494218 15339 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:08.488266 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48112 (request call id 256) took 1931 ms. Trace:
I20260709 13:05:08.486336 15270 rpcz_store.cc:276] 0709 13:05:06.777225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.606335 (+829110us) service_pool.cc:224] Handling call
0709 13:05:07.606744 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.101257 (+494513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.485215 (+383958us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b5400011654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:08.485644 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131623680}
W20260709 13:05:08.460065 15266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2067) took 1617 ms (client timeout 1706 ms). Trace:
W20260709 13:05:08.496923 15266 rpcz_store.cc:269] 0709 13:05:06.842307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.850421 (+  8114us) service_pool.cc:224] Handling call
0709 13:05:08.459390 (+1608969us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54001d9cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:08.459749 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1138523904}
W20260709 13:05:08.502450 15191 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 276) took 2220 ms (client timeout 1892 ms). Trace:
I20260709 13:05:08.502874 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2166) took 2098 ms. Trace:
W20260709 13:05:08.503276 15191 rpcz_store.cc:269] 0709 13:05:06.281799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.982566 (+700767us) service_pool.cc:224] Handling call
0709 13:05:08.501860 (+1519294us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000fafd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:08.502151 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239918976}
I20260709 13:05:08.503479 15265 rpcz_store.cc:276] 0709 13:05:06.404103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.504581 (+1100478us) service_pool.cc:224] Handling call
0709 13:05:08.459784 (+955203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:08.460494 (+   710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.460568 (+    74us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:08.460672 (+   104us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:08.460733 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.460869 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.502484 (+ 41615us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54001d9cd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:08.502673 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2175269120}
W20260709 13:05:08.506387 15193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1679) took 2381 ms (client timeout 3074 ms). Trace:
W20260709 13:05:08.507108 15193 rpcz_store.cc:269] 0709 13:05:06.124434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.660700 (+1536266us) service_pool.cc:224] Handling call
0709 13:05:08.505809 (+845109us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b5400226ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:08.506133 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1224823040}
I20260709 13:05:08.507879 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2152) took 2117 ms. Trace:
I20260709 13:05:08.508361 15267 rpcz_store.cc:276] 0709 13:05:06.390244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.390399 (+   155us) service_pool.cc:224] Handling call
0709 13:05:06.462758 (+ 72359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.928345 (+1465587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.507330 (+578985us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54003296d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:08.507679 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3369105792}
I20260709 13:05:08.494889 15337 rpcz_store.cc:276] 0709 13:05:06.556417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.481700 (+1925283us) service_pool.cc:224] Handling call
0709 13:05:08.488103 (+  6403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:08.463102 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.450595 15188 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:05:08.352962 19506 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:05:08.527160 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:08.537045 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 94147.7us
W20260709 13:05:08.353242 18904 consensus_meta.cc:287] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.001s
I20260709 13:05:08.362710 19501 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.593468 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1674) took 2473 ms. Trace:
I20260709 13:05:08.595925 15188 rpcz_store.cc:276] 0709 13:05:06.101103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.889632 (+1788529us) service_pool.cc:224] Handling call
0709 13:05:07.890016 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.449900 (+559884us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b54002b64a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5684dc0 00007f36e570f1c0 00007f36e5710231 00007f36e570cd8f 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c
0709 13:05:08.536503 (+ 86603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.574742 (+ 38239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89872768}
I20260709 13:05:08.379815 19391 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.599692 19500 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:08.608194 19268 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.609293 19268 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.611821 19386 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:08.613092 19386 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
W20260709 13:05:08.384166 19505 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:05:08.349211 19234 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.639151 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:08.639633 19408 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.640522 19408 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.642179 15268 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:08.642450 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2168) took 1573 ms. Trace:
I20260709 13:05:08.648044 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2160) took 2254 ms. Trace:
W20260709 13:05:08.647106 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.648635 18944 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.647120 19253 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:08.649430 18944 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:08.650080 19253 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.650509 19253 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.650807 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:08.361218 19427 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.654621 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:08.655779 15267 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:08.644104 15344 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:08.653306 15266 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:08.653916 19395 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:08.352447 19456 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.374329 19404 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:08.360337 19422 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.363703 19332 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:08.360320 19504 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:08.356122 19496 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.669450 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:08.660655 19395 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.672013 19508 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:08.672816 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:08.366822 19433 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.685920 19433 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.687024 15339 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.648545 15263 rpcz_store.cc:276] 0709 13:05:06.393316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.095513 (+702197us) service_pool.cc:224] Handling call
0709 13:05:07.095896 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:07.147308 (+ 51412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:07.147349 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:07.147953 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 13:05:07.369433 (+221480us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:07.382093 (+ 12660us) log.cc:844] Serialized 14 byte log entry
0709 13:05:08.473354 (+1091261us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b18004233a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:05:08.473933 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.647479 (+173546us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b54001d92d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:08.647546 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:08.647634 (+    88us) raft_consensus.cc:1685] finished
0709 13:05:08.647647 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.647841 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52601,"prepare.queue_time_us":13433,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2668,"raft.queue_time_us":1258454,"raft.run_cpu_time_us":668,"raft.run_wall_time_us":128113,"spinlock_wait_cycles":138043008,"thread_start_us":161898,"threads_started":1,"wal-append.queue_time_us":223426,"wal-append.run_cpu_time_us":2791,"wal-append.run_wall_time_us":1188897}
I20260709 13:05:08.682721 15869 raft_consensus.cc:1813] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Handling vote request from an unknown peer 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:08.669097 19403 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.693877 15869 raft_consensus.cc:2410] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:05:08.365512 19502 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.676981 19268 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:08.703192 19404 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:08.703540 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:08.703244 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:08.704612 15344 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:08.705304 19404 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:08.358631 19454 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:08.707592 19403 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.642994 15272 rpcz_store.cc:276] 0709 13:05:07.069362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.923625 (+854263us) service_pool.cc:224] Handling call
0709 13:05:07.923939 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.924120 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:07.933019 (+  8899us) log.cc:844] Serialized 14 byte log entry
0709 13:05:08.574541 (+641522us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:08.574692 (+   151us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:08.627202 (+ 52510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.634866 (+  7664us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.642249 (+  7383us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":373492,"prepare.queue_time_us":8750,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":4197,"raft.queue_time_us":518870,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9987,"thread_start_us":255822,"threads_started":2,"wal-append.queue_time_us":219196}
I20260709 13:05:08.707818 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:08.720747 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 54886.2us
I20260709 13:05:08.722393 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:08.373550 19428 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.723508 19397 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:08.723786 15338 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
W20260709 13:05:08.724325 15092 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 160) took 28901 ms (client timeout 15000 ms). Trace:
I20260709 13:05:08.724741 19499 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:08.725329 19499 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.725394 19428 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.691123 19508 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.725955 19499 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.732347 15342 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:05:08.735183 19408 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:08.735325 19397 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:05:08.737664 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.737978 15162 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:08.738373 19454 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:08.738586 19428 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.741241 19428 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.743844 19428 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:08.739562 19404 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:08.728904 19508 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.738942 19397 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:08.748090 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 1.38073e+06us
I20260709 13:05:08.748770 15343 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:08.749543 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:08.691696 19395 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.759110 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:08.760079 18938 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:08.754706 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:08.753949 15346 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1640) took 2214 ms (client timeout 2013 ms). Trace:
W20260709 13:05:08.761122 15346 rpcz_store.cc:269] 0709 13:05:06.539649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.359251 (+819602us) service_pool.cc:224] Handling call
0709 13:05:08.753551 (+1394300us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b54000979d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:08.753761 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130003712}
I20260709 13:05:08.764129 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1671) took 2663 ms. Trace:
I20260709 13:05:08.764570 15194 rpcz_store.cc:276] 0709 13:05:06.100148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.864603 (+1764455us) service_pool.cc:224] Handling call
0709 13:05:07.864952 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:08.036839 (+171887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.036869 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:08.037522 (+   653us) log.cc:844] Serialized 52 byte log entry
0709 13:05:08.103273 (+ 65751us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:08.103310 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.103379 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:08.383342 (+279963us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:08.763595 (+380253us) raft_consensus.cc:1685] finished
0709 13:05:08.763628 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.763934 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":190,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9997,"spinlock_wait_cycles":3420416,"thread_start_us":219461,"threads_started":2,"wal-append.queue_time_us":101214}
I20260709 13:05:08.767112 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:08.767494 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:08.768220 15193 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:08.770998 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:08.766731 18922 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.772483 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:08.773254 15870 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:08.774246 15341 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
W20260709 13:05:08.774770 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 666365us
I20260709 13:05:08.772832 18922 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:08.780755 19397 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:08.780992 18922 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:08.750976 15343 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:08.781167 19253 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:08.782676 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 121689us
I20260709 13:05:08.784204 15193 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:05:08.752620 15312 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.099s (SENT) [suppressed 52 similar messages]
I20260709 13:05:08.788738 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:08.800431 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:08.825286 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.801419 15188 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:08.363881 19484 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:08.862620 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 113291us
I20260709 13:05:08.864559 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:08.865541 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:08.864006 15339 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:08.887265 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 167789us
I20260709 13:05:08.874063 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:08.801440 18944 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:08.906919 15344 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:08.911756 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:08.917209 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:08.724870 15092 rpcz_store.cc:269] 0709 13:04:39.701751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.702002 (+   251us) service_pool.cc:224] Handling call
0709 13:04:40.236750 (+534748us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5677090 00007f36e5715f3a 00007f36eb4cc1cc 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc 00007f36e9a8a392 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:08.602964 (+28366214us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:57.758342 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:57.828025 (+ 69683us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:57.828063 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:04:57.828082 (+    19us) tablet.cc:662] Decoding operations
0709 13:04:57.962608 (+134526us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:57.962690 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:57.962716 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:57.963796 (+  1080us) tablet.cc:701] Row locks acquired
0709 13:04:57.963815 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:04:57.963971 (+   156us) write_op.cc:270] Start()
0709 13:04:57.964077 (+   106us) write_op.cc:276] Timestamp: P: 1783602297963926 usec, L: 0
0709 13:04:57.964109 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:04:57.987082 (+ 22973us) log.cc:844] Serialized 4773 byte log entry
0709 13:04:58.059905 (+ 72823us) op_driver.cc:464] REPLICATION: finished
0709 13:04:58.381841 (+321936us) write_op.cc:301] APPLY: starting
0709 13:04:58.395742 (+ 13901us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:58.396189 (+   447us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:58.442289 (+ 46100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:58.783874 (+341585us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:58.784256 (+   382us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:04:58.784298 (+    42us) write_op.cc:312] APPLY: finished
0709 13:04:58.784731 (+   433us) log.cc:844] Serialized 88 byte log entry
0709 13:04:58.784932 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:58.785369 (+   437us) write_op.cc:454] Released schema lock
0709 13:04:58.785442 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:58.806594 (+ 21152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:58.806625 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45927,"reported_tablets":56,"spinlock_wait_cycles":237443328,"child_traces":[["op",{"apply.queue_time_us":264606,"apply.run_cpu_time_us":10206,"apply.run_wall_time_us":481585,"num_ops":12,"prepare.queue_time_us":420299,"prepare.run_cpu_time_us":48552,"prepare.run_wall_time_us":325837,"raft.queue_time_us":1369,"raft.run_cpu_time_us":22401,"raft.run_wall_time_us":198751,"replication_time_us":95584,"thread_start_us":532153,"threads_started":4,"wal-append.queue_time_us":56817,"wal-append.run_cpu_time_us":5385,"wal-append.run_wall_time_us":1733320}]]}
I20260709 13:05:08.920588 15188 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:08.853541 19408 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:05:08.911873 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 172881us
I20260709 13:05:08.931129 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:08.936023 19513 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.937019 19513 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:08.938247 18944 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:08.917342 19397 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:05:08.938882 18944 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.939642 18944 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.936252 19207 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.936360 15340 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:08.943647 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:08.944087 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 191528us
I20260709 13:05:08.943612 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2167) took 2449 ms. Trace:
W20260709 13:05:08.948328 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 170689us
I20260709 13:05:08.953070 15311 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:08.920415 19268 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:08.971894 15194 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:05:08.994692 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44203.3us
I20260709 13:05:09.002956 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:08.951143 18922 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:09.026101 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 159250us
I20260709 13:05:09.026247 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:09.027626 15339 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:09.109591 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:09.110363 15339 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:09.111340 19397 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:09.111958 19397 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:09.112244 15339 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:09.112985 19397 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.036805 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:09.037588 15870 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
W20260709 13:05:09.115262 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73380.6us
I20260709 13:05:09.116357 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.117012 19318 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:05:09.118741 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.044054 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:09.044801 19527 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:09.045889 19268 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:09.047894 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 95020us
I20260709 13:05:09.048806 19496 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:09.052342 19209 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:09.140625 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2320) took 1411 ms. Trace:
W20260709 13:05:09.026373 15237 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.106s (SENT)
I20260709 13:05:09.141521 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:09.142095 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.142304 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.142961 15263 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:09.143077 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.144021 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2080) took 1042 ms. Trace:
I20260709 13:05:09.144294 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:09.058316 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.141073 15340 rpcz_store.cc:276] 0709 13:05:07.729564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.759329 (+ 29765us) service_pool.cc:224] Handling call
0709 13:05:07.759614 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:09.002063 (+1242449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.140320 (+138257us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540005a354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:09.140546 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2694601600}
I20260709 13:05:09.062196 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.063154 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:09.145955 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.063279 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:09.065096 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:09.071400 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 206105us
I20260709 13:05:09.074226 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.074632 19253 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:09.078552 19484 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:09.097045 19207 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:09.065122 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68662.2us
I20260709 13:05:09.037837 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:09.147540 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.154294 15345 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:09.149891 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.118983 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.119771 19513 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.030385 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.122718 18829 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:08.947849 15269 rpcz_store.cc:276] 0709 13:05:06.405154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.509751 (+1104597us) service_pool.cc:224] Handling call
0709 13:05:07.510119 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.510323 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:07.510661 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:05:08.668458 (+1157797us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:08.694509 (+ 26051us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:08.787885 (+ 93376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.791152 (+  3267us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.854062 (+ 62910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":827277,"prepare.queue_time_us":340,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":964940,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"spinlock_wait_cycles":8448,"thread_start_us":294640,"threads_started":2,"wal-append.queue_time_us":201806,"wal-append.run_cpu_time_us":2133,"wal-append.run_wall_time_us":1217966}
W20260709 13:05:09.104146 15842 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.892s (SENT)
I20260709 13:05:09.139918 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:09.145329 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.144412 15264 rpcz_store.cc:276] 0709 13:05:08.101621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.168981 (+ 67360us) service_pool.cc:224] Handling call
0709 13:05:08.169398 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.633855 (+464457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.636277 (+  2422us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.690714 (+ 54437us) log.cc:844] Serialized 26 byte log entry
0709 13:05:08.932269 (+241555us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:08.932321 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.932470 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.143682 (+211212us) raft_consensus.cc:1685] finished
0709 13:05:09.143698 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.143857 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306463,"raft.queue_time_us":444215,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":225,"thread_start_us":338836,"threads_started":2,"wal-append.queue_time_us":450892}
I20260709 13:05:09.146891 15272 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.160048 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2169) took 2083 ms. Trace:
I20260709 13:05:09.141609 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:09.150705 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.182267 15267 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.177071 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:09.183650 15268 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:09.184099 15196 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:09.185241 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.187256 15263 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.186733 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.190327 15268 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:09.191354 19496 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.191942 19404 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:09.193207 19404 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:09.193645 19404 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:09.193878 15272 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:09.193681 19456 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:09.195078 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.195324 19502 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:09.195847 15272 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:09.191963 19496 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.197506 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:09.198115 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:09.198369 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:09.198686 19496 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:09.199229 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:09.201385 15340 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:09.199692 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:09.201743 19508 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.202560 15338 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:05:09.199833 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.194875 19404 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.210434 19404 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.209209 15272 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:09.212226 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.213052 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:09.214433 15270 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:09.214433 15272 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:09.218328 18922 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:09.160997 19403 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.147883 19541 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.219007 18922 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:09.221125 19395 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.146816 19268 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.220335 19541 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:09.223593 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:09.227203 19541 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.227547 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:09.229611 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 89814.2us
I20260709 13:05:09.230664 15311 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:09.218344 15268 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:09.231719 15344 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:09.243358 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:09.247339 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:09.249425 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 71365.3us
I20260709 13:05:09.070772 19497 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.173s
I20260709 13:05:09.241207 19433 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:09.254858 19543 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:09.129125 19499 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:09.180074 15271 rpcz_store.cc:276] 0709 13:05:07.076694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:07.924266 (+847572us) service_pool.cc:224] Handling call
0709 13:05:07.924631 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.658442 (+733811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.662710 (+  4268us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.809064 (+146354us) log.cc:844] Serialized 26 byte log entry
0709 13:05:08.994527 (+185463us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:08.994577 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.994646 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.159599 (+164953us) raft_consensus.cc:1685] finished
0709 13:05:09.159632 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.159847 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":551973,"raft.queue_time_us":689871,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":162,"thread_start_us":178823,"threads_started":2,"wal-append.queue_time_us":280403}
I20260709 13:05:09.261813 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.257448 19268 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:09.273226 19209 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:09.278381 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.280324 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.283062 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.283778 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.254338 19253 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:09.297245 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44350.8us
I20260709 13:05:09.298736 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:09.300292 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:09.264155 19433 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:09.297165 15263 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:09.309144 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 295569us
I20260709 13:05:09.316978 15264 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.303603 19484 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:09.324548 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:09.311539 19433 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.305754 19454 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:09.322976 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:09.326100 19333 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:05:09.335945 19499 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:09.336300 19333 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:09.336715 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 106189us
I20260709 13:05:09.338551 19207 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.333254 18944 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.341457 18944 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.344769 15342 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:05:09.336748 19333 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:09.347162 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 314398us
I20260709 13:05:09.346753 19333 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.348759 19333 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:09.349900 15095 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 63) took 14095 ms (client timeout 15000 ms). Trace:
I20260709 13:05:09.331418 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:09.350270 15095 rpcz_store.cc:269] 0709 13:04:55.223373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.229326 (+  5953us) service_pool.cc:224] Handling call
0709 13:05:09.291425 (+14062099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:06.531548 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:07.489931 (+958383us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b5c00184b8c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb8ff331 00007f36eb8ff221 00007f36eb8f9f6c 00007f36e9157d69 00007f36e91430a6 00007f36e9142d58 00007f36e91479f1 00007f36e91479a9 00007f36e9147939 00007f36e9147901 00007f36e9146b2d
0709 13:05:07.490058 (+   127us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:07.490124 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:05:07.490169 (+    45us) tablet.cc:662] Decoding operations
0709 13:05:07.491486 (+  1317us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:07.491591 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:07.491630 (+    39us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:05:07.492542 (+   912us) tablet.cc:701] Row locks acquired
0709 13:05:07.492598 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:05:07.492829 (+   231us) write_op.cc:270] Start()
0709 13:05:07.493139 (+   310us) write_op.cc:276] Timestamp: P: 1783602307492742 usec, L: 0
0709 13:05:07.493172 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:05:07.643894 (+150722us) log.cc:844] Serialized 2999 byte log entry
0709 13:05:08.344227 (+700333us) op_driver.cc:464] REPLICATION: finished
0709 13:05:08.409389 (+ 65162us) write_op.cc:301] APPLY: starting
0709 13:05:08.409632 (+   243us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:08.409858 (+   226us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:08.409881 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:08.410720 (+   839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:08.410943 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:05:08.411017 (+    74us) write_op.cc:312] APPLY: finished
0709 13:05:08.616156 (+205139us) log.cc:844] Serialized 58 byte log entry
0709 13:05:08.616609 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:08.616984 (+   375us) write_op.cc:454] Released schema lock
0709 13:05:08.617113 (+   129us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:08.617885 (+   772us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:08.617924 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5766731,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":62778,"apply.run_cpu_time_us":4257,"apply.run_wall_time_us":208403,"num_ops":7,"prepare.queue_time_us":533317,"prepare.run_cpu_time_us":24402,"prepare.run_wall_time_us":1267911,"raft.queue_time_us":121925,"raft.run_cpu_time_us":7490,"raft.run_wall_time_us":187227,"replication_time_us":742894,"spinlock_wait_cycles":39141760,"thread_start_us":538968,"threads_started":4,"wal-append.queue_time_us":121530}]]}
I20260709 13:05:09.353770 19186 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:09.354216 19186 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.354581 19186 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:09.357483 19433 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:09.359766 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109228us
I20260709 13:05:09.328187 19395 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:09.366165 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 59828us
I20260709 13:05:09.366842 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:09.329260 18829 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.372593 18944 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:09.373662 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:09.375803 15873 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:09.378794 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.374074 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.327296 19403 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:09.391746 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 102619us
I20260709 13:05:09.371816 19268 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:09.374248 19484 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:09.374626 19508 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:09.392347 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 281274us
I20260709 13:05:09.386796 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:09.385082 18944 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:09.394642 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.396562 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:09.396991 15873 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:09.399621 15311 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:09.388253 19527 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:09.409297 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 78204.6us
I20260709 13:05:09.408169 15093 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 9, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 9 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.410928 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:09.411192 19524 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:09.412109 19524 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:09.419639 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:09.421169 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51797.2us
I20260709 13:05:09.423218 19209 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:09.424876 19499 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:05:09.431591 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46126.7us
I20260709 13:05:09.434456 18922 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.432106 15270 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:09.437356 19499 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:09.439126 18829 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.441196 15093 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 5 to 7, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 7 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.451257 15093 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 5 to 8, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 8 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.444511 18922 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.455734 18922 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:09.448714 19318 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:09.456446 19318 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:09.458627 19318 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.460727 19318 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.463141 18922 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:09.448966 19333 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:09.442248 18829 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.465009 18829 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:09.465619 18829 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:09.445750 19524 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:09.466831 18829 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.469532 19186 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.470651 19333 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:09.471697 19433 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:09.396063 19496 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:09.405360 19253 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:09.475986 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 81393.7us
I20260709 13:05:09.396171 19484 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.397375 19408 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.397073 19403 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.405661 19527 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:09.486939 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.495952 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:09.496738 15873 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.497308 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:09.498267 15267 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:09.471271 18922 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.488139 19332 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:09.483523 19395 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.485800 19496 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:09.493403 19484 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:09.499603 19527 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:09.502303 19508 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:09.508059 19496 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:09.520146 15264 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:09.502818 19253 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:09.519387 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.532473 19525 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:09.534505 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.535257 19454 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:09.535662 19454 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:09.535754 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:09.536126 19454 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.513428 19502 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:05:09.521958 19524 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:09.526947 19433 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:09.542783 19404 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:05:09.549224 19456 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:09.549567 18938 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:09.547195 15093 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 8, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 8 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.503528 19333 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:09.557775 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 146943us
I20260709 13:05:09.503948 18944 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:09.549877 19428 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:09.507843 19408 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.520579 19395 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.511335 19332 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:09.569301 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 88579.2us
I20260709 13:05:09.565593 15093 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:09.569111 19250 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:09.576962 19250 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:09.583791 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48110.7us
I20260709 13:05:09.584950 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.586086 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.574203 19497 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:09.574784 19333 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.628211 19404 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:09.628844 19404 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:09.629307 19404 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.631543 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2093) took 1501 ms. Trace:
I20260709 13:05:09.632083 15266 rpcz_store.cc:276] 0709 13:05:08.129607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.670886 (+541279us) service_pool.cc:224] Handling call
0709 13:05:08.707694 (+ 36808us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.931001 (+223307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.931066 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.998568 (+ 67502us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.365508 (+366940us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:09.365569 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.365663 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.631218 (+265555us) raft_consensus.cc:1685] finished
0709 13:05:09.631249 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.631450 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153603,"raft.queue_time_us":184423,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":10833,"thread_start_us":313323,"threads_started":1,"wal-append.queue_time_us":558919}
I20260709 13:05:09.635643 15873 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:09.637202 15237 leader_election.cc:400] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:09.637650 15237 leader_election.cc:403] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:05:09.594741 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.636431 15093 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 8, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:09.687424 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:09.596150 19186 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.591411 19497 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:09.702831 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 353679us
I20260709 13:05:09.588663 19502 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:05:09.703228 15093 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 6 to 8, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 8 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:09.712764 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 133096us
I20260709 13:05:09.713222 19408 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.713748 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:09.713969 19403 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.714601 19403 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:09.716662 15842 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.197s (SENT)
I20260709 13:05:09.717116 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:09.721161 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 94905.2us
I20260709 13:05:09.720872 19527 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.592308 19253 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:09.727221 19513 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:09.732064 19497 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.733546 19497 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.735968 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2346) took 1117 ms. Trace:
W20260709 13:05:09.736550 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.746767 19395 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:09.747457 19525 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:09.703202 19456 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:09.748651 19456 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.749032 19456 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.596657 19250 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.756088 19332 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:09.756970 15084 maintenance_manager.cc:419] P d7ef35df06e147c6a6e7757620253191: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033393
I20260709 13:05:09.714766 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:09.761875 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 174764us
W20260709 13:05:09.767491 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 52833.2us
I20260709 13:05:09.736354 15343 rpcz_store.cc:276] 0709 13:05:08.618878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.816344 (+197466us) service_pool.cc:224] Handling call
0709 13:05:08.930130 (+113786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:09.048204 (+118074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:09.048262 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:09.049276 (+  1014us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.304030 (+254754us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:09.304076 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.304148 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.735646 (+431498us) raft_consensus.cc:1685] finished
0709 13:05:09.735677 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.735873 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10214,"raft.queue_time_us":13478,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":154,"thread_start_us":240429,"threads_started":1,"wal-append.queue_time_us":678940}
I20260709 13:05:09.756992 19250 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.762594 19403 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:09.822599 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.766604 19428 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:09.825991 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:09.829332 15344 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:05:09.784420 19408 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:09.791435 19395 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:09.832110 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:09.833774 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:09.838985 15264 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.839947 15342 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:05:09.821489 19209 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:09.826401 19403 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.841383 15266 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.843475 19508 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:09.850492 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 320057us
I20260709 13:05:09.836428 19428 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:09.843639 19395 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:09.871894 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:09.865948 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 443126us
I20260709 13:05:09.844605 19408 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:09.873790 15264 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
W20260709 13:05:09.877811 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 458419us
I20260709 13:05:09.886027 18829 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:09.857954 19527 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:09.893837 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.064s
W20260709 13:05:09.895205 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.064s
I20260709 13:05:09.892249 15268 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:09.893783 18938 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:09.889133 19433 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:09.933658 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.928954 19186 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:05:09.944167 15344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:05:09.945848 19496 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.947875 19433 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.951160 19508 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.956147 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:09.963513 19408 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.970120 15344 raft_consensus.cc:606] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:09.973135 15344 raft_consensus.cc:614] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:09.976447 19527 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:09.968693 19560 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.936472 19454 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.921459 19209 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:10.011960 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.010874 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 119201us
W20260709 13:05:10.020332 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.035864 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.038462 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:10.039595 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 103895us
I20260709 13:05:09.968745 19395 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.992585 19560 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:09.990542 19333 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:05:09.972824 19428 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:10.041620 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.015290 19253 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.050365 18938 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:10.052258 19484 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.007s
I20260709 13:05:10.063511 19496 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:10.063740 19553 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:10.064225 19562 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:05:10.006549 18944 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:05:10.090775 15343 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:10.094272 15873 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
W20260709 13:05:10.079514 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48776.4us
I20260709 13:05:10.097221 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.097559 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.097916 15339 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:10.085139 15238 connection.cc:256] RPC call timeout handler was delayed by -2.8378518369999028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3074s for a response
I20260709 13:05:10.081475 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.102619 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.103804 15342 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:10.103340 15346 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
W20260709 13:05:10.115821 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74306us
I20260709 13:05:10.117919 15344 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:10.127606 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46288.5us
I20260709 13:05:10.127633 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:10.128614 15872 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.128683 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.109282 19524 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:10.130765 15238 connection.cc:256] RPC call timeout handler was delayed by -2.01560976199994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
W20260709 13:05:10.132953 15238 connection.cc:256] RPC call timeout handler was delayed by -1.9580097619999606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2098s for a response
W20260709 13:05:10.133404 15238 connection.cc:256] RPC call timeout handler was delayed by -1.8804876709999689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
I20260709 13:05:10.087059 19484 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.087296 19404 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.087117 19253 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:10.133800 15238 connection.cc:256] RPC call timeout handler was delayed by -1.7465304309999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 13:05:10.115434 19496 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.137454 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.139272 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:10.141316 15238 connection.cc:256] RPC call timeout handler was delayed by -1.7020996250000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:05:10.141987 15238 connection.cc:256] RPC call timeout handler was delayed by -1.6691097619999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2419s for a response
I20260709 13:05:10.118875 18944 consensus_queue.cc:1243] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:10.130303 19408 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:10.148022 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:10.134763 19524 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.136395 19332 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:10.195353 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.153973 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:10.196341 15267 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:10.155483 18922 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:10.155948 19404 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.156430 15268 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 14. Ops: []
I20260709 13:05:10.159761 19556 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:10.161463 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:10.163130 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:10.200521 15269 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.164737 15872 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:10.168015 19560 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.168498 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:10.169653 19454 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.170341 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2081) took 2068 ms. Trace:
I20260709 13:05:10.171222 19484 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:10.172881 19558 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:05:10.172753 19573 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:10.173205 19570 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.211709 19573 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.212262 19573 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:10.174250 19571 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:10.175231 19403 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.214391 19403 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.177053 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:10.215960 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:10.216761 15271 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:10.217967 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:10.218600 15271 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:10.178128 19456 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.220798 19456 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.180414 19253 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.181267 15266 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:10.163645 19557 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:10.203015 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:10.224025 15272 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:10.195709 19524 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:10.208901 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:10.208330 19332 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.211930 19570 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.173542 19408 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:10.200583 15874 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:10.223505 19557 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:10.229530 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:10.232738 15337 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
W20260709 13:05:10.233662 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65311.4us
I20260709 13:05:10.203270 19556 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.235718 15339 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:10.239212 19408 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:10.235708 19571 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:10.241112 19571 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.242375 15267 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:10.233623 19560 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:10.244138 19570 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.244827 19556 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.246202 19556 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.247809 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:10.248596 19332 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.249064 15264 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:05:10.248581 15267 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:05:10.250407 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:10.250756 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.251449 15238 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.985s (SENT)
I20260709 13:05:10.236241 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:10.256866 15268 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.256108 19527 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:10.255609 19557 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.259008 15269 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:10.260231 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:10.263168 19333 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:10.263577 19333 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:10.202643 15265 rpcz_store.cc:276] 0709 13:05:08.102257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.921317 (+819060us) service_pool.cc:224] Handling call
0709 13:05:08.950341 (+ 29024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:09.103295 (+152954us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:09.375526 (+272231us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.789712 (+414186us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:09.828042 (+ 38330us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.828236 (+   194us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:09.828550 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.828748 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.828839 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.170085 (+341246us) raft_consensus.cc:1685] finished
0709 13:05:10.170112 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.170271 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":526371,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":4911,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":34965,"spinlock_wait_cycles":16141952,"thread_start_us":654926,"threads_started":2,"wal-append.queue_time_us":516486}
I20260709 13:05:10.272161 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:10.274852 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43600.5us
I20260709 13:05:10.276726 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.277730 15337 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:10.278642 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:10.264045 19333 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:10.275885 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.281821 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:10.284845 15238 leader_election.cc:336] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.060s (SENT)
I20260709 13:05:10.285532 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:10.297555 15272 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:05:10.299495 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.301195 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.302968 15337 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:10.308756 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.313522 19397 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:10.314026 19397 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.292364 19527 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:10.326737 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:10.322675 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:10.351511 15337 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.351743 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:10.338500 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.361537 19587 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:10.321918 19560 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:05:10.363313 15268 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:10.306799 19570 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:05:10.365435 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.365005 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.370422 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.309186 19253 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:10.316659 19433 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:05:10.384554 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 99615.5us
I20260709 13:05:10.397308 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:10.388885 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.320896 19428 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:10.398663 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.363955 19456 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:10.385510 19570 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.391842 18829 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.413458 15268 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:10.396519 19527 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:10.388576 19209 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:10.427245 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 119236us
I20260709 13:05:10.435577 15337 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:10.413254 19570 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.314915 19397 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.413719 19497 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:10.424571 19395 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.420264 19456 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:10.450734 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.436715 19428 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:10.453820 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:10.456380 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86092us
W20260709 13:05:10.456741 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 58156.9us
I20260709 13:05:10.445871 19253 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:10.466557 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:10.461076 19584 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:05:10.454566 19433 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:10.461479 19525 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:10.459071 19497 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.478205 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.451828 18829 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.461227 19395 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:10.453799 19209 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:10.482522 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:10.457924 19524 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.474252 19595 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:10.503067 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:10.503484 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 114643us
I20260709 13:05:10.478432 19525 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.479678 19594 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.513317 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.514585 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:10.482770 18922 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:05:10.523965 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:10.529906 15337 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:10.509392 19525 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:10.483134 19456 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.537479 19583 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:10.537766 19588 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:10.537998 19583 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.538283 19588 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.538412 19583 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:10.538694 19588 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:10.506980 19497 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.509392 19250 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:05:10.547197 19395 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.548713 18829 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.526012 19253 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.542199 19333 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:10.553251 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.556697 18922 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.560041 18922 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:10.562621 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 80191.6us
W20260709 13:05:10.563539 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 85394.1us
I20260709 13:05:10.564859 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.508064 19573 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.563855 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:10.573980 19573 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.574779 19601 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:10.563251 18922 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.571132 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:10.579854 18829 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.613862 19602 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:10.566120 19610 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:05:10.524852 19594 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:05:10.628810 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 114295us
I20260709 13:05:10.612349 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.532095 19428 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:10.629720 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 58708.7us
I20260709 13:05:10.536428 19433 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.570160 19598 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:05:10.631985 18829 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.633229 19250 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:10.638594 19250 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.639189 18829 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:10.639616 19250 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:10.611953 19527 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:10.642825 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.634481 18922 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:10.647320 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.648216 19250 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.651868 15194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46344
I20260709 13:05:10.652482 19333 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:10.653317 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.654063 15343 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:10.654318 19502 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:10.654928 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.650300 19555 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:05:10.655601 15343 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:10.655869 19555 consensus_queue.cc:1243] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:10.652554 15194 raft_consensus.cc:606] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Received request to transfer leadership
I20260709 13:05:10.656527 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.641072 19602 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:10.653872 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.657708 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.658864 15342 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:10.659842 19508 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:10.660248 19508 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:10.660338 19594 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:10.660423 15342 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:05:10.661087 19508 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.663218 15343 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:05:10.648396 18922 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.663403 19456 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.684690 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:05:10.685891 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54691.5us
I20260709 13:05:10.686225 18922 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:10.699949 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.700600 19555 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:05:10.702330 15179 tablet_service.cc:1558] Processing DeleteTablet for tablet c1011f7cfdb64b11bff42c90ec444dbe with delete_type TABLET_DATA_TOMBSTONED (TS 5e6eed5c7a6b4571b5f898002fc990d2 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:46344
I20260709 13:05:10.703254 19209 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:10.718128 19555 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:10.729471 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.721792 19395 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.730616 19550 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:05:10.710497 19527 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.727363 19555 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.745085 19253 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:10.746595 19186 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:05:10.750010 19610 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:10.762012 19610 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.763286 19610 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.764750 19610 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:10.762238 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.761411 19395 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:05:10.766978 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 46224.2us
I20260709 13:05:10.770536 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.755143 19612 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:10.784448 19621 tablet_replica.cc:333] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:05:10.767388 19588 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:10.787369 19555 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.788539 19588 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.791409 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.751767 19583 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.789951 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2344) took 2171 ms. Trace:
I20260709 13:05:10.776921 19598 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:10.791577 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:10.775429 19186 consensus_queue.cc:1243] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:05:10.804018 19576 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.659s	user 0.009s	sys 0.003s
I20260709 13:05:10.778726 19612 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.788832 19555 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.828945 19556 raft_consensus.cc:993] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:05:10.829517 19556 raft_consensus.cc:1081] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:05:10.792603 15263 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:10.830267 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.788604 19554 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:10.831171 19612 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.832993 19554 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.805364 19428 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:10.834015 19554 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.841264 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.841969 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:10.792246 15341 rpcz_store.cc:276] 0709 13:05:08.618205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.775287 (+157082us) service_pool.cc:224] Handling call
0709 13:05:09.155231 (+379944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:09.155630 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:09.579453 (+423823us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.934774 (+355321us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:09.934848 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:09.942275 (+  7427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.942539 (+   264us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.789767 (+847228us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400245c50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:10.789888 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7013,"prepare.queue_time_us":572387,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":58327,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6122,"spinlock_wait_cycles":872721792,"thread_start_us":656943,"threads_started":2,"wal-append.queue_time_us":439576}
I20260709 13:05:10.778956 19525 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.848618 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.848743 15263 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:10.850108 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.850253 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.850564 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.851109 19557 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.851336 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.852152 15193 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:05:10.852965 19611 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.853492 19611 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.855185 19594 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:10.855711 19617 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:05:10.855675 19594 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.857664 19594 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.858064 19594 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.858408 19594 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.859514 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.859753 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.851729 19557 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.860767 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.862071 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.862339 19557 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.862658 15197 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.863312 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.864199 15193 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:05:10.864779 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.865101 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.865464 15195 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:10.866737 19611 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.866886 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:10.872330 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:10.872098 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.843241 19554 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.883257 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.884438 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.884594 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.845423 19598 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:10.883129 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.889160 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.887712 19253 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.876470 19611 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:10.890399 19611 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.890792 19611 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:10.891172 19602 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.891650 19602 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.888080 19428 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.893136 19428 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.893904 19602 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.889912 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.895378 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:10.895689 19586 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.585s	user 0.000s	sys 0.003s
I20260709 13:05:10.896448 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.896605 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.897542 15189 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:10.898504 15189 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:10.899391 15189 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.884599 19525 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:10.907104 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:10.908838 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:10.908746 19253 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.904814 15195 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:05:10.881678 19562 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.923759 15195 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:10.924098 15195 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:10.927281 15195 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.927646 19253 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.928251 15195 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:10.928578 15197 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:10.929860 15197 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:10.931288 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:10.927676 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:10.936121 15195 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:10.937007 15194 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:10.911093 15189 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.941258 15197 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:10.876991 18922 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:10.944839 15189 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.945755 18922 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:10.944805 15188 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:10.951505 15872 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:10.931823 19525 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:10.954138 19565 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:10.924974 19562 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.956179 19502 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:10.956707 19502 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:10.957333 19562 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.958650 19502 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.962674 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.937070 19428 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:10.956051 19557 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:10.967372 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:10.964076 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:10.955633 19564 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:11.006865 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.007881 15337 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
I20260709 13:05:11.007957 15189 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:05:11.008675 15189 pending_rounds.cc:85] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 6
I20260709 13:05:11.009131 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:10.943324 19253 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:11.011382 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.017755 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.009001 15189 pending_rounds.cc:107] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:05:11.023823 15189 raft_consensus.cc:2889] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.024211 15343 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:11.024366 15338 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:11.026537 15345 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:11.026994 15341 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:10.974673 19557 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:05:11.028868 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 260419us
I20260709 13:05:11.030074 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.031363 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.032778 15194 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:11.031876 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:11.004911 19564 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:11.037060 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.038342 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.046518 15345 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:11.031003 19557 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:11.045087 15191 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:11.048203 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.039597 18829 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:11.035671 19428 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.052491 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.039448 19583 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.059996 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.015923 19612 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.049836 19318 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.052757 19570 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.006s
I20260709 13:05:11.064371 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.052644 19403 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:11.071658 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:11.076079 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.048834 19499 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:05:11.085255 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.086046 15192 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.084548 15191 raft_consensus.cc:2368] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
W20260709 13:05:11.066886 19619 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:05:11.089164 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.062268 18829 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:11.068434 19620 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
W20260709 13:05:11.133574 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67613.3us
I20260709 13:05:11.068444 19623 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.131798 19621 raft_consensus.cc:2243] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:11.148094 19621 raft_consensus.cc:2272] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:11.140661 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:11.092228 19594 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.145798 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.073992 19318 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.066789 19428 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:11.073369 19570 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:11.154393 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.068643 19593 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:05:11.070274 19609 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:05:11.155146 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:11.215334 15192 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:11.216357 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.071172 19564 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.215719 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.159777 19583 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:11.210054 19620 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:05:11.227450 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.153491 19623 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:11.223707 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 71630.6us
I20260709 13:05:11.214882 19603 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:11.233628 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.234817 19499 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:05:11.235944 19582 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.006s	user 0.010s	sys 0.003s
W20260709 13:05:11.237263 19628 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:05:11.232350 19632 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:11.239467 19594 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.224746 19625 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:05:11.240190 15194 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:11.219887 19583 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.221971 19593 consensus_queue.cc:1243] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:11.249518 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.258533 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.260831 15194 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:11.245112 19621 ts_tablet_manager.cc:1916] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:11.251787 19632 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.266206 15191 raft_consensus.cc:2410] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:05:11.266206 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.271451 19622 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:05:11.271791 19637 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:11.272663 19622 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:11.273046 19622 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.273859 19622 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.275477 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2373) took 1126 ms. Trace:
I20260709 13:05:11.276414 19524 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.276636 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df18975ee214645b49e472675883b73"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:11.277416 15192 raft_consensus.cc:606] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:11.259665 19499 consensus_queue.cc:1243] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:05:11.283169 15874 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:11.286036 19397 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:11.286924 19581 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.057s	user 0.004s	sys 0.000s
I20260709 13:05:11.252321 19603 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.289222 19603 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.272368 19637 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.278879 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.262358 19583 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.294329 15194 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:11.250747 19186 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:05:11.276010 15342 rpcz_store.cc:276] 0709 13:05:10.148821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.711402 (+562581us) service_pool.cc:224] Handling call
0709 13:05:10.720298 (+  8896us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:10.722539 (+  2241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:10.722570 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:10.731866 (+  9296us) log.cc:844] Serialized 52 byte log entry
0709 13:05:10.832387 (+100521us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:10.832414 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:10.832508 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:11.275148 (+442640us) raft_consensus.cc:1685] finished
0709 13:05:11.275179 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.275395 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1843,"raft.queue_time_us":2675,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":542,"thread_start_us":64889,"threads_started":1,"wal-append.queue_time_us":183862}
I20260709 13:05:11.290282 19632 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:11.318910 19318 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.289508 19557 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.320418 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.320935 19557 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:11.225289 18829 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.304857 19633 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:11.324349 19633 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:11.308717 19209 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:05:11.309988 15192 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:05:11.313846 19508 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:11.337872 19633 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.339051 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.339705 15264 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:05:11.340196 19623 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:11.343791 19635 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 13:05:11.320950 15196 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:11.302795 15193 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:11.321091 15191 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:11.262140 19594 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.358151 15194 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:11.366083 15191 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:11.336333 19622 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:11.327472 19603 consensus_queue.cc:1175] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:11.372323 19408 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:11.373895 19250 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:11.375017 18922 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:11.379653 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.379969 15874 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:11.387439 19428 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:11.416116 15346 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:11.416796 15340 raft_consensus.cc:1217] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Deduplicated request from leader. Original: 8.5->[10.6-12.7]   Dedup: 10.6->[12.7-12.7]
I20260709 13:05:11.417553 15340 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 13:05:11.391359 19570 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:11.366658 15191 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.399224 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.360723 19527 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.409720 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:11.424175 15343 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:11.409701 19250 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.419857 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.419631 15192 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:11.435549 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:11.434288 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:11.405853 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.422482 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:11.441606 15873 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:11.442343 15338 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:11.409585 15342 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:05:11.443954 15342 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.444459 15342 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:11.424763 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:11.420775 19611 consensus_meta.cc:287] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.004s
I20260709 13:05:11.450040 15869 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:11.412698 18922 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.457377 15842 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.462224 15870 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:05:11.464701 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 101513us
I20260709 13:05:11.465701 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.466312 15192 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:11.466485 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.467090 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.467693 15194 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:11.469040 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.418897 19408 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.471019 15341 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:11.474011 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.480871 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.481333 15872 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:11.479525 15268 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:11.482759 15270 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:11.479440 15263 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:11.484822 15873 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:11.473536 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.459054 15191 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.482071 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.486831 15343 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:11.488178 15263 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:11.489684 15264 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:11.490921 15266 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:11.460389 19612 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.494684 15192 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:11.493937 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:11.478332 19554 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 13:05:11.493465 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.498461 15268 raft_consensus.cc:1813] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Handling vote request from an unknown peer 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:11.499102 15268 raft_consensus.cc:2368] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:11.510357 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.470736 19633 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:11.474125 19594 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.497270 15190 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:11.521162 19630 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:11.516285 15191 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:11.440119 19527 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.470818 19525 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:11.519325 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50387us
I20260709 13:05:11.455861 19611 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.542126 19611 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.542788 19611 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:11.526378 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.545146 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.547490 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.548687 15268 raft_consensus.cc:2410] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:05:11.552675 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.511375 15345 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:11.539120 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:11.561697 19604 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.025s	user 0.006s	sys 0.000s
I20260709 13:05:11.572721 15189 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:11.559702 15342 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.574535 15344 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:11.575342 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.580085 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.587468 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.592195 15270 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:11.519908 19332 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:11.479835 19250 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.594633 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.598341 15268 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:11.594758 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.598681 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.599112 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.599323 15270 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.599392 15337 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:11.588456 15341 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 7.
I20260709 13:05:11.600251 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.539777 19594 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.601014 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.601557 15196 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:05:11.602361 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.603404 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.602632 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:11.604092 15337 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.604264 15196 raft_consensus.cc:2410] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:11.605154 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.606602 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.606314 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.608284 15342 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:11.611456 15345 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:11.615608 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.616102 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.619297 15337 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:11.626587 15270 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:11.631412 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.627664 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:11.627400 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 136249us
I20260709 13:05:11.635713 15268 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.607443 19633 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.636807 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.634161 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.600961 19544 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:11.637147 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.606628 19541 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:11.580305 19525 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.638914 15188 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:11.626829 19250 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:11.659641 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.660269 15269 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:11.661350 15192 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:11.654815 19524 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:11.640427 15270 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:11.634305 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:11.663177 19642 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.633757 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:11.664032 19639 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:05:11.638942 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.665460 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:11.665664 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.666277 19560 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:11.666428 15342 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:11.643990 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.626971 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:11.667665 15265 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.651450 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.667933 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.635803 15341 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:11.597643 19332 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.663726 19642 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.655560 15266 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:11.664062 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.671545 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.675627 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:11.672228 15264 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:11.675782 15271 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.615665 19594 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.674330 15238 leader_election.cc:400] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:11.671392 19433 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:11.688314 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:11.688769 19332 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.689674 19630 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:11.690163 19630 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:11.690202 15271 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:11.690873 19630 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:11.651671 19408 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.677924 19524 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:11.678257 15345 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:11.678905 15270 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:05:11.679874 15263 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:11.652789 19633 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.682413 15337 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:11.683451 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.684823 19525 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.684944 15269 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:11.697847 15264 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:11.686372 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.686842 15238 leader_election.cc:403] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:11.677460 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.698540 15343 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:11.698755 15266 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.699963 15268 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:11.672447 19541 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:11.702008 19541 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.702679 19642 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.649506 19632 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.710029 15193 raft_consensus.cc:2368] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8.
I20260709 13:05:11.710695 15268 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:11.709980 15265 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:11.713057 18944 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:11.713482 18944 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.713327 19583 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.715308 15196 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:11.715657 19583 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.716750 19527 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:11.728811 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54607us
I20260709 13:05:11.730320 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.734771 19594 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.736610 19594 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:11.736974 19633 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.737990 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.738188 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.739147 19594 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:11.740172 19637 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:11.740198 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.741051 19637 raft_consensus.cc:2764] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:05:11.742157 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.743953 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.744876 19637 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:11.745901 19637 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:11.746779 19563 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:11.747678 15264 raft_consensus.cc:2410] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:11.748420 19563 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:11.714474 18944 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.751530 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:11.751850 18944 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:11.752588 15870 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:11.710492 19525 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:11.762761 15196 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:11.763185 15196 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.763404 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.764199 15195 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:11.764721 15195 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.762745 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:11.719668 19632 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:11.767278 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:11.763902 15196 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.771839 15196 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:11.782498 15190 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:05:11.784411 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.785228 15268 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:11.785962 15265 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:11.786532 19564 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:11.786688 15264 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:11.789978 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:11.791281 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.791571 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.792083 15338 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:11.792595 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.794171 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.793546 19648 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:05:11.800562 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.802493 15339 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:11.785153 15197 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:11.804209 15197 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.796584 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:11.806646 15340 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 7: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:11.765756 15195 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.810180 15195 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:11.816025 15266 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
W20260709 13:05:11.819446 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.805346 15197 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.836272 15197 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.820159 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:11.838969 15266 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: [15.8-17.9]
I20260709 13:05:11.844668 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:11.854441 19648 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:11.862520 19648 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.859748 19403 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:11.861452 15237 leader_election.cc:400] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:11.818115 19560 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:05:11.865367 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.865002 15237 leader_election.cc:403] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:11.866974 19557 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:11.868994 19557 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:11.871418 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:11.863070 19648 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:11.876848 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.877449 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.877774 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.878189 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.878615 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.878926 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.891556 19602 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:11.892040 19602 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.851056 19563 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:05:11.894327 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.895237 15266 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:11.896297 15265 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:11.897607 15268 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:11.898728 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.899277 19403 raft_consensus.cc:2764] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:11.900242 15263 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:11.900017 19630 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:11.901486 15270 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:11.892390 19602 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:11.904735 15263 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:11.906600 15271 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:05:11.907303 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46344
I20260709 13:05:11.913410 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.921866 15197 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:05:11.922431 15197 pending_rounds.cc:85] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 7
I20260709 13:05:11.747013 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.922739 15197 pending_rounds.cc:107] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:05:11.923075 15197 raft_consensus.cc:2889] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.923313 15196 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:11.924584 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.929368 15267 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:11.926126 19403 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:11.929334 15270 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:11.912583 19622 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.928022 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
W20260709 13:05:11.924327 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 177382us
I20260709 13:05:11.934414 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:11.935925 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:11.936945 15263 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.928747 15195 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:11.940208 15189 raft_consensus.cc:606] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:05:11.940575 15189 raft_consensus.cc:614] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:11.940619 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.941943 15271 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:11.923768 19557 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:11.949805 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:11.950631 15269 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
W20260709 13:05:11.951313 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.920852 19565 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 13:05:11.958491 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.969434 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.958685 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:11.938572 19250 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:11.964125 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:11.925318 19563 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:05:11.939545 19622 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:11.975458 15338 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:11.976924 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:12.033869 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:12.021095 15192 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:05:12.036979 15342 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:12.037338 15192 pending_rounds.cc:85] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 8
I20260709 13:05:12.037746 15192 pending_rounds.cc:107] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:05:12.038071 15192 raft_consensus.cc:2889] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:11.943130 19524 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:12.007236 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:12.043064 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.045334 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.045688 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.046066 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.046556 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.047044 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.047914 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 77492.9us
I20260709 13:05:11.998167 19454 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:12.050570 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77178.2us
I20260709 13:05:11.958077 18938 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 13:05:11.991503 19250 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:11.959185 19403 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.060557 15271 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:05:11.966856 15267 raft_consensus.cc:2410] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:05:11.948786 19621 ts_tablet_manager.cc:1929] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:05:12.064894 15268 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:11.956707 19428 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:05:11.989064 19630 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.052248 19564 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:12.002753 19570 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:05:12.071108 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:12.081879 15271 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:11.968231 19632 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:05:12.052446 19557 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:12.075088 15342 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:12.070101 15263 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:12.075313 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:12.077960 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:12.088024 15267 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:12.088342 15265 raft_consensus.cc:2410] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:05:12.080235 15269 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:12.092989 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:12.083726 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.084870 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.085405 15266 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:12.032876 18922 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.093611 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:12.063653 19186 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:05:12.096500 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:12.096778 15269 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:12.072808 19564 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:12.065848 19403 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:12.105402 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50056.9us
I20260709 13:05:12.107939 15271 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:05:12.092453 19454 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:12.085773 19397 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:05:12.101082 19621 log.cc:1199] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/wals/c1011f7cfdb64b11bff42c90ec444dbe
I20260709 13:05:12.109555 15267 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:12.114197 15270 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:05:12.103315 19633 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:12.116181 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:12.114120 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:12.088270 19250 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:12.110150 18922 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:12.113955 19433 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:05:12.120993 19433 consensus_queue.cc:1243] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:12.122076 19397 consensus_queue.cc:1243] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:12.112509 19550 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:12.122467 19651 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:05:12.115684 19560 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:05:12.124790 19403 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:12.126346 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:12.127609 19622 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.133239 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.143579 15267 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:12.099378 19557 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.150014 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:12.155473 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 106312us
I20260709 13:05:12.143164 19632 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:12.145573 18829 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:12.145584 19633 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:12.183348 15264 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:12.176667 19564 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.164050 19541 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:12.143257 19428 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:05:12.201711 19621 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46344 (request call id 76) took 1558 ms. Trace:
I20260709 13:05:12.205595 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:12.208709 19557 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.195102 18829 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.181595 19632 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:12.210266 15267 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:12.212378 15264 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.215751 19633 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:12.196583 19541 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:12.224988 19564 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:12.225900 19541 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:12.229882 19664 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:05:12.230193 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.219203 18829 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:12.253814 15267 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:12.199272 19454 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:12.276759 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 81406.2us
I20260709 13:05:12.279402 15267 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:12.332180 15264 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:12.308797 15267 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:12.264115 19632 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.205217 19621 rpcz_store.cc:276] 0709 13:05:10.664033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.694201 (+ 30168us) service_pool.cc:224] Handling call
0709 13:05:10.727003 (+ 32802us) ts_tablet_manager.cc:1151] Deleting tablet c1011f7cfdb64b11bff42c90ec444dbe
0709 13:05:10.731912 (+  4909us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:05:11.776422 (+1044510us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:11.939797 (+163375us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:12.201620 (+261823us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238559,"tablet-delete.queue_time_us":23896,"thread_start_us":15151,"threads_started":1}
I20260709 13:05:12.372078 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:12.373184 15264 raft_consensus.cc:2410] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:12.376982 15267 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:05:12.384477 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:12.385105 15270 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:12.393875 15270 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:12.395190 15267 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:12.396591 15272 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:12.397557 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:12.492137 15266 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:12.400889 15269 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:05:12.493232 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.403437 15265 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:05:12.416772 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.405434 19557 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.416342 19403 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:12.470364 19654 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.440s	user 0.003s	sys 0.009s
W20260709 13:05:12.471789 19602 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.010s
I20260709 13:05:12.448622 19524 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:12.484061 19428 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.466707 19591 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.790s	user 0.004s	sys 0.002s
I20260709 13:05:12.489285 19564 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.484982 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.511281 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.513304 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:12.524816 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.516073 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.449533 19630 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.489296 19598 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.526223 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.526957 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.543537 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 256041us
I20260709 13:05:12.546119 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:12.546690 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:12.514890 19557 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:12.547998 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:12.553406 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:12.517637 19602 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.519631 19403 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.565857 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:12.537328 18938 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:12.537488 19524 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.527256 19662 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.570191 18938 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.526583 19428 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.570468 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:12.572559 15272 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:12.572724 15265 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:12.577349 15264 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:12.578787 15263 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.537200 19630 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:12.580950 15196 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:05:12.590389 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:12.595383 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.651440 15267 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:12.536240 19598 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.536724 19564 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.596295 15345 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:12.573210 19648 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.680s	user 0.015s	sys 0.007s
W20260709 13:05:12.651593 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.653533 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.653934 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.654245 15197 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.655164 15873 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:12.654131 15266 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:12.644894 15238 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.034s (SENT)
I20260709 13:05:12.659080 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.660010 15342 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:12.661204 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:12.662599 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:12.663183 15337 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:12.589107 19397 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:12.585866 19689 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:12.676169 15872 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:12.572633 19524 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.672231 15191 pending_rounds.cc:85] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 5
I20260709 13:05:12.679742 15191 pending_rounds.cc:107] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:05:12.680150 15191 raft_consensus.cc:2889] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.670792 19686 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.571374 19662 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.669294 19648 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:12.732518 19654 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:05:12.678989 19454 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:05:12.765484 19598 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:12.756588 18922 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.631s	user 0.012s	sys 0.000s
I20260709 13:05:12.792044 15269 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:12.795703 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 134576us
W20260709 13:05:12.794998 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 59982.3us
W20260709 13:05:12.798976 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 208369us
I20260709 13:05:12.800403 15188 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:12.802086 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:12.791723 19681 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:05:12.771950 19692 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.804023 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 146817us
I20260709 13:05:12.799795 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.809763 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.811295 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:12.734881 19686 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:12.803193 19691 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:05:12.871789 15337 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:12.805198 19693 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:12.813944 19557 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:12.875365 19403 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.879870 15345 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:12.809569 19602 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:12.875919 19687 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:05:12.879083 15192 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.812861 19570 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 13:05:12.910341 19564 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:12.911623 19688 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:05:12.911767 19662 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:12.912725 19695 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:05:12.913563 19648 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.914289 19686 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:12.914507 19660 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.735s	user 0.001s	sys 0.002s
I20260709 13:05:12.812037 19692 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.923471 19524 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.925575 19692 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.889377 19557 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:12.885962 18938 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:12.926221 19557 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:12.926407 19706 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:12.918236 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 108561us
I20260709 13:05:12.896409 19403 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:12.904361 19454 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:12.919623 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2393) took 1156 ms. Trace:
I20260709 13:05:12.932113 15188 rpcz_store.cc:276] 0709 13:05:11.761485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.761611 (+   126us) service_pool.cc:224] Handling call
0709 13:05:11.761940 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.800913 (+1038973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.916060 (+115147us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54000fb4d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:12.917382 (+  1322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385939328}
I20260709 13:05:12.916468 19630 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:12.926662 19557 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:12.933156 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:12.917948 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:12.934531 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 123315us
I20260709 13:05:12.926833 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1723) took 1013 ms. Trace:
I20260709 13:05:12.947490 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:12.929153 19667 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.745s	user 0.006s	sys 0.000s
I20260709 13:05:12.943753 15340 rpcz_store.cc:276] 0709 13:05:11.913021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.913128 (+   107us) service_pool.cc:224] Handling call
0709 13:05:11.923974 (+ 10846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.932958 (+  8984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.932989 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:11.940167 (+  7178us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.154614 (+214447us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:12.154652 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.154719 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:12.879130 (+724411us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:12.926527 (+ 47397us) raft_consensus.cc:1685] finished
0709 13:05:12.926549 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.926774 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26049,"raft.queue_time_us":9127,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8301,"spinlock_wait_cycles":23376640,"thread_start_us":153385,"threads_started":1,"wal-append.queue_time_us":183550}
W20260709 13:05:12.953567 18829 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.006s
I20260709 13:05:12.954026 18829 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.955346 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:12.955932 18829 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:12.959136 19698 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:12.959898 19698 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:12.961030 19698 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.928493 19705 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.963577 19709 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:12.933792 19403 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:12.979084 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:12.979331 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 259336us
I20260709 13:05:12.980259 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.949932 19657 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:12.984467 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.986359 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:12.978785 19403 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:12.988585 19433 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:12.990640 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:12.991940 19570 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:12.987174 19657 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.940124 19706 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:12.982707 19524 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:12.984047 19692 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:12.997232 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:12.999155 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:13.002166 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:12.986733 19702 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:13.024168 19657 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:13.010243 19508 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:13.028120 19508 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:13.015189 19648 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.015614 19712 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:05:13.016292 19665 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:05:13.015691 19541 consensus_meta.cc:287] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.786s	user 0.005s	sys 0.007s
W20260709 13:05:13.031111 19676 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.547s	user 0.000s	sys 0.009s
I20260709 13:05:12.992296 19715 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:05:13.005216 19696 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:05:12.977487 19705 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.035365 19705 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:13.018838 19706 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:13.006790 19662 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:05:13.004918 19709 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.005537 19711 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:05:12.993378 19704 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:12.985544 19454 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:05:13.031445 19541 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:13.040800 15870 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:13.042421 19541 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.050971 19717 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.051759 19557 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:13.054785 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55837.2us
I20260709 13:05:13.052839 19403 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.056021 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2137) took 1005 ms. Trace:
I20260709 13:05:13.056562 15268 rpcz_store.cc:276] 0709 13:05:12.050632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.050781 (+   149us) service_pool.cc:224] Handling call
0709 13:05:12.064648 (+ 13867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.066901 (+  2253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.055762 (+988861us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54004164d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:13.055942 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31056256}
I20260709 13:05:13.056893 19403 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.060788 19704 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:13.055104 19557 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.064469 15268 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:05:13.065759 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 396592us
I20260709 13:05:13.066836 15271 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:13.067852 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.068368 15263 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:05:13.008512 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:13.072160 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 63757.2us
I20260709 13:05:13.080538 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:13.081413 15263 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:13.085954 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:13.085743 15309 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:13.099407 19662 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:13.088071 19657 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:13.079282 18938 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:13.093394 19630 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:13.112486 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:13.093429 19403 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.095917 19711 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:13.113917 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:13.118198 15338 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:13.119184 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.116302 15343 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:13.103771 15263 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:13.094659 19544 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:05:13.092820 19563 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:05:13.092628 19541 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:05:13.158063 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:13.172559 15265 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.158788 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:13.159125 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.173753 15264 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:13.174656 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.175262 15264 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:05:13.175398 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.094405 19454 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:05:13.162063 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.188016 15272 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
W20260709 13:05:13.188216 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70072.9us
W20260709 13:05:13.176108 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.178445 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.179829 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:13.191586 15345 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:13.191315 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.185761 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:13.191375 15263 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:13.195053 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.195863 15267 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:13.117647 19630 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:13.184737 15338 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:13.205528 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:13.206272 15342 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:13.202853 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:13.207795 18829 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.208434 18829 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.210013 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:13.211051 15268 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:13.212069 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:13.213303 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:13.214507 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:13.215327 15337 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:05:13.150277 19657 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:13.116279 19707 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:05:13.225680 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:13.226655 15160 leader_election.cc:400] T c1011f7cfdb64b11bff42c90ec444dbe P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:13.223449 15162 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:13.199223 19649 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:13.232690 15265 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:13.230195 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:13.150839 19403 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.230906 19696 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:13.217768 19630 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:13.240135 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.204795 19711 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.120790 19680 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:05:13.239408 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:13.252213 18829 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.222916 19397 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:13.229297 19694 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.269428 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.257197 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:13.244973 19716 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.251487 19696 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.232429 19550 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:05:13.248404 19686 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:13.327280 18829 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:05:13.328330 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71224.6us
I20260709 13:05:13.253063 19564 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:05:13.262357 19649 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:05:13.373754 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.374532 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.375051 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.375394 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.377491 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:13.378376 15194 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:13.380757 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:13.368562 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:13.246244 19662 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:05:13.263577 19705 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:13.383213 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:13.405642 15192 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:13.406783 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:13.407549 15192 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
W20260709 13:05:13.373023 19660 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:05:13.327841 19696 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.411589 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:13.420933 15193 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.396364 19563 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:05:13.403775 19656 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.191s	user 0.004s	sys 0.000s
I20260709 13:05:13.431761 18938 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:13.433028 19403 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.396376 19499 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.415937 19454 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.321640 19694 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:13.438905 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70406.3us
I20260709 13:05:13.445225 19564 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:13.446322 19683 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.411375 19705 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.368965 19686 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.262746 19711 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.419337 19622 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.401019 19716 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:13.396009 18922 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:05:13.538897 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:13.539983 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 300645us
I20260709 13:05:13.540989 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:13.527506 19403 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.543324 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 273612us
I20260709 13:05:13.434427 19563 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:13.452105 18938 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:13.538311 19720 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 13:05:13.552165 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 254736us
W20260709 13:05:13.542644 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 139751us
I20260709 13:05:13.564574 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:13.538924 19702 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:13.412667 19657 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.542306 19564 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:13.584296 15238 leader_election.cc:336] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.590s (SENT)
I20260709 13:05:13.585068 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1721) took 1673 ms. Trace:
I20260709 13:05:13.496445 19499 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.554090 19705 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:13.580475 19563 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:13.583794 19403 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:13.412792 19649 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:13.664520 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 109161us
I20260709 13:05:13.551819 19686 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:13.539942 19454 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:13.649664 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:13.649791 15193 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:13.668944 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:13.654158 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 91541.3us
I20260709 13:05:13.649703 15344 rpcz_store.cc:276] 0709 13:05:11.911942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.912905 (+   963us) service_pool.cc:224] Handling call
0709 13:05:11.913298 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.913744 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.913783 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:11.922480 (+  8697us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.058785 (+136305us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:12.058838 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.058985 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.116983 (+1057998us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:13.581003 (+464020us) raft_consensus.cc:1685] finished
0709 13:05:13.581027 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.585001 (+  3974us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3205,"raft.queue_time_us":117,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":9578,"spinlock_wait_cycles":28771584,"thread_start_us":100679,"threads_started":1,"wal-append.queue_time_us":165595}
I20260709 13:05:13.653442 19564 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:13.543004 19397 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.650725 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:13.678342 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 94067.3us
I20260709 13:05:13.683274 19743 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:13.684136 19743 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:13.685222 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2222) took 1120 ms. Trace:
I20260709 13:05:13.685658 15269 rpcz_store.cc:276] 0709 13:05:12.565245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.565572 (+   327us) service_pool.cc:224] Handling call
0709 13:05:13.685028 (+1119456us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001b3854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:13.685160 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499816320}
I20260709 13:05:13.686239 15192 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:13.687260 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:13.683419 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2407) took 1027 ms. Trace:
I20260709 13:05:13.690742 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:13.561049 19622 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.688176 15197 rpcz_store.cc:276] 0709 13:05:12.655718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.656426 (+   708us) service_pool.cc:224] Handling call
0709 13:05:12.673460 (+ 17034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.177089 (+503629us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:13.317987 (+140898us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.547190 (+229203us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.547713 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.547851 (+   138us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:13.547890 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.547964 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.683177 (+135213us) raft_consensus.cc:1685] finished
0709 13:05:13.683198 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.683345 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":600265,"prepare.queue_time_us":192849,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":544071,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":41397,"thread_start_us":249095,"threads_started":3,"wal-append.queue_time_us":362989}
W20260709 13:05:13.697659 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 156742us
I20260709 13:05:13.698513 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:13.698921 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:13.651868 19648 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:13.594995 19716 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.551397 19683 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.714553 19675 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:13.715224 19722 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.705777 19677 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.686870 18922 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:13.694438 19702 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.696878 19662 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:13.738121 15192 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:13.714788 19727 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:13.736819 19718 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
I20260709 13:05:13.745921 15194 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:13.739657 19677 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.715252 19675 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.760787 18922 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:13.740520 19707 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:13.716729 19692 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.736059 19722 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:05:13.759577 19745 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:13.716144 19714 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.795405 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 256553us
W20260709 13:05:13.794956 15238 leader_election.cc:336] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.662s (SENT)
I20260709 13:05:13.820631 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:13.705972 19648 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:13.769097 19724 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.797240 19727 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.797612 19499 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.803897 19550 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:05:13.831910 15238 leader_election.cc:336] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.690s (SENT)
I20260709 13:05:13.867612 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:13.869124 15238 leader_election.cc:336] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.709s (SENT)
I20260709 13:05:13.869655 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:13.818300 19570 consensus_meta.cc:287] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.821s	user 0.006s	sys 0.005s
I20260709 13:05:13.811744 19707 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:13.840102 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 141681us
I20260709 13:05:13.832840 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:13.821465 19672 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.024s	sys 0.031s
W20260709 13:05:13.823055 19733 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.147s	user 0.000s	sys 0.005s
W20260709 13:05:13.824465 19737 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 13:05:13.871685 15238 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.632s (SENT)
W20260709 13:05:13.882622 15238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.849s (SENT) [suppressed 21 similar messages]
I20260709 13:05:13.827973 19702 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.823364 19742 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:13.877338 19707 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:13.799149 19662 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:13.819957 19692 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:13.878851 19672 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.024s	sys 0.031s
I20260709 13:05:13.862799 19727 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.876778 19689 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:13.873065 19524 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:13.880198 19570 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:13.879881 19550 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:13.885571 19499 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.825280 18922 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:13.909073 19734 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.059s	user 0.000s	sys 0.005s
I20260709 13:05:13.927389 19743 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:13.915489 19732 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:05:13.920260 19499 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.919896 19677 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.927081 19403 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:13.909507 19751 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:05:13.910593 19747 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 13:05:13.919307 19738 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
W20260709 13:05:13.915723 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.899202 19758 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:05:13.925640 18938 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.894204 19711 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:13.924916 19630 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.000s
I20260709 13:05:13.825448 19714 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:13.902674 19749 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:05:13.936110 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:13.983225 19433 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.929708 19735 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:05:13.928740 19761 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:13.937950 19683 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.853788 19724 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.939258 19648 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:13.941488 19675 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:13.943943 19739 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:05:13.946604 19454 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:13.947190 19622 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:13.949110 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:13.932932 19755 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:13.921362 19692 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:13.951789 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 96677.1us
I20260709 13:05:13.899701 19702 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.990342 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.929136 19721 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.558s	user 0.000s	sys 0.002s
I20260709 13:05:13.942416 19564 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:13.993290 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.002637 15869 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:13.986683 19751 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:14.022177 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 189410us
I20260709 13:05:14.047740 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:14.040845 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:14.043485 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.055280 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.013741 19428 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.057020 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2406) took 1401 ms. Trace:
I20260709 13:05:14.059712 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.072052 15340 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:14.063376 19755 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:14.072743 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:14.073480 19760 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:14.074651 19685 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.486s	user 0.007s	sys 0.007s
I20260709 13:05:14.075088 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.095726 15337 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 7.
W20260709 13:05:14.078505 19696 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.630s	user 0.008s	sys 0.000s
I20260709 13:05:14.080636 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.003576 19630 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:14.015739 19433 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.015071 19550 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.055379 19692 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:14.050800 19751 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:14.055670 19648 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.059821 15191 rpcz_store.cc:276] 0709 13:05:12.655416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.655583 (+   167us) service_pool.cc:224] Handling call
0709 13:05:12.672017 (+ 16434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:13.107142 (+435125us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.107173 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:13.107706 (+   533us) log.cc:844] Serialized 52 byte log entry
0709 13:05:13.537212 (+429506us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:13.537259 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.537338 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.056816 (+519478us) raft_consensus.cc:1685] finished
0709 13:05:14.056837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.056964 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382132,"raft.queue_time_us":425297,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":15039,"thread_start_us":365623,"threads_started":1,"wal-append.queue_time_us":567711}
I20260709 13:05:14.114449 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.116192 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.123769 15872 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:14.124433 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:14.016947 19761 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:14.129542 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 427026us
I20260709 13:05:14.130018 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.045573 19702 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.122430 19692 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.177836 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.104594 19563 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.182060 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:14.135138 19570 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:14.186478 15338 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:14.105815 19696 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.168175 19622 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.190235 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 290) took 1664 ms. Trace:
I20260709 13:05:14.172325 19692 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:14.156278 19675 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:14.125569 19686 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.171185 19524 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:14.196166 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:14.193683 15189 rpcz_store.cc:276] 0709 13:05:12.525540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.526983 (+  1443us) service_pool.cc:224] Handling call
0709 13:05:12.541189 (+ 14206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:12.541417 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.541443 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.048993 (+507550us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:13.049506 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.116927 (+ 67421us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:13.267437 (+150510us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.416740 (+149303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.416845 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.928452 (+511607us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:14.189969 (+261517us) raft_consensus.cc:1685] finished
0709 13:05:14.189998 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.190166 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165693,"prepare.queue_time_us":252849,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":182778,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":90198,"spinlock_wait_cycles":196343936,"thread_start_us":132491,"threads_started":2,"wal-append.queue_time_us":270546}
I20260709 13:05:14.136210 19648 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.212142 19648 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.213899 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:14.221200 19730 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.790s	user 0.002s	sys 0.000s
I20260709 13:05:14.224858 19694 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.102466 19760 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:14.226912 19693 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.227633 19693 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.233642 19563 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.205827 19499 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.206748 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:14.209755 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:14.240012 15189 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:14.187476 19725 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:14.246091 15194 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:14.247424 15337 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:14.253366 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:14.191478 19758 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:14.249434 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.255155 15194 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:05:14.256282 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.256032 15194 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:14.257028 15868 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:05:14.256731 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.192417 19662 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:14.262694 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.263599 15346 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:14.204566 19675 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.266332 15194 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.301317 15194 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:14.301285 15191 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:14.190644 19570 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.330267 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.245110 19648 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:14.334506 15346 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:05:14.341830 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 203147us
I20260709 13:05:14.300129 19675 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:14.343395 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 164416us
I20260709 13:05:14.247996 19524 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.208086 19622 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:14.177433 19755 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.390774 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:14.368366 19690 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.634s	user 0.000s	sys 0.034s
I20260709 13:05:14.267474 19725 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.336665 18922 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:14.339083 19564 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:14.449254 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 203583us
I20260709 13:05:14.265870 19758 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:14.459240 19770 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 13:05:14.459417 19769 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:05:14.459856 19727 consensus_meta.cc:287] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.000s
I20260709 13:05:14.460265 19630 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.462128 19433 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.465029 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2404) took 2238 ms. Trace:
I20260709 13:05:14.465431 15190 rpcz_store.cc:276] 0709 13:05:12.226435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.226605 (+   170us) service_pool.cc:224] Handling call
0709 13:05:12.237418 (+ 10813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:12.460487 (+223069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.460531 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:12.474130 (+ 13599us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.587132 (+113002us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:12.587173 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.587247 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.331494 (+1744247us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:14.464719 (+133225us) raft_consensus.cc:1685] finished
0709 13:05:14.464739 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.464967 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50798,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":5675904,"thread_start_us":293925,"threads_started":2,"wal-append.queue_time_us":181159}
I20260709 13:05:14.352707 19648 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:14.563251 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 312294us
I20260709 13:05:14.533350 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.564375 15346 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:14.565497 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:14.475643 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.550765 15194 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:05:14.571271 15194 pending_rounds.cc:85] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 11
I20260709 13:05:14.571774 15194 pending_rounds.cc:107] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:05:14.572190 15194 raft_consensus.cc:2889] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:14.575706 19785 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.553349 19761 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.577469 19758 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:14.638199 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:14.562992 19760 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:14.562906 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 140722us
I20260709 13:05:14.577490 15869 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:14.503563 19771 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:05:14.641361 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2425) took 1180 ms. Trace:
I20260709 13:05:14.554136 19696 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:14.553066 19776 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:05:14.502357 19773 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:05:14.646930 15189 rpcz_store.cc:276] 0709 13:05:13.460733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.253595 (+792862us) service_pool.cc:224] Handling call
0709 13:05:14.294816 (+ 41221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:14.295287 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.295330 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:14.325667 (+ 30337us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.640907 (+315240us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:14.640981 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.641074 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.641133 (+    59us) raft_consensus.cc:1685] finished
0709 13:05:14.641150 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.641292 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31626,"raft.queue_time_us":4294,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9051,"thread_start_us":275473,"threads_started":1,"wal-append.queue_time_us":229432}
I20260709 13:05:14.511544 19403 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:14.467808 18922 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.652655 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:14.642935 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:14.642319 19705 consensus_meta.cc:287] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.967s	user 0.012s	sys 0.000s
I20260709 13:05:14.530740 19693 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.672358 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.670722 19781 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:05:14.664245 19707 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 13:05:14.679157 19250 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:14.679661 19707 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.682089 19707 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:14.682695 19751 consensus_meta.cc:287] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.002s
I20260709 13:05:14.683228 19758 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:14.687399 19758 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:14.666524 19403 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.688337 18922 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.688512 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2399) took 2568 ms. Trace:
I20260709 13:05:14.688912 19686 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.576390 19785 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.688849 15195 rpcz_store.cc:276] 0709 13:05:12.119701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.119829 (+   128us) service_pool.cc:224] Handling call
0709 13:05:12.120210 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:12.264681 (+144471us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:12.491251 (+226570us) log.cc:844] Serialized 14 byte log entry
0709 13:05:12.541876 (+ 50625us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:14.066938 (+1525062us) spinlock_profiling.cc:243] Waited 8.39 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:14.067529 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.187289 (+119760us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:14.187338 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.188509 (+  1171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.688217 (+499708us) raft_consensus.cc:1685] finished
0709 13:05:14.688310 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.688451 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36771,"prepare.queue_time_us":114445,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":17850,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":28799,"spinlock_wait_cycles":19288448,"thread_start_us":488940,"threads_started":4,"wal-append.queue_time_us":335412,"wal-append.run_cpu_time_us":2382,"wal-append.run_wall_time_us":1273084}
I20260709 13:05:14.683945 19783 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:14.691483 19783 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.691859 19783 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:14.687754 19758 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:14.695924 19622 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:14.696640 19758 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.698028 19758 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:14.659124 19743 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.691504 19785 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.702041 19743 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:14.702240 19751 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.671218 19705 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.704492 19751 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.705951 19705 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:14.706987 19779 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:05:14.710664 19648 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.713011 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:14.720638 19783 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.726200 19783 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.727175 19622 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:14.728871 19743 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.729424 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:14.720721 19689 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.820s	user 0.006s	sys 0.006s
I20260709 13:05:14.731490 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:14.745009 15346 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.746122 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:14.747187 19686 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:14.732008 19705 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:14.734541 19648 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.750156 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:14.650125 19760 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:14.460282 19727 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.736410 19693 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.745970 19781 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:14.757186 19781 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:14.757536 19692 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.003s
I20260709 13:05:14.757632 19781 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:14.747954 19250 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:14.667131 19524 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.759485 19702 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:14.740675 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 68785.8us
I20260709 13:05:14.752341 18922 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:14.750029 19689 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:14.749823 19622 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:14.811380 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:14.811591 19622 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.812405 18922 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:14.747923 19686 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:05:14.754659 19648 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:14.818604 19648 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:14.733639 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.819360 15340 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:05:14.820487 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.754688 19705 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.824044 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2421) took 1408 ms. Trace:
I20260709 13:05:14.824616 15192 rpcz_store.cc:276] 0709 13:05:13.415929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.686976 (+271047us) service_pool.cc:224] Handling call
0709 13:05:14.823785 (+1136809us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54003e53d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:14.823948 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114441600}
I20260709 13:05:14.824640 19705 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.760746 19727 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.828014 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:14.828814 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:14.828850 15869 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:14.829627 15188 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:14.830096 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2414) took 1447 ms. Trace:
I20260709 13:05:14.830390 15188 rpcz_store.cc:276] 0709 13:05:13.382290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.382426 (+   136us) service_pool.cc:224] Handling call
0709 13:05:14.828706 (+1446280us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8eee 0000000000375939 00007f36ea65c1e0 00007f36ea7250c4 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:05:14.830032 (+  1326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4786432}
I20260709 13:05:14.831470 15870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 360) took 2644 ms. Trace:
I20260709 13:05:14.831832 15870 rpcz_store.cc:276] 0709 13:05:12.187212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.187376 (+   164us) service_pool.cc:224] Handling call
0709 13:05:12.187710 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.041260 (+853550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.831217 (+1789957us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b540068f6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:14.831373 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961506560}
I20260709 13:05:14.758739 19781 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:14.833308 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48159.7us
I20260709 13:05:14.761876 19675 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.762775 19693 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.836020 19693 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.745299 19758 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:05:14.761214 15238 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.203s (SENT)
W20260709 13:05:15.136885 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 375679us
I20260709 13:05:14.758160 19692 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:14.785785 15346 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:15.139518 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:15.140264 15346 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.140481 19692 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.815148 19793 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:14.833592 19781 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.141665 15162 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:15.142072 19793 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.142632 19742 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:15.143227 19742 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:14.836071 19675 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:14.765089 19760 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.144340 19793 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:15.144137 19742 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.145080 19760 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:14.840266 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:15.145172 19632 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:15.145694 15340 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:15.146595 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.844689 19598 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:14.859277 15870 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:14.860111 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 325) took 1696 ms. Trace:
I20260709 13:05:14.884541 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:14.887526 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.147835 15270 rpcz_store.cc:276] 0709 13:05:13.163713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.196999 (+ 33286us) service_pool.cc:224] Handling call
0709 13:05:13.197370 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.201892 (+  4522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.201936 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.220032 (+ 18096us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.317399 (+ 97367us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:13.317443 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.317520 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.942281 (+624761us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b4800061a58. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:05:14.848955 (+906674us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b24001100a8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265efb0 00007f36e52d5488 00007f36e52d5be8 00007f36e52ad398 00007f36e52a876a 00007f36e52a7bb6
0709 13:05:14.859865 (+ 10910us) raft_consensus.cc:1685] finished
0709 13:05:14.859889 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.860040 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4018,"raft.queue_time_us":8446,"raft.run_cpu_time_us":1713,"raft.run_wall_time_us":723328,"spinlock_wait_cycles":29025536,"thread_start_us":66714,"threads_started":1,"wal-append.queue_time_us":322671}
W20260709 13:05:14.889217 19774 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.399s	user 0.000s	sys 0.007s
I20260709 13:05:15.159318 19598 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:15.159801 19759 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:14.902225 19666 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:14.924075 19745 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:15.161489 19666 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:14.929198 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:15.161995 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:15.162201 15337 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:15.162571 15340 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:14.911609 19714 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:15.002204 19725 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:15.159235 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 274765us
I20260709 13:05:15.164523 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:15.165616 15312 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:14.936884 19508 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.166648 19508 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.167409 19792 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:15.005743 15222 heartbeater.cc:646] Failed to heartbeat to 127.13.181.62:42621 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.181.62:42621 timed out after 15.000s (SENT)
I20260709 13:05:15.166615 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:15.171454 19703 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:15.034973 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.173168 15268 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:15.035995 15263 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:15.046037 19777 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.585s	user 0.000s	sys 0.003s
I20260709 13:05:15.052068 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2422) took 1089 ms. Trace:
I20260709 13:05:15.176791 15344 rpcz_store.cc:276] 0709 13:05:13.963073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.963266 (+   193us) service_pool.cc:224] Handling call
0709 13:05:13.963756 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.175678 (+211922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.175720 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:14.175772 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:14.175818 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.051826 (+876008us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001761d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:15.051879 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.052007 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486844288}
I20260709 13:05:15.178241 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:15.052817 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.040302 15872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58400 (request call id 310) took 1104 ms. Trace:
I20260709 13:05:15.054754 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.179737 15269 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:15.054848 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2430) took 1051 ms. Trace:
I20260709 13:05:15.070386 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2425) took 1103 ms. Trace:
I20260709 13:05:15.062319 19724 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.118878 18938 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:15.128244 19550 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:15.128441 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 378347us
W20260709 13:05:15.132469 19729 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.806s	user 0.002s	sys 0.000s
W20260709 13:05:15.133774 19583 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260709 13:05:15.106987 19602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.894s	user 0.029s	sys 0.018s
I20260709 13:05:14.798839 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:14.688393 19403 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.187150 19550 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:15.191737 19550 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:15.192821 19403 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.193619 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2426) took 1226 ms. Trace:
I20260709 13:05:15.194448 19759 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:14.843364 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2418) took 1444 ms. Trace:
I20260709 13:05:15.146863 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:15.200050 15339 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:05:15.200479 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53690.6us
I20260709 13:05:15.201681 19583 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:15.202101 19583 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.150666 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.203150 15270 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:15.157153 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.204046 15266 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:15.159749 19598 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:15.162418 19666 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:15.176097 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.207798 15268 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:15.202515 19583 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:15.209474 19724 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:15.202188 19792 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:05:15.161715 19745 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:15.220418 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82882.8us
I20260709 13:05:15.081768 19454 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:15.180812 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.214813 15340 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
W20260709 13:05:15.180974 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.182834 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.183568 15344 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:15.181000 15341 rpcz_store.cc:276] 0709 13:05:13.966689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.967245 (+   556us) service_pool.cc:224] Handling call
0709 13:05:13.994242 (+ 26997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.994516 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:14.094809 (+100293us) log.cc:844] Serialized 14 byte log entry
0709 13:05:14.331615 (+236806us) log.cc:844] Serialized 14 byte log entry
0709 13:05:14.836286 (+504671us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800366be0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:14.880871 (+ 44585us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b1800366be0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:14.935014 (+ 54143us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b1800366be0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:15.069871 (+134857us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b1800366be0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:05:15.069994 (+   123us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:15.070052 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:15.070120 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.070192 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.070320 (+   128us) inbound_call.cc:177] Queueing success response
0709 13:05:15.116795 (+ 46475us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800366be0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
Metrics: {"mutex_wait_us":82689,"prepare.queue_time_us":126965,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":283635,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":233,"spinlock_wait_cycles":170475776,"thread_start_us":535038,"threads_started":3,"wal-append.queue_time_us":366625}
I20260709 13:05:15.179354 15872 rpcz_store.cc:276] 0709 13:05:13.935700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.936585 (+   885us) service_pool.cc:224] Handling call
0709 13:05:13.937486 (+   901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.126348 (+188862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.039995 (+913647us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54006301d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:15.040179 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428001664}
W20260709 13:05:15.228492 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45726.6us
I20260709 13:05:15.185721 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.229285 15272 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:15.181488 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.229745 15263 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:15.188122 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:15.231632 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:15.185067 15337 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:15.199198 15197 rpcz_store.cc:276] 0709 13:05:13.398649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.716141 (+317492us) service_pool.cc:224] Handling call
0709 13:05:13.716554 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.820518 (+103964us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:13.820545 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.821001 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.095313 (+274312us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:14.095376 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.842942 (+747566us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54001e64d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:14.842988 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.843069 (+    81us) raft_consensus.cc:1685] finished
0709 13:05:14.843081 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.843296 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4200,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":238254848,"thread_start_us":219905,"threads_started":1,"wal-append.queue_time_us":403288}
I20260709 13:05:15.215843 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.232620 15268 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:15.180146 15346 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
W20260709 13:05:15.190337 19602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.989s	user 0.029s	sys 0.018s
I20260709 13:05:15.180555 15338 rpcz_store.cc:276] 0709 13:05:14.003114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.003265 (+   151us) service_pool.cc:224] Handling call
0709 13:05:14.019414 (+ 16149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:14.186928 (+167514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.054635 (+867707us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b5400424854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:15.054776 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383785856}
I20260709 13:05:15.227805 15269 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:15.193984 15345 rpcz_store.cc:276] 0709 13:05:13.967597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.967748 (+   151us) service_pool.cc:224] Handling call
0709 13:05:13.968235 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.989870 (+ 21635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.989918 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.990539 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.248742 (+258203us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:14.248800 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.248888 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:15.045429 (+796541us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:15.193327 (+147898us) raft_consensus.cc:1685] finished
0709 13:05:15.193348 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:15.193557 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16544,"raft.queue_time_us":31417,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":15404,"spinlock_wait_cycles":18843008,"thread_start_us":232053,"threads_started":1,"wal-append.queue_time_us":351582}
I20260709 13:05:15.236653 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.237336 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2438) took 1100 ms. Trace:
I20260709 13:05:15.237726 15344 rpcz_store.cc:276] 0709 13:05:14.137114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.179003 (+1041889us) service_pool.cc:224] Handling call
0709 13:05:15.183416 (+  4413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.237126 (+ 53710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:15.237286 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:15.219344 19768 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.873s	user 0.008s	sys 0.008s
I20260709 13:05:15.239379 19454 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.241156 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.233985 15266 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:15.241897 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.243062 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.244192 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.247891 15269 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:15.244995 15272 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:15.249732 15263 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:15.251632 15270 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:15.252602 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.251679 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.253293 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.253907 15192 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:15.253297 15266 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:15.254494 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.253177 15272 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:15.255097 15263 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.255759 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:15.257409 15238 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.964s (SENT)
I20260709 13:05:15.255304 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.259614 15193 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.259819 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.259684 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.235458 19714 raft_consensus.cc:2764] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:05:15.232128 19696 raft_consensus.cc:2764] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:05:15.222431 19745 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.235421 19765 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:15.255541 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.275661 15195 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:15.262425 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.262897 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:15.265192 15268 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:15.265589 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.235051 19675 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:15.255470 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.269451 15263 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
W20260709 13:05:15.271494 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 80770.3us
I20260709 13:05:15.277796 15270 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:15.279657 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.282617 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.283931 15189 raft_consensus.cc:2368] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12.
I20260709 13:05:15.240414 19743 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:05:15.285647 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:15.286152 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49589us
I20260709 13:05:15.287823 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.288071 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.288810 15266 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:05:15.255615 19186 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:15.293978 15194 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:15.224088 19550 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.255574 19403 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.285038 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:15.291867 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.301478 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.301802 15197 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:15.292606 15270 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:15.296060 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.302651 15191 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:15.289978 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.306016 15266 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:15.311906 15195 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:15.313352 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.314388 15195 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:15.279778 19765 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:15.220829 19598 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:15.320986 15193 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:15.255049 19781 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:05:15.328339 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.328490 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:15.331348 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.333760 15193 raft_consensus.cc:2368] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8.
I20260709 13:05:15.289073 19704 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:15.265026 19727 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:05:15.266160 19758 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:05:15.326797 19765 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:15.270774 19783 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:05:15.293534 19692 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:15.315908 19792 raft_consensus.cc:2764] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:05:15.341766 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:15.343618 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:15.347074 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45695.1us
I20260709 13:05:15.347755 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.324887 19759 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:15.360474 15192 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:15.354806 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.334656 19186 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:15.328949 19684 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:05:15.327297 19766 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:15.361413 19692 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.346015 19742 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:15.362416 15197 raft_consensus.cc:2368] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:15.362310 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.363260 15189 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:15.325766 19622 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:05:15.361464 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.316017 19403 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.374315 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.474834 15192 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:15.474931 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:15.471693 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 141466us
I20260709 13:05:15.476590 19717 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:15.476972 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:15.477656 15842 leader_election.cc:336] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.879s (SENT)
I20260709 13:05:15.479343 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.377925 19186 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:15.479851 15312 leader_election.cc:400] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12.
I20260709 13:05:15.443624 19787 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.367290 19550 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.482378 19787 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.483464 15343 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:15.457734 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:15.484248 15269 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:15.424530 15272 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:15.365782 19454 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:15.365034 19766 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.490387 19766 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.436038 19704 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.491768 19704 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.493458 19693 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:15.494216 19704 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.494050 19693 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:15.494777 19704 raft_consensus.cc:476] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Not starting pre-election -- already a leader
I20260709 13:05:15.370739 19692 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.436046 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.496243 19693 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:15.496644 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.497355 15189 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:15.497870 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.364310 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.499188 15195 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:15.499119 19693 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:15.471439 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 184332us
I20260709 13:05:15.499796 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.507747 15194 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:15.508567 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.509053 15194 raft_consensus.cc:2376] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15. Re-sending same reply.
I20260709 13:05:15.475914 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.481086 15312 leader_election.cc:403] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:05:15.479846 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:15.425004 18922 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:05:15.510926 15265 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:05:15.436095 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 68241.7us
I20260709 13:05:15.498180 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.499950 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.420023 15188 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:15.377198 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.515010 15197 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:15.436477 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 75093.1us
I20260709 13:05:15.411655 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.352808 19598 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:15.500758 15191 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:15.516050 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:15.506035 15269 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
W20260709 13:05:15.532440 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 52894us
I20260709 13:05:15.536981 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.537899 15194 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:15.537726 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:15.352028 19706 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:15.536008 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.541142 19816 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:15.541647 19816 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:15.541975 19819 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:15.536418 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.543306 19826 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:15.538800 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:15.576339 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.542033 19816 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:15.551260 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71998.5us
I20260709 13:05:15.574532 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.574640 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.577487 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.436228 19632 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:15.579089 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 63157.6us
I20260709 13:05:15.630122 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:15.630432 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.631479 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.418146 19725 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:15.581301 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.578293 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:15.631707 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.584950 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.585282 15269 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:15.501861 19714 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:15.418102 19783 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.168s
I20260709 13:05:15.406410 19742 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:15.481138 19186 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:15.735183 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 156987us
I20260709 13:05:15.447328 19762 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:05:15.657804 15238 leader_election.cc:336] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.887s (SENT)
I20260709 13:05:15.752231 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:15.753049 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 95315.3us
I20260709 13:05:15.575575 19826 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:15.554665 19706 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.507308 19693 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.553730 19819 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.369361 19583 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:15.637766 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:15.773169 15192 raft_consensus.cc:606] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:15.773555 15192 raft_consensus.cc:614] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:15.774483 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.698009 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.775310 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:15.735648 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 310447us
W20260709 13:05:15.776783 15238 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.936s (SENT)
I20260709 13:05:15.777478 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:15.539321 19766 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:15.692028 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:15.739251 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 107597us
I20260709 13:05:15.577646 19717 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:15.536623 19454 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12.
I20260709 13:05:15.413878 19782 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:15.795092 15189 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:15.795003 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.775137 19819 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:15.749632 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:15.803373 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 53955.7us
I20260709 13:05:15.804858 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:15.754472 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:15.751173 15193 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:15.633970 19703 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:15.711408 19763 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:15.756845 19725 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:15.763621 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:15.762492 19680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.351s	user 0.007s	sys 0.031s
I20260709 13:05:15.763172 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:15.830127 15872 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:05:15.765813 19762 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:15.628001 19698 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:15.775444 15195 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:15.448416 19759 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:15.779582 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:15.748921 19792 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:15.842486 15193 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:15.747606 19712 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:15.782130 15192 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:15.884907 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:15.806813 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52432.2us
I20260709 13:05:15.802110 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.754688 15269 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:15.952786 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.953588 15194 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:15.954463 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.780633 19833 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:15.823876 15190 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:15.851681 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.793442 19826 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:15.859511 19825 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 13:05:15.860389 19830 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:15.819888 19832 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:05:15.826750 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.975240 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:15.975512 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.879388 15271 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:05:15.820075 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 303195us
I20260709 13:05:15.885864 15192 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:16.101356 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.102562 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.818311 19583 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:15.691990 19632 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:15.819494 19675 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:16.198485 19675 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:15.829885 19680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.430s	user 0.008s	sys 0.031s
W20260709 13:05:15.846547 19710 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:05:12.767604 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.13.181.1:39515 (local address 127.0.0.1:40254)
0709 13:05:12.989527 (+221923us) negotiation.cc:107] Waiting for socket to connect
0709 13:05:12.989647 (+   120us) client_negotiation.cc:175] Beginning negotiation
0709 13:05:13.054212 (+ 64565us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:05:15.845297 (+2791085us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.13.181.1:39515: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":194648,"thread_start_us":171876,"threads_started":1}
I20260709 13:05:15.802362 19742 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.767620 19693 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:15.758468 19706 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:15.751787 19714 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:16.393649 19714 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:15.790326 19717 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:16.395273 19717 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:15.783849 19766 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.402715 19766 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:15.794644 19782 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:15.893210 19762 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.828462 19696 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:16.427345 19696 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.428313 19696 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.827502 19705 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:16.431821 19705 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:16.432283 19705 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:12.733502 15082 catalog_manager.cc:5028] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): tablet c1011f7cfdb64b11bff42c90ec444dbe (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
W20260709 13:05:16.435945 15082 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 3.84086e+06us
I20260709 13:05:15.822669 19763 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:16.438759 19763 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:15.832738 19703 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.443871 19693 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:15.864775 19759 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.925390 19836 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.926478 19816 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.476199 19836 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.477579 19816 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.935787 19835 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:15.936575 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.478528 19836 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.478430 19835 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.481504 19835 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:16.482191 15869 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:16.484088 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:16.484733 15338 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:15.946143 15238 leader_election.cc:336] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.849s (SENT)
I20260709 13:05:15.955634 15264 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:05:16.486740 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:16.486943 15870 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:16.487190 15345 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:16.487861 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2181) took 1478 ms. Trace:
I20260709 13:05:16.488372 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:16.488271 15264 rpcz_store.cc:276] 0709 13:05:15.009577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.902805 (+893228us) service_pool.cc:224] Handling call
0709 13:05:15.955309 (+ 52504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.486819 (+531510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.487678 (+   859us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b5400290250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:16.487794 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119628672}
I20260709 13:05:16.489717 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.490083 19762 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:15.956259 15194 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:16.491760 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.492674 15341 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:16.492780 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.930773 19819 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.493804 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:16.494335 19762 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:16.494843 19762 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.495133 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:16.495445 19819 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:15.970428 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:15.989580 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.496243 15190 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:16.496948 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.007748 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.497907 15195 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:16.498253 15197 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 8: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:16.006702 19832 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:16.499114 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.500087 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:16.500028 19832 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.500988 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:16.494539 15868 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:05:16.028095 19847 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:05:15.967115 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:40254 (local address 127.13.181.1:39515)
0709 13:05:16.025781 (+ 58666us) server_negotiation.cc:207] Beginning negotiation
0709 13:05:16.025815 (+    34us) server_negotiation.cc:400] Waiting for connection header
0709 13:05:16.025873 (+    58us) server_negotiation.cc:408] Connection header received
0709 13:05:16.026032 (+   159us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:05:16.026061 (+    29us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:05:16.026370 (+   309us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:05:16.026883 (+   513us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40254: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":38251,"thread_start_us":9686,"threads_started":1}
I20260709 13:05:16.032462 19838 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.041692 19724 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:16.052726 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 268562us
I20260709 13:05:16.020972 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1739) took 1376 ms. Trace:
I20260709 13:05:16.502820 19838 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:16.503345 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:16.503211 15346 rpcz_store.cc:276] 0709 13:05:14.644315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.233512 (+589197us) service_pool.cc:224] Handling call
0709 13:05:15.233760 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.256131 (+ 22371us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:15.270042 (+ 13911us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.420285 (+150243us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:15.420353 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:15.420422 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.020625 (+600203us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b54001770d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:16.020692 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.020870 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90214,"prepare.queue_time_us":14810,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":60,"raft.queue_time_us":65437,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":18627,"spinlock_wait_cycles":50403584,"thread_start_us":86175,"threads_started":1,"wal-append.queue_time_us":79057,"wal-append.run_cpu_time_us":967,"wal-append.run_wall_time_us":1005138}
I20260709 13:05:16.023197 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.080147 19792 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.085930 18922 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.505889 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.086602 19853 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:16.094518 19765 consensus_meta.cc:287] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.004s
I20260709 13:05:16.506886 15191 raft_consensus.cc:2410] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:16.507279 19765 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.508047 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.078444 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2427) took 2093 ms. Trace:
I20260709 13:05:16.107736 19846 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:16.513257 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:16.513979 19846 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:16.491016 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.108394 19828 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:16.120453 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.120923 19793 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:16.517164 19793 consensus_queue.cc:1243] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:16.517827 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.518368 19760 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:16.519007 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:16.196376 19598 consensus_meta.cc:287] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.004s
I20260709 13:05:16.197899 19632 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:16.200256 19675 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.207808 19833 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.520974 19833 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.521941 15339 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:16.212448 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.523386 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 287) took 2291 ms. Trace:
I20260709 13:05:16.513402 15342 rpcz_store.cc:276] 0709 13:05:13.984669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.984805 (+   136us) service_pool.cc:224] Handling call
0709 13:05:13.997729 (+ 12924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:14.022589 (+ 24860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.022631 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:14.023181 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:05:14.249150 (+225969us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:14.249201 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.078052 (+1828851us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b54000b5754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:16.078100 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:16.078143 (+    43us) raft_consensus.cc:1685] finished
0709 13:05:16.078154 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.078376 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10341,"raft.queue_time_us":22121,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":3117,"spinlock_wait_cycles":48030592,"thread_start_us":155585,"threads_started":1,"wal-append.queue_time_us":389511,"wal-append.run_cpu_time_us":2825,"wal-append.run_wall_time_us":1261313}
I20260709 13:05:16.523932 15339 rpcz_store.cc:276] 0709 13:05:14.231944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.200902 (+968958us) service_pool.cc:224] Handling call
0709 13:05:15.201153 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.522473 (+1321320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.523139 (+   666us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003ab6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:16.523331 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036791680}
I20260709 13:05:16.215816 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.525221 15269 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.521863 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.526098 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.526983 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.527369 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.214701 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.218104 19454 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.528519 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.528899 19454 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.495913 19835 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:16.529402 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.530099 15271 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 6.
I20260709 13:05:16.216509 15270 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:05:16.530453 19762 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.531424 19454 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.531930 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.532137 19762 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.532763 15270 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.533660 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.534410 15270 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.241360 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2199) took 1217 ms. Trace:
I20260709 13:05:16.247462 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.535197 15268 rpcz_store.cc:276] 0709 13:05:15.023756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.280007 (+256251us) service_pool.cc:224] Handling call
0709 13:05:15.318237 (+ 38230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.371167 (+ 52930us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:15.425017 (+ 53850us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.548315 (+123298us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.573864 (+ 25549us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:15.573917 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:15.573971 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.048746 (+474775us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b180045ec20. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db
0709 13:05:16.241062 (+192316us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b5400327dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:16.241117 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.241299 (+   182us) inbound_call.cc:177] Queueing success response
0709 13:05:16.269725 (+ 28426us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:16.340978 (+ 71253us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b180045ec20. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
Metrics: {"mutex_wait_us":44311,"prepare.queue_time_us":359994,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":36640,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":49272,"spinlock_wait_cycles":404676736,"thread_start_us":121999,"threads_started":1,"wal-append.queue_time_us":122355}
I20260709 13:05:16.536926 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.259074 19678 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:16.537518 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.537822 19678 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:16.538722 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.538681 19678 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.539575 15268 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:16.539882 19678 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.260035 19563 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:16.270354 19824 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.723s	user 0.005s	sys 0.000s
I20260709 13:05:16.543354 19563 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:16.277868 19694 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.904s	user 0.010s	sys 0.023s
I20260709 13:05:16.535918 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:16.544466 19694 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.178s	user 0.010s	sys 0.023s
I20260709 13:05:16.544950 19632 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:16.545382 19563 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.287225 19570 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.296015 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2194) took 1273 ms. Trace:
I20260709 13:05:16.520977 19675 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.546869 15337 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:16.546188 15272 rpcz_store.cc:276] 0709 13:05:15.022479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.283541 (+261062us) service_pool.cc:224] Handling call
0709 13:05:15.283895 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.487431 (+203536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.295736 (+808305us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54001b4754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:16.295942 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321713920}
I20260709 13:05:16.548053 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.548718 15341 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:16.548763 15272 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:16.549990 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:16.315897 19723 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 2.882s	user 0.006s	sys 0.000s
I20260709 13:05:16.530957 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.324317 19672 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:16.552829 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:16.325106 19817 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.549s	user 0.002s	sys 0.002s
I20260709 13:05:16.327986 19781 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:16.553758 19781 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:16.553869 19722 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:16.333076 19666 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:16.554672 19722 consensus_queue.cc:1243] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:16.344678 19403 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.554903 15188 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:16.555776 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2408) took 3899 ms. Trace:
I20260709 13:05:16.556255 15196 rpcz_store.cc:276] 0709 13:05:12.656011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.660959 (+  4948us) service_pool.cc:224] Handling call
0709 13:05:12.661471 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.065571 (+404100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.065593 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.066033 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.205982 (+139949us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:13.206016 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.206081 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:16.315324 (+3109243us) spinlock_profiling.cc:243] Waited 96.4 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:16.555484 (+240160us) raft_consensus.cc:1685] finished
0709 13:05:16.555505 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.555699 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":500707,"raft.queue_time_us":403756,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"spinlock_wait_cycles":221725056,"thread_start_us":109237,"threads_started":1,"wal-append.queue_time_us":177194}
I20260709 13:05:16.557687 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.558632 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.350556 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.560730 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.562016 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.369880 19787 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.371443 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2178) took 3171 ms. Trace:
I20260709 13:05:16.371795 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2200) took 1347 ms. Trace:
I20260709 13:05:16.374621 15095 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 16 to 17, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 17 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:16.377617 19827 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.549s	user 0.002s	sys 0.000s
I20260709 13:05:16.564121 18829 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:16.564569 18829 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:16.414130 19782 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.565383 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.565833 19782 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:16.563519 15267 rpcz_store.cc:276] 0709 13:05:13.200006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.200349 (+   343us) service_pool.cc:224] Handling call
0709 13:05:13.225290 (+ 24941us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:13.269283 (+ 43993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.269311 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:13.321836 (+ 52525us) log.cc:844] Serialized 52 byte log entry
0709 13:05:15.935408 (+2613572us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b180025ab00. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:15.951775 (+ 16367us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:15.952491 (+   716us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.952679 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.371114 (+418435us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b54001b5654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:16.371165 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:16.371212 (+    47us) raft_consensus.cc:1685] finished
0709 13:05:16.371226 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.371383 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4809,"prepare.queue_time_us":193,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":75171,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":4891,"spinlock_wait_cycles":90829824,"thread_start_us":16067,"threads_started":1,"wal-append.queue_time_us":2599404}
I20260709 13:05:16.565408 18829 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:16.420993 15143 auto_rebalancer.cc:893] Removing replace marker failed: Client connection negotiation failed: client connection to 127.13.181.1:39515: received 0 of 4 requested bytes
I20260709 13:05:16.424659 19766 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:16.567701 15143 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:05:16.567660 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.567931 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.568627 15189 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:16.568904 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.569082 19766 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.569432 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.554646 19781 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.570901 19781 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.571820 15272 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:16.573441 15272 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:16.445815 19705 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.450196 19703 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.871771 19725 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.546346 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:16.581594 19675 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:16.564330 15263 rpcz_store.cc:276] 0709 13:05:15.024001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.281677 (+257676us) service_pool.cc:224] Handling call
0709 13:05:15.281939 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.282142 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:15.458169 (+176027us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.357470 (+899301us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b180045ece0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a
0709 13:05:16.358006 (+   536us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.371421 (+ 13415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.371480 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:16.371553 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.371628 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.371741 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34164,"prepare.queue_time_us":162900,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":20479,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":8224128,"thread_start_us":228704,"threads_started":3,"wal-append.queue_time_us":92232}
I20260709 13:05:16.583890 19705 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.584600 15263 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: [12.9-14.10]
W20260709 13:05:16.586567 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.558640 15188 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:16.588699 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.469758 19706 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:15.945310 19823 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:16.595438 15872 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:16.595605 19823 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.597838 19823 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:16.487663 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 541543us
W20260709 13:05:16.599150 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46776us
W20260709 13:05:16.600337 15238 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.905s (SENT)
I20260709 13:05:16.600765 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:16.602722 18829 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.604040 19849 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:16.497057 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.606283 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d932cad3925e47b28537cca64ba27320"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:16.606812 15190 raft_consensus.cc:606] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:16.607128 15190 raft_consensus.cc:614] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:16.607661 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.607411 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.608417 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2456) took 1273 ms. Trace:
I20260709 13:05:15.988628 18938 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:16.609180 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.609380 18938 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:16.609793 18938 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:16.609925 15271 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.608747 15190 rpcz_store.cc:276] 0709 13:05:15.334543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.607674 (+1273131us) service_pool.cc:224] Handling call
0709 13:05:16.607912 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.608072 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.608096 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.608134 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:16.608184 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.608233 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.608329 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:16.501989 19758 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:16.612279 19403 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:16.502962 19724 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.569435 15267 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:16.615675 19724 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.506018 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:16.616782 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110827us
I20260709 13:05:16.071790 19712 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.619752 19712 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.620050 19759 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:15.841802 19698 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.508718 15344 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:16.623924 15194 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:16.624056 19698 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.505944 19508 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:16.624784 19508 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:16.625265 19508 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.626024 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2458) took 1256 ms. Trace:
I20260709 13:05:16.626765 15264 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.509931 19765 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.106853 15192 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:16.629456 15264 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:16.506764 19853 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.626454 15194 rpcz_store.cc:276] 0709 13:05:15.369977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.625240 (+1255263us) service_pool.cc:224] Handling call
0709 13:05:16.625525 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.625696 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.625736 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.625775 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:16.625816 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.625870 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.625973 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:16.631763 19853 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.631589 19759 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:16.632074 15194 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:16.505861 19792 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.632738 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2460) took 1262 ms. Trace:
I20260709 13:05:16.633085 15194 rpcz_store.cc:276] 0709 13:05:15.370681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.631614 (+1260933us) service_pool.cc:224] Handling call
0709 13:05:16.631905 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.632508 (+   603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.632688 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:16.505120 19838 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:16.506124 18922 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.636238 19508 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.637071 18922 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.512392 15346 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:16.498885 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.638567 15196 raft_consensus.cc:2410] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:05:16.639216 19762 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:16.640640 19762 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.641032 19762 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.514616 19846 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:16.642598 15193 raft_consensus.cc:2410] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:16.114750 15083 maintenance_manager.cc:643] P d7ef35df06e147c6a6e7757620253191: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.356s	user 0.186s	sys 0.040s Metrics: {"bytes_written":29923,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":18251,"dirs.run_cpu_time_us":420,"dirs.run_wall_time_us":5897,"drs_written":1,"lbm_read_time_us":369,"lbm_reads_lt_1ms":4,"lbm_write_time_us":358065,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":12,"lbm_writes_lt_1ms":19,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"spinlock_wait_cycles":163712,"thread_start_us":30946,"threads_started":2,"update_count":7,"wal-append.queue_time_us":12424}
I20260709 13:05:16.523340 15266 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:16.644414 15266 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:05:16.644323 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 125370us
I20260709 13:05:16.644946 15084 maintenance_manager.cc:419] P d7ef35df06e147c6a6e7757620253191: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7948 bytes on disk
I20260709 13:05:16.645728 15266 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:16.213662 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.647228 15265 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.649281 19787 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:16.651276 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2463) took 1101 ms. Trace:
I20260709 13:05:16.651656 15194 rpcz_store.cc:276] 0709 13:05:15.550135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.650499 (+1100364us) service_pool.cc:224] Handling call
0709 13:05:16.650774 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.650942 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.650967 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.651042 (+    75us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:16.651087 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.651139 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.651227 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:16.468324 19717 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:16.240195 15343 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1735) took 2139 ms (client timeout 1526 ms). Trace:
W20260709 13:05:16.654707 15343 rpcz_store.cc:269] 0709 13:05:14.100571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.129726 (+ 29155us) service_pool.cc:224] Handling call
0709 13:05:16.239914 (+2110188us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001748d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:16.240072 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3089031040}
I20260709 13:05:16.361475 19826 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:16.368943 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.655843 19717 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:16.568181 15143 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:05:16.660471 15083 maintenance_manager.cc:643] P d7ef35df06e147c6a6e7757620253191: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":298,"lbm_reads_lt_1ms":4}
I20260709 13:05:16.661916 19846 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:15.831097 19692 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.465552 19763 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.669926 19703 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:16.671062 19763 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.670442 15191 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 8.
I20260709 13:05:16.591204 15197 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:16.676538 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.677825 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.592873 19766 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.592530 15345 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:16.679318 19766 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.528532 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.680640 15269 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.681629 19766 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:16.681809 15269 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:16.683619 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:16.685868 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:16.570719 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.687551 15189 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:16.687079 15265 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:16.688308 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.524467 19833 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.663496 19846 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:16.690290 15269 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:16.671466 19698 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:16.690762 19698 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.691884 19508 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.698079 19508 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:16.678869 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.600773 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.701226 15270 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:16.701345 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.702153 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.710340 19508 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:16.719249 19508 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:16.730319 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:16.737114 19846 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:16.745965 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.746932 15270 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.748018 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.741204 19508 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.751770 19508 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.691654 19698 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.672164 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:16.693918 19869 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.053s	user 0.003s	sys 0.000s
I20260709 13:05:16.695600 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.696666 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.673532 15264 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:16.699551 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1766) took 1275 ms. Trace:
I20260709 13:05:16.663447 18922 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:16.689512 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.702696 19724 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:16.704681 19675 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:05:16.707474 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.689941 19762 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.753038 19833 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.755014 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:16.807793 19692 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:16.809089 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54119.1us
I20260709 13:05:16.757762 15193 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.758123 19698 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.815676 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.785938 19762 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.742549 18938 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.831018 15193 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:16.794320 19694 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:16.839112 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:16.794360 19508 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:16.840142 19762 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:16.840701 19762 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.840488 19508 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.841133 18938 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.841609 19762 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.590521 15338 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:16.838892 19694 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:16.797026 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.802107 19717 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.844256 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:16.844645 19717 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.804695 19766 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:16.802700 19759 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.845882 19766 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.846145 19759 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:16.806087 19838 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:16.847628 19838 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.848049 19766 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:16.765072 15189 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:16.850189 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.851210 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:16.851344 15842 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.250s (SENT)
I20260709 13:05:16.851713 15189 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.851792 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:16.804979 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:16.805816 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:16.773439 15194 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:16.855970 15344 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:16.781692 15196 rpcz_store.cc:276] 0709 13:05:15.424099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.639700 (+1215601us) service_pool.cc:224] Handling call
0709 13:05:16.640021 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.640376 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.640524 (+   148us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.641061 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.699214 (+ 58153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:16.699256 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.699319 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:16.699361 (+    42us) raft_consensus.cc:1685] finished
0709 13:05:16.699372 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.699493 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1628,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":57771,"threads_started":1,"wal-append.queue_time_us":53635}
I20260709 13:05:16.856623 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.856773 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.777544 15191 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:05:16.857391 15194 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 8: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:16.857504 15191 pending_rounds.cc:85] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 9
I20260709 13:05:16.857933 15191 pending_rounds.cc:107] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:16.858233 15191 raft_consensus.cc:2889] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:16.854097 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:16.860600 15194 pending_rounds.cc:85] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 6
I20260709 13:05:16.844262 19694 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.861056 15194 pending_rounds.cc:107] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:05:16.860561 19703 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:16.861330 15194 raft_consensus.cc:2889] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:16.861645 19703 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.862339 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:16.863145 15872 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:16.862601 19703 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.866544 19787 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:16.869592 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:16.870405 15196 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:16.782637 19833 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:16.875752 19833 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.876199 19838 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.874996 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:16.846813 19717 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.879312 19833 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:16.881417 19717 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:16.881853 19717 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.882205 19717 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:16.882365 15346 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:16.853652 19508 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:16.854452 19846 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:16.788954 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:16.757157 19706 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:16.889642 19759 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:16.890262 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:16.891392 19724 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:05:16.891495 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 310127us
I20260709 13:05:16.892439 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:16.893464 19724 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:16.895910 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:16.897336 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:16.899822 15293 debug-util.cc:398] Leaking SignalData structure 0x7b08000471c0 after lost signal to thread 14039
W20260709 13:05:16.900918 15293 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd4c0 after lost signal to thread 15129
W20260709 13:05:16.902105 15293 debug-util.cc:398] Leaking SignalData structure 0x7b08001767c0 after lost signal to thread 15221
I20260709 13:05:16.839180 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:16.903455 15193 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:16.903617 15293 debug-util.cc:398] Leaking SignalData structure 0x7b08003553a0 after lost signal to thread 15296
W20260709 13:05:16.903965 15293 debug-util.cc:398] Leaking SignalData structure 0x7b080033b0e0 after lost signal to thread 15297
W20260709 13:05:16.905057 15293 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7fe0 after lost signal to thread 15370
W20260709 13:05:16.905339 15293 debug-util.cc:398] Leaking SignalData structure 0x7b08000a63e0 after lost signal to thread 15371
W20260709 13:05:16.906631 15293 debug-util.cc:398] Leaking SignalData structure 0x7b080030d020 after lost signal to thread 15900
W20260709 13:05:16.906999 15293 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7440 after lost signal to thread 15901
W20260709 13:05:16.909374 15293 debug-util.cc:398] Leaking SignalData structure 0x7b080034b9a0 after lost signal to thread 19730
W20260709 13:05:16.910310 15293 debug-util.cc:398] Leaking SignalData structure 0x7b080031c740 after lost signal to thread 19794
I20260709 13:05:16.916460 15188 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:16.920418 15268 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:16.922775 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 112676us
I20260709 13:05:16.923789 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:16.926158 15265 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:05:16.930655 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:16.932031 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 227733us
I20260709 13:05:16.934494 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2459) took 1564 ms. Trace:
I20260709 13:05:16.662382 15267 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:05:16.938045 15266 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:16.930272 15095 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 6 to 7, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:16.941012 15095 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 7 to 12, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 12 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:16.946090 15095 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 10 to 11, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 11 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.936829 15192 rpcz_store.cc:276] 0709 13:05:15.370371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.628485 (+1258114us) service_pool.cc:224] Handling call
0709 13:05:16.628768 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.629093 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.629121 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.629541 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.924609 (+295068us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:16.924647 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.924713 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:16.934259 (+  9546us) raft_consensus.cc:1685] finished
0709 13:05:16.934277 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.934429 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2118,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":1280,"thread_start_us":294763,"threads_started":1,"wal-append.queue_time_us":294847}
I20260709 13:05:16.950284 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.952951 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:16.953943 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.955113 15271 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:16.956089 15189 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:16.953976 15346 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:16.960707 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:16.958822 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:16.961246 15341 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:16.957337 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:16.974922 15263 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:16.976328 19766 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:16.977911 19792 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:16.978549 19792 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:16.979521 19792 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:16.983608 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:16.984720 15266 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:17.032112 15095 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.984694 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:17.033535 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48926.2us
I20260709 13:05:16.951514 19763 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.035725 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:17.037145 15238 leader_election.cc:400] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:17.037552 15238 leader_election.cc:403] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:16.956446 19833 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:17.035240 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.041203 15269 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:17.043409 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:17.044134 15872 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:16.945014 19692 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:05:17.050990 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.052946 15346 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:17.053184 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 155951us
W20260709 13:05:17.053544 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 120521us
I20260709 13:05:17.054687 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.056341 15193 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:17.039111 19766 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:17.062589 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:17.064635 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.042528 19693 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:17.066298 15192 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:17.042219 19833 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.079499 15344 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:17.079712 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.080535 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.080686 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.040424 19838 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:17.063455 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:17.085366 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2464) took 1535 ms. Trace:
I20260709 13:05:17.085975 18922 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:17.083458 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.086517 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.085850 15197 rpcz_store.cc:276] 0709 13:05:15.550422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.702244 (+1151822us) service_pool.cc:224] Handling call
0709 13:05:16.702530 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.702741 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:16.702985 (+   244us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.934235 (+231250us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.084990 (+150755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.085032 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:17.085093 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.085180 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.085316 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144685,"prepare.queue_time_us":4819,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"spinlock_wait_cycles":6092032,"thread_start_us":230540,"threads_started":1,"wal-append.queue_time_us":230905}
I20260709 13:05:17.042430 19763 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.096505 19763 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:17.097435 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.097800 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.089828 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.093538 15341 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:17.092886 15346 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:17.089370 19724 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:17.090714 19698 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:17.085350 19838 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.100883 19838 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.065713 19727 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:17.100577 19508 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:17.092706 15342 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:17.107918 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.068423 19766 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.063192 19672 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:05:17.110038 18829 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:17.085268 19833 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:17.110249 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.091300 19693 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
W20260709 13:05:17.133148 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.117264 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.164127 15342 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:05:17.165768 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55606.3us
I20260709 13:05:17.167845 15341 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
W20260709 13:05:17.168890 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.117288 18829 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:17.169618 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.174409 18829 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.110641 19766 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:17.090962 19675 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:05:17.100654 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:05:17.180701 15082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80129.2us
I20260709 13:05:17.116639 19717 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.194983 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2461) took 1824 ms. Trace:
I20260709 13:05:17.174883 19693 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.170985 19698 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:17.215930 19698 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.220022 19823 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.220892 19823 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.198235 15195 rpcz_store.cc:276] 0709 13:05:15.371001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.638531 (+1267530us) service_pool.cc:224] Handling call
0709 13:05:16.672574 (+ 34043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.672755 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:16.697463 (+ 24708us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.060722 (+363259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.060795 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:17.060873 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.060965 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.194799 (+133834us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54000fb4d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:17.194921 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117293,"prepare.queue_time_us":19941,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":118062,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":205,"spinlock_wait_cycles":77573376,"thread_start_us":269921,"threads_started":2,"wal-append.queue_time_us":234154}
W20260709 13:05:17.223574 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 43597us
I20260709 13:05:17.224493 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.224572 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:17.200675 19879 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:05:17.197897 19850 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:05:17.223477 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43552.8us
W20260709 13:05:17.197471 19886 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:05:17.233070 15345 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:17.239899 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.177039 18829 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.252360 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.261507 19826 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:17.261700 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.262410 19717 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:17.229269 19693 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.264971 19725 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:17.265152 19693 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.265697 19693 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.265858 19826 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:17.266201 19693 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.312230 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.265697 19725 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.275322 19887 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:05:17.231716 19686 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:05:17.332923 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.337608 15341 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:05:17.339386 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.324904 19838 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.389438 15346 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:17.323644 19725 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:17.323076 19675 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:05:17.323458 19686 consensus_queue.cc:1243] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:17.449774 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.394304 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.393797 19694 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.440631 19868 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
W20260709 13:05:17.456830 19889 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:05:17.458369 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.408735 18829 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:17.457114 19884 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
W20260709 13:05:17.471699 19888 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:05:17.475438 19823 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:17.505695 19890 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:05:17.482136 19838 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.482992 19693 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.489282 19725 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:17.496832 19766 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:17.510804 15093 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 169) took 38897 ms (client timeout 15000 ms). Trace:
W20260709 13:05:17.511762 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 474835us
W20260709 13:05:17.513337 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 241420us
W20260709 13:05:17.455562 19865 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 13:05:17.519848 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 255271us
I20260709 13:05:17.521858 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:17.536788 15341 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:17.528978 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.535992 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.536535 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.535773 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.534446 18829 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:17.540129 15842 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.961s (SENT)
I20260709 13:05:17.540706 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2457) took 2189 ms. Trace:
I20260709 13:05:17.538914 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.508100 19694 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.570955 15190 rpcz_store.cc:276] 0709 13:05:15.351666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.611634 (+1259968us) service_pool.cc:224] Handling call
0709 13:05:16.612208 (+   574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.612565 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.612593 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.625986 (+ 13393us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.032718 (+406732us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:17.032780 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.032881 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.540421 (+507540us) raft_consensus.cc:1685] finished
0709 13:05:17.540452 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.540626 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":662,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":406254,"threads_started":1,"wal-append.queue_time_us":464531}
I20260709 13:05:17.572270 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.574673 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.576356 18829 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:17.576464 18922 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:17.577845 18829 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:05:17.579156 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.580262 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.581254 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.582165 15191 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:17.583302 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:17.584985 15268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.009s	sys 0.011s
W20260709 13:05:17.585352 15268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.009s	sys 0.011s
I20260709 13:05:17.586150 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:17.576112 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:17.528855 15093 rpcz_store.cc:269] 0709 13:04:38.605700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.605849 (+   149us) service_pool.cc:224] Handling call
0709 13:05:17.502498 (+38896649us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:10.050453 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:10.051141 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:10.051193 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:05:10.051210 (+    17us) tablet.cc:662] Decoding operations
0709 13:05:10.052043 (+   833us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:10.052131 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:10.052157 (+    26us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:05:10.052907 (+   750us) tablet.cc:701] Row locks acquired
0709 13:05:10.052968 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:05:10.053135 (+   167us) write_op.cc:270] Start()
0709 13:05:10.053270 (+   135us) write_op.cc:276] Timestamp: P: 1783602310053077 usec, L: 0
0709 13:05:10.053293 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:10.053984 (+   691us) log.cc:844] Serialized 2848 byte log entry
0709 13:05:10.493069 (+439085us) op_driver.cc:464] REPLICATION: finished
0709 13:05:10.553554 (+ 60485us) write_op.cc:301] APPLY: starting
0709 13:05:10.553678 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:10.554859 (+  1181us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:10.554996 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:10.555923 (+   927us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:10.556210 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:05:10.556268 (+    58us) write_op.cc:312] APPLY: finished
0709 13:05:10.559951 (+  3683us) log.cc:844] Serialized 58 byte log entry
0709 13:05:10.560133 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:10.560250 (+   117us) write_op.cc:454] Released schema lock
0709 13:05:10.560299 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:10.560691 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:10.560726 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":364210,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":55597,"apply.run_cpu_time_us":3781,"apply.run_wall_time_us":7134,"num_ops":7,"prepare.queue_time_us":330062,"prepare.run_cpu_time_us":32133,"prepare.run_wall_time_us":95361,"raft.queue_time_us":147008,"raft.run_cpu_time_us":20569,"raft.run_wall_time_us":87929,"replication_time_us":420473,"thread_start_us":453348,"threads_started":4,"wal-append.queue_time_us":219009,"wal-append.run_cpu_time_us":28074,"wal-append.run_wall_time_us":1288794}]]}
I20260709 13:05:17.587129 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.615621 15342 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:17.544188 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.616279 15343 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:17.586552 15191 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:05:17.594547 15266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.009s
I20260709 13:05:17.618489 15194 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:17.573097 19693 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:17.568542 19766 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.573479 19675 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:17.579428 19891 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:17.579949 19692 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:05:17.619692 15266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.010s	sys 0.014s
I20260709 13:05:17.625610 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:17.626355 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50321.9us
I20260709 13:05:17.625499 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:17.627089 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 439722us
I20260709 13:05:17.630210 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.634032 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.539762 19838 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:17.540916 19833 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:17.639437 15237 leader_election.cc:336] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.526s (SENT)
I20260709 13:05:17.648037 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:17.645545 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 56265.7us
I20260709 13:05:17.652278 19899 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:17.653949 19758 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:17.646498 15270 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:17.656147 19725 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.656374 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.656683 19725 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.657923 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.658812 19725 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.646426 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.647089 15263 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:17.579577 19850 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:05:17.660384 18829 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.660334 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.661882 15263 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:17.658651 15270 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:17.664979 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.661002 18829 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.670948 18829 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.669196 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.691095 15270 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:17.672844 15263 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:17.674139 19838 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:17.675669 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.676262 19692 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:17.677048 19898 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:17.699316 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.702183 15264 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:17.679279 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.680352 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.628921 19766 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:17.703088 19692 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:17.703476 19692 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:17.700810 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.704030 15191 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:17.704629 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.707077 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.707573 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.708829 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:17.709074 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:17.709687 15194 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:17.711894 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:17.712855 15342 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:17.715122 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.715569 19678 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:17.715936 19678 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:17.716601 15195 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:05:17.716691 19678 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.697091 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.717808 19898 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:17.717959 19678 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:17.719727 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.720394 15192 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:17.720980 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.721545 15272 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:05:17.723730 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.725642 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.726496 15192 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:05:17.727638 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:17.728216 15193 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:17.728966 19898 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:17.729918 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54317.6us
I20260709 13:05:17.730695 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:17.732371 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.732652 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:17.693053 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.678390 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:17.681874 19693 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:17.736819 19403 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:17.737068 19833 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.737509 19403 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.737790 19833 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:17.738011 19403 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:17.738833 19727 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.739503 19727 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:17.743996 19694 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:17.746598 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
W20260709 13:05:17.746781 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68461.6us
I20260709 13:05:17.747265 15192 raft_consensus.cc:606] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.747624 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.748064 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.748733 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:17.749739 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:17.749802 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:17.750281 15189 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:17.754962 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.755733 15339 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:17.756171 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:17.701699 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:17.693687 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53253.8us
I20260709 13:05:17.757540 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:17.758067 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.759173 19833 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:17.759622 19833 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.762379 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.776578 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.781473 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.783691 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.746477 19403 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:17.781188 19675 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:17.781211 19724 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.786592 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.787966 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.787761 19724 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.788403 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.789098 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.789511 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.789688 15268 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:17.790261 15266 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:17.790532 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.790369 19724 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:17.791465 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:17.791824 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.792248 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.793592 19766 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:17.794956 19896 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 13:05:17.796167 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.753688 19823 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:17.804737 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:17.753692 19891 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:17.760931 19763 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:17.760104 19693 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:17.800561 15268 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:17.800751 15193 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:17.844290 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 78405.8us
I20260709 13:05:17.830545 19724 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.778988 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:17.803814 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:17.846962 15272 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:17.760001 19833 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:17.805572 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 172468us
I20260709 13:05:17.848013 19823 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:17.848394 19823 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.848503 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.848785 19823 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.806440 19850 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:17.692116 19899 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:05:17.823226 15189 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:17.761212 19826 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:17.858433 19826 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.827890 15269 raft_consensus.cc:2410] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:17.828611 18829 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:17.828632 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 80270.3us
I20260709 13:05:17.831243 15270 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:17.833573 19908 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:17.799603 19838 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:17.835618 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.824810 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:17.846532 19724 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:17.758602 19835 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:17.821147 15191 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:17.858829 19826 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.889281 15189 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:17.859997 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:17.888262 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 250581us
I20260709 13:05:17.843636 19693 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.892774 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.901970 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:17.894078 15868 pending_rounds.cc:85] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 12
I20260709 13:05:17.908443 15868 pending_rounds.cc:107] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:05:17.908715 15868 raft_consensus.cc:2889] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:17.913336 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 77787.7us
I20260709 13:05:17.916353 15195 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:17.852818 19850 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:17.918632 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:17.933049 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44671.6us
I20260709 13:05:17.933089 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:17.926436 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:17.943953 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:17.942641 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:17.946070 15872 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:17.868501 19835 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:17.907248 19693 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:17.909294 19675 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:17.907192 19706 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:17.951696 15195 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:17.945149 18938 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:17.908049 19759 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:17.954785 19724 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:17.955615 19835 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.917470 19900 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:17.960170 15264 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:17.976526 15264 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:17.951501 19686 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:17.983825 19686 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.984333 19686 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:17.986558 19833 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.969966 15263 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:17.942257 19850 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:17.988580 15191 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:17.987993 19692 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:17.963373 19838 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:18.031838 19686 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.023514 19835 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:18.024935 19907 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:18.029739 19692 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:17.968211 19675 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:17.967693 19403 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:18.046948 15263 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:18.096220 15263 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:18.054469 15266 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:18.112185 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 349841us
I20260709 13:05:18.113188 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.110888 15263 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:18.118674 19826 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.120469 19727 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.124436 19823 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.128803 19675 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.129304 19686 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.122522 19850 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.147782 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:18.143935 15263 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:18.141953 19833 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.156303 15197 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:18.157886 15263 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:05:18.163762 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.166371 15189 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:18.138507 19403 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:18.168423 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 410446us
I20260709 13:05:18.169377 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:18.184788 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 381062us
I20260709 13:05:18.186300 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.189489 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.135062 19693 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.155053 19838 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:18.208124 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.171084 19675 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:18.233462 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 339834us
I20260709 13:05:18.204293 19508 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.204394 19678 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:18.296598 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 353520us
I20260709 13:05:18.202827 19759 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:18.181311 19403 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:18.263707 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116019us
W20260709 13:05:18.268958 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 420499us
I20260709 13:05:18.264441 19833 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:18.263459 19766 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:18.290805 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 351796us
I20260709 13:05:18.279222 19792 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:18.301244 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.300541 18829 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:18.301432 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 93415.2us
I20260709 13:05:18.334692 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.343276 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:18.345151 15346 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:18.309700 19678 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.318185 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.314648 19698 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:18.311390 19911 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:18.333777 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.302341 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 112905us
I20260709 13:05:18.319733 19838 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:18.321446 19454 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:18.368132 18829 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:18.370103 18829 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:18.370627 18829 consensus_queue.cc:1243] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:18.370517 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:18.371920 15345 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.372583 19694 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:18.374805 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:18.341321 19826 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.314321 19508 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.356472 19678 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:18.349634 19850 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:18.384392 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49572.6us
I20260709 13:05:18.361696 19891 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:18.361064 19727 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.392740 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.349970 19766 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:05:18.395159 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:18.324805 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 391761us
I20260709 13:05:18.392947 19898 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:18.393332 19833 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:18.464557 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:18.367695 19698 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:18.476322 15265 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.394166 19838 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:18.477352 18829 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.477991 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:18.376080 19454 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:18.482204 15195 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:18.481210 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:18.442896 19762 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:18.507782 18829 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:18.453220 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:18.500149 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 145855us
I20260709 13:05:18.509932 15193 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:18.510211 15271 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:05:18.494944 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 100221us
I20260709 13:05:18.368523 19911 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:18.502780 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:18.519641 15263 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:18.511324 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:18.511551 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.493636 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:18.389050 19936 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.104s
I20260709 13:05:18.518796 15193 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:18.522122 15265 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:18.495594 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.522766 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:18.525909 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:18.478242 19833 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.529944 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:18.460268 19891 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:18.531980 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.477973 19725 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:18.545635 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:18.523622 19901 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:05:18.547917 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:18.469698 19766 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:18.459837 19919 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:05:18.547154 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:18.556057 18829 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:18.574316 18829 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:18.523638 19948 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:18.566148 15263 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:05:18.548039 19912 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:05:18.547752 19913 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
W20260709 13:05:18.555796 19925 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:05:18.587219 18829 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:18.555159 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:18.540019 19833 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.541162 19891 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:18.548133 19910 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.540512 19838 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:18.556427 19936 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:18.596552 18829 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:18.585969 19926 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:05:18.598191 15345 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:18.603900 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:18.586886 19693 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.562521 19725 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.655167 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2480) took 1571 ms. Trace:
I20260709 13:05:18.676651 15340 rpcz_store.cc:276] 0709 13:05:17.083617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.083731 (+   114us) service_pool.cc:224] Handling call
0709 13:05:17.084079 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.084429 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.084456 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.747144 (+662688us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b2c00136ac8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:17.747511 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.276173 (+528662us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:18.276243 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.276947 (+   704us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.654803 (+377856us) raft_consensus.cc:1685] finished
0709 13:05:18.654827 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.655091 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10657,"raft.queue_time_us":2444,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4343,"spinlock_wait_cycles":8985984,"thread_start_us":449959,"threads_started":1,"wal-append.queue_time_us":526981}
I20260709 13:05:18.653119 19838 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.602106 19403 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.683972 19403 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:18.684718 19403 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:18.685120 19838 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.685770 19403 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.684731 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2284) took 1026 ms. Trace:
W20260709 13:05:18.619450 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64473.1us
W20260709 13:05:18.615023 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83125.8us
I20260709 13:05:18.691906 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.694301 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.676684 15265 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:18.607340 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:18.701004 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 93712.9us
I20260709 13:05:18.704193 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:18.704952 15872 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:18.707906 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:18.708640 15873 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:18.600430 19921 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:18.651141 19916 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
W20260709 13:05:18.655532 19917 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 13:05:18.681782 19936 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.689826 15272 rpcz_store.cc:276] 0709 13:05:17.658250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.032057 (+373807us) service_pool.cc:224] Handling call
0709 13:05:18.032474 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.032833 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:18.033107 (+   274us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.332729 (+299622us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.335419 (+  2690us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.335581 (+   162us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:18.335612 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.335699 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.684532 (+348833us) raft_consensus.cc:1685] finished
0709 13:05:18.684553 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.684678 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9218,"prepare.queue_time_us":1458,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":27925,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":23068,"thread_start_us":290020,"threads_started":1,"wal-append.queue_time_us":562535}
I20260709 13:05:18.665132 19564 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:18.684664 19762 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:18.719556 15265 pending_rounds.cc:85] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 4
I20260709 13:05:18.750620 15265 pending_rounds.cc:107] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:05:18.750959 15265 raft_consensus.cc:2889] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:18.698603 19692 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.591s	user 0.006s	sys 0.006s
I20260709 13:05:18.707474 19727 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.658720 19508 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:18.719117 19693 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:18.727070 19921 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:18.594869 19948 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.727406 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 339) took 1093 ms. Trace:
I20260709 13:05:18.776060 19948 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.728513 19454 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:18.729934 19698 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:18.776528 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2287) took 1041 ms. Trace:
I20260709 13:05:18.660283 19911 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:18.665239 19927 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:18.777530 19927 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:18.778048 19927 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:18.761554 19570 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:18.760910 19762 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.780064 19570 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.740070 19891 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.781417 19891 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.732905 19725 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.634523 19900 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:18.784714 19900 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.761142 19907 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:18.787101 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2283) took 1129 ms. Trace:
I20260709 13:05:18.787571 15270 rpcz_store.cc:276] 0709 13:05:17.658017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.993965 (+335948us) service_pool.cc:224] Handling call
0709 13:05:17.994342 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.994752 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.994791 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.997784 (+  2993us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.394295 (+396511us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:18.394388 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.394486 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.786862 (+392376us) raft_consensus.cc:1685] finished
0709 13:05:18.786891 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.787010 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20975,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":14592,"thread_start_us":253560,"threads_started":1,"wal-append.queue_time_us":729190}
W20260709 13:05:18.770682 19835 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.001s
I20260709 13:05:18.788834 19937 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:18.790923 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 306) took 1213 ms. Trace:
I20260709 13:05:18.791993 19930 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:18.791297 15190 rpcz_store.cc:276] 0709 13:05:17.577581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.577733 (+   152us) service_pool.cc:224] Handling call
0709 13:05:17.578069 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.582277 (+  4208us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:17.801440 (+219163us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.181288 (+379848us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.181459 (+   171us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.202463 (+ 21004us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.202689 (+   226us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:18.202732 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.202808 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.658744 (+455936us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b180031a860. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:18.790722 (+131978us) raft_consensus.cc:1685] finished
0709 13:05:18.790744 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.790867 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44741,"prepare.queue_time_us":358230,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":5058,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":19127,"spinlock_wait_cycles":84505600,"thread_start_us":523787,"threads_started":2,"wal-append.queue_time_us":536016}
I20260709 13:05:18.793740 19403 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:18.753021 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 316568us
I20260709 13:05:18.711071 19724 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:18.710139 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:18.762935 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 452263us
I20260709 13:05:18.763887 18922 raft_consensus.cc:993] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:18.825268 18922 raft_consensus.cc:1081] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:18.662949 19929 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:05:18.771422 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2495) took 1018 ms. Trace:
I20260709 13:05:18.604480 19910 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.774570 19693 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.825924 15338 rpcz_store.cc:276] 0709 13:05:17.753059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.753318 (+   259us) service_pool.cc:224] Handling call
0709 13:05:17.753623 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.839468 (+ 85845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.839496 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.853306 (+ 13810us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.275118 (+421812us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:18.275163 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.275231 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.771199 (+495968us) raft_consensus.cc:1685] finished
0709 13:05:18.771222 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.771363 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87074,"raft.queue_time_us":89458,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":5414,"thread_start_us":340619,"threads_started":1,"wal-append.queue_time_us":469890}
I20260709 13:05:18.795104 19727 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.776263 15267 rpcz_store.cc:276] 0709 13:05:17.633466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.634002 (+   536us) service_pool.cc:224] Handling call
0709 13:05:17.634319 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:17.649966 (+ 15647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.649994 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:17.650752 (+   758us) log.cc:844] Serialized 52 byte log entry
0709 13:05:17.830960 (+180208us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b1800307ea0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:18.056588 (+225628us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:18.056646 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.056740 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.727080 (+670340us) raft_consensus.cc:1685] finished
0709 13:05:18.727104 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.727330 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18205,"raft.queue_time_us":15353,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":72417664,"thread_start_us":225367,"threads_started":1,"wal-append.queue_time_us":616313}
I20260709 13:05:18.776976 15269 rpcz_store.cc:276] 0709 13:05:17.735127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.170474 (+435347us) service_pool.cc:224] Handling call
0709 13:05:18.206877 (+ 36403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.261809 (+ 54932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.261849 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.262489 (+   640us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.388246 (+125757us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:18.388296 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.388380 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.776330 (+387950us) raft_consensus.cc:1685] finished
0709 13:05:18.776354 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.776474 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66681,"raft.queue_time_us":67981,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":4779,"thread_start_us":125391,"threads_started":1,"wal-append.queue_time_us":452803}
I20260709 13:05:18.797474 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2282) took 1139 ms. Trace:
I20260709 13:05:18.789381 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2277) took 1132 ms. Trace:
I20260709 13:05:18.836659 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2493) took 1130 ms. Trace:
I20260709 13:05:18.836851 15268 rpcz_store.cc:276] 0709 13:05:17.656492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.974502 (+318010us) service_pool.cc:224] Handling call
0709 13:05:17.987614 (+ 13112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.988266 (+   652us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:17.988297 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.988946 (+   649us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.296481 (+307535us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:18.296670 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.296742 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.789196 (+492454us) raft_consensus.cc:1685] finished
0709 13:05:18.789214 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.789330 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":77,"thread_start_us":305737,"threads_started":1,"wal-append.queue_time_us":797869}
I20260709 13:05:18.749253 15872 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:18.740541 19936 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.783835 19570 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:18.796023 19564 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:18.920976 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 210937us
I20260709 13:05:18.836134 15264 rpcz_store.cc:276] 0709 13:05:17.657753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.977275 (+319522us) service_pool.cc:224] Handling call
0709 13:05:17.977595 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.978366 (+   771us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:17.978948 (+   582us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.299989 (+321041us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.306192 (+  6203us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.306516 (+   324us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:18.306565 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.306651 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.797289 (+490638us) raft_consensus.cc:1685] finished
0709 13:05:18.797309 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.797421 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13678,"prepare.queue_time_us":147,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":14730,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":8640,"thread_start_us":307121,"threads_started":1,"wal-append.queue_time_us":805610}
W20260709 13:05:18.922309 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.713s (SENT) [suppressed 25 similar messages]
I20260709 13:05:18.907256 19758 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:05:18.914397 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 78806.6us
I20260709 13:05:18.800220 19900 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.917129 19693 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:18.924201 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:18.837352 15341 rpcz_store.cc:276] 0709 13:05:17.706397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.751949 (+ 45552us) service_pool.cc:224] Handling call
0709 13:05:17.752238 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.828884 (+ 76646us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:17.864989 (+ 36105us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18004a44c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf 00007f36e5727038
0709 13:05:18.265733 (+400744us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.760029 (+494296us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.760617 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.760788 (+   171us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:18.760836 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.761205 (+   369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.803317 (+ 42112us) raft_consensus.cc:1685] finished
0709 13:05:18.836336 (+ 33019us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.836553 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78376,"prepare.queue_time_us":445832,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"raft.queue_time_us":261483,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":9168,"spinlock_wait_cycles":2982656,"thread_start_us":851733,"threads_started":3,"wal-append.queue_time_us":488144}
I20260709 13:05:18.953260 19758 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:18.959681 19758 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.845301 19724 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:18.970187 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46075.5us
W20260709 13:05:18.969972 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 275727us
I20260709 13:05:18.973420 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.976577 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2259) took 1307 ms. Trace:
I20260709 13:05:18.977139 15266 rpcz_store.cc:276] 0709 13:05:17.669258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.791236 (+121978us) service_pool.cc:224] Handling call
0709 13:05:18.976316 (+1185080us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002a94d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:18.976490 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529404160}
I20260709 13:05:18.955742 19911 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:18.918603 19927 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:18.988490 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:18.777082 19921 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:18.982612 19937 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:18.990677 19911 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:19.011066 19570 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:19.049938 19911 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:19.047132 19717 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:19.063620 19833 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:19.083734 19970 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:05:19.092274 19930 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:19.099417 19927 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:19.100402 19943 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.592s	user 0.007s	sys 0.006s
I20260709 13:05:19.141202 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.149231 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.149290 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:19.152168 15193 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:19.153232 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.155365 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2515) took 1239 ms. Trace:
I20260709 13:05:19.155398 15195 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:19.155941 15189 rpcz_store.cc:276] 0709 13:05:17.915851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.915967 (+   116us) service_pool.cc:224] Handling call
0709 13:05:17.916274 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.166782 (+250508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.154716 (+987934us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54003e6cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:19.155131 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":574723968}
I20260709 13:05:19.158224 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2509) took 1338 ms. Trace:
I20260709 13:05:19.158716 15197 rpcz_store.cc:276] 0709 13:05:17.819178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.820095 (+   917us) service_pool.cc:224] Handling call
0709 13:05:17.824250 (+  4155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.156893 (+332643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.157597 (+1000704us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400225bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:19.157996 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760244608}
W20260709 13:05:19.159476 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.172912 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:19.173883 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:19.174829 15266 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:19.173882 15264 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:19.182324 15269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:05:19.183390 15269 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:19.183988 15269 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:19.185544 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 197037us
I20260709 13:05:19.186882 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:19.195487 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 207297us
I20260709 13:05:19.207958 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2501) took 1288 ms. Trace:
I20260709 13:05:19.208453 15339 rpcz_store.cc:276] 0709 13:05:17.918870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.918992 (+   122us) service_pool.cc:224] Handling call
0709 13:05:17.919261 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.990194 (+ 70933us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:18.259377 (+269183us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.278779 (+ 19402us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.288378 (+  9599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:18.288438 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:18.288507 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.205653 (+917146us) spinlock_profiling.cc:243] Waited 7.04 ms on lock 0x7b180034e820. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419
0709 13:05:19.207451 (+  1798us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b5400059e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:19.207494 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.207738 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13293,"prepare.queue_time_us":479301,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":6821,"raft.queue_time_us":11510,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":12734,"spinlock_wait_cycles":178666112,"thread_start_us":243815,"threads_started":1}
I20260709 13:05:19.211266 15193 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:19.226784 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:19.226933 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:19.228231 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.228533 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.228965 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.233043 15189 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:19.233456 15195 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 7.
I20260709 13:05:19.233043 15197 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:19.229540 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.235273 15191 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:05:19.243702 15269 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.245138 18922 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.245932 19403 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.246919 19454 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:19.247573 19508 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:19.245185 18829 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:19.248751 19678 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.856s	user 0.007s	sys 0.005s
I20260709 13:05:19.010865 19724 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.248853 19564 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:19.250363 19727 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.251127 19759 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:19.251487 19725 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.252533 19570 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.257673 19675 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.258935 19833 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.294480 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 372026us
W20260709 13:05:19.302969 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 100022us
I20260709 13:05:19.311893 15269 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.313696 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 111607us
I20260709 13:05:19.310442 18829 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.094334 19910 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.343439 19727 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.344336 19727 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.347342 19899 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.348204 19899 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.350682 19570 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.351230 19403 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.352334 19725 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.338032 18922 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.338857 19693 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.370460 19693 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.405236 19727 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.527575 19727 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.528512 19727 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.405791 19936 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.420166 19823 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.342667 19675 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.533218 19898 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:19.341024 19678 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.533762 19833 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.534646 19833 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:19.448911 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 101368us
I20260709 13:05:19.544646 15192 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:05:19.545334 19838 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.546268 19838 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.406910 19962 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:19.416041 19910 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.533857 19898 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:19.572448 19833 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.574113 19838 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.352370 19968 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.582883 19899 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.580813 19762 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.800s	user 0.016s	sys 0.005s
I20260709 13:05:19.603238 19833 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.604161 19833 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.605342 19838 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.606011 19838 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.525795 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:19.633025 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 88298.4us
I20260709 13:05:19.606858 19833 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.644367 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 285177us
I20260709 13:05:19.645416 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:19.647532 19967 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:19.647938 19975 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:19.648190 18922 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.648645 19975 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:19.649107 19725 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:19.649788 19823 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.650050 19975 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.650527 19823 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.626971 19762 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.663388 19693 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.663757 19762 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:19.664198 19693 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.665256 19958 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.665125 19693 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.665951 19958 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.669947 18829 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.672880 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 301818us
W20260709 13:05:19.677523 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.672771 18922 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:19.660337 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 134169us
I20260709 13:05:19.688274 18922 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.690426 18922 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.694211 19454 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.695152 19454 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.699213 19838 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.700512 19911 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.626s	user 0.007s	sys 0.004s
I20260709 13:05:19.701085 19675 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.701506 19911 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.704454 15095 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 64) took 9969 ms. Trace:
I20260709 13:05:19.704600 19823 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.706692 19958 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.707388 19982 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.130s	user 0.004s	sys 0.000s
I20260709 13:05:19.708828 19965 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:19.712423 19758 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:19.718042 19678 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.718809 19792 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:19.720541 19706 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:19.714428 19985 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:05:19.725230 15197 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:19.728029 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.729279 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:19.731882 19762 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.737900 19898 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.704886 15095 rpcz_store.cc:276] 0709 13:05:09.735229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.738371 (+  3142us) service_pool.cc:224] Handling call
0709 13:05:19.704198 (+9965827us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:17.628865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:17.728840 (+ 99975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:17.728887 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:05:17.728905 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:17.729836 (+   931us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:17.729933 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:17.729971 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:05:17.730582 (+   611us) tablet.cc:701] Row locks acquired
0709 13:05:17.730604 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:05:17.730759 (+   155us) write_op.cc:270] Start()
0709 13:05:17.730878 (+   119us) write_op.cc:276] Timestamp: P: 1783602317730704 usec, L: 0
0709 13:05:17.730905 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:05:17.833882 (+102977us) log.cc:844] Serialized 2115 byte log entry
0709 13:05:18.675239 (+841357us) op_driver.cc:464] REPLICATION: finished
0709 13:05:19.073251 (+398012us) write_op.cc:301] APPLY: starting
0709 13:05:19.074938 (+  1687us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:19.102277 (+ 27339us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:19.102393 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:19.104871 (+  2478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:19.105045 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:05:19.105074 (+    29us) write_op.cc:312] APPLY: finished
0709 13:05:19.105256 (+   182us) log.cc:844] Serialized 56 byte log entry
0709 13:05:19.105383 (+   127us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.105452 (+    69us) write_op.cc:454] Released schema lock
0709 13:05:19.105483 (+    31us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:19.105781 (+   298us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.105797 (+    16us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4920719,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":389471,"apply.run_cpu_time_us":11473,"apply.run_wall_time_us":35798,"cfile_cache_hit":18,"cfile_cache_hit_bytes":18837,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":3837,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":5,"prepare.queue_time_us":538132,"prepare.run_cpu_time_us":32504,"prepare.run_wall_time_us":585076,"raft.queue_time_us":212346,"raft.run_cpu_time_us":35518,"raft.run_wall_time_us":383005,"replication_time_us":871256,"thread_start_us":1117450,"threads_started":4,"wal-append.queue_time_us":480415}]]}
I20260709 13:05:19.655689 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:19.751883 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 64298.3us
I20260709 13:05:19.754578 15190 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:19.643620 19910 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.765657 15872 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:19.698854 19454 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:19.770109 15195 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:19.751718 19833 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.765753 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.643740 19968 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.756574 19403 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.770154 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.783344 19995 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:05:19.784705 19988 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:05:19.785059 19762 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.787204 19937 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:19.755756 19965 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:19.756944 19838 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.813548 19995 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.814086 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:19.816038 19995 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.816694 19403 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.821720 19936 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:19.823338 19911 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:19.824079 19898 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:19.824543 19693 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.826200 19727 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.826543 19968 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.827922 19910 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:19.807402 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 170003us
I20260709 13:05:19.828392 19762 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:19.828975 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:19.829252 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.822466 19403 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.800671 19958 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.832571 19672 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:19.832535 19958 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.824030 19911 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.833343 19672 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.833623 19911 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.834976 19927 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:19.835458 19927 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:19.835772 19911 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.836234 19672 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.836517 19927 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.837989 19927 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.844277 19965 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:19.848162 19962 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:19.848706 19962 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:19.846910 19403 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.849676 19962 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:19.836253 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54131.1us
I20260709 13:05:19.853471 19986 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:19.853852 19762 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:19.854110 19706 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:19.858444 15196 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:05:19.858973 15195 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:05:19.834838 19958 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:19.802333 19570 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:19.881482 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52687.3us
I20260709 13:05:19.886178 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:19.892995 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:19.853854 19717 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:05:19.886088 19833 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.949342 15190 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:19.952955 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:19.904246 19838 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:19.979146 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:19.980757 15191 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:19.983767 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:19.973610 19990 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:19.987344 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2302) took 1411 ms. Trace:
I20260709 13:05:19.987792 15265 rpcz_store.cc:276] 0709 13:05:18.494752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.695864 (+201112us) service_pool.cc:224] Handling call
0709 13:05:18.719274 (+ 23410us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:18.765477 (+ 46203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.765521 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:18.766245 (+   724us) log.cc:844] Serialized 78 byte log entry
0709 13:05:19.181556 (+415311us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b1800442b40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:19.351744 (+170188us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:19.417041 (+ 65297us) log.cc:844] Serialized 14 byte log entry
0709 13:05:19.706573 (+289532us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:19.882577 (+176004us) log.cc:844] Serialized 14 byte log entry
0709 13:05:19.882775 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.893123 (+ 10348us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.893164 (+    41us) raft_consensus.cc:1685] finished
0709 13:05:19.893175 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.906582 (+ 13407us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":451482,"prepare.queue_time_us":231412,"prepare.run_cpu_time_us":948,"prepare.run_wall_time_us":16052,"raft.queue_time_us":21847,"raft.run_cpu_time_us":405,"raft.run_wall_time_us":11903,"spinlock_wait_cycles":70110336,"thread_start_us":425984,"threads_started":2,"wal-append.queue_time_us":634936}
W20260709 13:05:19.990329 19891 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.197s	user 0.026s	sys 0.002s
I20260709 13:05:19.991353 15270 raft_consensus.cc:2410] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:05:19.991302 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:19.986018 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:19.973941 19958 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:19.983943 19975 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.006810 19967 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.007616 19967 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.008260 20004 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.008934 20004 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.010510 20008 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.011319 19999 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.011168 20008 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.011925 19999 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.013499 20008 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.014060 20008 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.015867 15269 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:20.012287 19761 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.017176 19761 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.018426 19962 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:20.020941 19987 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:20.021377 19987 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:20.021647 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.022389 15264 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:20.023695 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.024374 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:20.024714 15267 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:19.986068 19403 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.003525 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.030674 15268 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:05:20.031376 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.031657 19727 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:20.031978 15266 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:05:20.032342 19727 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.014577 20008 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.041946 19958 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.048092 19403 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.048255 19906 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:05:20.049319 19906 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:20.049546 19958 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.049710 19906 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:20.050203 19403 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.042876 19981 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.043449 19975 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.035991 19727 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:20.060338 19833 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.061098 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:20.045495 19838 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.055992 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.062947 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.025962 19937 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:20.056761 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 281872us
I20260709 13:05:20.067802 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.068130 19838 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:20.068629 19838 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.069048 19838 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:20.069180 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.025679 20004 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.067831 19833 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:20.085002 19833 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:20.085069 20010 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.086145 20010 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.089339 20010 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.051259 19981 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.093813 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.094627 15196 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:20.095541 15271 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:20.101550 19975 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:20.103513 19678 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:20.106709 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.086453 19833 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.022415 19987 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.120469 19998 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:20.121436 19998 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:20.121639 19967 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:20.121861 19998 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:20.050840 19906 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.097668 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:20.124202 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:20.124922 15868 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:20.126703 19990 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.109833 19987 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:20.127279 19990 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:20.128180 19706 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:20.128603 19706 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.128981 19706 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.129120 19761 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:20.127532 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74752.4us
I20260709 13:05:20.131095 19761 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:20.122944 19998 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.146431 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:20.098126 19981 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:20.155208 15872 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:20.135237 20004 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.161441 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.167380 15270 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
W20260709 13:05:20.174890 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.160251 19998 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:20.179804 18829 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:20.157305 19967 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:20.159546 19981 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.182631 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.186868 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.203758 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:20.179171 19975 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:20.197643 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:20.208155 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62010.3us
I20260709 13:05:20.209493 15312 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:20.163976 20004 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.213946 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.215055 15264 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:20.215371 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.215713 20004 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.217571 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.218266 15263 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 8.
I20260709 13:05:20.219112 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:20.219293 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:20.219750 15270 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:20.220556 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.220837 15271 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:20.223278 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.223891 19958 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.224529 19958 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.226235 20008 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.229257 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.230583 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.231267 15264 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:20.163009 19761 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:05:20.232764 15266 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:20.234407 15263 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:20.235620 19698 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.226878 19958 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.186870 19967 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:20.231757 15271 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:20.244958 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:20.245710 15191 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:20.216087 15267 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:20.246928 15191 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:20.235934 19986 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.236997 19403 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:20.282083 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:20.286720 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77382.3us
I20260709 13:05:20.287760 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.288527 15197 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:20.291886 19980 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.292618 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:20.294834 19996 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.359s	user 0.000s	sys 0.004s
I20260709 13:05:20.292471 19980 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.286581 19761 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.322026 15270 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:20.236425 19698 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.316210 15191 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.326277 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.296336 19403 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:20.320938 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.332866 15193 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:20.336055 15191 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:20.372467 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:20.374542 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.376660 15269 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:20.336387 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.408593 15192 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:20.328576 19761 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.285960 19981 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.413308 15344 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:20.413270 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.322839 19975 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
W20260709 13:05:20.429543 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 133679us
I20260709 13:05:20.427784 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.323189 19927 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:05:20.323050 19792 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:05:20.430264 15268 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:20.319617 19986 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.435578 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.452435 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.453186 15192 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:20.437420 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.458236 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:20.451069 15237 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.700s (SENT)
I20260709 13:05:20.454663 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.460536 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.461279 15197 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:20.463304 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.409583 19967 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.464634 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:20.449545 19936 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:20.450911 19570 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:20.478796 15272 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:20.480072 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.485140 15266 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:05:20.487612 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.488696 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.465797 19937 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:20.491791 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.497958 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:20.500273 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.446430 19403 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.513636 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.490993 19985 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:20.478400 19570 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:20.515719 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.475682 19990 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.522388 19698 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:20.524621 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:20.525364 15194 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:20.526146 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:20.526789 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.527933 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.528918 20016 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:05:20.529964 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.530073 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.530722 18938 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:20.531126 18938 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:20.531162 19967 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.532151 18938 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.533388 18938 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:20.533452 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.534032 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.534243 15188 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
W20260709 13:05:20.537214 20013 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.253s	user 0.003s	sys 0.019s
I20260709 13:05:20.537945 19706 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:20.539283 20018 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.229s	user 0.000s	sys 0.002s
I20260709 13:05:20.539427 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.545838 19906 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:20.549469 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.550588 19570 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.551199 19823 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:20.551637 19823 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:20.551893 19570 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:20.552717 19998 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:20.552507 19823 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.553921 15195 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:20.554175 19823 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:20.556341 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.558146 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.559006 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.559698 18829 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.560148 18829 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:20.561138 19981 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.559717 15188 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:20.564510 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.564706 19761 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:20.566473 19980 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:20.569150 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48578.8us
I20260709 13:05:20.570451 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.558817 15195 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:20.571827 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.573182 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.573994 19958 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:20.574097 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.574479 19958 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.574887 19958 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:20.575769 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.576700 19965 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:20.577175 19965 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.577589 19965 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.579834 20004 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:20.580252 20004 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.580598 20004 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:20.584192 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.582986 19958 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:20.556643 20019 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:20.557045 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.557853 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.589455 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:20.591282 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:20.592411 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70538.2us
I20260709 13:05:20.596689 15344 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:20.598075 15338 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:20.599435 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.603235 18829 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.604841 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:20.606583 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:20.573110 19706 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:20.611331 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.642903 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.642890 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.645469 15266 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:20.591667 19758 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.612263 15868 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:20.598327 19962 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:20.643512 15194 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:20.650171 18829 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.602860 20008 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:20.659546 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 208513us
I20260709 13:05:20.674144 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.679684 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:20.686520 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:20.673295 19987 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.009s
I20260709 13:05:20.694792 15266 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:20.649488 19981 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.655987 19962 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.661787 20008 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.693172 15872 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:20.697458 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:20.732723 15237 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.708s (SENT)
W20260709 13:05:20.733771 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46151us
I20260709 13:05:20.735500 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.734113 18829 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:20.737849 18829 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.738348 18829 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:20.661911 19758 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:20.738582 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 90850.1us
I20260709 13:05:20.738582 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.719136 19962 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:20.754563 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.757666 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.758673 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:20.733500 20008 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:20.732956 19998 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.772342 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.777088 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:20.784902 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:05:20.785517 20028 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:05:20.786118 20025 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:05:20.786746 19900 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:20.787412 19900 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.787880 19900 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:20.788923 20045 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:20.789592 20045 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.752141 19823 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:05:20.771502 19675 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.791239 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:20.791931 19675 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.792287 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:20.792876 15869 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:20.794207 19675 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.731864 19981 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.802469 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.816052 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.817006 15341 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:20.818018 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.819299 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.819898 15340 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:20.820308 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.820847 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.821537 15340 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:20.822252 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.824028 19985 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:20.824983 15343 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:20.825083 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:20.797923 19838 consensus_meta.cc:287] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.004s
I20260709 13:05:20.827395 19838 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.828701 15265 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 7. Current term is 8. Ops: []
W20260709 13:05:20.829403 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.827391 20045 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:20.830343 19838 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.833979 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.835681 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.838124 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:20.837970 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.838620 15189 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.839388 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.840795 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.841346 15341 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
W20260709 13:05:20.843267 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.845279 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.846468 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.847359 19675 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:20.847813 19675 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.848323 19675 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:20.848814 20024 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:05:20.850121 20015 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
W20260709 13:05:20.847640 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 75064.4us
W20260709 13:05:20.851400 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 140519us
I20260709 13:05:20.852903 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:20.854928 19823 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:20.855779 15868 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:20.786057 20034 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.776332 19986 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:20.870196 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.870592 15189 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:20.780499 19980 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:20.881820 15190 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:20.881927 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:20.882565 15188 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:20.802121 19958 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.878825 15338 raft_consensus.cc:2368] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
W20260709 13:05:20.883549 15237 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.780s (SENT)
I20260709 13:05:20.897339 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:20.902513 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.902231 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:20.906239 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.783625 19998 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:20.910993 18829 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.872037 15342 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:20.875002 19936 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:20.917464 15197 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:20.918684 15191 consensus_meta.cc:287] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:05:20.919112 15191 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:20.891952 19986 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.926328 18829 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.880180 19980 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:20.911645 20023 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:05:20.930751 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.910595 19672 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:20.936589 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.936882 19672 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.938194 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:20.938602 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.939231 19672 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.939713 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.940481 15338 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:20.941293 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.942354 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:20.926625 19761 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.955569 19761 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.910410 20034 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.957949 19761 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:20.921319 19823 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:20.935401 15337 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:20.935739 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:20.936297 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.935853 19986 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.959017 20034 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:20.961712 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.972477 15337 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:20.973327 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.974531 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.962054 15343 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:20.976011 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.976992 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.978076 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:20.978888 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 119035us
I20260709 13:05:20.963569 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.980226 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.981186 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.981796 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.942863 15338 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:20.911806 19990 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.984375 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:20.964993 19986 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:20.881342 19927 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:05:20.994429 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.995509 15340 raft_consensus.cc:2410] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:05:20.921902 19936 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.933965 19980 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:20.959417 19999 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:21.007639 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.968662 19975 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:20.962472 19758 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:20.959329 19823 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:20.925298 19987 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:20.974598 19675 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.031519 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:20.958787 19965 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:20.997835 19706 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:21.012980 19927 consensus_queue.cc:1243] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:21.003371 20047 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:21.008265 20043 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:21.003163 19936 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:21.058770 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.016057 19975 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:21.080135 15272 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
W20260709 13:05:21.066962 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 154225us
I20260709 13:05:21.047765 19403 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.031674 20046 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.082031 15341 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:21.080744 15272 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:21.050513 19998 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.086974 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.087682 15267 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:21.087052 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.088392 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.017020 20004 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.091423 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.019433 20045 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:05:21.063645 19706 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:21.088586 15340 raft_consensus.cc:2376] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14. Re-sending same reply.
I20260709 13:05:21.094851 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:21.089488 19906 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.543s	user 0.012s	sys 0.000s
I20260709 13:05:21.085134 19823 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:21.107864 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.109935 15873 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:21.111773 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.110494 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.096308 19758 raft_consensus.cc:2764] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:21.083897 19987 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:21.100358 19706 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:21.100740 20047 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.106457 19899 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:21.119081 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.125319 15343 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:21.120596 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:21.117487 15338 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:21.126926 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.133015 15341 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:21.135344 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.114573 20008 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.141505 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.092396 20046 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.143740 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.144268 15190 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:21.097363 19900 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.125710 19990 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:21.148087 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.150418 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.133910 19899 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:21.151705 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.156454 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.157819 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.160575 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.161715 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:21.162614 20044 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:21.124775 19962 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.163002 20044 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.171473 20044 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.172345 19986 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:21.172737 19986 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:21.173616 19986 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.174048 19900 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:21.163618 20050 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:21.163241 19833 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:21.170872 15337 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:21.169432 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.174829 15195 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 12. Ops: [10.6-10.6]
I20260709 13:05:21.110181 19403 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.169734 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.179411 15263 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.096920 20043 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.183698 19987 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:21.185213 19936 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.187238 19936 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.187543 19675 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:21.188344 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.189054 15342 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:21.190037 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.176815 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.169116 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.190591 15272 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:21.178148 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.180760 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.181126 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.181406 15340 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:21.177209 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.191787 15266 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:21.191002 15341 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:21.195505 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.195745 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.196105 15340 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 8.
I20260709 13:05:21.196403 15266 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:21.196929 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.197108 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.197635 15340 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:21.198109 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.198328 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.134876 20047 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.199294 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.199991 15338 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:21.200675 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.201274 15338 raft_consensus.cc:2368] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
W20260709 13:05:21.169682 20035 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.405s	user 0.000s	sys 0.001s
W20260709 13:05:21.204569 15345 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.000s
W20260709 13:05:21.205354 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.209295 15345 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
W20260709 13:05:21.209477 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.209574 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.152626 19927 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.155920 19899 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.176822 19990 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:21.210583 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.133513 19975 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.222514 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.282153 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.174824 19986 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.214332 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.216255 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:21.285876 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50867.9us
W20260709 13:05:21.283433 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72890.4us
I20260709 13:05:21.286516 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:21.288120 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.211340 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.284013 15195 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:21.288888 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:21.280629 15264 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:21.284265 15341 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:21.211237 15263 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:21.289013 15190 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:21.212141 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.222513 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.291677 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:21.294137 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.226006 15191 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:21.294293 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.297739 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:21.215906 20020 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.481s	user 0.001s	sys 0.001s
I20260709 13:05:21.298991 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.207896 19833 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:21.218413 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.328681 15195 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:21.222235 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.331382 15344 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
W20260709 13:05:21.334447 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 188346us
I20260709 13:05:21.335299 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.337129 20054 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:21.337564 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.339907 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.340530 19724 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:21.341034 19724 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:21.341460 19724 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:21.342676 19906 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.326481 19675 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:21.343351 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.343919 19990 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.344424 19823 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.346637 19823 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:21.347172 20012 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:05:21.329262 19833 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:21.347841 19833 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.351624 19980 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.352623 15196 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:21.353696 19980 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.354128 20004 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.355504 19403 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.337677 20054 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:21.343953 19675 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:21.356302 19675 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:21.356606 20054 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.334493 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.358774 15269 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:21.359098 19975 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.359305 15091 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.360996 15091 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 8 to 11, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 11 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.334481 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.334600 20040 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.363746 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.280144 20008 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.290457 20010 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:21.365155 20010 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.365725 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.366755 19981 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.366825 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.367225 20010 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.297410 19936 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.368040 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.346966 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.368826 15270 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:21.369321 15342 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:05:21.363737 15338 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:21.365517 15337 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:21.353624 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.224718 20046 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:21.370877 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.362658 15091 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 12 to 13, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 13 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.374094 15272 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:21.374727 15196 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:21.290771 20042 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:21.376138 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2267) took 1147 ms. Trace:
I20260709 13:05:21.379550 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.381738 15265 rpcz_store.cc:276] 0709 13:05:20.229130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.235453 (+  6323us) service_pool.cc:224] Handling call
0709 13:05:20.235744 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.829175 (+593431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.375923 (+546748us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400415fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:21.376077 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363250560}
I20260709 13:05:21.208895 19725 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:21.380095 15269 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:21.383795 15091 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 9 to 13, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 13 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.383073 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.386672 15338 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:21.326426 19761 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:21.380745 15270 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:21.215303 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.306043 20034 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:21.389030 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51533us
I20260709 13:05:21.385783 15269 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:21.217377 20045 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:21.390735 15091 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 11 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 15 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.395188 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.374876 19936 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:21.294282 19958 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:05:21.426321 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:21.429394 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.403069 15091 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 8, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 8 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:21.383790 20042 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:21.437925 15272 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:21.438004 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2511) took 1006 ms. Trace:
I20260709 13:05:21.431846 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.457667 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.440490 15270 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:21.458609 19672 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.390060 19761 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.459295 19761 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.425894 20010 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:21.466317 19672 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:21.467234 19981 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.467372 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.469086 15270 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:21.469403 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.456068 15345 rpcz_store.cc:276] 0709 13:05:20.432116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.458794 (+ 26678us) service_pool.cc:224] Handling call
0709 13:05:21.437858 (+979064us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54002738d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:21.437950 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170675584}
I20260709 13:05:21.301303 20044 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.470183 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:21.471379 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44739.1us
I20260709 13:05:21.296411 19927 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.457682 15269 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 13:05:21.455650 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.468966 15091 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 9 to 12, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 12 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.476270 15272 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:21.477643 15272 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:21.398908 20045 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.480595 20044 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.480983 20045 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.480305 15091 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 9 to 12, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 12 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.396214 19937 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:05:21.439677 20034 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:21.484464 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.485078 15269 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.485347 20034 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.486068 15343 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:05:21.487257 20044 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:21.487408 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:21.488343 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:21.488682 19986 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:21.489194 19986 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.489552 19986 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:21.493834 19570 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:21.494341 19570 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.494688 19570 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:21.496622 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.525051 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.525769 15190 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:21.482254 15091 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:21.534759 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:21.535879 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.531445 19698 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:05:21.427142 19967 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:05:21.543596 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.545056 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.546356 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.554936 15190 raft_consensus.cc:2410] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:21.483816 20042 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.557685 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.558487 15268 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:21.574577 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.542326 19962 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:21.597410 19919 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.598075 19919 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.603850 19965 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.605628 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.606331 15263 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.609159 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.525604 19987 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:05:21.624886 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.623869 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.612529 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.624907 15196 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:21.629401 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.630337 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.613896 15269 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:05:21.613984 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69026.9us
I20260709 13:05:21.595240 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.638924 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.553409 19985 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
W20260709 13:05:21.644690 19706 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.505s	user 0.002s	sys 0.006s
I20260709 13:05:21.645262 19706 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.646488 15338 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:21.646584 15344 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:21.649029 15346 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:05:21.645270 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 189698us
I20260709 13:05:21.650256 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.657259 19985 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:21.657728 19985 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:21.660053 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.660216 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.660817 15190 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.577373 15091 catalog_manager.cc:5697] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 12, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 12 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.650794 20010 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:21.665823 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.675621 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.677062 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:21.677663 15870 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.678920 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.679875 19927 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:21.680405 19927 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.681087 19927 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:21.682385 19927 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:21.682972 19823 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:21.685760 15870 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:21.680315 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.712752 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.683178 20044 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:21.686290 19962 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.716146 19962 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.718101 19962 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:21.719928 20047 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.721428 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2283) took 1263 ms. Trace:
W20260709 13:05:21.725494 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45241.5us
I20260709 13:05:21.726222 19758 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:21.726562 19833 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.728585 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2334) took 1209 ms. Trace:
I20260709 13:05:21.665131 19936 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:21.730708 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.736621 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.734411 15267 rpcz_store.cc:276] 0709 13:05:20.518929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.756044 (+237115us) service_pool.cc:224] Handling call
0709 13:05:21.085821 (+329777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.088030 (+  2209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.728333 (+640303us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400349250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:21.728512 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757571456}
I20260709 13:05:21.739470 18829 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:21.739962 18829 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.740259 18829 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.741357 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.741918 15268 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.721802 15271 rpcz_store.cc:276] 0709 13:05:20.457882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.465520 (+  7638us) service_pool.cc:224] Handling call
0709 13:05:20.481514 (+ 15994us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:20.516567 (+ 35053us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:20.527583 (+ 11016us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.125893 (+598310us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b1800329f20. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9
0709 13:05:21.220085 (+ 94192us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b1800329f20. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:21.355452 (+135367us) spinlock_profiling.cc:243] Waited 63.9 ms on lock 0x7b1800329f20. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:05:21.530812 (+175360us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:21.545905 (+ 15093us) log.cc:844] Serialized 52 byte log entry
0709 13:05:21.546126 (+   221us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:21.546403 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.546597 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.546686 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:21.721210 (+174524us) raft_consensus.cc:1685] finished
0709 13:05:21.721230 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.721374 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36476,"prepare.run_cpu_time_us":249,"prepare.run_wall_time_us":249,"raft.queue_time_us":13616,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":14116,"spinlock_wait_cycles":209600640,"thread_start_us":175079,"threads_started":1,"wal-append.queue_time_us":1155548}
I20260709 13:05:21.746917 15263 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
W20260709 13:05:21.747957 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.745781 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.658610 19985 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.753386 15272 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:21.755532 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 105348us
I20260709 13:05:21.758680 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:21.759629 15091 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.760666 15264 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:21.759296 18829 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.762682 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.736038 19758 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.731706 19987 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:21.733073 19823 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:21.768970 19958 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:21.738714 19717 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:21.772552 18938 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:21.767156 20047 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:21.778421 19958 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:21.780594 20047 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:21.780920 19761 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.781805 20047 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.782471 19725 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:21.782975 19725 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.783839 15191 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:21.732545 20055 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:05:21.780699 19958 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.756961 19936 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:21.785411 15091 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 10, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.786626 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.787592 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:21.787923 15343 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 11. Ops: []
I20260709 13:05:21.792680 15272 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.792692 19761 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:21.787211 18829 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.790659 20008 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:05:21.773134 19758 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.800958 15272 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:21.805384 19761 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:21.806124 19919 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:21.805976 19761 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.807972 19761 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:21.814589 15272 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:21.801548 15091 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 8 to 10, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.778535 20046 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:21.813812 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:21.774729 20044 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:05:21.791550 19985 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:21.819959 19403 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:21.825484 20044 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:21.825963 20044 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:21.827184 20004 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:21.811210 20040 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:21.827764 20004 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.828744 15091 catalog_manager.cc:5697] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 6 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.829820 20004 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.825524 19403 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:21.831627 19403 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.832229 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1778) took 1039 ms. Trace:
W20260709 13:05:21.826073 20065 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:21.834915 15344 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:05:21.830619 15091 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 10 to 13, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 13 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.835381 15344 pending_rounds.cc:85] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 5
I20260709 13:05:21.832779 15346 rpcz_store.cc:276] 0709 13:05:20.792994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.795668 (+  2674us) service_pool.cc:224] Handling call
0709 13:05:21.211875 (+416207us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b58001f0e98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:05:21.831966 (+620091us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b54003ab1d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:21.832160 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837309056}
I20260709 13:05:21.836567 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:21.835732 15344 pending_rounds.cc:107] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:05:21.839354 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.841920 15344 raft_consensus.cc:2889] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:21.840381 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62776.8us
I20260709 13:05:21.832868 19403 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:21.843149 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.842839 15272 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:21.847517 15091 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 10, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.855594 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.856765 15091 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 8 to 10, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.867566 19927 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:21.867971 19761 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:21.868345 19965 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:21.868271 15091 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.869460 19761 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:21.869885 19761 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:21.870807 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.860208 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:21.870729 19761 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.871630 15870 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:21.871970 20043 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:21.872330 19761 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:21.873392 20008 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.860985 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:21.871075 15873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 324) took 1140 ms. Trace:
I20260709 13:05:21.876484 15873 rpcz_store.cc:276] 0709 13:05:20.730802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.730954 (+   152us) service_pool.cc:224] Handling call
0709 13:05:21.870802 (+1139848us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54006301d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:21.870974 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743443712}
I20260709 13:05:21.876827 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.842149 20073 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:05:21.880962 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67231.6us
I20260709 13:05:21.881775 15870 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:21.881737 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.883991 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.889302 18938 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:21.890799 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:21.891896 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.870225 15091 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 12, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 12 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:21.881536 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.894548 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:21.898061 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.901991 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.902199 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.903251 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.903520 20043 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:21.903936 20075 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:21.904157 19981 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:21.904414 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:21.905874 15191 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:21.907451 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.907907 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.908181 15341 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:21.908854 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.908906 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.911132 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:21.910797 15343 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:05:21.912034 15343 pending_rounds.cc:85] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 9
I20260709 13:05:21.912305 15343 pending_rounds.cc:107] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:21.912540 15343 raft_consensus.cc:2889] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:21.904758 19937 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:05:21.913479 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:21.913823 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:21.915074 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.904520 19967 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:05:21.919600 15192 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:21.919991 20073 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:21.920869 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.927959 20075 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:21.928406 15873 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:21.928900 20075 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:21.932346 19833 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:21.932437 19967 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:21.934676 15341 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:21.935251 18938 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:21.904559 19981 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:21.900566 19724 consensus_meta.cc:287] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.551s	user 0.002s	sys 0.021s
I20260709 13:05:21.838335 20045 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.945554 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.945785 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:21.964108 15870 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:21.946632 18938 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:05:21.965148 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54120.8us
I20260709 13:05:21.965729 18938 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:21.893077 19899 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260709 13:05:21.883311 19823 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.942098 15091 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.942550 20043 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.942001 19967 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:21.950554 20074 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.950911 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:21.950570 19981 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:21.954514 20008 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.955183 19919 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:21.956717 19975 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:21.988878 15270 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:21.957383 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:21.989552 18938 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.990660 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:21.959076 19706 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:21.826922 20044 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.899967 20042 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:21.932533 19698 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:21.832939 19936 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.972564 15268 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:21.946144 20057 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:21.977501 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:22.007761 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73880.7us
I20260709 13:05:22.008126 15191 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:05:21.884315 19675 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.958243 19761 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:21.992103 15266 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:21.994204 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:21.995445 18938 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.998435 15267 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:21.999065 15091 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 10, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.000741 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.006609 15345 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:21.920902 20073 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.013026 15870 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:21.988384 19919 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.981587 19965 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:21.980626 20055 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:21.996913 19962 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:22.021878 15091 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.024564 15190 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:22.018162 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:22.024243 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.963989 19724 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:21.970274 19987 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:05:22.029630 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.033591 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.976553 19986 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.039772 18829 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:22.040283 18829 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.040705 18829 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:22.033852 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:21.969822 19899 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.034744 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:22.042291 15191 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:22.043216 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:22.001381 19698 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.013857 19833 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:21.993105 20074 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:22.043758 15191 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:22.021185 19706 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:22.069626 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 87439.7us
I20260709 13:05:22.080693 15193 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:22.082690 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.023943 19965 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:22.090754 15190 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:22.027866 20044 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:22.092041 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.028921 19962 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:22.093595 15188 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:22.037864 20057 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:22.023748 19919 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:22.037801 20042 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:22.115195 18938 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:22.115859 18938 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:22.129734 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47114.9us
I20260709 13:05:22.130753 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:22.088693 19761 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:22.043737 19717 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 13:05:22.144661 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 154058us
I20260709 13:05:22.136309 15091 catalog_manager.cc:5697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 9, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 9 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.138484 15189 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:22.148451 15189 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:22.149138 18938 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:22.110809 19962 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:22.135020 20042 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:22.172956 20042 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.127409 20047 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:22.145620 19958 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.179070 15272 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:22.180462 15091 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 10, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.182154 15091 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.199882 15091 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:05:22.201481 19570 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.706s	user 0.009s	sys 0.007s
I20260709 13:05:22.201956 19570 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.203899 19758 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.206091 19758 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.038055 19672 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:05:22.139881 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.088068 19990 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:05:22.157635 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.150920 20077 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:05:22.159449 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:22.240401 15267 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: [12.8-13.9]
I20260709 13:05:22.159626 19706 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:22.160336 15340 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:22.145032 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:22.161010 19724 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.161257 15189 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:22.102957 20054 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:05:22.163393 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:22.167661 19698 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.090260 19833 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.143908 19761 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.063639 19967 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.128443 20057 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:22.183233 20070 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:05:22.184665 20074 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:22.187120 19675 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.189358 19725 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.190596 15188 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:22.192456 19899 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.195487 19986 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:22.157570 15191 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:22.201679 15091 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 12, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 12 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.269238 15091 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 9, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 9 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.141680 18829 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.093170 19965 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:22.152346 20008 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:05:22.225654 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 182992us
I20260709 13:05:22.256425 19985 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:22.208376 19962 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:22.233835 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 94026.1us
I20260709 13:05:22.283332 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:22.234325 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 204788us
I20260709 13:05:22.235695 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:22.284257 15263 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:22.272526 18829 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.237787 15266 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:22.124557 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:22.286191 15190 raft_consensus.cc:606] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.286648 15190 raft_consensus.cc:614] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:22.246349 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:22.247891 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.288201 15269 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:22.248863 15189 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:05:22.250305 15271 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:05:22.251948 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 106984us
I20260709 13:05:22.240903 20004 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:22.297627 15195 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:22.257148 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:22.259383 20045 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.253835 19706 consensus_queue.cc:1243] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:22.227445 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2578) took 1020 ms. Trace:
I20260709 13:05:22.283167 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.304965 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.154503 15270 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:22.271008 15091 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 7 to 10, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:22.294600 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.241070 20055 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:22.248584 19758 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:22.301868 15193 rpcz_store.cc:276] 0709 13:05:21.207421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.294110 (+ 86689us) service_pool.cc:224] Handling call
0709 13:05:21.339355 (+ 45245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.083295 (+743940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.226909 (+143614us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54001e7dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:22.227341 (+   432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1704534272}
I20260709 13:05:22.279322 19967 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:22.279173 19985 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.281255 19698 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:22.272955 19833 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.277407 20008 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:22.326902 15269 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:22.331389 15091 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 8 to 10, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:22.347828 15091 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 4 to 6, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 6 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:05:22.358004 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80331.4us
I20260709 13:05:22.376881 15197 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:22.346930 20008 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:22.330253 19985 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:22.319089 19403 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:22.384182 18829 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:22.344040 20045 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:05:22.386205 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 81426.6us
I20260709 13:05:22.387449 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:22.319360 20088 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:22.390623 20088 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:22.392009 20076 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.390s	user 0.004s	sys 0.000s
I20260709 13:05:22.393029 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:22.393343 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:22.393643 15193 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:22.394027 15188 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 9: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:22.394078 19990 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:22.395268 20087 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:22.395659 20087 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:22.398069 19975 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.398680 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2572) took 1192 ms. Trace:
I20260709 13:05:22.398573 19975 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.399084 15197 rpcz_store.cc:276] 0709 13:05:21.206046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.208030 (+  1984us) service_pool.cc:224] Handling call
0709 13:05:21.827810 (+619780us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:05:21.828042 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.378593 (+550551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.398453 (+ 19860us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54003e71d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:22.398623 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270922496}
I20260709 13:05:22.400636 19975 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:22.402251 19975 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:22.307125 19761 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.372931 19570 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:22.405359 19990 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:22.405601 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.406234 19990 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:22.406572 19936 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:22.406661 19990 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:22.414214 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:22.415179 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.415388 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.416378 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:22.416401 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.417641 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.406333 19981 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:22.423012 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.424110 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.380841 19758 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:22.430709 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.434002 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.439738 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:22.440488 15340 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:22.421489 20010 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:22.421692 20045 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:22.424758 19900 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:05:22.422514 20044 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:22.445191 15237 leader_election.cc:400] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:22.448062 15237 leader_election.cc:403] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:22.426859 19403 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:22.445549 15342 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:22.446563 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:22.426859 19899 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:22.447376 15194 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:22.429837 19833 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:22.447183 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:22.432247 19936 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:22.409875 19990 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:22.453958 15338 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:22.486428 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:22.487684 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:22.450677 20045 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:22.440912 19986 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:05:22.519840 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.529098 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.530087 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.530560 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:22.531443 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.382675 20055 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:22.524765 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.551724 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.554195 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.442102 19672 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:22.556456 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:22.561789 15266 raft_consensus.cc:2368] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:05:22.555615 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.566960 15270 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:22.456106 19403 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:22.528287 20045 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:22.613188 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.613863 15271 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:22.619210 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 188612us
I20260709 13:05:22.634932 15193 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:22.562379 20044 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:22.647487 15338 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:22.566576 19725 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.442516 20096 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.191s
I20260709 13:05:22.591562 19403 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:22.571410 19962 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:22.622363 19990 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:22.689489 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:22.698133 15270 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:22.699223 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:22.701144 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.701067 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.701853 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.702461 15270 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:22.702929 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.637368 19936 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:22.705781 15193 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 10.
I20260709 13:05:22.652782 20101 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:22.711740 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 181645us
I20260709 13:05:22.660825 20073 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:22.719266 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:22.662281 20044 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:22.710599 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 270541us
I20260709 13:05:22.646238 19975 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 13:05:22.709263 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 280801us
I20260709 13:05:22.721961 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:22.722527 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 192051us
I20260709 13:05:22.569983 19758 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.728199 18829 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:22.727367 15264 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:05:22.704571 20074 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:22.730559 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.704382 20075 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.704236 19823 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:22.731709 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:22.722673 20086 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
W20260709 13:05:22.725643 19919 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.003s
I20260709 13:05:22.736651 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:22.737489 20099 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:05:22.378837 20057 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.397025 20088 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.732506 15160 leader_election.cc:400] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:05:22.752208 15309 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.747223 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.748685 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:22.751693 19706 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:22.753688 20093 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:05:22.754441 19706 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:22.574854 20087 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.752447 15160 leader_election.cc:403] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:22.609406 20040 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:22.759196 19987 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:05:22.750204 18829 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:22.762475 20092 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:05:22.763230 20100 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:05:22.764120 20097 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:05:22.741365 20103 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:22.754972 19706 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.756387 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:22.741333 20089 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 13:05:22.726135 20073 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:22.783603 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55646.8us
I20260709 13:05:22.784147 18829 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:22.791174 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44033.4us
W20260709 13:05:22.779657 20043 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.799s	user 0.006s	sys 0.004s
I20260709 13:05:22.795534 20043 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:22.772471 20087 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:22.771456 19936 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:22.797746 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 94888.8us
I20260709 13:05:22.799571 18938 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:22.799939 18938 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.793609 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.800500 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.800623 18938 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.801690 18938 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:22.801853 15271 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:22.749446 20106 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:22.768395 19987 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:22.759569 19570 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:22.817088 18829 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:22.779140 19958 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.771778 20085 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:22.824718 19570 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.824954 20085 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:22.749274 19986 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:05:22.771241 20044 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.825731 19570 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.792112 19980 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:05:22.746345 20075 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.823995 20098 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:22.806800 20103 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:22.750805 19919 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:22.835414 15870 raft_consensus.cc:2368] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:05:22.821703 19899 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:22.836086 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.836371 19899 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:22.821652 19965 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.000s
I20260709 13:05:22.841141 20112 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:22.843178 19570 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:22.843514 20073 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.823946 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:22.848206 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.848764 19675 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:22.849319 19675 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:22.849407 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.851215 20043 raft_consensus.cc:2764] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:05:22.852885 20084 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:22.853404 20084 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.853207 19403 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.855175 20106 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:22.855710 20008 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.856179 20106 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.857872 20008 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.857968 20004 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:22.822288 20096 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:05:22.775246 20101 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:05:22.859375 19706 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:22.860289 20101 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:22.860626 20101 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.861479 20101 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.862715 20101 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:22.775444 20105 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:22.850692 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.873769 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:22.863463 15263 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:22.802502 19717 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:22.806115 20040 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:22.871690 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49917.2us
I20260709 13:05:22.867707 15269 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:22.884578 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.837245 19899 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.896627 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.901073 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2584) took 1022 ms. Trace:
I20260709 13:05:22.891685 20040 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:22.893244 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:22.876546 20105 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:22.894446 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:22.823123 19987 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:22.820614 20047 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:22.901506 15195 rpcz_store.cc:276] 0709 13:05:21.878926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.882049 (+  3123us) service_pool.cc:224] Handling call
0709 13:05:21.893108 (+ 11059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.300065 (+406957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.900854 (+600789us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54000f8cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:22.901021 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895488768}
I20260709 13:05:22.918752 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2580) took 1041 ms. Trace:
I20260709 13:05:22.850376 19675 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.906778 15266 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:22.746119 20074 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:22.908387 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 57791us
I20260709 13:05:22.892696 19958 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:22.932874 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.840123 19965 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.854429 20084 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:22.833945 19698 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:22.876811 19717 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.919245 15194 rpcz_store.cc:276] 0709 13:05:21.876994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.891923 (+ 14929us) service_pool.cc:224] Handling call
0709 13:05:22.918509 (+1026586us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54002364d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:22.918680 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199926144}
I20260709 13:05:22.907665 20040 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:22.947502 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54349.4us
I20260709 13:05:22.949048 15270 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:22.920687 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 190140us
I20260709 13:05:22.917107 19927 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:22.955077 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:22.965741 15272 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:22.968957 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:22.944048 19403 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:22.980541 15269 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:22.981438 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:22.982244 15197 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:22.984217 15197 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:22.955193 20088 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:22.986883 15267 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:22.961970 19717 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:22.990005 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45109.9us
I20260709 13:05:22.988408 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:22.995641 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 182070us
I20260709 13:05:22.991011 19937 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:22.961624 19919 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:22.998924 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:23.001657 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:23.004185 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:22.968108 19675 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:22.964821 19927 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.010015 15195 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:23.008838 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:23.011478 15265 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:22.975267 20043 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:23.013674 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.024950 15271 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:23.025327 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:23.026072 15268 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:22.989423 20084 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:22.969439 19962 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:05:23.040182 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:23.023893 20075 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.005769 20088 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:23.050452 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:23.007354 19937 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.031520 20103 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:23.063414 15265 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:23.066105 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 101984us
I20260709 13:05:22.984997 19987 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.002354 20073 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:05:23.062302 20054 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.064836 20075 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.065047 19698 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:23.085078 20113 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.134s
I20260709 13:05:23.086205 20115 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:23.086786 20002 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:23.087177 20072 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 13:05:23.041878 20111 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.266s
I20260709 13:05:23.040479 20047 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:05:23.087690 20131 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:23.089797 20102 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.376s	user 0.001s	sys 0.001s
W20260709 13:05:23.078534 19985 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.659s	user 0.003s	sys 0.007s
W20260709 13:05:23.100396 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 93788.2us
I20260709 13:05:23.059355 19986 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:05:23.121758 19987 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:23.116876 20075 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.122193 19698 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.086562 20045 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.122337 20088 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.050930 20105 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.130314 20004 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:23.075999 20083 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:05:23.093843 19927 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:23.136258 20122 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:23.136637 19981 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:23.138226 20110 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:05:23.121440 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 69994.7us
W20260709 13:05:23.145153 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 141967us
W20260709 13:05:23.146021 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 272345us
I20260709 13:05:23.147511 15192 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:23.148092 15268 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:05:23.153015 19919 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:23.211055 19919 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.211736 19919 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:23.171792 19965 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.127256 19937 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.169207 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.170308 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.237730 15193 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:23.238689 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.170218 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.239795 15338 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:23.241003 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:23.241511 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.173125 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.147485 20131 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.116343 20054 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.181726 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.187520 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.187992 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.189993 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.229995 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:23.154186 19985 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.179091 19990 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:23.179533 20111 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.225135 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.317149 15341 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.242612 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:23.243642 15195 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:05:23.244108 15190 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:23.244498 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:23.245069 15189 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:23.248875 15337 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 9: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:23.249723 20075 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.251237 19927 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:23.253401 20131 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.254999 20074 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.262385 15339 raft_consensus.cc:2410] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:23.232234 19570 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.311082 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:23.364954 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 53974us
I20260709 13:05:23.234166 20083 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.272822 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:23.322727 15346 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:23.351604 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:23.368223 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.332276 19937 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:23.359978 20110 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:23.374704 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:23.376262 15870 raft_consensus.cc:2368] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:23.386965 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.389575 15341 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:23.370308 20115 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:23.370028 20131 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:23.398500 15237 leader_election.cc:400] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
W20260709 13:05:23.399475 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.370394 19899 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.417096 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.417737 15237 leader_election.cc:403] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:23.357731 20129 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:05:23.321213 19698 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.350224 19990 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:23.369437 19570 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.333799 20111 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:23.372429 20083 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.419771 20004 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:23.444703 15339 raft_consensus.cc:2410] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:05:23.455440 15192 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:23.461467 15340 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:23.467207 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 100673us
I20260709 13:05:23.468511 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.438090 20045 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.478518 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.479100 15341 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:23.480751 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.481328 15343 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:23.483497 20137 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:05:23.483620 20118 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.307s	user 0.002s	sys 0.000s
I20260709 13:05:23.484470 20054 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.485268 19985 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.492714 19990 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:23.502923 19570 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.503302 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:23.504655 15268 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:05:23.505167 19975 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:23.505600 15266 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:23.432179 19899 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.507177 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.508196 15271 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:05:23.509498 15342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:05:23.509589 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.538712 15271 pending_rounds.cc:85] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 5
I20260709 13:05:23.511176 20034 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.511595 18938 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.540150 18938 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:23.513072 20136 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:05:23.505612 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.514070 20083 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:23.514365 20140 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:05:23.514773 20138 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:05:23.518333 19919 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:23.535566 20119 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:23.523018 20134 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.157s	user 0.004s	sys 0.000s
W20260709 13:05:23.568003 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.526374 15870 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:23.527529 15268 pending_rounds.cc:85] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 10
I20260709 13:05:23.536010 19975 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.529980 15343 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
W20260709 13:05:23.501679 19672 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.913s	user 0.007s	sys 0.003s
I20260709 13:05:23.538890 15342 raft_consensus.cc:606] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.539006 15271 pending_rounds.cc:107] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:05:23.572271 15271 raft_consensus.cc:2889] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:23.545610 18938 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:23.536186 20101 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.659s	user 0.002s	sys 0.010s
I20260709 13:05:23.519586 19985 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:23.559860 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.577152 19672 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:23.537482 19403 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.578161 19403 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.580940 19403 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.550033 20034 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.570181 20119 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:23.583478 20034 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.584021 20119 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:23.585162 15337 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.535836 20121 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:23.558916 15341 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:23.471107 19706 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:23.569304 15268 pending_rounds.cc:107] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:05:23.587266 20121 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.587900 15268 raft_consensus.cc:2889] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:23.529846 15338 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:23.570638 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.589345 15343 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:23.589464 20121 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.591337 19919 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.594125 20111 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:23.595546 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:23.596673 15870 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:05:23.597312 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:23.597934 15188 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:05:23.593869 15337 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:23.603852 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.604528 15268 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:23.578684 15194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "685539345e364189892668dfd1ff7309"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:23.605654 15194 raft_consensus.cc:606] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.606010 15194 raft_consensus.cc:614] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:23.610438 19986 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:23.610764 15337 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:23.610908 15343 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:23.611078 19986 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.612049 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.612960 20073 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:23.613135 15343 raft_consensus.cc:2410] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:05:23.613400 20073 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.614128 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.614387 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:23.575562 15342 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:23.614850 15267 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:23.615206 15341 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.619530 20112 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:23.619932 20112 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:23.621069 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:23.563942 20084 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.001s
I20260709 13:05:23.575977 20142 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:23.623543 19919 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.620765 20112 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.624176 15344 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:23.624043 19919 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:23.612167 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.627810 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.627908 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:23.628464 15194 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:05:23.628875 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.629665 20047 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:23.630462 20043 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:23.631124 20045 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:23.633983 20130 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.624609 20112 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.635787 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.614279 20073 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.636121 15341 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:23.636736 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:23.638809 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:23.659081 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.659384 15194 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:23.663571 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:23.664167 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:23.664453 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:23.664770 15267 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:23.596035 19899 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:23.574059 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.612133 19986 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.639478 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:23.651391 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:23.634557 20130 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:23.644239 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.673252 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.677824 15271 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:23.647389 15188 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:05:23.687379 15337 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:23.689268 20125 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.689548 19937 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.689826 20125 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.690353 19937 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.692144 20125 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.692821 19937 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.693984 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.694887 20105 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:23.695578 20105 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:23.696527 20105 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.666787 20043 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.666666 19965 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:23.669703 20004 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:23.704846 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.670049 20124 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:23.706403 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.714648 15192 raft_consensus.cc:606] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.713758 15264 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
W20260709 13:05:23.717504 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53109.3us
I20260709 13:05:23.718631 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.700201 19985 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:23.711411 19899 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:23.729797 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.733129 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.733543 15270 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:23.733801 15266 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
W20260709 13:05:23.742811 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 43762.8us
I20260709 13:05:23.713668 20043 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.745190 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.745196 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:23.723531 19919 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.727322 19965 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:23.756140 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.756659 15265 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:05:23.757349 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.745061 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.749293 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.751335 20130 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:23.752432 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:23.758414 15270 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:23.758414 15271 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:23.762223 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:23.748606 20040 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.772s	user 0.011s	sys 0.001s
I20260709 13:05:23.763126 15270 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:23.728374 19985 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:23.760342 19717 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.000s
I20260709 13:05:23.772305 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:23.776187 15271 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:23.737658 19899 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:23.772328 19919 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:23.775563 20004 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:23.773706 19717 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:23.817041 20143 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 13:05:23.819895 20145 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:05:23.821077 20083 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.823523 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.829175 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:23.766752 20040 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:23.833698 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 115134us
I20260709 13:05:23.834517 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:23.819974 19899 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:23.840499 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.831537 19985 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:23.842842 15266 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:23.846359 20090 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.846766 15162 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.846875 20090 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.847674 20043 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.848223 20043 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:23.848531 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.848870 20043 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:23.849071 20090 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.849440 19975 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.851341 20154 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:23.851923 20154 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:23.852821 20154 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.855304 20040 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:23.856833 20004 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.859439 20150 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:05:23.860879 20150 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.861351 20150 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.838629 19919 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:23.868005 20094 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:23.850760 19975 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:23.870823 19672 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:23.873623 20090 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:23.874455 19899 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:23.835951 20083 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.839046 19965 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:05:23.840356 19927 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.889786 15267 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:05:23.890983 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:23.883988 19919 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.927357 15839 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:23.874230 20124 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:23.929534 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:23.934309 15342 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:23.936513 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:23.939587 15342 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:23.868151 19717 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:23.906315 20040 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.967619 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2373) took 1443 ms. Trace:
W20260709 13:05:23.972342 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 129425us
I20260709 13:05:23.962437 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:23.962657 15339 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:23.962857 15341 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:23.973063 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:24.034719 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:23.968317 15263 rpcz_store.cc:276] 0709 13:05:22.524179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.568734 (+ 44555us) service_pool.cc:224] Handling call
0709 13:05:22.572798 (+  4064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.875389 (+302591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.967284 (+1091895us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002b02d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:23.967541 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667910400}
I20260709 13:05:23.941651 15346 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:24.015959 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:24.035902 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:24.018999 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.036688 15343 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:24.021050 18829 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:24.037129 15237 leader_election.cc:400] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:24.023381 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:24.037956 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:24.023836 15188 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:23.937299 19919 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:24.037504 18829 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:23.941017 20135 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:24.025471 15162 leader_election.cc:400] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:05:24.049877 15162 leader_election.cc:403] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:23.941179 20096 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:24.027086 15196 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:24.027170 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.033299 15340 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:23.905973 19403 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:24.039338 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.036051 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:23.901463 20094 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.050872 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.019829 19761 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:24.056267 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.064476 15342 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:24.064399 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:24.057394 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.054860 15194 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
W20260709 13:05:24.049878 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.936169 19927 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:24.088619 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 145126us
I20260709 13:05:24.025980 19698 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:24.039358 20150 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.049018 19717 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.095283 18829 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.091967 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.102824 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:24.050467 19985 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.106467 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.082440 20074 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.107637 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.107421 20074 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:24.108196 15341 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:24.109205 15341 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:24.109494 20074 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.087252 19403 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:24.111274 20094 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.111518 20160 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:24.111168 19985 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.112313 20160 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:24.113021 20160 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:24.113066 19403 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:24.113440 19985 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.113622 20160 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:24.050031 20010 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:24.025696 20105 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:05:24.122954 18829 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:05:24.141403 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.046417 20040 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.086632 20135 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:24.156919 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.157074 20154 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.157356 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 132116us
I20260709 13:05:24.138409 19899 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:24.160495 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:24.163923 20130 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:24.164358 20130 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.164727 20130 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:24.168519 20164 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:05:24.173799 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.151809 20112 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:24.114758 20160 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.115684 19698 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.122069 19717 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.187417 19981 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:24.188262 19981 consensus_queue.cc:1243] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:24.188696 20171 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:24.189152 20171 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:24.190279 20171 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.191133 20111 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:24.193104 20111 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.193547 20111 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:24.194193 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.194962 15263 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 8: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:24.196120 15268 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:24.196566 20170 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:24.192553 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.192022 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.198410 15269 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:24.196924 19672 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:24.200145 20094 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:24.197264 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.200881 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.201673 20101 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:24.201763 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.201848 20094 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:24.202175 20101 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:24.202826 20101 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:24.202399 20094 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:24.203972 20094 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.205698 20094 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.206636 20171 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:24.211228 20101 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.212591 20170 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:24.214102 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.214637 20101 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:24.215134 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.215371 20101 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:24.215699 20088 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:24.215802 20101 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.215787 20111 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.217592 20101 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.217463 20088 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.218315 15338 raft_consensus.cc:2368] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:05:24.218163 20088 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.219509 20111 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.220222 20171 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:24.146150 20010 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.154050 19962 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:05:24.171499 20154 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:24.178391 20112 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:24.260706 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 222823us
I20260709 13:05:24.161921 19937 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:05:24.179718 20133 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:24.255632 20156 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:05:24.253021 20084 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.261787 20114 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.181938 20083 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.255470 19698 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.187067 20087 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:05:24.265139 20112 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.298511 18829 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:24.222334 20094 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.286053 20173 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.287317 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68819.6us
I20260709 13:05:24.291293 20180 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.292176 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.294891 20090 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.295828 20101 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.296890 15272 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:24.222680 19725 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:05:24.180580 19899 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:24.308794 20163 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:05:24.321729 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 120032us
I20260709 13:05:24.298400 20113 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.267549 20105 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:05:24.325202 15267 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:24.325794 20185 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:24.328260 15194 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:24.330034 15264 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:24.311146 20094 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.269471 20004 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:05:24.345465 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:24.284670 20084 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.319154 20180 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.319684 19403 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.263346 20085 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.322077 20043 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.264379 20135 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:24.352499 20179 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:05:24.371605 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.344456 19985 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.373683 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:24.290226 20114 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.368340 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.321017 20090 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.363596 19962 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:24.382516 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:24.383018 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.388083 15265 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:24.379083 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.320067 20173 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:24.391398 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:24.392241 15263 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.352702 20172 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:05:24.400782 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68508.4us
I20260709 13:05:24.402275 20002 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:24.406365 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.409186 20173 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:24.409967 20090 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.395160 20180 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.413173 15263 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:24.374850 20055 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:05:24.415351 15194 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:24.380932 20004 consensus_queue.cc:1243] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:24.354398 20113 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.364812 19698 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:05:24.414819 19975 consensus_meta.cc:287] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.000s
I20260709 13:05:24.422386 15196 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:24.432950 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.433790 15197 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:24.374526 19403 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.386996 19927 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.440742 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.446609 15271 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:24.438670 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.378496 20043 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:24.441310 20155 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.604s	user 0.003s	sys 0.001s
I20260709 13:05:24.455998 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.453986 15266 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:24.457762 15337 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:24.458320 15264 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:24.458634 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.459918 15271 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:24.467829 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.446067 20169 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:24.436746 20124 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:05:24.455144 20150 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:24.451664 19717 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.439649 20180 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:05:24.472126 20073 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.475457 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.479269 20176 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:24.483206 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.467041 20094 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.508490 19403 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.510021 20113 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.511376 20130 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.513784 20040 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.514128 15265 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:24.515240 20106 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.513615 20130 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.515801 20106 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.502377 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.514926 19899 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.526964 20106 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.523970 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.483704 20150 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.503655 19698 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.528091 20150 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.528242 19698 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.529103 19986 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:24.527678 15337 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:24.530534 19698 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.499538 20169 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.520303 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:24.530427 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.522058 20160 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:24.554087 19698 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.524521 20174 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.140s
I20260709 13:05:24.564395 20160 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:24.487856 20185 consensus_queue.cc:1243] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:24.568346 15338 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:24.572259 20121 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.572746 15338 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:24.572811 20121 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.568701 20169 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.551080 19919 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:24.564545 19698 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.585209 19698 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.570112 20160 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.586578 20160 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.564020 20088 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.588431 20088 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.589578 20154 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:24.551652 20124 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:24.590696 19919 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.590504 20124 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.592610 20124 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.594278 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.595072 15345 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:24.595945 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.536779 20043 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.515211 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.554879 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.597141 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:24.597313 15340 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:24.598152 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.598563 20103 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.598456 20185 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.599221 20103 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.599638 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.599517 20185 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.600210 15339 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:24.600796 15340 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:24.601011 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:24.601552 15339 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.598518 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:24.602289 20103 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.602451 15868 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:24.601519 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.601490 20185 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.603350 15340 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:05:24.604272 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.604427 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.605036 15340 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:24.605850 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.606392 15340 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:24.607162 20088 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.607632 20088 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.608814 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:24.609347 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.610015 15341 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:24.610095 20088 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.610411 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:24.611286 20043 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:24.611790 20043 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:24.611986 20047 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:24.612285 20043 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.612459 20047 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:24.612955 20047 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.619674 20055 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.620373 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:24.620280 20055 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.620659 20043 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:24.622639 20055 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.624369 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.624629 15339 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:24.607199 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.625664 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.626246 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.626441 15339 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:24.627272 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.628079 15340 raft_consensus.cc:2410] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:05:24.629165 15340 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:24.629216 20160 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:24.629427 15265 raft_consensus.cc:2410] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:24.629931 20187 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:24.630326 20187 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:24.631502 19823 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:24.631129 20187 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.631906 19823 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:24.632683 20187 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:24.633282 19823 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.634500 19823 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:24.635655 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.636085 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.636684 15264 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:24.637468 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.637966 20088 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.638018 15264 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:24.638834 15190 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:24.639057 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:24.639456 20101 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.639636 15264 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:24.640349 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:24.640842 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.641414 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.644413 15342 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:24.646410 15342 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:24.647753 15872 raft_consensus.cc:2368] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12.
I20260709 13:05:24.647790 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.648694 15195 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:05:24.649353 15874 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:24.650403 15195 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:24.652522 20088 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.604480 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.654909 15343 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:24.653967 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.655864 15266 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:24.656200 15343 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:24.656284 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.657086 15339 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:24.657357 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.657990 15193 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:24.658793 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.660184 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d932cad3925e47b28537cca64ba27320"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:24.660717 15196 raft_consensus.cc:606] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:24.661008 15196 raft_consensus.cc:614] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:24.625598 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.661856 15263 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:24.610895 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.664135 15341 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:24.665512 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:24.669716 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.670944 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.650911 15264 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:24.675698 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.679970 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.684859 15263 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:24.684882 15264 raft_consensus.cc:2410] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:05:24.688594 15162 leader_election.cc:400] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12.
I20260709 13:05:24.677592 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.691992 15162 leader_election.cc:403] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:05:24.692365 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.673835 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.693547 15267 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:24.694237 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:24.694399 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.695190 15341 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:05:24.695529 15341 pending_rounds.cc:85] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 8
I20260709 13:05:24.695753 15341 pending_rounds.cc:107] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:05:24.695986 15341 raft_consensus.cc:2889] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:24.692981 15189 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:24.699837 15874 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:24.700381 18829 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:24.700652 15339 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:24.703974 15264 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:05:24.704528 15264 pending_rounds.cc:85] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 7
I20260709 13:05:24.704828 15264 pending_rounds.cc:107] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:05:24.705127 15264 raft_consensus.cc:2889] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:24.713513 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.713840 15343 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:24.713696 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:24.714622 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44979us
I20260709 13:05:24.715077 15266 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.715730 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.558327 20085 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:24.719738 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.721800 15195 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:05:24.556532 20010 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.724936 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:24.671948 19698 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.691002 20045 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:24.728786 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.730613 18938 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.744916 18938 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.752317 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.758497 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:24.724411 20187 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:24.764092 18829 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12.
I20260709 13:05:24.769665 15190 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:24.775568 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 318202us
I20260709 13:05:24.735443 20045 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:24.785494 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 114620us
I20260709 13:05:24.756827 20124 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:24.732216 20158 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:05:24.740363 19927 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.801326 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:24.732502 20160 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:05:24.757650 19962 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.802137 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 73459.3us
I20260709 13:05:24.802958 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.797098 18938 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.781490 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:24.801753 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.834470 15195 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 7.
I20260709 13:05:24.822192 18829 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:24.835588 18829 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.836009 18829 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:24.724956 20055 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:05:24.769661 20106 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:24.832444 15266 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:24.758808 20043 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:24.767886 20174 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:24.759975 20192 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:24.860888 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 59707.8us
I20260709 13:05:24.866746 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:24.867947 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.861109 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.860893 18829 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:24.863072 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60165.7us
I20260709 13:05:24.864049 18938 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:24.871140 18938 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.871580 18938 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.740772 19698 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.803115 20124 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.774348 20187 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:24.739127 20166 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:05:24.885025 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.870441 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.770701 19985 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.085s
I20260709 13:05:24.758976 19725 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:05:24.822044 20045 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:24.859575 20174 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:24.860550 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 79192.7us
I20260709 13:05:24.767200 19672 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:05:24.759308 20090 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:05:24.780593 20010 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 13:05:24.822701 20034 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:24.881057 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:24.956004 15189 raft_consensus.cc:2410] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:24.883916 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:24.886188 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:24.859771 19962 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.892021 19900 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.890437 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.864383 20087 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:24.872402 20192 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.897922 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.863008 20170 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:24.989372 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:24.991149 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:24.991815 15189 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:24.902504 18829 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.884877 20187 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.896595 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:24.887629 20124 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:24.877354 20121 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.879494 20040 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:24.944979 15193 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:24.945567 20193 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:05:24.946336 20182 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:24.947265 20195 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:24.948374 20189 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
W20260709 13:05:24.948498 20196 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:05:24.950387 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.004426 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:24.855578 19927 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.893599 20096 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:24.865440 20106 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.986119 19937 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:24.899223 20174 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:24.948829 20190 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:24.899325 20083 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:05:24.974045 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 90201.4us
I20260709 13:05:24.974049 15191 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:25.029834 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:24.996196 20088 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:24.977589 19962 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.994573 18938 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.999581 20040 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:25.035672 18938 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:24.958604 19725 consensus_queue.cc:1243] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:24.998772 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.043286 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:24.995486 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:24.963850 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 77721.2us
I20260709 13:05:25.045166 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.046104 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:25.046864 20198 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:05:25.047894 19962 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:25.048357 19962 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.048738 19962 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:25.048815 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.047317 18938 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:25.050318 18938 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.050643 18938 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:24.997169 20112 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:05:25.056447 20112 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:24.994683 19758 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:25.058382 19758 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.033239 20096 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:25.060410 20096 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.058806 19758 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.986788 20192 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:24.974277 20034 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:24.943849 20180 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.005842 20182 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.034880 20083 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:25.051307 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:25.026716 20197 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:05:25.014477 20154 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:25.054652 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.120240 18938 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.121035 15190 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:25.005640 20195 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:25.083693 15342 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:25.122149 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.065062 15162 leader_election.cc:400] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:05:25.094492 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.134723 15194 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.065182 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.095288 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:25.097272 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.997483 20170 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.022368 19937 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.160988 19937 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:25.162384 20170 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.164793 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.015635 19965 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:25.115372 20114 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.166105 19965 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.129931 20195 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:25.168417 19965 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.052368 20040 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:25.101334 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.130537 20121 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:25.174309 20121 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.174751 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.175293 20084 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.101383 15338 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:05:25.176510 20073 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.005s
I20260709 13:05:25.024848 20190 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:25.176755 19698 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.177129 15346 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:05:25.024278 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.178859 19927 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.179468 20130 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.179991 20130 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.180370 20193 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:25.180944 20193 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:25.107391 20182 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.183665 20114 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:25.108067 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61108.6us
I20260709 13:05:25.118866 15189 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:25.185360 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.186125 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.188638 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.189568 15189 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:25.033907 20166 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.133021 15196 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:25.142143 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.148300 18938 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.149255 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:25.150967 20202 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:05:25.191895 15189 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:25.151692 20185 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:05:25.152396 20206 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:05:25.156759 20204 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:05:25.208927 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2592) took 1026 ms. Trace:
I20260709 13:05:25.159566 20034 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.165472 15195 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:25.102919 15873 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 330) took 1167 ms. Trace:
I20260709 13:05:25.101501 20112 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.103317 19985 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
W20260709 13:05:25.181529 20194 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:05:25.051074 19672 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:05:25.137852 15162 leader_election.cc:403] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:25.182812 15312 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.570s (SENT) [suppressed 13 similar messages]
I20260709 13:05:25.194690 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.193437 20139 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:25.201375 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.201452 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.197592 20073 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:25.204166 19986 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:25.204936 20130 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.244812 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.196595 20185 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:25.208217 20205 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:25.184290 20114 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.209313 15346 rpcz_store.cc:276] 0709 13:05:24.182471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.291904 (+109433us) service_pool.cc:224] Handling call
0709 13:05:25.208779 (+916875us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54001770d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:25.208877 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2003151104}
W20260709 13:05:25.242410 20047 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.000s
I20260709 13:05:25.217370 15873 rpcz_store.cc:276] 0709 13:05:23.935777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.935909 (+   132us) service_pool.cc:224] Handling call
0709 13:05:25.089405 (+1153496us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54005dd4d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:25.102856 (+ 13451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767209216}
I20260709 13:05:25.107831 20180 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.190465 19965 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:25.197839 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.230732 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.267081 15189 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:25.268023 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:25.232656 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 167790us
I20260709 13:05:25.202345 20101 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.273442 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.276057 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.276734 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.277803 15270 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:25.254463 20073 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:25.195770 20084 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:05:25.248467 15338 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:25.195335 20166 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:25.256637 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.174780 20121 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:25.260450 15346 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:25.240490 19672 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 8. Current term is 9.
I20260709 13:05:25.279698 15263 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:25.282245 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.235328 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.280635 19962 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.305887 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.273967 19965 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:25.243813 20083 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.276901 20101 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.289597 20187 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.314525 15194 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:25.291649 15191 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:25.268379 20047 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.301090 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.324666 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.250276 19986 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:25.299254 20045 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:25.304679 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 121894us
I20260709 13:05:25.330452 15344 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:25.291375 20195 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.306293 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:25.283067 20211 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:25.282914 20090 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:25.307422 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.276571 20087 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:05:25.278995 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.320806 20106 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.325117 15264 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:25.346086 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:25.311578 20212 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:05:25.355787 15272 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:25.360165 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.361043 15264 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:25.293584 20185 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.333825 18829 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:25.364478 18829 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:25.364903 18829 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:25.334244 15162 leader_election.cc:400] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:25.365594 15162 leader_election.cc:403] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:25.341255 15270 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:25.368158 20187 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.304551 19985 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.342904 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.369829 19985 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.372287 19985 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.372428 20084 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.372906 20084 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.336040 20193 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:25.375308 19965 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:25.375329 20084 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:25.341044 20213 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:05:25.379231 20170 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:25.305972 15195 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:25.380920 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.381151 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.381469 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.381768 15195 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:05:25.382059 15267 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:25.390511 19672 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:25.399742 18829 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.406134 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.407830 15267 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
W20260709 13:05:25.382396 20203 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 13:05:25.411517 15264 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:25.413271 15162 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.414587 15188 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:25.381714 20166 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:25.415969 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.420598 15195 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:25.422115 20180 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.409991 20124 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.424010 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.425129 15270 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:25.438825 15266 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:25.428422 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.439460 15267 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:25.431613 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.432579 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.410192 19672 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.436277 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.340408 20073 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.425866 15264 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:25.444855 15264 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:25.445216 18829 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.447278 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.448514 15340 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:25.447527 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.451478 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:25.430012 20088 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:25.454728 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:25.455588 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2405) took 1127 ms. Trace:
I20260709 13:05:25.456027 15193 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:25.456458 15193 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:25.456590 15264 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:25.456158 15268 rpcz_store.cc:276] 0709 13:05:24.328579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.328698 (+   119us) service_pool.cc:224] Handling call
0709 13:05:24.329085 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.660135 (+331050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.660179 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.690483 (+ 30304us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.001731 (+311248us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:25.001815 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.184311 (+182496us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400087d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:25.184360 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.447190 (+262830us) raft_consensus.cc:1685] finished
0709 13:05:25.447211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.455504 (+  8293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3958,"raft.queue_time_us":12131,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":17585,"spinlock_wait_cycles":278584064,"thread_start_us":474443,"threads_started":2,"wal-append.queue_time_us":382916}
I20260709 13:05:25.429540 20106 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:25.457294 15193 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.452538 19823 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:05:25.439869 20084 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.464910 15193 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:25.474414 15266 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:25.515432 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:25.469133 15268 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:25.517742 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1852) took 1126 ms. Trace:
I20260709 13:05:25.444892 20185 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:25.542215 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.543012 15191 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:25.546290 20195 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.548954 20045 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:25.549449 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.519155 15337 rpcz_store.cc:276] 0709 13:05:24.391529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.593367 (+201838us) service_pool.cc:224] Handling call
0709 13:05:24.593651 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.673007 (+ 79356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.673038 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.673429 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:05:24.894898 (+221469us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:24.894937 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.894997 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.517525 (+622528us) raft_consensus.cc:1685] finished
0709 13:05:25.517544 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.517687 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78973,"raft.queue_time_us":79103,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":161741,"threads_started":1,"wal-append.queue_time_us":390539}
I20260709 13:05:25.452745 20114 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.522037 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.442473 20087 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:05:25.550912 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:25.491248 20085 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.765s	user 0.012s	sys 0.007s
I20260709 13:05:25.569581 15194 raft_consensus.cc:2376] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14. Re-sending same reply.
I20260709 13:05:25.570869 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.571970 15194 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
W20260709 13:05:25.573012 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 51080.9us
I20260709 13:05:25.444082 19672 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:25.544147 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.517083 20124 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.489106 20201 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:25.580902 15191 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:25.581928 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:25.489583 20105 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:25.515398 20176 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:05:25.459537 19900 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.121s
I20260709 13:05:25.571417 20087 consensus_queue.cc:1243] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:05:25.584579 20216 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:05:25.503229 20055 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:05:25.595805 15193 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:25.505010 19990 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:05:25.471529 20040 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:25.594435 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 136968us
I20260709 13:05:25.575961 20114 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:25.577217 19899 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.614796 19899 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.615743 20040 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.615393 19937 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.523983 20182 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.615844 15192 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:25.578672 19986 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:25.490260 20106 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.616662 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.617276 15342 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:25.553095 20084 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.630105 20090 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:25.593967 20047 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.612375 19962 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.595870 20139 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:05:25.644131 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:25.644762 15873 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.587095 20201 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.593281 20105 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:25.648286 20150 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.120s	user 0.008s	sys 0.008s
I20260709 13:05:25.649546 20154 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:25.659336 20154 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:25.663635 15873 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:25.665445 19937 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.667593 20087 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:25.667788 20090 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:25.668064 20087 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:25.668191 20090 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:25.668627 20090 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:25.668929 20087 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.670120 20087 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:25.672333 20106 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.672930 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2422) took 1002 ms. Trace:
I20260709 13:05:25.673274 15267 rpcz_store.cc:276] 0709 13:05:24.670856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.422242 (+751386us) service_pool.cc:224] Handling call
0709 13:05:25.439258 (+ 17016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.439864 (+   606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.672668 (+232804us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54001da6d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:25.672872 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38267136}
I20260709 13:05:25.674793 20150 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.676976 20150 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.652302 20182 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.677943 15271 raft_consensus.cc:2368] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:05:25.679064 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2413) took 1179 ms. Trace:
I20260709 13:05:25.679399 15271 rpcz_store.cc:276] 0709 13:05:24.500121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.503048 (+  2927us) service_pool.cc:224] Handling call
0709 13:05:25.678843 (+1175795us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000d6954. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:25.678967 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644655872}
I20260709 13:05:25.601902 19758 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.604043 20192 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.684710 20192 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.687458 15197 raft_consensus.cc:2368] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:25.686883 20190 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.688194 20190 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:25.689818 15196 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:05:25.667615 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53391.7us
I20260709 13:05:25.692170 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.693315 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.693938 15873 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:25.694494 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:25.692307 19981 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:05:25.695297 20124 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:25.695732 20124 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:25.696141 20124 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.697721 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.700012 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.700719 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.701225 20002 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:25.702504 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.701488 15337 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:05:25.703812 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.693368 19403 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:25.704469 15874 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:05:25.704550 15193 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:25.712862 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:25.650161 20174 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.615s	user 0.004s	sys 0.007s
I20260709 13:05:25.713097 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.713927 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.701486 15192 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:25.697681 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.710242 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.714116 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.714974 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.720971 15197 raft_consensus.cc:2368] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:25.722043 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.722987 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.723898 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.725569 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.726931 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:25.722334 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.732014 15162 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:25.733064 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.729156 15267 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 8.
I20260709 13:05:25.745596 15337 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:25.749774 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.718012 19725 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:25.753787 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.753882 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.754518 15267 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:25.755111 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.756626 19990 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:25.757048 18938 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:25.757453 18938 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.757606 19990 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:25.757859 18938 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:25.758039 19990 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:25.758774 20176 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:25.756413 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.756237 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.659340 20201 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.717825 20135 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:05:25.717569 20158 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:25.750790 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:25.764503 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.760113 15340 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:05:25.783581 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.783784 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.761291 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.761487 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.784945 15337 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:25.751864 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.714318 20106 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:25.756258 15162 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.787772 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.788077 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.788385 15340 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.788836 15267 raft_consensus.cc:2368] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:05:25.786397 15197 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:25.788947 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.789633 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.791620 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.791791 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.803215 18938 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.791265 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.808538 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.809796 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:25.793593 20114 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:05:25.821178 18938 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:25.796411 20227 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:25.817888 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:25.810993 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.815104 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:25.823503 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67170.9us
I20260709 13:05:25.757082 20130 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:05:25.820835 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 94232.3us
I20260709 13:05:25.759295 19986 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:25.825137 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.813344 15267 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:25.787559 20180 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:25.719506 20174 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.829761 15345 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:25.832742 15337 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:25.841097 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:25.841498 18938 raft_consensus.cc:2764] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:25.833153 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.809486 19965 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:25.808740 20088 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:25.843401 15337 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:25.840994 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:25.762714 20112 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:05:25.810315 20158 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:25.817370 20166 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:25.845855 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:25.823814 20096 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:25.853159 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:25.855485 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.882817 15266 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:25.830061 19986 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.891283 15269 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:25.891175 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.830077 19758 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:25.823009 20106 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:25.834060 20084 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:25.835182 19927 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:25.830523 20073 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:25.758993 19990 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:25.919658 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 70074.5us
W20260709 13:05:25.901517 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 90600.5us
W20260709 13:05:25.921487 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 131635us
I20260709 13:05:25.848693 20130 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:25.843096 20055 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260709 13:05:25.923915 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 132731us
I20260709 13:05:25.835635 19717 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:05:25.922645 19986 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.936440 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.922552 20193 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:25.839337 20083 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:05:25.892544 20043 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:25.842209 20170 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:05:25.843341 19937 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:25.949133 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:25.943902 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:25.923269 20088 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:25.835426 20229 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:25.923559 15267 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.955045 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:25.935246 19927 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.931555 20034 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:05:25.980249 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.948596 19758 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:25.990670 15238 leader_election.cc:400] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
W20260709 13:05:26.042049 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51560.8us
W20260709 13:05:26.042836 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 99015.5us
I20260709 13:05:26.043159 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:25.991185 20193 raft_consensus.cc:2764] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:05:25.991935 20234 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:05:25.992286 19403 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:25.967722 19990 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.972364 20043 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.999148 19672 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.001277 20124 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:25.962815 19717 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:26.017199 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:26.021605 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:26.023540 20228 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 13:05:26.028138 20231 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:05:26.028513 20158 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.031438 15267 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:25.959056 20040 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:26.045284 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:26.123303 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 186067us
I20260709 13:05:26.053048 15340 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:26.043813 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:26.060611 15197 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:26.064800 15238 leader_election.cc:400] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:26.035966 19927 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:26.102754 20073 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:26.035133 20101 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:26.036481 20088 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:26.059396 20150 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:26.100435 20232 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:05:26.119107 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:26.121174 15194 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:05:26.100594 20160 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:26.132966 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68358.2us
I20260709 13:05:26.133129 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:26.184051 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 140306us
I20260709 13:05:26.184338 15197 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.184847 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:26.185933 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:26.100740 20240 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:26.182829 15191 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:26.122432 20040 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:26.219472 20193 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:26.186864 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:26.067812 20106 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:26.236526 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49750.6us
W20260709 13:05:26.231356 20090 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.006s
I20260709 13:05:26.243595 15197 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:26.245180 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:26.245661 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 399881us
I20260709 13:05:26.190973 20083 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:26.230214 20101 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:26.254909 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.228657 20040 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.239187 20240 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:26.237076 20174 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.234028 20130 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:26.268507 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:26.237486 19937 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.187572 20150 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:26.279837 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:26.270980 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 147044us
I20260709 13:05:26.320489 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:26.273751 15340 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
W20260709 13:05:26.268026 20190 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.006s
I20260709 13:05:26.322593 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:26.322917 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50767.4us
W20260709 13:05:26.272116 20230 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.335s	user 0.000s	sys 0.001s
I20260709 13:05:26.259455 20243 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:26.289568 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:26.232259 20193 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.266149 19758 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:26.319715 20130 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.357986 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:26.353229 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:26.243571 20245 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.344317 15190 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:26.265350 20090 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.336481 19403 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.318698 20083 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:26.322278 20084 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:26.338675 20160 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.397897 20085 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.447533 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:26.449020 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:26.324425 20247 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:26.375435 20243 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:26.478973 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:26.335616 19937 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:26.463699 20236 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.383s	user 0.000s	sys 0.001s
I20260709 13:05:26.486511 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:26.394251 20190 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.395176 20130 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:26.490098 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 236964us
W20260709 13:05:26.533926 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 199535us
W20260709 13:05:26.537401 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 184288us
W20260709 13:05:26.538723 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 202619us
I20260709 13:05:26.541489 15160 leader_election.cc:400] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:05:26.436151 20073 consensus_queue.cc:1059] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:05:26.542980 15160 leader_election.cc:400] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:05:26.476123 20247 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:26.490069 20243 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.548612 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.462112 20255 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:05:26.460469 20245 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.545420 20101 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:26.546092 15341 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:26.485072 20085 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.475934 20160 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:26.488004 19672 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.579738 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2418) took 1945 ms. Trace:
I20260709 13:05:26.460031 19403 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.377365 20088 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.492539 20124 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.585821 15269 rpcz_store.cc:276] 0709 13:05:24.634326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.175873 (+541547us) service_pool.cc:224] Handling call
0709 13:05:25.176184 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.922803 (+746619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.579402 (+656599us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54001d8dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:26.579639 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644164352}
I20260709 13:05:26.544227 20190 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.501920 20254 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 13:05:26.612157 15341 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:26.605322 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:26.616439 15269 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:26.490520 20240 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.544826 19758 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.570919 20083 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:26.648638 15263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2368) took 1454 ms (client timeout 1526 ms). Trace:
W20260709 13:05:26.653898 15263 rpcz_store.cc:269] 0709 13:05:25.194739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.262233 (+ 67494us) service_pool.cc:224] Handling call
0709 13:05:26.648447 (+1386214us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b54001da1d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:26.648571 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6597504}
I20260709 13:05:26.656073 15269 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
W20260709 13:05:26.658380 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 124422us
W20260709 13:05:26.659812 20256 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:05:26.660056 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:26.664156 20245 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.664927 20245 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:26.665380 20245 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:26.667431 20249 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:05:26.615619 20251 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:26.681077 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 132542us
I20260709 13:05:26.684692 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.674592 15269 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:26.696902 19717 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:26.697613 19717 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.699971 19717 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:26.701864 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:26.641165 20254 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:26.714160 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:26.657791 19986 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.002s
I20260709 13:05:26.653391 20150 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.672502 20193 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.711236 20090 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.666589 20245 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:26.759352 20254 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:26.615725 20247 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.650621 20101 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:26.765786 19975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.007s
W20260709 13:05:26.787294 19975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.008s
W20260709 13:05:26.782364 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 441776us
I20260709 13:05:26.803509 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:26.745251 19986 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.814049 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:26.817003 20121 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.505s	user 0.011s	sys 0.011s
I20260709 13:05:26.812126 20254 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:26.815995 19975 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:26.836114 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1867) took 1642 ms. Trace:
I20260709 13:05:26.816654 20160 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:26.817860 20247 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:26.836746 15343 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:26.846203 15270 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:05:26.847569 15272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 377) took 1902 ms (client timeout 1853 ms). Trace:
I20260709 13:05:26.818176 20085 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.847910 15344 rpcz_store.cc:276] 0709 13:05:25.193306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.193505 (+   199us) service_pool.cc:224] Handling call
0709 13:05:25.203402 (+  9897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.330849 (+127447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.835859 (+1505010us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400059e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:26.836056 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291414912}
I20260709 13:05:26.850107 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.853046 20002 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:26.829759 20267 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:26.836702 19975 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:26.860849 15272 rpcz_store.cc:269] 0709 13:05:24.944794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.004135 (+ 59341us) service_pool.cc:224] Handling call
0709 13:05:26.845758 (+1841623us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400013bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:26.847491 (+  1733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797193600}
I20260709 13:05:26.865582 19986 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:26.828420 20253 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:26.880482 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:26.900547 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 149380us
I20260709 13:05:26.845831 19403 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.903375 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:26.904033 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 189972us
I20260709 13:05:26.906629 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:26.907280 15272 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:26.906641 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.848753 20273 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:26.836477 20121 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:26.901014 20154 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.241s	user 0.006s	sys 0.006s
W20260709 13:05:26.904467 20040 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.003s
I20260709 13:05:26.865686 20263 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:26.864681 20190 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.921134 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.898234 19717 raft_consensus.cc:2764] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:05:26.913034 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.901160 19975 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:26.904620 20085 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.898283 20002 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:26.911669 20084 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:26.922909 20253 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:05:26.944972 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.933033 15346 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:26.947911 15272 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:26.918208 20154 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:26.939867 20087 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.269s	user 0.010s	sys 0.002s
W20260709 13:05:26.935964 20208 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.742s	user 0.005s	sys 0.012s
I20260709 13:05:26.939307 20263 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.956209 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2359) took 2578 ms. Trace:
I20260709 13:05:26.957369 20263 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.956616 15265 rpcz_store.cc:276] 0709 13:05:24.378334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.659369 (+281035us) service_pool.cc:224] Handling call
0709 13:05:24.659694 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.700034 (+ 40340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.700064 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.724556 (+ 24492us) log.cc:844] Serialized 26 byte log entry
0709 13:05:24.973131 (+248575us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:24.973216 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.973332 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.897832 (+1924500us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:26.955891 (+ 58059us) raft_consensus.cc:1685] finished
0709 13:05:26.955913 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.956123 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12309,"raft.queue_time_us":42401,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":13687,"spinlock_wait_cycles":20784000,"thread_start_us":202656,"threads_started":1,"wal-append.queue_time_us":324866}
I20260709 13:05:26.946352 19761 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:26.959021 19761 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:26.960006 19761 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:26.960784 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1901) took 1711 ms. Trace:
I20260709 13:05:26.961225 19761 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:26.908164 20271 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:05:26.965160 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44129.2us
I20260709 13:05:26.961246 15190 rpcz_store.cc:276] 0709 13:05:25.249011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.270722 (+ 21711us) service_pool.cc:224] Handling call
0709 13:05:25.271003 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.416593 (+1145590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.960501 (+543908us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002251d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:26.960715 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467062656}
I20260709 13:05:26.972172 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:26.974309 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:26.975106 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:26.975435 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:26.975723 15267 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:26.976696 15272 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:26.976823 15267 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:05:26.974028 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:26.941242 19990 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.835s	user 0.007s	sys 0.003s
I20260709 13:05:26.963205 20266 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:26.923678 20276 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:26.923379 20040 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.990708 20276 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:26.992205 20040 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:26.992481 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:26.993227 15269 raft_consensus.cc:2368] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18.
I20260709 13:05:26.994704 15192 raft_consensus.cc:2410] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:05:26.985188 20154 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:26.958956 19927 consensus_meta.cc:287] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
I20260709 13:05:26.988904 20130 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.940783 20274 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:26.918975 20254 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.968382 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:26.935865 20002 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:26.969718 20226 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.320s	user 0.004s	sys 0.000s
I20260709 13:05:26.978708 19717 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:26.934413 20085 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.014045 20243 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.015516 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1903) took 1729 ms. Trace:
I20260709 13:05:27.011091 19927 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:26.967514 20087 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:27.015913 15195 rpcz_store.cc:276] 0709 13:05:25.285765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.434313 (+148548us) service_pool.cc:224] Handling call
0709 13:05:25.434746 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:25.450246 (+ 15500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.450277 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:25.459036 (+  8759us) log.cc:844] Serialized 52 byte log entry
0709 13:05:25.637364 (+178328us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:25.654852 (+ 17488us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.786702 (+131850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.786801 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.873965 (+1087164us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b180047d400. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:26.932565 (+ 58600us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b2400114ff8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265f09d 00007f36e529110e 00007f36e52a888c 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221
0709 13:05:27.015284 (+ 82719us) raft_consensus.cc:1685] finished
0709 13:05:27.015308 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.015456 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":329335,"prepare.queue_time_us":17342,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":131718,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":20630,"spinlock_wait_cycles":132187264,"thread_start_us":68853,"threads_started":1,"wal-append.queue_time_us":183667}
I20260709 13:05:27.019840 15337 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 13:05:27.011870 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43563.1us
I20260709 13:05:27.012740 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.022344 15267 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:27.023644 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.024345 15195 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:27.025525 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.027405 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.028596 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.029332 15197 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:27.012043 15269 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:27.041117 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.042301 15193 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:27.044709 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.045545 15190 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:27.016090 20243 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.015921 20085 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.017994 20083 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:27.019847 20170 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:27.058514 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:27.060328 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.057287 15197 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:27.061194 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.061882 15197 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:27.061089 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.053332 20284 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.059819 20170 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:27.066334 20247 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:27.085014 15190 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:27.086701 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.094825 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.098026 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.099681 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.088059 20088 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:27.086406 20247 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:27.116654 20088 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.117447 15193 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:05:27.117076 20247 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.104797 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:27.119262 20088 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.119660 15188 raft_consensus.cc:606] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:27.120057 15188 raft_consensus.cc:614] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:27.088059 20284 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.122754 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:27.123829 15190 raft_consensus.cc:2410] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:05:27.122210 15188 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:27.126910 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.127969 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:27.128422 20275 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:05:27.018514 20274 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.129647 20267 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:27.104591 20170 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.106423 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2427) took 2433 ms. Trace:
I20260709 13:05:27.110440 20273 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:27.085623 20083 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:27.113623 19927 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.114753 20130 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.115401 20010 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.054011 20276 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.115577 19758 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:27.132025 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:27.131923 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:27.131857 15270 rpcz_store.cc:276] 0709 13:05:24.672618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.442498 (+769880us) service_pool.cc:224] Handling call
0709 13:05:26.845916 (+1403418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:26.860804 (+ 14888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.106232 (+245428us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400013bd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:27.106365 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190662912}
I20260709 13:05:27.130614 15188 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:27.090435 20266 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.136186 19975 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.137964 20274 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.139400 20083 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.140198 20073 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:27.142634 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:27.142872 15309 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:27.150493 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56083.9us
I20260709 13:05:27.154776 15160 leader_election.cc:400] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18.
I20260709 13:05:27.164601 15160 leader_election.cc:403] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:05:27.141351 20267 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:27.167357 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:27.164402 15874 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:27.171304 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:27.153054 20130 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:27.152894 20276 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:27.152709 19758 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.173623 15188 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:27.169610 20101 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:27.173452 20284 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.172518 20262 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:27.150032 20010 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.198410 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.201381 15188 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:27.163311 19672 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:05:27.166456 20273 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:05:27.167322 20085 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18.
I20260709 13:05:27.190245 20276 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.215256 15188 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:27.161069 20266 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.197263 20274 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.217607 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.221096 15188 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:27.215992 20223 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:27.203882 20101 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:27.227573 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.219379 20276 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:27.217025 19761 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.226548 20267 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.237612 19899 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.237773 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:27.207943 19975 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:27.230147 20293 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:05:27.241968 15188 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:27.242724 19761 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.245930 20083 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.224891 20274 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.247268 20101 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.229017 20223 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:27.262512 15188 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:05:27.257442 20010 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.255564 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.239646 20073 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.264261 20274 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:27.267148 20217 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.839s	user 0.002s	sys 0.002s
I20260709 13:05:27.268038 20073 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.268507 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1869) took 2074 ms. Trace:
I20260709 13:05:27.268906 15339 rpcz_store.cc:276] 0709 13:05:25.193861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.194014 (+   153us) service_pool.cc:224] Handling call
0709 13:05:25.202251 (+  8237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.202601 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.202631 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:25.203185 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.330222 (+127037us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:25.330262 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.330333 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.260574 (+1930241us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:27.268193 (+  7619us) raft_consensus.cc:1685] finished
0709 13:05:27.268225 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.268446 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3164,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":63,"spinlock_wait_cycles":6361344,"thread_start_us":126532,"threads_started":1,"wal-append.queue_time_us":210939}
I20260709 13:05:27.270633 20073 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.271428 19758 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:27.281056 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.281111 15193 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:27.255146 20002 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:27.283231 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.285137 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:27.265031 20223 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.294378 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1896) took 2103 ms. Trace:
W20260709 13:05:27.298813 15192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1913) took 1550 ms (client timeout 1942 ms). Trace:
I20260709 13:05:27.301142 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:27.307524 15874 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:27.302213 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:27.342056 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.304515 15196 rpcz_store.cc:276] 0709 13:05:25.191370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.191514 (+   144us) service_pool.cc:224] Handling call
0709 13:05:25.191836 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.690626 (+498790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.294089 (+1603463us) spinlock_profiling.cc:243] Waited 498 ms on lock 0x7b54000c03d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:27.294305 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1144590720}
I20260709 13:05:27.281987 20274 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:27.306177 15192 rpcz_store.cc:269] 0709 13:05:25.748384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.782505 (+ 34121us) service_pool.cc:224] Handling call
0709 13:05:27.298538 (+1516033us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003e62d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:27.298711 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2693226368}
I20260709 13:05:27.296974 19937 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.353116 15192 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:05:27.353688 15192 pending_rounds.cc:85] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 9
W20260709 13:05:27.293896 20252 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.040s	user 0.001s	sys 0.000s
I20260709 13:05:27.354146 15192 pending_rounds.cc:107] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:05:27.365525 15192 raft_consensus.cc:2889] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:27.354954 20244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.008s	sys 0.008s
W20260709 13:05:27.367472 20244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.008s	sys 0.009s
I20260709 13:05:27.355008 20274 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.368793 20105 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.369374 20274 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.353322 20276 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.372272 20276 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.377004 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.377674 15263 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:27.378278 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2369) took 2182 ms. Trace:
I20260709 13:05:27.378463 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2391) took 1044 ms. Trace:
I20260709 13:05:27.378850 15263 rpcz_store.cc:276] 0709 13:05:26.333598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.654857 (+321259us) service_pool.cc:224] Handling call
0709 13:05:27.376860 (+722003us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5800160b98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6d30a0 00007f36ea6d2984 00007f36e3c4d6d4 00007f36e3c4d662
0709 13:05:27.378410 (+  1550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34156416}
I20260709 13:05:27.312330 19758 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.378775 15264 rpcz_store.cc:276] 0709 13:05:25.195369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.470281 (+274912us) service_pool.cc:224] Handling call
0709 13:05:25.470539 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.659584 (+189045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.659615 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.659657 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:25.659695 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.377965 (+1718270us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54000d7354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:27.378033 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.378207 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434302336}
I20260709 13:05:27.288878 20002 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:27.409780 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.425715 19965 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:27.426213 19965 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:27.426608 19965 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:27.408932 19758 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.428988 20245 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:27.430951 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:27.429085 19758 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.405930 20010 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.442943 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 384) took 1258 ms. Trace:
I20260709 13:05:27.443432 15271 rpcz_store.cc:276] 0709 13:05:26.184815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.186169 (+  1354us) service_pool.cc:224] Handling call
0709 13:05:26.219667 (+ 33498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:26.220064 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:26.220303 (+   239us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.431483 (+211180us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.437935 (+  6452us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:26.438441 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:05:26.438631 (+   190us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:26.438863 (+   232us) log.cc:844] Serialized 14 byte log entry
0709 13:05:27.292365 (+853502us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b18001062a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:27.425363 (+132998us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b18001062a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:05:27.442519 (+ 17156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.442596 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.442638 (+    42us) raft_consensus.cc:1685] finished
0709 13:05:27.442653 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.442884 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":972314,"prepare.queue_time_us":1715697,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":997476,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":19038,"spinlock_wait_cycles":85726976,"thread_start_us":227498,"threads_started":2,"wal-append.queue_time_us":315679}
I20260709 13:05:27.429778 20166 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:27.455679 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 857030us
I20260709 13:05:27.452975 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2389) took 1120 ms. Trace:
I20260709 13:05:27.456615 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:27.466037 20266 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.466989 20201 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.467567 20201 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.470268 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:27.470664 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.473637 15267 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:27.451977 20150 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:27.482566 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.483748 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.485780 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.469641 20201 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.452699 20269 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.487545 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.489107 15263 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:05:27.488323 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 57456.4us
I20260709 13:05:27.490588 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.481686 19962 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:27.491780 20304 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:27.490746 15272 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:27.505919 15272 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:27.494297 19965 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.495443 20312 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:27.500559 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:27.448987 20010 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.499967 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.501677 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.503225 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2629) took 1777 ms. Trace:
I20260709 13:05:27.503594 20160 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:27.481853 20124 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.505489 19962 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.506794 15272 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.474200 20166 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.543123 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.558825 15272 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:27.560582 15269 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:27.560421 15265 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:27.497251 20201 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.565196 15270 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:27.498369 20114 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:27.500337 19403 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.556746 15345 rpcz_store.cc:276] 0709 13:05:25.725639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.889663 (+164024us) service_pool.cc:224] Handling call
0709 13:05:25.890027 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.955262 (+ 65235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.955307 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:26.029892 (+ 74585us) log.cc:844] Serialized 26 byte log entry
0709 13:05:26.100408 (+ 70516us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:26.121981 (+ 21573us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.607973 (+485992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.608162 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.293302 (+685140us) spinlock_profiling.cc:243] Waited 5.41 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:27.496771 (+203469us) raft_consensus.cc:1685] finished
0709 13:05:27.502992 (+  6221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.503163 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103041,"prepare.queue_time_us":21337,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":177218,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":8888,"spinlock_wait_cycles":12440832,"thread_start_us":520841,"threads_started":3,"wal-append.queue_time_us":113803}
W20260709 13:05:27.567708 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 77708.8us
I20260709 13:05:27.568372 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.570122 15263 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:27.568419 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:27.566031 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 121726us
I20260709 13:05:27.570910 15269 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:27.560523 19962 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:27.537473 20266 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:27.575896 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75415us
I20260709 13:05:27.576553 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:27.577466 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:27.579067 20166 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.579233 19965 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.584533 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:27.587848 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.583197 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:27.582623 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.592474 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.596436 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:27.598312 15272 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:05:27.598809 15272 pending_rounds.cc:85] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 9
I20260709 13:05:27.599010 15269 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:27.599128 15272 pending_rounds.cc:107] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:05:27.600613 15272 raft_consensus.cc:2889] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:27.561415 20124 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.572230 20114 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.628749 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:27.629588 15342 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:27.630492 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:27.602491 20154 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:27.631539 20154 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:27.632031 20154 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:27.635311 15342 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:27.580863 20002 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.570430 20201 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:27.657857 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75157.3us
I20260709 13:05:27.662736 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.663599 15345 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:27.664660 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.665325 15345 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:27.666280 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.626689 20135 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:27.574851 19403 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:27.667780 20308 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:05:27.667877 20135 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.669857 19403 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.670056 20135 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.581496 20040 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:27.670585 20314 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:27.684175 15267 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:27.671247 20313 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.122s
I20260709 13:05:27.715621 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:27.717468 20114 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.507912 20312 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.722537 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:27.732714 15342 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.500840 20269 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:27.743237 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 83818.7us
I20260709 13:05:27.738510 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:27.648893 20160 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:27.671802 20105 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:27.672158 20106 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:27.756397 20314 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:27.762887 20314 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.763921 20201 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.726755 19937 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.764889 19937 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.744107 20113 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:05:27.768965 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:27.744638 20047 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:27.583554 20266 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.778445 20266 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.779264 15342 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:27.780462 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.780380 20106 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.781488 15342 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:27.782574 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:27.783381 15342 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:27.784113 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.784221 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:27.770519 20193 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:27.787197 20047 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:27.768169 20040 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:05:27.799439 19937 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.801282 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1905) took 2514 ms. Trace:
I20260709 13:05:27.782919 20106 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.804412 20312 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.809602 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:27.807410 20278 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.972s	user 0.000s	sys 0.003s
I20260709 13:05:27.817466 15194 rpcz_store.cc:276] 0709 13:05:25.286422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.572618 (+286196us) service_pool.cc:224] Handling call
0709 13:05:25.572924 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:26.183326 (+610402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.801015 (+1617689us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54001e82d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:27.801221 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260206976}
I20260709 13:05:27.802795 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:27.818842 20047 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.819588 20010 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.825142 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.827164 15342 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:27.827589 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:27.828190 15271 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:05:27.831233 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.831812 15339 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:27.775409 20105 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.833801 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:27.824891 20113 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:27.846335 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.851985 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:27.856802 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 111970us
I20260709 13:05:27.860895 15271 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:05:27.852172 20270 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.034s	user 0.002s	sys 0.002s
I20260709 13:05:27.873925 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:27.875296 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.876436 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.885066 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.886118 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:27.887262 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:27.887742 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:27.888526 20128 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:27.889052 20279 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.889542 20279 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:27.892130 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2628) took 2166 ms. Trace:
I20260709 13:05:27.892517 15337 rpcz_store.cc:276] 0709 13:05:25.725430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.886519 (+161089us) service_pool.cc:224] Handling call
0709 13:05:25.886931 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:27.020262 (+1133331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.891900 (+871638us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540016d354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:27.892077 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604801280}
I20260709 13:05:27.893648 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.893955 19962 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.894594 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:27.897950 19761 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.898514 19761 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:27.904027 15874 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:05:27.849589 20113 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:27.909158 20113 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.911962 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1880) took 1603 ms. Trace:
I20260709 13:05:27.912734 20105 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.913452 20243 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:27.913996 20243 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.914829 15269 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:27.917037 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.920982 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.926445 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.912352 15340 rpcz_store.cc:276] 0709 13:05:26.308867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.322758 (+ 13891us) service_pool.cc:224] Handling call
0709 13:05:26.323825 (+  1067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.324072 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:26.413946 (+ 89874us) log.cc:844] Serialized 14 byte log entry
0709 13:05:27.911450 (+1497504us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b1800390160. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a
0709 13:05:27.911627 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:27.911669 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:27.911732 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.911804 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.911908 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34196,"prepare.queue_time_us":141314,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":6307,"raft.queue_time_us":780,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":9058048,"thread_start_us":128047,"threads_started":1,"wal-append.queue_time_us":495176}
I20260709 13:05:27.928197 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.929292 15340 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:27.934607 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.930748 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.936451 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.830569 20160 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.935295 15337 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:05:27.926564 20223 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.001s
I20260709 13:05:27.939633 15345 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:27.872526 20269 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.898950 19761 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:27.941392 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.932353 20112 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:27.942350 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.940644 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.953303 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.931137 20113 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:27.961272 19962 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:27.940696 20158 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:27.962450 15873 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:27.953125 20223 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:27.966859 20223 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:27.962472 20158 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:27.971855 20158 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.972975 15337 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:27.973347 20279 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:27.980082 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:27.949810 20124 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:27.995748 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1883) took 1684 ms. Trace:
I20260709 13:05:28.007949 15338 rpcz_store.cc:276] 0709 13:05:26.311220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.494790 (+183570us) service_pool.cc:224] Handling call
0709 13:05:26.495122 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:26.495447 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.495474 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:26.535494 (+ 40020us) log.cc:844] Serialized 26 byte log entry
0709 13:05:26.616904 (+ 81410us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:26.616962 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.617050 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.820036 (+1202986us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:27.978358 (+158322us) raft_consensus.cc:1685] finished
0709 13:05:27.978380 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.995651 (+ 17271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21009,"raft.queue_time_us":49798,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":3386,"spinlock_wait_cycles":137765248,"thread_start_us":81012,"threads_started":1,"wal-append.queue_time_us":243230}
I20260709 13:05:28.012939 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.013897 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.014782 15337 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:28.018240 20247 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.024328 20282 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.024893 20282 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:28.026162 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.027771 20170 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:28.027990 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:28.029996 20245 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:05:28.013706 15338 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:28.036619 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.042099 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:28.042721 15873 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:28.043589 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:28.045784 20253 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:28.046555 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.026966 20282 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.047854 20258 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:28.048328 20258 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:28.049093 20258 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.050028 20258 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.050239 20243 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.051141 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.051651 15195 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:05:28.051710 15191 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:28.052811 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.052949 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:28.053717 15197 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:28.054490 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.037775 19990 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.055509 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:27.978696 20112 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:28.056288 15345 raft_consensus.cc:2410] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:05:28.057029 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.057974 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.058108 20112 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:28.059288 19761 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.059828 20043 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.063176 15342 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:28.063308 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:28.064368 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.065019 15339 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:28.065619 15339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:05:28.066128 15339 raft_consensus.cc:606] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.066483 15339 raft_consensus.cc:614] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:28.066679 15188 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:28.050328 15189 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:28.066809 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.046306 20253 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:28.065629 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:28.069345 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.058701 20180 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.058893 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.080611 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:27.954823 20154 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.090337 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.083590 20112 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.096263 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:28.098811 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64237.2us
I20260709 13:05:28.097311 18938 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:28.097397 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.100857 15188 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:28.093250 19717 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.086781 20291 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.082888 20282 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:28.100317 15345 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:28.098224 20259 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:28.035127 20124 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:05:28.055538 19990 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.091964 20254 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.091936 20266 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.113234 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.117242 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:28.113773 15345 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:28.118801 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.121877 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.122990 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.084602 20180 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.089432 20267 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:05:28.098812 20240 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:05:28.110483 20259 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:28.131165 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.137281 20253 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:28.111512 20282 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:28.141124 20282 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:28.141602 19717 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:28.142097 19717 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:28.141633 20259 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:28.142949 19717 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.144153 19717 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:28.145452 20121 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.146420 20154 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.118050 20274 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:05:28.151319 20274 consensus_queue.cc:1243] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:28.151754 19758 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:28.152141 19758 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:28.153224 20182 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:28.153008 19758 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.153885 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.154314 19758 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:28.154698 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.155436 20087 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:28.155966 20087 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.156325 20087 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:28.157569 15272 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:28.130021 20279 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:28.103996 20245 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:05:28.159390 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.160005 15265 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:28.160367 20279 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:28.160882 20279 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:28.161293 15267 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:28.162492 15270 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:28.135885 20250 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:28.164001 20250 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.166035 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:28.166204 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:28.159402 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.167695 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:28.109270 20291 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.168742 19725 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:28.169173 19725 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.169205 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.169734 19725 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:28.170383 20291 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.171430 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.171626 20128 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:28.123440 20088 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:28.172803 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:28.107930 20192 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:05:28.178123 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 79571us
I20260709 13:05:28.173707 18938 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:28.174393 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:28.175329 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.179490 15270 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:28.104089 20112 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.184976 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.177433 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:28.186728 15270 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:28.175976 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.187475 15269 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:28.188614 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.188912 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.190156 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.129773 20055 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:28.185745 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.158871 15272 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:28.194311 15341 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:28.178532 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.195549 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.191578 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.192569 15269 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:28.197224 15265 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:28.194046 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.181306 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.134431 20096 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:28.201408 15338 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:28.201323 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.204717 15267 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:28.202292 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.119323 20254 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.184155 20253 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:28.215233 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.198421 20055 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.193240 19717 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:28.200879 20240 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:28.218725 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.210837 15341 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:28.203472 20096 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.206900 19962 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:28.184223 20257 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:05:28.184057 20121 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:05:28.184985 20267 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:05:28.211580 19900 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:28.250633 20245 raft_consensus.cc:2764] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:05:28.252072 15344 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:28.223587 20192 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:28.237496 19717 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.224272 20055 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.266176 20254 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.241861 19962 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.268209 19962 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:28.271212 19761 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:28.272171 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1920) took 1182 ms. Trace:
I20260709 13:05:28.272580 15196 rpcz_store.cc:276] 0709 13:05:27.089449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.342952 (+253503us) service_pool.cc:224] Handling call
0709 13:05:27.344230 (+  1278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.345857 (+  1627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.345898 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.346422 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.971355 (+624933us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b180012fb80. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:28.122996 (+151641us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:28.123072 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.123133 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.271872 (+148739us) raft_consensus.cc:1685] finished
0709 13:05:28.271893 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.272112 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":15929728,"thread_start_us":151147,"threads_started":1,"wal-append.queue_time_us":876557}
I20260709 13:05:28.238793 20240 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.265168 19717 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:28.265844 20326 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:05:28.271981 19761 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:28.242553 20096 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:28.262360 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43764.7us
I20260709 13:05:28.217283 20253 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.281414 20055 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.276525 20267 consensus_queue.cc:1243] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:28.264719 19900 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:28.287169 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.288538 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.291729 15190 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:28.276906 20240 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.211704 20247 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:05:28.303526 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.309223 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 95625.2us
I20260709 13:05:28.276461 20259 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.306442 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.373152 15339 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:05:28.447010 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.458379 15268 rpcz_store.cc:276] 0709 13:05:26.333017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.333173 (+   156us) service_pool.cc:224] Handling call
0709 13:05:26.333468 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.333669 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:26.541989 (+208320us) log.cc:844] Serialized 14 byte log entry
0709 13:05:27.452410 (+910421us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:27.452479 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:27.452552 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:27.452647 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.452897 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":682275,"prepare.queue_time_us":620577,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":683929,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":109745920,"thread_start_us":407312,"threads_started":2,"wal-append.queue_time_us":267536}
W20260709 13:05:28.404012 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 222777us
I20260709 13:05:28.376423 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.408061 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2621) took 2682 ms. Trace:
I20260709 13:05:28.449640 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.368660 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:28.332510 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.451894 15344 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:05:28.453599 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.453852 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:28.454463 15190 raft_consensus.cc:2368] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:28.455539 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.455627 15337 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:28.456763 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.457700 15193 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:28.457016 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:28.285218 20253 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.450826 15343 rpcz_store.cc:276] 0709 13:05:25.722615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.746537 (+ 23922us) service_pool.cc:224] Handling call
0709 13:05:26.836536 (+1089999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.860351 (+ 23815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.404659 (+1544308us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400059e50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:28.404830 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2376951040}
I20260709 13:05:28.457016 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.460402 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.459049 20245 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.462368 20245 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.464424 20245 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:28.354805 20221 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.484s	user 0.003s	sys 0.002s
I20260709 13:05:28.468132 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.471319 15196 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
W20260709 13:05:28.471524 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 300145us
I20260709 13:05:28.296345 20170 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:28.474068 15196 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:28.475672 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:28.305449 20192 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.478735 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:28.341064 20328 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:05:28.469986 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.472438 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.472540 15311 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.480123 15265 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:28.354375 20055 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.476482 15269 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:28.476768 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.486975 15270 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:28.375203 20180 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:28.438520 20340 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:05:28.479625 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:28.401206 20112 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:28.340590 20331 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:05:28.482474 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.482856 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.486188 18829 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.311194 19990 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.487716 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.477263 20166 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:28.474277 20040 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.489306 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.540746 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:28.541128 15272 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:28.541491 15194 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
W20260709 13:05:28.425369 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:28.466888 20284 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.477725 20245 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:28.487852 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.494199 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.474030 20342 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.382853 19725 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:28.556447 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 84063us
I20260709 13:05:28.444458 20279 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.353560 20096 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.484897 19403 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:28.557693 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1879) took 2256 ms. Trace:
I20260709 13:05:28.558188 19403 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:28.558369 15346 rpcz_store.cc:276] 0709 13:05:26.289054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:26.289268 (+   214us) service_pool.cc:224] Handling call
0709 13:05:28.545413 (+2256145us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54000b6b54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:28.545581 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279098112}
I20260709 13:05:28.538924 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:28.540016 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54329.9us
I20260709 13:05:28.560153 15197 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:28.490080 20341 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:28.378216 19900 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:28.548744 15082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 123608us
W20260709 13:05:28.551954 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64162.9us
I20260709 13:05:28.565691 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.553732 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:28.490844 20251 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:28.557320 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.592876 15265 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:05:28.596256 18829 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.481426 20170 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.484946 20192 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.597813 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:28.621371 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64131.3us
I20260709 13:05:28.621508 15272 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:28.622360 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.623848 15188 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:28.490687 20187 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:05:28.620349 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.628418 15237 leader_election.cc:400] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:28.630847 15237 leader_election.cc:403] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:05:28.550997 20284 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.562407 20342 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.568073 19990 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:28.594159 20313 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:28.635313 18829 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.646672 18829 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.648762 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.649367 15197 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:28.651669 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.652516 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.634089 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:28.654428 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.643537 15189 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:28.644759 19403 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:28.556751 20040 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:28.632180 20176 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:28.634732 20174 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:28.667958 18829 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.671007 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.629112 20055 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:05:28.678908 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.652702 20313 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.683197 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.652364 20114 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:28.659317 20180 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:28.668447 20047 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:28.636067 20247 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:05:28.688516 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.687986 19403 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:28.692266 18829 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:28.692368 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.690451 20313 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:28.702194 15194 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:05:28.687359 20166 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.687166 20113 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:28.703976 20113 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:28.704353 20113 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:28.691073 20180 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.707309 20180 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:28.712672 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.716085 20187 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:28.716555 20187 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:28.716940 20187 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:28.714949 20045 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.687547 20174 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:28.723835 20174 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.726378 20240 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.730157 15340 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:28.733685 20240 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.668525 20176 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:28.734884 19962 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.735352 20176 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:28.735965 15338 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:28.697386 20047 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.697808 20259 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.728222 20040 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:28.700212 20245 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:05:28.746332 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:28.760625 15874 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:05:28.756963 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64679.2us
I20260709 13:05:28.775389 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.776257 15195 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:28.756434 20247 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:28.756975 20047 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.758237 20166 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:28.789887 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.790796 15195 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
W20260709 13:05:28.795375 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.795650 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 203288us
W20260709 13:05:28.796337 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.788170 20166 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.805025 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.805784 15189 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:28.801488 20344 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:28.810595 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 327796us
I20260709 13:05:28.812575 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.813156 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:28.811064 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 246604us
I20260709 13:05:28.811897 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.814635 15346 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:28.827369 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.778551 20195 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:05:28.781925 20245 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:05:28.809309 19717 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.001s
I20260709 13:05:28.802304 20279 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.803541 20166 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.841631 20240 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.844646 20344 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.856717 20344 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.858744 20344 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.846706 20257 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:28.847877 20112 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:28.848730 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.795887 20247 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.860615 20180 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:28.864327 20349 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:28.864789 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:28.865602 20346 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:28.866148 20313 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.812094 20170 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.830785 20101 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:28.845826 20243 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:28.910516 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.867702 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.877854 20121 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:05:28.911173 15343 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:28.812453 20192 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.830262 20251 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:28.911756 20243 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.870152 19717 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.912106 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.912300 20243 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.912724 15343 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:28.912602 20251 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.913594 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.913740 19717 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.914187 15343 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:28.914274 20243 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.914500 15345 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:05:28.853699 20239 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.915337 20239 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.903697 20284 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.893263 20342 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.918119 20239 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.897603 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:28.919786 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.920570 15192 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:28.921615 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:28.922564 15192 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:28.924876 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.928086 20262 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:28.929404 15196 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:28.930751 15196 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:05:28.931262 19962 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.882006 20195 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:28.935127 20195 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.935675 15189 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:28.936513 15195 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:28.937120 20195 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:28.940395 20087 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.784s	user 0.010s	sys 0.002s
I20260709 13:05:28.940830 20087 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.944242 20101 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:28.944515 20313 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.944926 15343 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:28.945041 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2638) took 1058 ms. Trace:
I20260709 13:05:28.945461 15339 rpcz_store.cc:276] 0709 13:05:27.886268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.094824 (+208556us) service_pool.cc:224] Handling call
0709 13:05:28.372839 (+278015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:28.448267 (+ 75428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.944863 (+496596us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54000b5c50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:28.944986 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619092352}
I20260709 13:05:28.945446 20253 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.948499 15193 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:28.949223 20160 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:28.949307 15195 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:28.949636 20160 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:28.950181 20253 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.952298 15238 leader_election.cc:400] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:28.952715 15238 leader_election.cc:403] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:28.953384 20055 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:28.953773 20055 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:28.953948 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.954548 20055 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.954979 20105 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:28.955569 20055 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.963200 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.906697 15344 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:28.907261 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.964305 15344 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:28.964493 15341 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:28.908066 15337 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:28.894323 20279 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:28.927779 20187 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.956246 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:28.956944 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.956734 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.901176 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:28.978052 15340 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:28.900158 15346 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:28.942763 20087 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:28.966693 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.981287 19965 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:28.981774 19965 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:28.982360 19965 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:28.986356 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:28.988075 20312 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:28.988798 20312 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.991423 20313 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:28.992019 20313 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.992503 20313 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.963845 15342 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:28.967125 15341 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:28.965587 19900 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:28.996827 19900 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.973121 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:28.999384 15196 raft_consensus.cc:606] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:28.999835 15196 raft_consensus.cc:614] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:29.007593 19900 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.009087 20312 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.015331 15190 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
W20260709 13:05:29.016814 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 60203.1us
I20260709 13:05:29.017856 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:28.972350 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.019280 15337 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:28.965050 15344 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.023692 15344 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:29.018548 20201 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:29.035374 20201 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:29.036003 20201 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:29.042687 20045 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:29.043605 20045 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:29.045357 20045 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:29.045780 20045 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:29.046855 20045 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.048314 20045 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.052985 15344 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:05:29.054123 20084 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:05:29.056828 15337 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:29.068679 20312 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:29.072253 15238 leader_election.cc:400] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:29.074913 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:28.903578 20257 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:28.862932 20047 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:28.955909 20105 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:29.079699 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 118884us
I20260709 13:05:28.895521 20247 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.088330 20180 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.084013 20272 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:05:29.090067 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.090732 20240 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.113394 20272 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:29.113935 20272 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:29.113840 20240 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.114923 20272 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.116175 20272 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:29.116269 20240 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:28.973886 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:29.077154 20114 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:29.117039 20105 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:29.117305 20253 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:29.117760 20114 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:29.118201 20114 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:29.118291 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 144446us
I20260709 13:05:29.118628 20114 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:28.969799 20279 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.119237 20279 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:29.120941 20247 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.087999 20113 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.101311 20312 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:05:28.977576 20176 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.120996 20180 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.123800 20180 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.124814 20176 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.125452 20176 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:29.125869 20176 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:29.126092 20180 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.127556 20113 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.128340 20187 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.111058 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:29.130208 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:29.131312 20253 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:29.131731 20253 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.132104 20253 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:29.132761 20244 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:29.133314 20244 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:29.108668 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 262310us
I20260709 13:05:29.135651 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:29.134259 20244 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.141059 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:29.142830 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.143301 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.143605 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.135890 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:29.146034 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.169487 15340 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:29.169534 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.170639 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.163527 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.171633 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:29.173025 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:29.175223 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.178036 15342 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:29.147535 20195 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:29.150220 20180 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:29.149120 20247 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:29.154946 20087 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.126693 20176 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.110092 20257 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.132825 20114 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.186165 15340 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:29.177462 20112 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:29.169035 19672 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:29.194376 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:29.178434 20244 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:29.147491 19965 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.211375 19823 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:29.207368 20362 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:05:29.211917 19823 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:29.212306 19965 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:29.213148 20330 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:29.214051 20047 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.214740 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2404) took 1352 ms. Trace:
I20260709 13:05:29.198349 20247 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.215106 15271 rpcz_store.cc:276] 0709 13:05:27.862043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.862279 (+   236us) service_pool.cc:224] Handling call
0709 13:05:27.862596 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:27.871116 (+  8520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.871145 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:27.928548 (+ 57403us) log.cc:844] Serialized 52 byte log entry
0709 13:05:28.082834 (+154286us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:28.092094 (+  9260us) log.cc:844] Serialized 14 byte log entry
0709 13:05:28.103232 (+ 11138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.103341 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.135235 (+1031894us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b18001de540. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:29.214448 (+ 79213us) raft_consensus.cc:1685] finished
0709 13:05:29.214547 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.214686 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":352296,"prepare.queue_time_us":10414,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":14996,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":56007,"spinlock_wait_cycles":5600000,"thread_start_us":120323,"threads_started":1,"wal-append.queue_time_us":166627}
I20260709 13:05:29.216851 20247 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.198910 20240 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:29.217653 20240 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:29.218158 20240 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:29.220665 20096 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.185667 20101 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:29.192166 20180 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:29.203364 20087 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.188424 20195 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.230047 19985 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:29.205468 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:29.237560 15343 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:29.239758 15191 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:29.240108 15193 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:29.240453 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:29.254626 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:29.254711 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:29.240712 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "685539345e364189892668dfd1ff7309"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:29.242096 15196 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:29.243613 15188 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:29.256610 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:29.256680 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:29.277737 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:29.277168 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:29.278972 15188 raft_consensus.cc:2410] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:05:29.280325 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:29.280346 15189 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:29.275187 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.282483 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:29.283161 15188 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:29.251824 20251 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:29.253180 19985 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:29.259016 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 182099us
W20260709 13:05:29.290441 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 85034.8us
I20260709 13:05:29.290642 15190 raft_consensus.cc:606] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:29.291077 15190 raft_consensus.cc:614] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:29.279798 20096 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.295341 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.295424 19900 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:29.238092 20313 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:29.253640 20195 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:29.299511 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.300721 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.301234 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.304070 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.253841 20180 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.305959 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.306702 15342 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:29.256393 19937 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:05:29.309590 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.305096 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:29.324347 15342 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:29.340101 15338 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:29.346072 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.308904 19937 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.355387 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.357586 15340 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:29.357815 15342 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:29.313915 20312 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:29.314162 19900 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:29.302794 20096 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:29.373399 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 298556us
I20260709 13:05:29.304919 20201 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.402935 20320 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:29.404120 20320 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:29.404348 20201 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.404623 20320 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:29.405534 20320 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.406991 20320 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:29.373873 20047 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:05:29.408288 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.411126 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.411916 15342 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:29.385237 20245 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:29.347222 19985 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.400846 20312 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:29.401087 20114 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.401661 20257 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:29.402098 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:29.382758 20274 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:05:29.436385 19900 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.415652 20262 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:29.440157 20240 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:29.440011 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.443950 20312 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.444854 20253 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.445037 19725 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:29.445497 20313 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:29.447124 20096 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.448068 20087 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.448446 20176 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.402971 19937 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:29.461526 20279 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:29.477650 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.531862 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.478204 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.478986 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:29.534689 15345 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:29.480449 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:29.482515 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:29.484411 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82426.7us
I20260709 13:05:29.536417 15338 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:29.536675 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:29.487452 20114 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:29.498966 20362 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:05:29.538710 20114 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:29.539171 20114 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:29.540723 20040 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:29.541491 20040 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.546205 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:29.546849 20114 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.547719 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:29.548012 20160 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.549257 20045 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:29.549443 20160 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:29.549676 20045 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.550068 20045 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.551281 20043 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:29.551736 20043 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:29.552047 15271 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:29.551231 20166 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:29.552997 20166 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:29.553371 20166 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:29.552117 20043 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:29.556490 15265 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:29.558849 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.561671 15268 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:29.496287 20244 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:05:29.499640 20084 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:05:29.498929 20101 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:05:29.577765 15337 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:29.581489 15272 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:29.501456 20262 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:29.520275 20344 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:05:29.528370 20363 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:05:29.570276 20180 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.590518 20266 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:29.607735 20279 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:29.609431 20373 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.166s	user 0.001s	sys 0.002s
I20260709 13:05:29.601924 20266 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:29.619474 20253 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.619391 20266 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.570755 15345 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:29.620970 20266 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:29.624472 20272 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
I20260709 13:05:29.616478 20240 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:29.614420 20045 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.621701 20114 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.499162 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:29.708335 15189 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:29.485033 15190 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:29.709342 15193 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:05:29.496601 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:29.712863 15195 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:29.714411 15196 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:29.708380 15188 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:29.731734 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.732373 15270 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:29.733675 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.734191 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.734640 15270 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:29.735673 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.736310 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.735698 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.737377 15265 raft_consensus.cc:2410] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:29.737795 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.738253 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.738508 15264 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:29.739722 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.740661 15267 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:29.741657 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.742435 15268 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:29.743788 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 233839us
I20260709 13:05:29.748541 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2473) took 1272 ms. Trace:
I20260709 13:05:29.757928 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:29.749071 15269 rpcz_store.cc:276] 0709 13:05:28.476491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.491281 (+ 14790us) service_pool.cc:224] Handling call
0709 13:05:28.491553 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:28.600233 (+108680us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:28.600262 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:28.600689 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.437818 (+837129us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b18002046a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:29.747796 (+309978us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:29.747889 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.747993 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.748063 (+    70us) raft_consensus.cc:1685] finished
0709 13:05:29.748075 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.748361 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128144,"raft.queue_time_us":129478,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8197,"spinlock_wait_cycles":8071552,"thread_start_us":309430,"threads_started":1,"wal-append.queue_time_us":1030657}
I20260709 13:05:29.769404 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.770368 15346 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:29.775585 18938 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:05:29.777361 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.776656 18938 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.780012 18938 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:29.646700 20043 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.786039 20043 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.789297 20045 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.794200 20253 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:29.797740 20253 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:29.805346 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80404.4us
I20260709 13:05:29.799015 20253 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:29.810652 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.816886 15265 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:05:29.834373 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.836515 20180 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.632943 20195 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.847898 20114 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:05:29.850099 20195 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.855334 20045 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:29.857458 20045 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:29.870697 15194 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:29.880196 20274 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.881175 20274 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.884378 15345 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:05:29.876927 20045 consensus_queue.cc:1243] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:29.896574 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.898412 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.909670 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.910589 15338 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:29.913568 15346 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:29.918479 15268 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:29.913889 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:29.925851 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.928467 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.923050 15265 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:29.934692 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.920781 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:29.937472 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:29.938200 15341 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
W20260709 13:05:29.939478 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.939383 19725 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:29.946606 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.955530 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.960078 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:29.965638 20040 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.935473 20195 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:05:29.958276 20045 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:29.970352 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:29.974534 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:29.976050 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 99597.1us
I20260709 13:05:29.976358 19900 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:05:29.953516 19725 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:29.978416 15268 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:29.979347 15263 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:29.971634 20045 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:29.988299 19900 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:29.988976 19900 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.992609 20253 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.994612 19761 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:29.995473 20166 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.997977 20166 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:29.999166 19761 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:30.000684 19761 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.001900 19761 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:30.003682 19725 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:30.006211 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 482951us
I20260709 13:05:30.008390 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:30.009393 15269 raft_consensus.cc:2410] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:05:30.010131 19985 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:30.010373 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:30.011929 20087 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:30.012490 20087 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:30.013926 20087 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:29.986654 20045 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:29.986614 15271 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:30.021879 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.019194 15093 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.021350 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.023550 15268 raft_consensus.cc:2410] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:30.024408 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.019205 20274 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.033799 15265 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:30.029855 15266 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:30.032878 20384 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:30.055156 20253 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.069535 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:30.079504 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 91971.2us
I20260709 13:05:30.080055 15338 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:30.080840 15266 raft_consensus.cc:2368] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16.
I20260709 13:05:30.078343 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.086012 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.089067 20362 raft_consensus.cc:2764] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:05:30.090184 15266 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:30.100962 15264 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:30.102540 15264 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:30.104652 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:30.105535 15269 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.107977 19900 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.083895 20087 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:30.115700 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 105480us
I20260709 13:05:30.117311 15238 leader_election.cc:400] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:30.118006 15238 leader_election.cc:403] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:30.089697 20240 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:05:30.120126 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.112033 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:30.128238 20084 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:30.128676 20084 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:30.128669 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:30.129313 20084 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:30.132638 20279 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:30.133234 18938 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:30.133605 15268 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:30.135046 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:30.138676 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:30.138965 15337 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:30.139868 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:30.141044 15266 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:05:30.141845 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:30.142210 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55783.4us
I20260709 13:05:30.142552 15346 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:30.142580 15266 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:30.143229 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:30.150045 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.151866 20040 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:30.152469 20040 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:30.152661 19823 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.162334 19823 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:30.153450 20040 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.172375 20312 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:30.172854 20312 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:30.173813 20312 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.174853 15269 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:30.179718 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:30.187763 15266 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:30.190387 15272 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:30.190871 15266 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:30.199923 20240 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:30.200444 15267 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
W20260709 13:05:30.212711 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64752.2us
I20260709 13:05:30.214179 19725 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:30.200443 20240 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:05:30.217806 20390 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.298s	user 0.000s	sys 0.004s
I20260709 13:05:30.217748 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:30.214979 19725 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.196373 20262 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.220290 20240 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.220860 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:30.221388 20388 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.219907 19900 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:30.230475 19900 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.230937 19900 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:30.224067 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 87326.6us
I20260709 13:05:30.209335 15093 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 7 to 9, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 9 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:30.226840 19725 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.216229 20312 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.237017 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:30.230573 20388 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.238113 15272 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:30.284821 20253 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.250070 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.280025 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:30.290162 20274 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:30.290697 20274 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:30.291637 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:30.291836 20274 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:30.294651 20160 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.745s	user 0.013s	sys 0.009s
I20260709 13:05:30.287348 20253 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.295872 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:30.298207 15269 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:30.287868 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.244915 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:30.288655 20176 consensus_meta.cc:287] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.733s	user 0.008s	sys 0.016s
I20260709 13:05:30.272184 20251 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:30.271705 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:30.263343 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.238894 20392 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:05:30.297242 20253 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.249965 20043 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:30.250089 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:30.313711 15346 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:30.301930 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:30.327481 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 184535us
I20260709 13:05:30.206914 20045 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.239923 15093 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 12 to 13, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 13 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.335517 15093 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 12 to 15, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 15 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.338626 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:30.339773 15093 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 7 to 15, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 15 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:30.341048 15193 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:30.337520 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.342377 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:30.342971 15272 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:30.333244 15265 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
W20260709 13:05:30.337426 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 87481.3us
I20260709 13:05:30.325654 20160 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:30.324293 19900 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.280369 19725 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:05:30.355274 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:30.361464 19900 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.347313 20195 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:30.345474 20043 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:30.353639 20176 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:30.378077 20388 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:30.376552 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.351784 20362 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:05:30.392334 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 120738us
I20260709 13:05:30.387270 15196 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:30.388928 15265 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:30.371438 20195 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:30.398141 15191 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:30.398270 15309 leader_election.cc:400] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16.
I20260709 13:05:30.401767 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:30.404590 15309 leader_election.cc:403] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:30.401587 20084 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:30.402437 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.384995 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:30.427531 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.437547 15193 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:30.425011 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 65391.2us
I20260709 13:05:30.379082 20160 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.413612 20195 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:30.455819 20362 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:30.457059 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 97585.1us
I20260709 13:05:30.459414 20388 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:30.448606 20160 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.460264 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2719) took 1212 ms. Trace:
I20260709 13:05:30.460736 15191 rpcz_store.cc:276] 0709 13:05:29.247775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.256329 (+  8554us) service_pool.cc:224] Handling call
0709 13:05:30.438818 (+1182489us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001a5254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:30.460173 (+ 21355us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2591049600}
I20260709 13:05:30.459370 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:30.462014 15338 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:30.441926 15269 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:30.466060 15270 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:05:30.466846 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.420208 20045 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:30.491377 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54031.3us
I20260709 13:05:30.491575 20043 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.493340 20362 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:30.494324 20384 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:30.494449 20362 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:05:30.495086 20266 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.011s
I20260709 13:05:30.495370 20363 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:30.495818 20363 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:30.496121 20266 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:30.496807 20363 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.498191 20363 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:30.500461 20266 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.501073 20266 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.504691 19937 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:30.506023 20384 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:30.506505 20384 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:30.506992 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:30.507438 20384 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.508249 20266 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:30.509008 19937 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:30.511243 20396 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:05:30.515004 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:30.515745 15265 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:30.533026 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:30.533820 15338 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:30.518889 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:30.508924 20384 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:30.443843 19985 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16.
I20260709 13:05:30.472349 20087 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:30.531592 19823 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:30.568310 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.460294 20388 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.556381 19900 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:30.573546 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:30.562556 20045 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:30.595309 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76510.5us
I20260709 13:05:30.572443 19823 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.622051 15337 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:30.603607 19761 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:30.625545 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:30.635766 15197 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:30.593273 20240 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.623521 19985 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.655732 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:30.656615 15197 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:05:30.653352 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.595073 20087 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:30.659189 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.639266 20192 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:30.670274 15338 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:30.674387 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 117144us
I20260709 13:05:30.619760 19900 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.640368 20040 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:30.677783 15340 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:30.626892 20266 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:05:30.641654 19725 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:30.628099 19937 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:05:30.652733 20176 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:30.641175 20045 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.664244 20253 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:30.673857 19761 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:30.699010 15267 raft_consensus.cc:2410] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:05:30.680786 20084 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:30.663133 19985 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:30.772322 20399 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:05:30.774096 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:30.776070 15271 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.702s	user 0.011s	sys 0.014s
I20260709 13:05:30.778096 15271 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:30.779584 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2497) took 1059 ms. Trace:
I20260709 13:05:30.699890 20253 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:30.779976 15271 rpcz_store.cc:276] 0709 13:05:29.720258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.936654 (+216396us) service_pool.cc:224] Handling call
0709 13:05:30.779493 (+842839us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:30.793874 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 118598us
I20260709 13:05:30.801548 20416 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:30.801855 18938 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.802920 15269 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:30.756274 20257 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:05:30.807132 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.802703 18938 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.804559 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:30.820232 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:30.748843 20040 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.828738 20043 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:30.829555 20043 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:30.830693 20407 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:05:30.830940 20045 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:30.832073 20411 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.832521 20420 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:30.833038 20420 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.832717 20411 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.802488 20084 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.834139 20084 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.834753 20388 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:30.835646 20375 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:05:30.802963 20114 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:30.833415 20420 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:30.755713 20192 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.857060 15193 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:30.836216 20180 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:30.845518 20416 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:30.876001 20240 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:30.876869 20240 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:30.877548 20240 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:30.877992 20195 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:30.879380 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.879822 19985 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:30.880362 20195 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.805737 19725 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.875236 20410 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.881338 18938 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:30.826977 20367 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
W20260709 13:05:30.892452 15272 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.004s
I20260709 13:05:30.793259 19761 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.892853 15272 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:30.857553 20262 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:30.895152 15192 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:30.836192 20257 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.876894 20427 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:05:30.897864 20413 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:05:30.898217 20416 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:30.881080 20409 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:05:30.864274 20411 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:30.927696 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 231145us
I20260709 13:05:30.873364 20084 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:30.892078 19823 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.884478 20045 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:30.940656 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.878643 20240 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.940016 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:30.932827 20427 consensus_queue.cc:1243] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:30.868803 20114 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.943374 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:30.957211 19900 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:30.962954 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.870851 20176 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:05:30.957397 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 129658us
I20260709 13:05:30.978947 20350 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:30.979296 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:30.979765 20350 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.980533 19725 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:30.980640 20362 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:30.981191 20362 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:30.982273 20350 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:30.982165 20362 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.983898 20040 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:30.935616 20262 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.985775 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:30.986486 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:30.932492 20180 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:30.902884 20410 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.001123 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:30.988471 15194 raft_consensus.cc:2410] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:05:31.003509 15268 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:31.005117 20397 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:05:31.005975 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.006311 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:31.006500 20262 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.007280 15868 raft_consensus.cc:2393] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:31.010661 20410 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:31.014137 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 141307us
I20260709 13:05:31.001578 15874 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:31.003139 15197 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 9.
I20260709 13:05:30.902213 20253 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:30.985613 18938 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.020646 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.022755 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:31.020514 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:30.955852 20045 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.030048 15194 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:31.040324 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:31.042950 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.049155 15270 raft_consensus.cc:2410] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:05:31.051520 18938 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.051867 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:31.030673 20388 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.052774 15195 raft_consensus.cc:2368] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14.
I20260709 13:05:31.053460 18938 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.053205 20388 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.053970 18938 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:31.055907 20422 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:05:31.056720 20180 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.056936 20437 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.036582 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.059438 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.054531 18938 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.071472 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.072535 15270 raft_consensus.cc:2410] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:31.024760 20251 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.076871 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:31.071910 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51545.2us
I20260709 13:05:31.043136 20087 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.082620 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.083319 15268 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:31.083640 15197 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:31.084149 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.057560 20437 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.110937 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:31.111544 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.113632 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:31.113782 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 98738us
I20260709 13:05:31.067411 20262 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:31.111136 15189 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:31.112131 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.119935 15195 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:31.092872 19725 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:31.076525 20257 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.127735 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:31.114569 20253 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.104280 20437 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:31.167061 15265 consensus_meta.cc:287] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.006s
I20260709 13:05:31.110996 20388 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.171561 15265 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:31.160034 20312 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.152298 20262 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.177913 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.178287 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.178982 15870 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
W20260709 13:05:31.168392 20423 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:05:31.178077 20312 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.150617 20410 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:31.183398 15197 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:31.185276 20434 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.185843 20434 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.187105 20166 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:31.187352 20043 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.187719 20166 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.190027 20429 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.190796 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.190750 20429 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.191813 20312 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.193014 20429 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.193609 20418 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:31.194166 20418 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:31.188042 20434 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.190107 20166 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.232810 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.244853 15338 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:31.245007 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.249974 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.123260 20251 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.180436 20192 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.255863 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:31.258080 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 201744us
I20260709 13:05:31.260366 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:31.260922 15345 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:31.259666 15337 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:31.264151 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.259642 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.310562 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:31.282035 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:31.315824 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 238067us
I20260709 13:05:31.319219 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.319671 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.320722 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.321723 20433 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.322286 20433 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.323366 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:31.323997 20455 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.324365 20433 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.324576 20455 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.315961 20428 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.326562 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.327149 15341 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:31.327389 15312 leader_election.cc:400] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14.
I20260709 13:05:31.314347 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.331202 15312 leader_election.cc:403] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:31.258827 20410 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.284412 20429 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.332345 20429 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.331449 15343 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 9.
I20260709 13:05:31.333484 20410 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.334235 20429 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.336655 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.337931 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.338011 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:31.338680 15341 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:31.338737 15343 raft_consensus.cc:2368] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:31.339615 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:31.330410 20045 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.343782 20428 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.345198 15342 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:31.346028 20428 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.347340 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.348450 20192 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:31.349077 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.350045 20192 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:05:31.353462 20363 consensus_meta.cc:287] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.855s	user 0.009s	sys 0.003s
I20260709 13:05:31.354339 15337 raft_consensus.cc:2410] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:05:31.355567 20439 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:05:31.357996 20428 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.358634 20428 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.360924 20428 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.264256 20432 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:31.338377 20420 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.368788 20251 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:31.368991 20447 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:31.213882 20418 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:31.330087 20424 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 13:05:31.371387 15345 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
W20260709 13:05:31.373199 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45946.6us
W20260709 13:05:31.378083 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.384222 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:31.397250 20450 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:31.397744 20450 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.397975 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2515) took 1148 ms. Trace:
I20260709 13:05:31.398078 20450 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.398413 15269 rpcz_store.cc:276] 0709 13:05:30.249607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.463282 (+213675us) service_pool.cc:224] Handling call
0709 13:05:30.779164 (+315882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.803370 (+ 24206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.397753 (+594383us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54001b4250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:31.397891 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661594368}
I20260709 13:05:31.399695 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.399847 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.400882 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.401926 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.407917 19725 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:31.402926 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.400511 15269 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:31.410277 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.410475 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.410880 15266 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:31.411273 15345 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:31.414062 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2734) took 1050 ms. Trace:
I20260709 13:05:31.408591 19725 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:31.414656 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.415961 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.416059 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.416534 15271 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:31.417073 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.417332 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.417678 15267 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:31.418370 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.418440 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.411911 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.422300 20420 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.423290 20455 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.383435 20429 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14.
I20260709 13:05:31.425244 15265 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:31.425182 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.426355 20448 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:31.426735 20448 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.410980 15269 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
W20260709 13:05:31.427933 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43789.6us
I20260709 13:05:31.413221 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.428792 15345 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:31.429730 15192 rpcz_store.cc:276] 0709 13:05:30.363547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.370839 (+  7292us) service_pool.cc:224] Handling call
0709 13:05:31.413881 (+1043042us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000c12d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:31.414006 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096567168}
W20260709 13:05:31.413183 20384 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.000s
W20260709 13:05:31.437223 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.439273 15339 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:31.448874 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.427124 20448 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.451673 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.451598 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.487313 15339 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:31.488459 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:31.488998 20442 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.227s	user 0.002s	sys 0.000s
I20260709 13:05:31.450512 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:31.490172 20446 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:31.490603 20446 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.490955 20446 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.459728 20449 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.463006 20363 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.463691 20251 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.463881 20451 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:31.464866 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.465924 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.453354 15340 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:31.468057 20266 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:31.469733 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.477787 20437 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.479094 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.448730 20429 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.480491 20412 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:31.480764 20403 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.854s	user 0.006s	sys 0.002s
W20260709 13:05:31.485620 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.499581 15268 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:31.493808 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:31.508242 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.520134 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.521524 15339 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:31.479172 20427 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:31.511742 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:31.509298 15345 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 9.
I20260709 13:05:31.528774 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.523325 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.451889 20420 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:05:31.507507 20266 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:31.534504 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.531948 15162 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:31.537293 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.529785 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.529080 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.516610 20428 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:31.543591 15195 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:31.547869 15345 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:31.522720 20421 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:31.507287 20363 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:31.551258 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.544430 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 117449us
I20260709 13:05:31.528640 20388 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.543380 15192 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:31.533896 20084 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.564591 20084 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.565076 20084 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.508852 19725 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.552490 19985 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:31.567574 19985 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.567983 19985 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:31.568632 19725 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.509301 20251 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.570634 20251 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:31.571226 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 105454us
I20260709 13:05:31.571593 15189 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:31.572845 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.574234 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.555130 15196 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:31.538697 20416 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:31.566780 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2730) took 1237 ms. Trace:
I20260709 13:05:31.549824 20240 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:31.577286 15341 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:31.522466 20412 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.563938 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:31.578516 15188 rpcz_store.cc:276] 0709 13:05:30.328884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.332791 (+  3907us) service_pool.cc:224] Handling call
0709 13:05:30.338620 (+  5829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.339223 (+   603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.339255 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.339848 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.476104 (+136256us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:30.526728 (+ 50624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.526836 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.480308 (+953472us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b2400114ed8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265f09d 00007f36e529110e 00007f36e52a888c 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221
0709 13:05:31.566474 (+ 86166us) raft_consensus.cc:1685] finished
0709 13:05:31.566494 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.566705 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29275,"raft.queue_time_us":2973,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":18088,"spinlock_wait_cycles":52936192,"thread_start_us":131786,"threads_started":1,"wal-append.queue_time_us":224711}
W20260709 13:05:31.585531 15842 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.757s (SENT) [suppressed 7 similar messages]
I20260709 13:05:31.523442 20429 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.506578 20449 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.586573 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.591506 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:31.595395 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75358us
I20260709 13:05:31.598598 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.576678 20438 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.562094 20388 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.581815 20432 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:31.599237 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.587139 20240 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.606982 15196 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:05:31.610064 15195 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:31.617542 15196 pending_rounds.cc:85] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 9
I20260709 13:05:31.611078 20363 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.612151 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:31.615738 20437 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.615538 19985 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:31.624524 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 101275us
I20260709 13:05:31.596963 20421 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:31.591653 20416 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:31.626935 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.602835 20418 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:31.563192 20450 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.606092 20420 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.617914 15196 pending_rounds.cc:107] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:31.629716 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.640719 15196 raft_consensus.cc:2889] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.607004 20438 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.638495 15345 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:31.624744 20240 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:31.608440 20388 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.627223 20451 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:31.663718 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 114186us
I20260709 13:05:31.630966 20253 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:31.666396 15346 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:31.663697 20438 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.665385 20251 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:31.683171 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:31.686527 15340 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:31.691684 18938 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.692076 19985 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.666661 20420 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:31.692559 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 80528.1us
I20260709 13:05:31.693763 20449 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.695807 20412 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.697664 20450 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:31.703294 20415 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.009s	user 0.004s	sys 0.000s
I20260709 13:05:31.703706 20420 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.667065 20257 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.705847 20257 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.706584 20257 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.698015 15342 raft_consensus.cc:1217] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-17.9]   Dedup: 12.7->[15.8-17.9]
I20260709 13:05:31.707350 15342 pending_rounds.cc:85] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 7
I20260709 13:05:31.707597 15342 pending_rounds.cc:107] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:05:31.707820 15342 raft_consensus.cc:2889] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.708014 20429 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.670643 20253 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:31.704797 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:31.701187 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.666006 20433 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:31.710841 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:31.708976 20253 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:31.670827 20451 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:31.716295 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.719417 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.730084 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:31.719947 15267 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:31.720554 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:31.721195 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.731709 15266 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.730357 15270 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:31.714614 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2439) took 1988 ms. Trace:
I20260709 13:05:31.720952 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.728552 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.716181 20362 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:31.717280 20266 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.725135 20451 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.748226 20266 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.749431 20240 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:31.721971 20426 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:05:31.751737 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.724888 20416 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.757436 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:31.758625 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.735620 15263 rpcz_store.cc:276] 0709 13:05:29.726650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.144206 (+417556us) service_pool.cc:224] Handling call
0709 13:05:30.154710 (+ 10504us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:30.210723 (+ 56013us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:30.346454 (+135731us) log.cc:844] Serialized 14 byte log entry
0709 13:05:30.597552 (+251098us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:30.657499 (+ 59947us) log.cc:844] Serialized 52 byte log entry
0709 13:05:30.657680 (+   181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:30.657715 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.657783 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.702849 (+1045066us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b24000f4688. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265f09d 00007f36e529110e 00007f36e52a888c 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221
0709 13:05:31.714333 (+ 11484us) raft_consensus.cc:1685] finished
0709 13:05:31.714433 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.714559 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238932,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":14061,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":15674,"spinlock_wait_cycles":27813120,"thread_start_us":117459,"threads_started":2,"wal-append.queue_time_us":95858}
I20260709 13:05:31.713340 20437 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.721602 20420 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:31.763664 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.721724 20429 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:31.764242 15269 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:31.764448 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:31.768419 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.769500 20446 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.770318 19823 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:31.732905 20433 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.773923 20451 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.788812 15237 leader_election.cc:400] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:31.789155 15237 leader_election.cc:403] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:31.783955 15266 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:31.787858 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.767561 20437 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:31.795714 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67924.6us
I20260709 13:05:31.788089 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:31.778582 20438 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.765154 20388 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.791095 20429 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:31.789727 20420 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:31.815989 20429 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.816655 20420 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.817287 20262 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.819492 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.822196 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.825277 20446 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:31.826598 20114 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:31.834707 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.835737 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.836627 20166 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.837023 20166 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:31.837375 20166 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.840205 20320 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.840611 20320 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.840957 20320 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.842486 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.842550 20388 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.808609 20471 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.797640 20467 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.805763 20412 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:31.809515 20087 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:31.810441 20433 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.800191 20437 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.814805 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.794605 20427 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:05:31.802481 20418 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:31.843865 15344 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:31.788702 20448 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:31.876919 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:31.844480 20045 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:31.822794 15346 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:31.807452 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.850010 15872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58398 (request call id 298) took 1173 ms. Trace:
I20260709 13:05:31.850685 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 358) took 1156 ms. Trace:
I20260709 13:05:31.846616 20114 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:31.886708 15193 rpcz_store.cc:276] 0709 13:05:30.694181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.797198 (+103017us) service_pool.cc:224] Handling call
0709 13:05:31.850509 (+1053311us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b54002111d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:31.850629 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29620608}
I20260709 13:05:31.853773 20451 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:31.860576 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:31.866214 20471 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.862304 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:31.905604 15340 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:31.867143 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.869936 15311 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.856184 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.876597 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:31.878037 15271 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:31.902849 15265 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
W20260709 13:05:31.880632 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 215063us
I20260709 13:05:31.907920 15311 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.908126 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.883347 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:31.886708 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.885769 15872 rpcz_store.cc:276] 0709 13:05:30.676696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.768221 (+ 91525us) service_pool.cc:224] Handling call
0709 13:05:31.687616 (+919395us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b58001d6498. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:05:31.810974 (+123358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.811218 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.811244 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.811286 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:31.811318 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.811374 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.849717 (+ 38343us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54006ce8d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:31.849827 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309267584}
I20260709 13:05:31.895325 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.896991 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:31.900424 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 172193us
I20260709 13:05:31.861501 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:31.911747 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:31.912081 15341 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:31.903117 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:31.873962 20467 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.873059 20087 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:31.913089 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:31.918665 15339 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:31.904033 20388 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:31.922139 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 66020.7us
I20260709 13:05:31.904788 20312 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.911242 20416 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.924765 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:31.928572 18938 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:31.929066 18938 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:31.906759 20471 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.926759 15337 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:31.873847 20084 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.914641 20362 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:31.917157 20180 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:31.919257 20266 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:31.919580 20449 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:31.939018 20468 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:31.940891 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 136012us
I20260709 13:05:31.943675 18938 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:31.928066 20114 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:05:31.995302 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:31.923053 20388 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.991551 20257 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:32.005455 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 97603.2us
I20260709 13:05:32.047003 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.048126 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:31.921139 20467 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.937769 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:31.951210 15339 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:31.925697 20455 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:32.013038 15338 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:31.932772 19985 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.023591 20449 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:32.006318 19937 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.947772 20362 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:32.025475 19761 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:32.027601 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:32.030419 15340 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:31.996251 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.109761 15263 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.048348 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.047776 15192 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:32.055482 15193 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:32.056893 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.111487 15346 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:05:32.011301 20180 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.933193 20312 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.008327 20266 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:32.114722 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 213101us
I20260709 13:05:32.047868 20388 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.109057 15343 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:32.119020 15189 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:32.131868 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.093468 20449 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:32.115483 20451 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.160174 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.065634 20455 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:32.116439 20180 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.108819 20362 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.161270 15346 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:32.037910 20166 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.108398 20438 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.121053 20266 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.168457 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:32.182597 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 95777.4us
I20260709 13:05:32.120160 19937 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.129576 20429 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.185810 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.191615 15194 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.187176 15193 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:32.188651 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 250970us
I20260709 13:05:32.181986 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.192600 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:32.189306 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.193292 15192 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.101441 20253 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.195741 15195 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:32.200182 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 172666us
I20260709 13:05:32.174120 20455 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:32.107640 20087 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.195065 20412 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:32.190745 20448 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.228785 15196 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:32.171957 20451 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.199193 20114 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.230270 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.205476 20468 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:32.238898 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.246158 15265 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:32.235296 20477 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260709 13:05:32.199456 20429 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.216988 19761 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:05:32.261433 15091 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 173) took 32509 ms (client timeout 15000 ms). Trace:
W20260709 13:05:32.263273 20478 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:05:32.263516 15179 tablet_service.cc:1558] Processing DeleteTablet for tablet c1011f7cfdb64b11bff42c90ec444dbe with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 10)) from {username='slave'} at 127.0.0.1:46344
W20260709 13:05:32.264685 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52115.8us
I20260709 13:05:32.245232 20114 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.265947 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.267277 20114 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.276067 20084 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.277719 20312 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.240772 20468 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:32.283399 20468 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:32.288326 20262 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:32.289429 20489 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:32.289637 20262 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:32.290161 20262 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:32.290104 20489 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.248023 20195 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:32.296032 20195 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:32.296446 19937 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.248371 20490 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:32.298673 20438 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:32.299084 20438 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:32.301126 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.333084 15192 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:32.338011 20429 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.340838 20491 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.341578 20491 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.349866 20257 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.352277 20253 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.354023 20166 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:32.359928 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.361236 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.361608 20451 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.362352 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.363207 20432 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:05:32.364212 20481 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.419s	user 0.002s	sys 0.000s
I20260709 13:05:32.364289 20421 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:32.365765 20166 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.366125 20421 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:32.366254 20166 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.365777 20420 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:32.369153 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:32.369328 20166 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.366850 20421 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:32.370736 20420 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:32.371201 20420 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:32.371551 20420 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:32.286449 20320 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.325500 20433 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.300065 20438 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.347978 20489 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.374993 15271 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:32.416399 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:32.410249 15194 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:32.413220 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.346733 20449 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:32.429514 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 227608us
I20260709 13:05:32.348920 20491 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.435353 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.412492 15263 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:32.443828 15264 raft_consensus.cc:2368] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17.
I20260709 13:05:32.383198 20195 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:32.445725 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.447875 15267 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:05:32.448558 15193 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:32.449767 20421 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:32.451057 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.451259 20176 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:32.451872 15269 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:32.453737 18938 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:32.262008 15091 rpcz_store.cc:269] 0709 13:04:59.752252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.752545 (+   293us) service_pool.cc:224] Handling call
0709 13:05:32.261175 (+32508630us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:23.004747 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:23.135616 (+130869us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:23.135708 (+    92us) write_op.cc:435] Acquired schema lock
0709 13:05:23.135744 (+    36us) tablet.cc:662] Decoding operations
0709 13:05:23.490294 (+354550us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:23.490391 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:23.490421 (+    30us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:05:23.494864 (+  4443us) tablet.cc:701] Row locks acquired
0709 13:05:23.494913 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:05:23.495114 (+   201us) write_op.cc:270] Start()
0709 13:05:23.495295 (+   181us) write_op.cc:276] Timestamp: P: 1783602323495050 usec, L: 0
0709 13:05:23.529419 (+ 34124us) op_driver.cc:348] REPLICATION: starting
0709 13:05:23.725212 (+195793us) log.cc:844] Serialized 12084 byte log entry
0709 13:05:25.015772 (+1290560us) op_driver.cc:464] REPLICATION: finished
0709 13:05:25.438430 (+422658us) write_op.cc:301] APPLY: starting
0709 13:05:25.453558 (+ 15128us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:25.540909 (+ 87351us) spinlock_profiling.cc:243] Waited 5.84 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570a32a 00007f36e568ff14 00007f36e568fec3 00007f36e568fe38 00007f36e568fdf3 00007f36e568f0dc 00007f36e56b8e16 00007f36e56a0cbb 00007f36e568b39d 00007f36e568ed75
0709 13:05:25.951600 (+410691us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:25.958842 (+  7242us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:27.508059 (+1549217us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:27.508496 (+   437us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 13:05:27.508543 (+    47us) write_op.cc:312] APPLY: finished
0709 13:05:27.509108 (+   565us) log.cc:844] Serialized 267 byte log entry
0709 13:05:27.574588 (+ 65480us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.603158 (+ 28570us) write_op.cc:454] Released schema lock
0709 13:05:27.656176 (+ 53018us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:27.773382 (+117206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.775644 (+  2262us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":686549,"reported_tablets":57,"spinlock_wait_cycles":5888,"child_traces":[["op",{"apply.queue_time_us":364900,"apply.run_cpu_time_us":69531,"apply.run_wall_time_us":2325304,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133893,"num_ops":31,"prepare.queue_time_us":211385,"prepare.run_cpu_time_us":29978,"prepare.run_wall_time_us":862045,"raft.queue_time_us":352555,"raft.run_cpu_time_us":44793,"raft.run_wall_time_us":634503,"replication_time_us":1443250,"spinlock_wait_cycles":13438208,"thread_start_us":657961,"threads_started":5,"wal-append.queue_time_us":186512,"wal-append.run_cpu_time_us":88150,"wal-append.run_wall_time_us":3134909}]]}
I20260709 13:05:32.457103 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.454382 18938 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.378620 20266 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.459023 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.401690 20433 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.461745 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.393034 20262 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.378623 20420 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.455235 20176 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:32.470441 15309 leader_election.cc:400] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17.
I20260709 13:05:32.504042 15268 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:32.504642 15309 leader_election.cc:403] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:32.460245 20491 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.463800 20438 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:32.512902 18938 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.510988 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:32.522841 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52778us
I20260709 13:05:32.523944 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:32.472157 20451 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.527597 18938 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.528677 15263 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:32.536285 15312 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.536808 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:32.542295 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76645.2us
I20260709 13:05:32.576503 15344 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:32.586344 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49670.9us
I20260709 13:05:32.538692 20489 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:32.512667 20491 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.576855 20450 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.581992 19761 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:32.533380 20468 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.535782 20451 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.636564 15311 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.593722 20312 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:32.599660 20489 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.633384 20490 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:05:32.642501 20114 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 13:05:32.650552 20494 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:32.653333 19937 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:32.612463 20493 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.656375 20421 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.660569 20421 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.662703 20421 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.612273 20495 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:32.602666 20432 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:05:32.639844 20482 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:32.670652 20253 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.709834 20253 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.672583 20468 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.712004 20253 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.695302 20180 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:32.712929 20501 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:05:32.672000 20192 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.715018 20482 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:32.714928 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.637759 20450 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.715600 20192 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.716257 15340 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:32.717299 20449 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.717978 20192 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.672485 20312 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:32.718128 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:32.718885 20312 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:32.719290 20312 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:32.720086 20312 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.720310 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.721171 20312 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.721838 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.726240 20491 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.646095 20502 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:32.726630 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.727927 15340 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:32.730289 15340 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:32.731564 20266 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.667389 20487 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:05:32.733753 15340 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:05:32.735674 20362 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.004s
W20260709 13:05:32.742060 19985 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.001s
I20260709 13:05:32.742602 19985 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:32.734874 15338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1944) took 1456 ms (client timeout 1577 ms). Trace:
W20260709 13:05:32.743674 15338 rpcz_store.cc:269] 0709 13:05:31.278143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.278275 (+   132us) service_pool.cc:224] Handling call
0709 13:05:32.734636 (+1456361us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54001761d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:32.734766 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1358726016}
W20260709 13:05:32.746610 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.747761 20388 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.005s
I20260709 13:05:32.747913 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 1956) took 1408 ms. Trace:
I20260709 13:05:32.748378 20388 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.750811 20240 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:32.751487 15345 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:05:32.753283 20482 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.759653 20450 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.761263 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 65) took 9769 ms. Trace:
I20260709 13:05:32.765997 15082 catalog_manager.cc:5028] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): tablet c1011f7cfdb64b11bff42c90ec444dbe (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
W20260709 13:05:32.673772 20437 consensus_meta.cc:287] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.777s	user 0.002s	sys 0.009s
I20260709 13:05:32.675522 20420 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.646266 20489 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:32.769273 20479 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.774s	user 0.000s	sys 0.007s
I20260709 13:05:32.666610 20495 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.679402 20451 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.771359 20495 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.643636 20176 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.691478 20443 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:32.772881 20176 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.773016 19823 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:32.773449 19823 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:32.727059 20502 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:32.779595 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.611974 20166 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:05:32.781788 20484 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:32.707108 20471 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.005s
I20260709 13:05:32.782274 20484 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:32.673127 20421 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:32.782629 20471 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.714749 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:32.784626 20045 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:32.785101 20421 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.724182 20433 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.774385 19823 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.788591 19823 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.714545 20180 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.672806 20493 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:32.785115 20045 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:32.791112 20493 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:32.644248 20320 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.791416 20045 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.792467 20045 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:32.748484 15343 rpcz_store.cc:276] 0709 13:05:31.339005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.819207 (+480202us) service_pool.cc:224] Handling call
0709 13:05:32.747665 (+928458us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54002733d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:32.747828 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664415104}
I20260709 13:05:32.730661 15868 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.796617 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2733) took 1349 ms. Trace:
W20260709 13:05:32.799912 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.762068 15093 rpcz_store.cc:276] 0709 13:05:23.003749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.059900 (+ 56151us) service_pool.cc:224] Handling call
0709 13:05:32.761156 (+9701256us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:30.632028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:30.867975 (+235947us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:30.872265 (+  4290us) write_op.cc:435] Acquired schema lock
0709 13:05:30.894366 (+ 22101us) tablet.cc:662] Decoding operations
0709 13:05:31.082408 (+188042us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:31.113478 (+ 31070us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:31.123155 (+  9677us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:05:31.185191 (+ 62036us) tablet.cc:701] Row locks acquired
0709 13:05:31.185255 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:05:31.185444 (+   189us) write_op.cc:270] Start()
0709 13:05:31.185604 (+   160us) write_op.cc:276] Timestamp: P: 1783602331185375 usec, L: 0
0709 13:05:31.185648 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:05:31.186395 (+   747us) log.cc:844] Serialized 2177 byte log entry
0709 13:05:31.575390 (+388995us) op_driver.cc:464] REPLICATION: finished
0709 13:05:31.681901 (+106511us) write_op.cc:301] APPLY: starting
0709 13:05:31.682008 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:31.685752 (+  3744us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:31.685854 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:31.746866 (+ 61012us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:31.747196 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:05:31.747244 (+    48us) write_op.cc:312] APPLY: finished
0709 13:05:31.747585 (+   341us) log.cc:844] Serialized 56 byte log entry
0709 13:05:31.747792 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:31.747908 (+   116us) write_op.cc:454] Released schema lock
0709 13:05:31.747968 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:31.748392 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:31.748423 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":790823,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":106223,"apply.run_cpu_time_us":9303,"apply.run_wall_time_us":66479,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":205087,"prepare.run_cpu_time_us":19498,"prepare.run_wall_time_us":658011,"raft.queue_time_us":178160,"raft.run_cpu_time_us":9885,"raft.run_wall_time_us":64144,"replication_time_us":389561,"thread_start_us":339133,"threads_started":4,"wal-append.queue_time_us":207849,"wal-append.run_cpu_time_us":10787,"wal-append.run_wall_time_us":1359443}]]}
I20260709 13:05:32.797063 15342 rpcz_store.cc:276] 0709 13:05:31.447077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.697378 (+250301us) service_pool.cc:224] Handling call
0709 13:05:31.697752 (+   374us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:31.708485 (+ 10733us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:31.708776 (+   291us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.791396 (+ 82620us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:31.798348 (+  6952us) log.cc:844] Serialized 52 byte log entry
0709 13:05:31.798577 (+   229us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:31.798628 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.798728 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:32.766506 (+967778us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:32.796301 (+ 29795us) raft_consensus.cc:1685] finished
0709 13:05:32.796395 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.796526 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2974,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":209,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"spinlock_wait_cycles":75686784,"thread_start_us":82201,"threads_started":1,"wal-append.queue_time_us":208835}
I20260709 13:05:32.805954 20502 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.810324 18938 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17.
W20260709 13:05:32.810992 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.813318 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.815692 15263 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:32.819017 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.820946 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.823324 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.810134 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:32.826490 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 190042us
I20260709 13:05:32.826812 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.828222 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.829178 15271 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:05:32.767433 20455 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 13:05:32.839802 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:32.840780 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 235370us
W20260709 13:05:32.841603 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.844318 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.736271 20362 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.842515 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:32.845407 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.845780 15193 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.845978 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.848786 15268 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.842553 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.849414 15264 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:32.848762 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.851364 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.851895 15346 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:32.851565 15269 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 10: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:32.854101 15338 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:32.855098 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.855782 15269 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:32.856691 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.802295 20437 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:32.857211 15266 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:32.858520 15192 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:32.840960 20467 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.009s
I20260709 13:05:32.861831 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.808003 20388 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.863467 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.867269 20467 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.869513 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.870121 15340 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:32.871196 20488 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:32.871757 20467 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:32.868291 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.872994 15343 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:05:32.873504 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.857199 20432 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:32.874720 20432 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.876986 20432 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:32.874119 15188 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:32.879431 20484 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:32.867316 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.883188 20438 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:32.886003 20437 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:32.854133 20455 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.887379 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.887965 15269 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.888290 15197 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:32.888511 15267 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:32.891119 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.891953 15265 raft_consensus.cc:2410] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:05:32.892446 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.892665 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.893040 15264 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:32.893639 20087 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:32.893754 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.867636 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:32.895304 15871 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.895347 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.896472 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.896775 15191 raft_consensus.cc:2410] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:05:32.897534 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.898937 20502 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:32.899524 20502 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:32.899312 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:32.899381 20421 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:32.900738 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.900543 20502 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.901459 15270 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:32.891170 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.904161 20488 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:32.904821 15263 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:32.905126 20488 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:32.843487 20180 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.906265 20180 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:32.907263 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.909351 15341 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:32.910461 15342 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:32.911235 15271 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
W20260709 13:05:32.909934 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 54797.8us
I20260709 13:05:32.871814 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.914921 15195 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:32.870993 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:32.894955 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:32.919251 15265 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:32.923207 15269 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:32.924902 15188 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:32.925938 15269 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:32.927349 15271 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:32.897547 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:32.934808 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1966) took 1192 ms. Trace:
I20260709 13:05:32.935088 15344 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:32.935293 15339 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:32.935218 15341 rpcz_store.cc:276] 0709 13:05:31.742731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.916107 (+173376us) service_pool.cc:224] Handling call
0709 13:05:31.924592 (+  8485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.910721 (+986129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.934593 (+ 23872us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400245c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:32.934755 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264332672}
I20260709 13:05:32.936496 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.937551 15265 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:32.929977 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.938895 15189 raft_consensus.cc:2410] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 19 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:05:32.940274 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.941452 15197 raft_consensus.cc:2410] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:05:32.945657 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:32.952033 15193 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:32.952710 15263 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:32.952162 15192 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:32.955615 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.958395 15268 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:32.961318 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:32.963966 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.964587 15192 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:32.964825 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:32.965641 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:32.965735 15266 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:05:32.966079 15342 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:32.965651 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.968508 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.969156 15192 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
W20260709 13:05:32.969827 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 336575us
I20260709 13:05:32.969352 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:32.971181 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.968755 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.974623 18938 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:32.975050 18938 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.975378 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:32.975397 18938 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:32.976161 15340 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:32.976714 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.977420 15193 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:32.978344 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.979193 15191 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.982046 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:32.982600 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:32.983387 15192 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.975636 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:32.970628 20429 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:32.995339 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.004730 15346 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 11: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:33.007578 20495 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.009939 20495 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:33.002543 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:33.011895 20176 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.012403 20176 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.014597 20176 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.027367 15264 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:32.988857 20180 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.031635 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.033329 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.035228 15312 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.037396 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:32.987396 20420 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:33.038987 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:32.973843 19985 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:05:32.980455 20437 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:05:33.023301 20499 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:32.987573 20432 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:05:33.060648 15192 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:33.004212 20429 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.056594 15265 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:33.048442 15340 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:32.987241 20418 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:05:32.989305 20496 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:05:33.059870 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.060570 18938 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.062126 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.037474 20433 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:33.064950 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:33.046159 20510 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:33.003966 20195 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:05:33.024078 20489 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.059873 20495 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:33.047887 20450 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:33.044508 20420 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.061097 20499 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:33.142443 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.065848 20429 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:33.049865 15193 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:05:33.088532 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 408895us
I20260709 13:05:33.113551 15192 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:33.142001 18938 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:33.146741 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:33.148099 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 235049us
I20260709 13:05:33.184002 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:33.187986 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.189900 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.194427 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.216396 15192 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:33.202911 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.218909 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:33.219142 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72519.7us
I20260709 13:05:33.219748 15193 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:33.221119 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.199061 15342 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:33.141099 20114 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.224509 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.224908 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.224542 15338 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:05:33.225479 15343 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:33.225869 15340 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:33.071888 20363 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:05:33.230792 18938 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:33.230994 15192 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:33.142867 20420 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:33.232079 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.182458 20384 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:33.078812 20510 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.155864 20499 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:33.183308 20450 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.237807 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.229666 20114 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.242292 15192 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:33.243119 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.243773 15192 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:33.243917 20114 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.180897 15871 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:33.247236 20471 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:33.248643 20455 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.249754 19985 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:33.250123 19985 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.250978 19985 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.254693 15190 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
W20260709 13:05:33.248646 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.239744 20320 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:33.255995 20320 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.256927 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:33.258069 20320 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.259989 20362 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:33.262593 20489 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:33.230013 20437 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:33.264127 15194 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:33.230482 20468 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:33.264840 20468 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.265542 15194 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:05:33.265895 15194 pending_rounds.cc:85] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 9
I20260709 13:05:33.266111 15194 pending_rounds.cc:107] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:05:33.266340 15194 raft_consensus.cc:2889] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:33.234692 20491 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:33.270062 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.267800 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:33.271643 15195 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:33.270702 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:33.274067 15193 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:33.244511 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.277153 15192 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:33.276090 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:33.284611 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.285598 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.286338 15340 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:33.176893 20495 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.266898 20468 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:33.293615 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:33.296904 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:33.304106 15345 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.299499 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.271243 20491 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.273124 20490 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:05:33.306608 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:33.283023 20320 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:33.308425 18938 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.310256 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.318806 15195 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:33.310463 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.319298 15192 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:33.310575 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:33.288561 20087 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:33.283372 20438 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:33.329720 15192 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:33.345208 15345 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:05:33.349077 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 117068us
W20260709 13:05:33.349165 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 55658.9us
I20260709 13:05:33.350857 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.352391 15266 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58520
I20260709 13:05:33.353065 15266 raft_consensus.cc:606] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Received request to transfer leadership
I20260709 13:05:33.353230 15196 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 13:05:33.353492 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.353987 20114 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:33.354522 20511 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:33.355584 20455 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:33.355863 20514 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:33.356051 20455 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.357199 20455 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:33.361726 15192 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:33.360451 18938 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.310068 20363 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.365741 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.313493 20491 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:33.354924 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.368916 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.372682 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.318426 20320 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.370371 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.360402 20087 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:33.382671 20087 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.387557 20240 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:33.395272 20510 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.395752 20495 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.376247 20176 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:33.399528 20176 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:33.400542 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45168.9us
W20260709 13:05:33.405033 20516 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:05:33.301301 20492 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:05:33.407280 15272 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58520
I20260709 13:05:33.407938 15272 raft_consensus.cc:606] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Received request to transfer leadership
W20260709 13:05:33.410225 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.348476 20438 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.333864 20471 raft_consensus.cc:2764] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:33.363319 20045 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:33.413540 15192 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:05:33.440411 15195 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:33.445219 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.446424 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:33.450299 20384 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:33.410995 20468 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:05:33.441452 20438 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:33.467298 15192 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:33.471940 15195 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:33.478910 15191 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:33.479877 15194 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:33.481782 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:33.438943 20518 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:05:33.482470 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.410015 20320 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:33.487572 15842 leader_election.cc:336] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.757s (SENT)
I20260709 13:05:33.501509 15196 raft_consensus.cc:2368] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:33.483422 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.450949 20384 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:33.447782 20491 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.507957 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.500061 15192 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:33.498973 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.430209 20266 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:33.411428 20451 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:33.412269 20493 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:33.409601 20363 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.400696 20176 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.511233 15191 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:33.514242 15188 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:33.509411 15196 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:33.570420 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.571918 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.572611 15188 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:33.573553 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.517867 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.575055 15189 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:33.546892 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:33.579102 15342 raft_consensus.cc:2376] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11. Re-sending same reply.
I20260709 13:05:33.580070 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:33.552760 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 302481us
I20260709 13:05:33.511900 15192 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:33.578095 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.560158 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.584573 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.580490 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.585227 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.585870 15191 raft_consensus.cc:2376] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16. Re-sending same reply.
W20260709 13:05:33.586280 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.582798 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.589196 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:33.590235 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:33.590925 15264 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:33.513150 20484 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:33.598438 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.597425 15267 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:33.599184 15192 raft_consensus.cc:2368] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:33.599764 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.585315 15189 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:33.600371 15191 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:33.513088 20451 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.600703 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.546021 20253 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:33.605029 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:33.611313 15271 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.546068 20493 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.605892 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:33.514019 20455 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.477306 20450 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:33.611685 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:33.626470 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.600344 15192 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:33.602764 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.597831 20437 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:33.530929 20266 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:33.527922 20499 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:33.621376 15189 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:33.614259 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.603420 20176 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:33.637331 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 267160us
I20260709 13:05:33.644639 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.636539 15196 raft_consensus.cc:2376] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11. Re-sending same reply.
I20260709 13:05:33.641228 15264 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:33.648301 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.628842 20496 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:33.659868 15868 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.645599 20514 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:33.667546 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.705910 20514 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:33.652103 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.706930 20514 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:33.708418 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56543.7us
W20260709 13:05:33.673172 20527 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:05:33.680553 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.680828 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.710984 20495 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.711297 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:33.711822 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.712426 15196 raft_consensus.cc:2376] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18. Re-sending same reply.
I20260709 13:05:33.654458 20529 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:05:33.713222 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.713765 15196 raft_consensus.cc:2376] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13. Re-sending same reply.
I20260709 13:05:33.653873 20489 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:33.714664 20489 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:33.715142 20489 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.716132 20535 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:33.716789 20535 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:33.619822 20253 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:33.717610 20535 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.719182 20253 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:33.711001 15192 raft_consensus.cc:2368] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:33.720398 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.720661 20499 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.721577 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.721642 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:33.722599 15192 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:33.682356 15340 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:33.724124 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:33.724503 20363 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:33.725425 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:33.683523 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.727353 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.728283 15189 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 10: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:33.729111 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.682351 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.688028 20491 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.650203 20266 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.691968 20451 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.692721 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:33.693321 20493 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.695317 20455 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.698931 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.765218 15197 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.765269 15271 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
W20260709 13:05:33.699668 20525 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:05:33.642568 20428 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:33.644865 20437 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:33.705341 20528 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:05:33.738566 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.739428 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.768695 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.714684 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.768805 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:33.769654 15196 raft_consensus.cc:2376] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20. Re-sending same reply.
I20260709 13:05:33.769709 15266 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:33.683096 20438 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.771522 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:33.779994 15238 leader_election.cc:336] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.506s (SENT)
I20260709 13:05:33.782301 15189 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:33.786188 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.787189 15192 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:33.795069 15340 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:05:33.797320 20530 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:33.781008 20251 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:33.804942 20251 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.787874 20491 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:05:33.781351 20536 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:33.807962 20536 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.801744 20388 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:05:33.809590 15238 leader_election.cc:336] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.511s (SENT)
I20260709 13:05:33.810156 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:33.810724 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.810969 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.811488 15196 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:33.811854 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.812714 15190 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:33.813549 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.814078 15190 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.822559 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.790316 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:33.826762 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:33.826925 15189 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:33.686803 20420 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.830090 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.831590 15195 raft_consensus.cc:2368] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:33.839159 20363 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:33.839805 20363 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:33.840350 20363 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:33.843447 20388 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:33.844759 20388 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.845757 20320 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:33.849007 20251 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:33.860293 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:33.868124 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.873430 15192 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:33.869165 15189 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:33.832751 20262 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:33.857851 20429 consensus_meta.cc:287] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.002s
W20260709 13:05:33.919243 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109672us
W20260709 13:05:33.920316 15238 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.530s (SENT)
I20260709 13:05:33.920889 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:33.912402 15188 raft_consensus.cc:2368] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:05:33.929203 15197 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:33.930466 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.885313 20362 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:33.931913 20362 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.932372 20362 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:33.872605 20320 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.871210 20114 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.878304 20251 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:33.935151 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.955947 15191 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:33.955237 15196 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:33.957674 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.958401 15196 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:33.966921 20535 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:33.968223 15868 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:05:33.967072 15238 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.577s (SENT)
I20260709 13:05:33.993073 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:33.993909 15196 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:05:33.995787 15238 leader_election.cc:336] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.674s (SENT)
I20260709 13:05:33.955174 20548 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.925724 20429 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:34.002265 20547 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:05:34.003253 20438 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:33.925547 20384 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.029645 15342 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:34.030804 20384 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:34.033919 20555 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.034659 20412 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:34.035413 20412 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:34.036319 20412 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.037407 20412 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:33.993566 20535 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:34.039141 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.039906 15189 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:34.040764 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.041271 15189 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:34.041635 20535 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:34.043370 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:34.043807 20420 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:34.044337 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:34.044739 20384 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:34.045125 20384 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:34.045374 18938 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:34.045583 20384 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:34.045895 18938 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:34.048787 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:34.011765 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:34.049768 15346 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:34.051533 15339 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:34.052260 20502 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:34.052652 20253 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.053478 20253 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:34.055953 20533 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.432s	user 0.004s	sys 0.000s
I20260709 13:05:34.046685 18938 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.059055 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:34.008661 20266 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:34.013357 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:34.069523 15337 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.022209 20180 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:34.034629 20555 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.052824 20502 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:34.015416 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.060321 15192 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:34.045145 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:34.052695 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:34.072386 20180 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:34.094833 20502 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:34.095263 20180 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.096676 20180 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:34.086709 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.079859 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.098836 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.063060 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:34.070865 15190 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:34.073377 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:34.100173 15346 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:34.100564 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47949.6us
I20260709 13:05:34.010614 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:34.101804 15191 raft_consensus.cc:2368] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:34.102001 15192 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:34.052434 20429 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:34.107586 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.115605 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70527.5us
I20260709 13:05:34.106256 20087 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:05:34.125730 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.130373 15346 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:34.132296 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:34.132653 15343 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:34.136838 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:34.138437 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.139019 15196 raft_consensus.cc:2376] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17. Re-sending same reply.
I20260709 13:05:34.133195 20266 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:34.143131 20548 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:34.049777 20363 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:34.147213 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 151448us
I20260709 13:05:34.148779 20363 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:34.104136 20512 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:34.148838 15238 leader_election.cc:336] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.704s (SENT)
I20260709 13:05:34.161429 15872 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:34.161942 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:34.165395 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.167332 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.168038 15193 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:34.173517 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.174268 15193 raft_consensus.cc:2368] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:34.170722 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:34.151115 20490 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:05:34.192134 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.162539 20498 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.194728 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45907.5us
I20260709 13:05:34.133895 20543 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:05:34.133077 20438 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:05:34.136464 20427 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:05:34.174626 20512 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:34.163148 20266 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:34.222416 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:34.224505 20545 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:05:34.222693 15238 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.797s (SENT)
I20260709 13:05:34.228197 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:34.233417 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:34.192842 20490 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:34.239948 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:34.192868 20534 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:34.240850 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:34.238595 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 106368us
I20260709 13:05:34.242401 15195 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.181241 20433 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:05:34.223663 20498 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:34.197542 20253 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:34.224066 20114 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:34.236701 20427 consensus_queue.cc:1243] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:05:34.261821 20554 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:05:34.250840 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.251753 15192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d932cad3925e47b28537cca64ba27320"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:34.252350 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.253326 15263 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:34.265239 15196 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:34.244616 20412 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:34.290839 15193 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:34.245247 20535 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.279968 20253 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.310087 20045 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:34.316426 20489 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
W20260709 13:05:34.317333 20557 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.090s	user 0.001s	sys 0.003s
I20260709 13:05:34.254740 20512 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:34.334398 20571 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:05:34.336544 20558 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.149s	user 0.002s	sys 0.002s
I20260709 13:05:34.291273 20266 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.327164 20045 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:34.338937 20045 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.340210 20045 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:34.362112 20512 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.318501 20535 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.326349 20484 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:34.279146 20114 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:34.379819 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 353) took 1123 ms. Trace:
I20260709 13:05:34.379572 20490 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:34.380359 15868 rpcz_store.cc:276] 0709 13:05:33.256542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.256679 (+   137us) service_pool.cc:224] Handling call
0709 13:05:34.379571 (+1122892us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54005e0e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:34.379714 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925358848}
I20260709 13:05:34.381285 20490 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:34.382879 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.328136 20253 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.385476 15192 raft_consensus.cc:606] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:34.385927 15192 raft_consensus.cc:614] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:34.342607 20489 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:34.387838 20511 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:34.388345 20511 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:34.389771 20489 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:34.390587 15345 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:34.400611 20420 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.401290 20420 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:34.415022 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 244406us
I20260709 13:05:34.422797 20412 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:34.423491 20412 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.424563 18938 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:34.426816 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 1969) took 1118 ms. Trace:
I20260709 13:05:34.427452 20509 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:34.427223 15194 rpcz_store.cc:276] 0709 13:05:33.308723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.321172 (+ 12449us) service_pool.cc:224] Handling call
0709 13:05:33.479677 (+158505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.480296 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.426599 (+946303us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54001e64d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:34.426757 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363690880}
I20260709 13:05:34.428241 20509 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:34.430809 20433 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:34.431418 20433 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:34.432432 20433 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.433888 20433 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:34.456456 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.460078 15194 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:05:34.460637 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.468603 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.477772 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.487179 20534 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:34.487625 20420 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:34.487809 20534 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.488495 20253 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:34.489985 20534 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:34.490525 20534 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:34.490768 20362 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.550s	user 0.008s	sys 0.004s
I20260709 13:05:34.389298 20511 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.498921 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.500985 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:34.492197 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:34.501536 15197 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:05:34.502005 15193 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:34.502346 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:34.503604 15337 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:34.504612 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:34.505405 15194 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:05:34.499419 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:34.509617 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.510418 15195 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:34.518041 18938 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:34.455513 19985 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:34.527922 15079 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 307306us
I20260709 13:05:34.528473 18938 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.528168 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:34.531417 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 284664us
I20260709 13:05:34.535871 15190 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:35.568954 15194 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:34.567981 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:35.571066 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 376) took 1072 ms. Trace:
W20260709 13:05:34.793321 20564 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.551s	user 0.000s	sys 0.001s
I20260709 13:05:34.494745 20384 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.934151 20467 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.611642 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.563834 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:35.579430 15194 rpcz_store.cc:276] 0709 13:05:34.498934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.506133 (+  7199us) service_pool.cc:224] Handling call
0709 13:05:35.568605 (+1062472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.570724 (+  2119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.570975 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:35.580899 15196 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:34.631444 20535 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:34.568708 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:35.611866 15868 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 355) took 1048 ms. Trace:
W20260709 13:05:35.069233 20585 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
W20260709 13:05:34.787840 20559 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.594s	user 0.004s	sys 0.000s
I20260709 13:05:34.929759 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2765) took 1464 ms. Trace:
W20260709 13:05:35.068230 20581 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:05:34.538136 20541 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:05:34.940953 15872 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58404 (request call id 423) took 1955 ms (client timeout 2227 ms). Trace:
W20260709 13:05:35.627524 15872 rpcz_store.cc:269] 0709 13:05:32.985762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.986007 (+   245us) service_pool.cc:224] Handling call
0709 13:05:34.940724 (+1954717us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540068f6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:34.940861 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604594048}
I20260709 13:05:34.952759 20437 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:35.166216 15238 leader_election.cc:336] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.846s (SENT)
I20260709 13:05:35.636121 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:35.636507 20192 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:35.636880 20192 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:35.637025 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 470836us
I20260709 13:05:35.637717 20192 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.638697 20192 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:34.924794 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.585309 20350 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.490972 20534 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:34.567255 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:35.232048 15842 leader_election.cc:336] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.595s (SENT)
W20260709 13:05:35.610945 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.495910 20498 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.625030 20412 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.612351 15868 rpcz_store.cc:276] 0709 13:05:34.563284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.563495 (+   211us) service_pool.cc:224] Handling call
0709 13:05:35.611802 (+1048307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:35.618681 15191 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 10: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:34.934947 20543 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:35.624094 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 368) took 1127 ms. Trace:
W20260709 13:05:34.791316 20573 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:05:34.566733 20388 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:34.558323 20511 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:35.622502 15343 rpcz_store.cc:276] 0709 13:05:33.465421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.685989 (+220568us) service_pool.cc:224] Handling call
0709 13:05:33.686353 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.135323 (+448970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.929402 (+794079us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b5400340154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:34.929695 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025986816}
W20260709 13:05:35.629081 15341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.018s	sys 0.030s
I20260709 13:05:34.935416 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 1990) took 1416 ms. Trace:
I20260709 13:05:35.663571 15188 rpcz_store.cc:276] 0709 13:05:33.519317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.573288 (+ 53971us) service_pool.cc:224] Handling call
0709 13:05:34.935207 (+1361919us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540024ca54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:34.935347 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776968960}
I20260709 13:05:35.658134 15196 rpcz_store.cc:276] 0709 13:05:34.496580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.523254 (+ 26674us) service_pool.cc:224] Handling call
0709 13:05:35.623984 (+1100730us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:35.664994 15341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.018s	sys 0.031s
I20260709 13:05:35.618003 20467 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:35.644609 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.649657 20535 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:35.645682 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:35.144959 20432 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.647053 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:35.685747 15197 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:35.590096 20087 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:35.589767 20509 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:34.790961 20537 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:35.612427 20536 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.651292 15263 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:34.998360 20569 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.651283 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:35.651959 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.525110 20362 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.655834 15195 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:35.657444 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 370) took 1160 ms. Trace:
I20260709 13:05:35.630460 20438 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:35.677471 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:35.640574 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.661258 20543 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:35.717388 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2540) took 2117 ms. Trace:
W20260709 13:05:35.679874 20180 consensus_meta.cc:287] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.583s	user 0.021s	sys 0.053s
I20260709 13:05:35.642756 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:35.653469 20350 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:35.681732 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.727574 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.717859 15268 rpcz_store.cc:276] 0709 13:05:33.594236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.599143 (+  4907us) service_pool.cc:224] Handling call
0709 13:05:33.617654 (+ 18511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.792760 (+175106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.792909 (+   149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.405442 (+612533us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b2c0000e678. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:34.405953 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.474521 (+ 68568us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:34.474559 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.474625 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.694352 (+1219727us) raft_consensus.cc:1685] finished
0709 13:05:35.694376 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.711890 (+ 17514us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":971,"raft.queue_time_us":75895,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":59455360,"thread_start_us":232393,"threads_started":2,"wal-append.queue_time_us":151419}
I20260709 13:05:35.676581 20388 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.686058 15196 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:35.694873 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.712779 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2535) took 1186 ms. Trace:
I20260709 13:05:35.714157 15191 rpcz_store.cc:276] 0709 13:05:34.497197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.523112 (+ 25915us) service_pool.cc:224] Handling call
0709 13:05:35.657358 (+1134246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:35.711982 20509 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.734593 15263 rpcz_store.cc:276] 0709 13:05:34.507982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.508543 (+   561us) service_pool.cc:224] Handling call
0709 13:05:35.694229 (+1185686us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:35.714156 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 482110us
W20260709 13:05:35.737517 15842 leader_election.cc:336] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.766s (SENT)
I20260709 13:05:35.687167 20266 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.717095 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.680333 20577 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:35.725335 15197 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:35.730401 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:35.739802 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.740100 15868 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:35.691403 20537 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:35.659423 20433 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.225s	user 0.009s	sys 0.006s
I20260709 13:05:35.730849 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 375) took 1232 ms. Trace:
I20260709 13:05:35.694931 20451 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.716776 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.715180 20498 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:35.715204 20431 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:35.720243 20535 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.742199 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 1996) took 2003 ms. Trace:
W20260709 13:05:35.742962 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 151087us
I20260709 13:05:35.694104 20087 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.745895 15190 rpcz_store.cc:276] 0709 13:05:34.498652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.524217 (+ 25565us) service_pool.cc:224] Handling call
0709 13:05:34.525924 (+  1707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.569822 (+1043898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.730592 (+160770us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b54003e62d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:35.730775 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2939648}
I20260709 13:05:35.731654 20536 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.733700 20180 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.750667 15263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58520
I20260709 13:05:35.702512 20432 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.747226 20443 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.743163 20266 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:35.752730 20589 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:35.753398 20534 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.752759 20451 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:35.755093 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 427) took 1277 ms. Trace:
I20260709 13:05:35.774389 15264 rpcz_store.cc:276] 0709 13:05:34.478025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.478146 (+   121us) service_pool.cc:224] Handling call
0709 13:05:34.497055 (+ 18909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.497411 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.497463 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.498413 (+   950us) log.cc:844] Serialized 494 byte log entry
0709 13:05:34.841450 (+343037us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:34.841504 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.841604 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.754804 (+913200us) raft_consensus.cc:1685] finished
0709 13:05:35.754833 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.755003 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":342594,"threads_started":1,"wal-append.queue_time_us":1197084}
I20260709 13:05:35.756850 20543 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:35.736763 20412 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:35.762562 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:35.767695 15263 raft_consensus.cc:606] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 13:05:35.786794 15263 raft_consensus.cc:614] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:35.725718 20438 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.769001 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:35.742760 20468 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:35.718107 20569 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.793526 15192 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:35.796461 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:05:35.808194 20432 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.809065 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:35.809757 15270 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:35.812422 20266 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:35.764092 20431 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:35.815562 20584 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:05:35.815693 20431 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:35.814440 20448 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:35.817323 20087 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.762323 15345 rpcz_store.cc:276] 0709 13:05:33.738903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.807777 (+ 68874us) service_pool.cc:224] Handling call
0709 13:05:33.808241 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.391177 (+582936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.741881 (+1350704us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001a40d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:35.742132 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338857344}
I20260709 13:05:35.739899 20509 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.800948 15868 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:35.800024 20590 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.783231 20443 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:35.748390 20577 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:35.821801 20045 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.481s	user 0.015s	sys 0.004s
W20260709 13:05:35.880602 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.772560 20535 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.773593 20180 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.909806 15311 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:35.909971 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:35.904723 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:35.907387 15842 leader_election.cc:336] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.693s (SENT)
I20260709 13:05:35.911723 15345 pending_rounds.cc:85] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 5
I20260709 13:05:35.911998 15345 pending_rounds.cc:107] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:05:35.912242 15345 raft_consensus.cc:2889] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:35.773540 20536 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.828145 20432 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:35.799880 20412 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.927896 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:35.928737 15343 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
I20260709 13:05:35.937141 20451 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:35.804737 20537 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.939615 15338 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:35.940248 20537 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:35.820075 20468 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.825959 20590 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.908597 20429 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:35.913563 20433 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:35.915186 20437 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:35.921044 20192 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.914173 20045 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:35.953055 15344 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:35.955431 15842 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.175s (SENT)
I20260709 13:05:35.968183 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:35.960310 20509 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:35.929633 20592 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:35.924523 20467 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:35.939608 20438 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.972282 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:35.981036 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.981469 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.982103 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.999991 15344 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:35.933192 20432 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:35.974053 20482 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:35.968097 20362 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:36.004218 20114 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:36.019097 20438 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.019711 20114 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:36.020367 20114 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.021351 20468 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:36.022684 20536 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.012935 20180 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.973886 20087 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:35.969897 20192 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.013594 20590 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.001938 20592 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:36.016484 20443 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:35.967752 20433 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.017779 20535 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.018334 20176 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:36.000211 20591 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:35.976377 20437 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:35.974144 20045 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.024849 20412 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:36.027065 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 289592us
I20260709 13:05:35.966481 20429 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.034353 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.022949 20114 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:36.156618 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 122377us
I20260709 13:05:36.037834 20590 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.159435 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.038700 18938 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:36.127561 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.033056 20548 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:36.160763 18938 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.163568 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.164569 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.170773 15190 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:36.173322 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.174935 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.140568 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:36.019726 20438 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.037348 20468 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:36.180080 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2776) took 1717 ms. Trace:
I20260709 13:05:36.135689 20591 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.186234 15190 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:05:36.186942 20192 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:36.205623 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.036691 20087 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.187225 20412 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:36.133837 20535 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.163152 20569 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.168193 20180 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:36.212471 15238 leader_election.cc:336] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.505s (SENT)
W20260709 13:05:36.224287 15238 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.586s (SENT)
I20260709 13:05:36.196411 15341 rpcz_store.cc:276] 0709 13:05:34.462480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.462602 (+   122us) service_pool.cc:224] Handling call
0709 13:05:34.491516 (+ 28914us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:34.598597 (+107081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.598627 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:34.630764 (+ 32137us) log.cc:844] Serialized 52 byte log entry
0709 13:05:35.665797 (+1035033us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:36.179331 (+513534us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.179606 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.179704 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.179759 (+    55us) raft_consensus.cc:1685] finished
0709 13:05:36.179776 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.179933 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106628,"raft.queue_time_us":106725,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":28942,"thread_start_us":1372714,"threads_started":2,"wal-append.queue_time_us":904936}
I20260709 13:05:36.181559 20114 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.227425 18938 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:36.227849 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.182758 20266 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:36.233966 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.208376 20511 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.531s	user 0.006s	sys 0.005s
I20260709 13:05:36.228518 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:36.134277 20176 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.203924 20555 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.168846 20590 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.246690 15197 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:05:36.248229 15238 leader_election.cc:336] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.660s (SENT)
W20260709 13:05:36.249825 15238 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.910s (SENT)
I20260709 13:05:36.212508 20412 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:36.041579 20592 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:36.241196 19985 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.703s	user 0.011s	sys 0.002s
I20260709 13:05:36.250989 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:36.211767 20468 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.254393 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.184311 20548 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:36.265435 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 131271us
I20260709 13:05:36.256881 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.248831 20569 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:36.269316 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.269474 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.270993 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.274987 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.272264 15269 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:05:36.276255 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.242317 20602 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:36.277262 15271 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:36.275170 15266 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:36.279212 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.280138 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.280872 15271 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:36.256739 20601 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.283843 15269 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:36.290170 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.290843 15269 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:36.250802 20180 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:36.234295 20535 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:36.263131 20412 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:36.251950 20577 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.241766 20266 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.284264 20511 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:36.293030 15265 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:36.284912 15270 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:36.297394 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.321208 15267 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:05:36.301673 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.270509 20599 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.306075 15196 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:36.307909 15271 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:36.328740 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.273793 20428 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.298506 20555 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:05:36.329092 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 152054us
I20260709 13:05:36.329988 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.330195 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.330288 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.330839 15191 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:36.292394 20192 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:36.298859 20362 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.276185 20603 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.292418 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.246739 20114 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.331305 15271 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:36.333529 15267 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:36.280735 20595 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:05:36.334949 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:36.336783 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.367741 15194 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:36.339217 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.341130 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.342334 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.322204 20432 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.267560 20437 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:36.323422 20600 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:36.299899 20601 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.337687 20433 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:36.336977 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 87194.3us
I20260709 13:05:36.371438 15269 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:36.374282 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:36.402617 15238 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.031s (SENT)
I20260709 13:05:36.312150 20606 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.383651 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.384891 20176 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.364725 20045 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.348043 20448 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51610 (request call id 2) took 4167 ms. Trace:
I20260709 13:05:36.347915 20598 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:36.403963 15264 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:36.403196 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:36.407192 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.407379 15265 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:36.409273 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 114956us
I20260709 13:05:36.366432 20604 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.410434 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.419166 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.329835 20593 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
I20260709 13:05:36.389389 20429 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:36.335587 20428 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.418742 20604 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.446810 20350 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.449224 20114 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.376921 20603 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:36.380273 20362 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:36.453034 20362 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:36.333458 20599 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.426191 20591 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.421689 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.457798 15197 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:36.400221 20569 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:36.430733 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.431933 15264 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:36.432250 15265 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:36.440121 15194 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
W20260709 13:05:36.423837 20594 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:05:36.414060 20448 rpcz_store.cc:276] 0709 13:05:32.168102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.168251 (+   149us) service_pool.cc:224] Handling call
0709 13:05:32.728601 (+560350us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b54000e59a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e568a520 00007f36e5713b42 00007f36e5712800 00007f36e570b9fa 00007f36ea6d34c9 00007f36e3c4fc54 00007f36e3c4fbe2 00007f36e3c4fb11 00007f36e3c4fa8c 00007f36e3c4ed42
0709 13:05:32.806047 (+ 77446us) log.cc:844] Serialized 494 byte log entry
0709 13:05:33.520504 (+714457us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b18004125a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5682dbe 00007f36e568d930 00007f36e568d8d8
0709 13:05:33.522007 (+  1503us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b54000e59a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5682dbe 00007f36e568d930 00007f36e568d8d8 00007f36e568d858 00007f36e568d813 00007f36e568ca9c 00007f36eb578626 00007f36eb572dd8 00007f36e56c97cb 00007f36e56cc2c0
0709 13:05:34.024220 (+502213us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b18004125a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e568db26 00007f36e568749a 00007f36e5686714
0709 13:05:34.025368 (+  1148us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54000e59a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e568db26 00007f36e568749a 00007f36e5686714 00007f36e5666eaa 00007f36e566dd53 00007f36e566dcd9 00007f36e566dc69 00007f36e566dc31 00007f36e566cdfd 000000000038f354
0709 13:05:34.261942 (+236574us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b54000e59a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5686142 00007f36e5666eaa 00007f36e566dd53 00007f36e566dcd9 00007f36e566dc69 00007f36e566dc31 00007f36e566cdfd 000000000038f354 000000000038f199 00007f36e2620475
0709 13:05:36.333421 (+2071479us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":244,"raft.run_cpu_time_us":33576,"raft.run_wall_time_us":1995091,"spinlock_wait_cycles":264540160,"thread_start_us":339349,"threads_started":1,"wal-append.queue_time_us":374456,"wal-append.run_cpu_time_us":5674,"wal-append.run_wall_time_us":1349517}
I20260709 13:05:36.424743 20384 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:36.407262 20555 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:36.413054 20615 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.411923 20180 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:05:36.536027 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 141903us
I20260709 13:05:36.536993 15265 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:36.562296 15868 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:36.537251 20621 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:05:36.538173 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 107535us
I20260709 13:05:36.538837 20591 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:36.414672 20438 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.547310 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.547657 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:36.570475 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 167903us
I20260709 13:05:36.570628 15192 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:36.548354 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:36.571151 15238 leader_election.cc:336] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.075s (SENT)
I20260709 13:05:36.401623 20600 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:36.554219 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.555389 15191 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:36.547371 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:36.453949 20045 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:36.564966 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:36.554677 20537 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.601s	user 0.012s	sys 0.000s
I20260709 13:05:36.578590 15195 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:36.578805 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.561661 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:36.566576 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.568331 15265 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:36.581115 15266 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 10.
W20260709 13:05:36.581539 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.582141 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.569779 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:36.571561 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:36.582484 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.574601 15197 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:36.575328 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 208981us
I20260709 13:05:36.582731 15868 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:36.582837 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.586565 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.586794 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.565639 20615 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:36.584440 20569 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:36.587318 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:36.599918 15341 raft_consensus.cc:2368] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 16. Current term is 17.
I20260709 13:05:36.587705 15081 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 35e75f905ad042d89b465e6461b29a5d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:36.600806 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.601104 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:36.587678 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.565286 20590 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.569535 20548 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.590204 15265 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:05:36.602742 15238 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.091s (SENT)
I20260709 13:05:36.595752 15343 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:36.596766 15344 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:05:36.413442 20606 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:36.603900 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.599942 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:36.634374 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.602681 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.562933 20555 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.585430 20621 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:36.640031 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.591454 15266 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:36.591018 15340 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:05:36.574086 20611 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.626113 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.586920 15188 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:36.607872 20536 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:36.596376 20599 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:36.636483 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:36.598371 15093 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.589771 20600 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:36.588766 20438 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:05:36.641438 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.632591 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.643126 15338 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:36.643096 15197 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:36.626621 20593 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:36.667461 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:36.645066 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:36.645596 15311 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:36.597680 20604 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.610188 20512 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:05:36.609536 20511 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:36.647910 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45176.7us
I20260709 13:05:36.644523 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.673509 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.600018 20603 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:36.641986 20621 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.593418 20615 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:36.594954 20595 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:05:36.657758 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.685328 15196 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:36.685705 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.686811 15341 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:05:36.658775 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:36.661135 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.660845 15265 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:05:36.651425 20429 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:36.658244 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.666891 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.701387 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.632654 20468 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:36.673684 15093 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 12 to 18, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 18 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:36.702617 15263 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:36.702803 15093 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:36.693790 15312 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.962s (SENT) [suppressed 46 similar messages]
I20260709 13:05:36.641988 20569 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:36.674535 15238 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.113s (SENT)
I20260709 13:05:36.675858 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:36.706277 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:36.683207 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:36.683610 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.707437 15264 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:36.646708 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:36.688416 15265 pending_rounds.cc:85] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 7
I20260709 13:05:36.689090 20628 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:36.680665 20192 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:36.646708 20611 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.691627 15193 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:36.692837 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:36.752935 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 78434.4us
W20260709 13:05:36.756695 15238 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.133s (SENT)
I20260709 13:05:36.757036 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:36.757726 15238 leader_election.cc:336] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.161s (SENT)
I20260709 13:05:36.758104 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:36.693760 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:36.694341 20622 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:36.695895 15192 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:36.763859 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.764460 15344 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
W20260709 13:05:36.764989 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 81300.7us
I20260709 13:05:36.696125 20598 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:36.696651 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.694671 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.666630 20180 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:36.708451 15265 pending_rounds.cc:107] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:05:36.667871 20593 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:36.723834 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.711862 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.681833 20621 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:36.752449 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.736307 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.726773 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.675151 20535 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:36.761315 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.765573 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.758978 15188 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:36.775733 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.776237 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.777906 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.807385 15346 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:36.805044 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.807931 15266 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:36.712328 20628 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:36.829838 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.832000 15264 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:36.839402 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:36.840119 15264 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:36.832068 15345 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:36.834889 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.844111 15266 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:36.845208 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.832834 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.846203 15346 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:36.847235 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.848089 15346 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:36.711719 20623 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:36.858130 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.858975 15266 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:36.860008 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.832772 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:36.851370 15189 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:36.860710 15266 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:36.876662 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.877445 15266 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:36.878432 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.832571 15265 raft_consensus.cc:2889] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.830497 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:36.879762 15192 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:36.829934 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72245.5us
I20260709 13:05:36.708110 20590 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:05:36.752262 20615 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:05:36.804304 20592 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:36.805274 20468 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:05:36.880622 15265 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:05:36.894722 15265 pending_rounds.cc:85] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 10
I20260709 13:05:36.895126 15265 pending_rounds.cc:107] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:05:36.895448 15265 raft_consensus.cc:2889] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.751905 20443 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.113s
W20260709 13:05:36.886320 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 49355.2us
I20260709 13:05:36.809845 20593 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:36.765857 20511 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:36.809661 20601 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.898294 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.901369 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:36.902498 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.903798 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:36.867594 20622 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:36.907446 15264 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:36.903446 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.899899 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.908695 15266 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:36.909013 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.910344 15270 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:36.727214 20350 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.169s
I20260709 13:05:36.912686 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:36.900838 20443 consensus_queue.cc:1243] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:36.915151 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:36.895375 20482 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:36.839404 20384 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:05:36.829710 20627 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 13:05:36.918375 20511 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:36.919477 20536 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:36.904309 20535 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.930771 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.864880 20623 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.933045 15263 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:36.967497 15268 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:36.934226 20628 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:36.897796 20592 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.938567 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.939889 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:36.940496 20555 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:36.941139 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:36.942474 15269 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:36.975716 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.976588 15269 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:36.979279 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.981065 15344 raft_consensus.cc:2368] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 16. Current term is 17.
I20260709 13:05:36.980613 20623 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:36.985046 15270 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:36.985199 20606 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:36.954144 20600 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:36.987112 20600 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.981477 20592 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:36.987497 20600 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:36.953454 20482 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:36.941808 20437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.004s	sys 0.046s
I20260709 13:05:36.960207 15264 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:36.924149 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:36.996433 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:36.972194 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:36.990268 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77658.6us
I20260709 13:05:36.992340 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.004567 15343 raft_consensus.cc:2410] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:37.006690 15343 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:37.007560 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.007925 15343 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:37.008422 15344 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:37.009261 15343 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:37.009853 15344 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:37.003170 20482 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:37.017951 20412 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.697s	user 0.008s	sys 0.002s
I20260709 13:05:37.035408 20599 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:05:37.035771 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.036067 20599 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:37.037217 20599 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.038321 20428 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:37.042541 15269 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:37.044401 15344 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:37.048408 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52080.8us
I20260709 13:05:37.052453 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.910310 15266 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:05:37.002552 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:36.912591 20045 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.055554 15263 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:37.062901 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:37.038816 20599 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:37.067996 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63457.5us
I20260709 13:05:37.057261 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.051234 20615 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:37.040231 20437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.046s
I20260709 13:05:37.056128 15266 pending_rounds.cc:85] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 6
I20260709 13:05:37.039960 20429 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:37.099377 20429 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:37.100531 20429 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.101950 20577 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.102597 20577 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.103462 20431 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:37.104184 20388 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:37.105098 20577 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.097925 15196 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:37.046353 20555 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:37.018563 20412 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:37.074656 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 151124us
I20260709 13:05:37.073179 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.076892 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.078027 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.111719 15269 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 12: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:37.079891 15266 pending_rounds.cc:107] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:05:37.080984 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2784) took 1133 ms. Trace:
I20260709 13:05:37.081103 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:37.112103 15266 raft_consensus.cc:2889] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.069229 15264 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 10.
I20260709 13:05:37.083662 15194 raft_consensus.cc:2410] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:05:37.086472 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:37.081357 20087 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.089370 20428 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:37.094339 20620 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:37.102804 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:37.107242 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 424090us
I20260709 13:05:36.981127 20535 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.112536 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.122865 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.124012 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.124763 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:37.087909 20451 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:37.114877 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.134739 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:37.112150 15339 rpcz_store.cc:276] 0709 13:05:35.947785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.947970 (+   185us) service_pool.cc:224] Handling call
0709 13:05:35.966960 (+ 18990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.156981 (+190021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.157009 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.157047 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:36.157075 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.080742 (+923667us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54001748d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:37.080797 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.080923 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436516224}
I20260709 13:05:37.071833 20628 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:37.126801 15340 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:37.128378 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.077476 20615 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:37.132519 15263 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:37.140074 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:37.140925 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.145432 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.142407 15268 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:37.148566 15238 leader_election.cc:400] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:37.150732 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.157487 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.157819 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:37.158439 15197 raft_consensus.cc:2376] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17. Re-sending same reply.
I20260709 13:05:37.158887 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.159997 15269 raft_consensus.cc:2410] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:05:37.115829 20603 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.161440 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:37.151646 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.163749 15192 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:37.159791 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.152381 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.168349 15238 leader_election.cc:403] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.075117 20045 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.195421 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.121644 20433 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:37.200377 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.197665 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.137368 20602 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.204443 18938 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:05:37.272825 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 72783.5us
I20260709 13:05:37.273268 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:37.178081 20192 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:37.274605 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.150909 20615 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:37.272861 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:37.130689 20087 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:37.143232 20596 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:37.202375 15189 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:37.285070 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.333340 15339 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 18 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:37.160593 20601 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:37.121250 20536 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:05:37.160414 20384 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:37.155191 20555 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:37.295874 15196 pending_rounds.cc:85] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 10
I20260709 13:05:37.341666 15196 pending_rounds.cc:107] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:05:37.341938 15196 raft_consensus.cc:2889] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.296123 15265 raft_consensus.cc:2410] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:37.298061 15874 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 9.
I20260709 13:05:37.204878 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:37.298210 15162 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:37.080214 20482 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:37.178401 20606 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.196970 20616 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:37.179158 20604 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:37.196950 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:37.287384 20431 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:37.276382 20433 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:37.192582 20603 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:37.352500 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 147742us
I20260709 13:05:37.339131 20384 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:37.357861 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 195282us
W20260709 13:05:37.359894 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 61836.6us
W20260709 13:05:37.360522 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 198244us
W20260709 13:05:37.361863 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 270380us
I20260709 13:05:37.284057 20362 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:05:37.331023 20602 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.371609 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.357414 20616 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.357877 20451 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:37.336414 20087 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:37.371609 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.369364 20384 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:37.359352 20431 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.332437 20192 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.380249 18938 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:37.381142 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:37.361420 20433 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:37.387969 15841 leader_election.cc:400] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 16. Current term is 17.
I20260709 13:05:37.403795 15841 leader_election.cc:403] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.364359 20512 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:37.390290 20616 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:37.407104 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.361557 20604 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:37.399901 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:37.405545 15195 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:37.401597 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:37.357599 20606 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.399873 20431 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.374094 20428 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:05:37.415460 20621 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.000s
I20260709 13:05:37.377048 20596 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:05:37.427726 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46643.5us
I20260709 13:05:37.425040 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.423807 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.392906 20467 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:05:37.412412 20512 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.392554 20601 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:05:37.421008 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:37.416096 20350 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 16. Current term is 17.
I20260709 13:05:37.412600 20640 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:37.428287 20590 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:37.447870 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:37.462051 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 313636us
I20260709 13:05:37.467556 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:37.468067 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.439893 20639 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:37.440025 15197 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:05:37.481357 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.451208 20512 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:37.448864 20438 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:37.446390 20636 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:37.483299 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:37.449100 20649 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:37.461090 20535 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:37.499776 20644 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:05:37.465683 20640 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:37.441795 20621 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.477876 20639 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.506775 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.472491 20412 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:37.501048 20633 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:05:37.516461 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.517439 15339 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:37.518759 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.497449 20590 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:37.507510 20612 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:37.498759 20045 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.461647 20598 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:05:37.532938 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.534446 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.535004 15265 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.535588 15265 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:05:37.516626 20635 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:05:37.510634 20627 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:37.543509 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.543643 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.539686 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.514109 20451 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:37.497071 20429 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:05:37.510396 20640 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:37.513491 20604 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:37.552526 15265 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:37.527690 20428 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:37.517334 20639 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:37.526767 20650 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:37.525533 20590 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:37.559854 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.569900 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.570878 15265 raft_consensus.cc:2393] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:37.571133 15189 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:37.528946 20543 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:37.535442 20612 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.575145 20612 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:37.575341 20654 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:05:37.575960 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.576424 20543 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:37.549741 20627 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:37.545791 20643 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:05:37.555683 20638 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:05:37.573365 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.574167 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.543335 20045 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:37.547148 20624 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.784s	user 0.004s	sys 0.000s
I20260709 13:05:37.544481 20657 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:37.546262 20606 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.589632 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:37.603286 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 156240us
I20260709 13:05:37.567723 20650 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:37.577335 20543 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:37.572921 20590 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:37.615754 20650 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:37.580518 20627 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:37.625699 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:37.627076 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 159121us
I20260709 13:05:37.628036 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:37.628147 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.585566 20087 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:37.629029 15341 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:37.593282 20657 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:37.615132 20602 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.635318 20661 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:37.624171 20645 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.205s	user 0.001s	sys 0.001s
I20260709 13:05:37.641177 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:37.644677 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 244861us
W20260709 13:05:37.634343 20648 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:05:37.648034 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.648440 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.654215 15337 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:37.632143 20192 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.659863 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2541) took 1406 ms. Trace:
I20260709 13:05:37.661204 15272 rpcz_store.cc:276] 0709 13:05:36.253595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.253736 (+   141us) service_pool.cc:224] Handling call
0709 13:05:36.274067 (+ 20331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.287490 (+ 13423us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:36.287536 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.300458 (+ 12922us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.409837 (+109379us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:36.409875 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.413419 (+  3544us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.546537 (+1133118us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:37.650846 (+104309us) raft_consensus.cc:1685] finished
0709 13:05:37.650876 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.659770 (+  8894us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8614,"raft.queue_time_us":9151,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":12004,"spinlock_wait_cycles":26792832,"thread_start_us":72892,"threads_started":1,"wal-append.queue_time_us":319486}
I20260709 13:05:37.667311 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:37.593284 20045 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:37.667958 15191 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
W20260709 13:05:37.651710 20623 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.002s
I20260709 13:05:37.640156 20657 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:37.685956 15197 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:37.651158 20661 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.660554 20606 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:37.664187 20602 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:37.691215 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 65295.4us
I20260709 13:05:37.663233 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:37.667240 20511 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:37.699482 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:37.703140 15873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:37.628507 20451 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.705791 15870 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:37.670733 20604 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:37.711509 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83601.5us
I20260709 13:05:37.721192 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:37.705613 20593 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.768s	user 0.011s	sys 0.002s
I20260709 13:05:37.677105 20412 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:05:37.740038 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.749074 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.682561 20623 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:37.750417 15271 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:37.755463 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:37.757048 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.730850 20621 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.766076 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:37.766927 15268 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:37.742393 20606 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:37.773197 18938 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:37.749135 20602 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:37.775408 15338 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:37.778707 20431 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:37.779379 20600 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.005s
I20260709 13:05:37.779866 20600 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.780954 20431 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:37.782083 20600 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:37.784744 15196 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:37.787482 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.787765 15339 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:37.726266 20604 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:37.781031 15343 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 9. Current term is 11. Ops: []
I20260709 13:05:37.789026 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:37.788219 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:37.799954 20661 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:37.800463 20665 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.125s
I20260709 13:05:37.802068 20672 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:05:37.802830 20663 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.803614 20045 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:37.804080 20664 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:37.804580 20664 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.806665 20664 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.807777 20627 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.808586 20603 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.800267 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:37.803337 20663 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:37.791841 20652 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.212s	user 0.001s	sys 0.001s
I20260709 13:05:37.740449 20593 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:37.823084 15271 raft_consensus.cc:2376] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13. Re-sending same reply.
I20260709 13:05:37.811105 15270 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:37.831532 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:37.832068 15270 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:37.832726 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:37.810159 20651 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
W20260709 13:05:37.810235 20631 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.832s	user 0.004s	sys 0.000s
W20260709 13:05:37.833340 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 365847us
I20260709 13:05:37.788676 20602 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:37.810101 20646 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:05:37.836146 15269 raft_consensus.cc:2376] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12. Re-sending same reply.
I20260709 13:05:37.810021 20627 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:37.844774 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:37.839478 20599 consensus_meta.cc:287] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.001s
I20260709 13:05:37.839558 20593 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:37.840390 15190 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:37.841840 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.843349 15268 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:37.848364 15268 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:37.849287 20412 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:05:37.851084 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.851341 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:37.862618 15268 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:37.865396 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:37.863984 15238 leader_election.cc:400] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:37.866735 15238 leader_election.cc:403] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.832628 20664 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:37.879696 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.882498 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.888566 15270 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:37.810756 20678 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 13:05:37.880872 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:37.799019 20650 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.882006 20603 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:37.810743 20666 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.237s
W20260709 13:05:37.896890 20675 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:05:37.898102 20615 consensus_meta.cc:287] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.570s	user 0.009s	sys 0.002s
I20260709 13:05:37.845177 20602 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.893591 15271 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:05:37.900377 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.881192 20664 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:37.890955 20665 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:37.916611 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.918854 15265 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:37.919420 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:37.907459 20628 consensus_meta.cc:287] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.762s	user 0.006s	sys 0.006s
I20260709 13:05:37.903069 20045 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:37.901005 20412 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:37.902783 20604 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:37.925529 15189 raft_consensus.cc:2410] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:37.905921 20603 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:37.931684 20669 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:37.932330 20669 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:37.933351 20669 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.934334 20438 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:37.934770 20438 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:37.935696 20438 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.935937 20512 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.937197 20438 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:37.928308 20603 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:37.916863 20615 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.956995 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.951423 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.958724 15337 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:37.951139 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.961931 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.964114 15345 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:37.964883 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:37.965772 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.960042 20664 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:37.974926 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:37.976195 15345 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:37.980757 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:37.982110 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.983166 15238 leader_election.cc:400] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:37.983453 15238 leader_election.cc:403] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.947444 20428 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:37.952450 20663 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.001324 15345 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:37.949831 20615 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:37.941308 20650 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.992087 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:37.990789 20592 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.003s	user 0.013s	sys 0.000s
I20260709 13:05:37.987843 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.938989 20512 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:37.963512 20045 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:38.052838 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:38.058553 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70830.7us
W20260709 13:05:38.058913 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54542.5us
I20260709 13:05:37.960239 20555 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:37.984521 20412 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:37.972054 20535 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:05:38.064316 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:37.988874 20604 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:37.954157 20640 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.052363 20664 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:38.064805 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.057857 20665 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:38.067871 20616 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.638s	user 0.008s	sys 0.003s
I20260709 13:05:38.065989 20569 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:38.047366 20612 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.080276 20045 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:38.117075 20045 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.117594 20045 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.082391 20685 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:38.083992 20640 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.087836 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2039) took 1390 ms. Trace:
I20260709 13:05:38.140889 15194 rpcz_store.cc:276] 0709 13:05:36.697545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.777644 (+ 80099us) service_pool.cc:224] Handling call
0709 13:05:38.087653 (+1310009us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54001e73d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.087778 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577243008}
I20260709 13:05:38.059271 20592 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.142150 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.142730 15194 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:38.093827 15192 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:38.144229 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.144764 15192 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:38.097193 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2010) took 1498 ms. Trace:
I20260709 13:05:38.097780 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2580) took 1092 ms. Trace:
I20260709 13:05:38.145998 15263 rpcz_store.cc:276] 0709 13:05:37.039670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.076599 (+ 36929us) service_pool.cc:224] Handling call
0709 13:05:38.097634 (+1021035us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b54002a85d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.097728 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48430976}
I20260709 13:05:38.101491 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:38.147208 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45812.9us
I20260709 13:05:38.147333 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.103179 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:38.145946 15343 rpcz_store.cc:276] 0709 13:05:36.598788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.010012 (+411224us) service_pool.cc:224] Handling call
0709 13:05:37.010292 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.792975 (+782683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.096967 (+303992us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54003abbd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:38.097134 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772112256}
I20260709 13:05:38.067548 20623 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:38.150465 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.151051 15263 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:37.976323 20657 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:38.151824 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48782.3us
I20260709 13:05:38.152680 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.153738 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.154028 15197 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:05:38.157284 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:38.113267 20569 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:38.159575 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53696.5us
I20260709 13:05:38.160151 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:38.160019 15192 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:38.162135 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.182524 15339 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:38.183023 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.162566 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.183769 15192 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:38.183640 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.184192 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.163450 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.186398 15264 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:38.158977 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.181628 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:38.190907 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.191859 15192 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:38.192569 15193 raft_consensus.cc:2368] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16.
W20260709 13:05:38.149535 20682 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.076s	user 0.001s	sys 0.003s
I20260709 13:05:38.140182 20412 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:05:38.139374 20628 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:05:38.158222 20535 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:05:38.168525 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.149861 20432 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:38.172307 20266 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:38.160703 20429 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:38.175359 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2862) took 1052 ms. Trace:
I20260709 13:05:38.195266 20569 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:38.178355 15194 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:38.236529 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.196925 20512 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.164330 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.204366 15264 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:38.206142 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.237421 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.241169 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.241966 15264 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:38.210965 15340 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:38.241412 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:38.242242 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.215116 15237 leader_election.cc:400] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
W20260709 13:05:38.216523 20689 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:38.217759 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.220139 15268 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:38.170492 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.158391 20604 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:38.113461 20616 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.247862 15189 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:38.238204 20535 consensus_queue.cc:1243] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:38.179533 20623 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:38.233935 15343 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:38.176815 20612 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.233323 15195 rpcz_store.cc:276] 0709 13:05:37.123318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.125253 (+  1935us) service_pool.cc:224] Handling call
0709 13:05:38.175193 (+1049940us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b540023a5d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.175304 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551850752}
I20260709 13:05:38.243289 20661 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:38.197225 20451 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:38.112962 20672 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:38.102905 20611 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:38.222656 20659 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:38.244491 15237 leader_election.cc:403] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:38.245121 15266 raft_consensus.cc:2410] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:38.245406 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.242992 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.247881 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.239320 20599 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:05:38.234484 20598 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:38.231901 15263 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:38.249846 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.226060 20450 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 13:05:38.260094 15338 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2007) took 1662 ms (client timeout 2201 ms). Trace:
I20260709 13:05:38.279184 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:38.279608 15338 rpcz_store.cc:269] 0709 13:05:36.597983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.939627 (+341644us) service_pool.cc:224] Handling call
0709 13:05:38.259873 (+1320246us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b5400246654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.260012 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1842028288}
W20260709 13:05:38.280229 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 84462.2us
I20260709 13:05:38.280892 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.281544 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:38.266852 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.279898 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.195066 20665 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:38.267499 20429 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.276137 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.247377 20512 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.288882 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.276463 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.222416 20596 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:05:38.236974 20603 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:38.250396 20673 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:38.235308 20432 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.281654 15194 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:38.250664 20431 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:38.271687 20384 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.870s	user 0.012s	sys 0.001s
I20260709 13:05:38.282569 15263 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:38.248767 20677 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:05:38.285153 20615 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:38.261060 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:38.283803 15839 leader_election.cc:336] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.728s (SENT)
I20260709 13:05:38.290097 20672 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:38.248838 20604 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.287220 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:38.287757 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:38.273435 20451 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.280731 20087 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:38.296025 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.295925 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.275141 20659 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.305379 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.268342 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2571) took 1114 ms. Trace:
I20260709 13:05:38.332926 15266 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 11: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:38.333180 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 91813.3us
I20260709 13:05:38.332038 15272 rpcz_store.cc:276] 0709 13:05:37.153683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.666208 (+512525us) service_pool.cc:224] Handling call
0709 13:05:37.687320 (+ 21112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.687710 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.687735 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.688195 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.919616 (+231421us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:37.926354 (+  6738us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.955600 (+ 29246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.955714 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.268044 (+312330us) raft_consensus.cc:1685] finished
0709 13:05:38.268091 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.268265 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28864,"prepare.queue_time_us":6512,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":49190,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":29834,"thread_start_us":231083,"threads_started":1,"wal-append.queue_time_us":290530}
I20260709 13:05:38.285252 20598 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:38.309103 15263 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:38.289839 20429 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:38.285916 20412 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:38.269647 20620 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:38.311769 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.288290 20660 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:38.315403 15189 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:38.316359 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.317322 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.350167 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.350759 15340 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:38.330399 20669 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:38.355355 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:38.308079 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 89480.6us
I20260709 13:05:38.333972 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:38.314211 20672 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.359504 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.320523 20604 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:38.308493 20509 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:05:38.317834 20673 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:38.324304 20451 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:38.349225 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65448.7us
W20260709 13:05:38.308916 20639 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
W20260709 13:05:38.341727 20433 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.923s	user 0.013s	sys 0.000s
I20260709 13:05:38.333837 20659 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.357573 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.365790 20672 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:38.385213 15272 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:38.311012 20384 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:38.408838 20384 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:38.387845 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.410435 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.388468 15194 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:38.349495 20592 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.411648 20592 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.412204 20592 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.363162 20636 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:38.355075 20620 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:38.415535 20636 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:38.416203 20620 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.416719 20636 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.392220 15195 raft_consensus.cc:2410] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:05:38.419356 15341 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 11: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:38.364224 20663 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:38.414794 20592 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.421411 20663 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:38.398509 15160 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:38.360672 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:38.345178 20266 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:05:38.381685 20599 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:38.363583 20669 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:38.423156 20669 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:38.355404 20657 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:38.355353 20692 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:38.420642 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.427021 20663 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:38.429207 20663 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:38.429771 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.430028 20663 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.430513 15196 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:38.434702 20592 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:38.435395 20592 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:38.445235 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 84671.3us
I20260709 13:05:38.383665 20673 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:38.450615 15340 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:38.392969 20087 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.463549 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.464236 15196 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:38.365655 20593 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
W20260709 13:05:38.461144 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 163714us
I20260709 13:05:38.467293 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.471305 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:38.487195 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.464746 20673 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:38.490665 15196 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:38.466643 20384 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:38.400374 20433 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.437098 20639 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:38.497337 20695 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
W20260709 13:05:38.497627 20696 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:05:38.499876 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:38.503857 20700 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:05:38.508023 20598 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:38.508646 20598 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:38.509157 20598 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.511112 20512 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.511579 20555 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:38.511987 20555 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:38.489276 20599 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:38.468267 20087 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.485080 20616 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:38.514520 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43538us
I20260709 13:05:38.487849 20708 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.557029 15346 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:38.492794 20384 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:38.567705 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.518095 20600 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:38.572605 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:38.589927 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.560606 20603 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:38.566716 20384 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:38.621398 20711 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:38.517319 20555 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.622478 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.623014 20555 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.627257 20599 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:38.629840 20698 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:05:38.631606 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.632331 20639 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.632773 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.633406 15265 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:38.634305 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.635093 15265 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 14 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:05:38.638345 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 379) took 1491 ms. Trace:
I20260709 13:05:38.638761 15190 rpcz_store.cc:276] 0709 13:05:37.146513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.146625 (+   112us) service_pool.cc:224] Handling call
0709 13:05:37.146856 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.845821 (+698965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.638104 (+792283us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b54000fafd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:38.638286 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1594562304}
I20260709 13:05:38.640017 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.641038 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:38.641532 20438 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.704s	user 0.005s	sys 0.006s
I20260709 13:05:38.642001 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.643476 20087 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:38.644338 15269 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2595) took 1259 ms (client timeout 1629 ms). Trace:
I20260709 13:05:38.644765 20592 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.649809 20433 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:38.650480 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.651654 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.653362 18938 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:38.654048 18938 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:38.561715 20708 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.655457 20673 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.657404 20708 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.574000 20432 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.659082 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.659734 15190 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:38.660154 15238 connection.cc:256] RPC call timeout handler was delayed by -1.0877151569999342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 13:05:38.663589 20045 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.003s
I20260709 13:05:38.658736 20659 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.663987 20045 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.664839 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2871) took 1140 ms. Trace:
W20260709 13:05:38.664995 20704 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:05:38.665120 15271 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:05:38.665933 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2026) took 1146 ms. Trace:
I20260709 13:05:38.666158 20045 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.666323 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2604) took 1272 ms. Trace:
I20260709 13:05:38.666742 15271 rpcz_store.cc:276] 0709 13:05:37.394178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.175361 (+781183us) service_pool.cc:224] Handling call
0709 13:05:38.175659 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.665579 (+489920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.666117 (+   538us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54000d7854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:38.666276 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125111168}
I20260709 13:05:38.667963 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.668916 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.669848 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.666324 15341 rpcz_store.cc:276] 0709 13:05:37.519504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.632923 (+113419us) service_pool.cc:224] Handling call
0709 13:05:38.665743 (+1032820us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b5400245c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.665865 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1786332928}
I20260709 13:05:38.671646 15191 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:38.591755 20602 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.001s
I20260709 13:05:38.673003 20602 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.675668 15192 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:38.644780 15269 rpcz_store.cc:269] 0709 13:05:37.384888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.416343 (+ 31455us) service_pool.cc:224] Handling call
0709 13:05:38.644182 (+1227839us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001d8dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.644283 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892155648}
I20260709 13:05:38.599192 20705 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:38.677795 20705 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:38.677977 20482 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.678211 20705 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:38.678983 15191 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:38.574481 20600 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:38.679618 20600 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:38.682221 20659 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:38.679167 15193 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 2866) took 1554 ms (client timeout 2064 ms). Trace:
I20260709 13:05:38.682933 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2882) took 1124 ms. Trace:
I20260709 13:05:38.683344 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:38.684289 15196 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:38.684839 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2883) took 1074 ms. Trace:
I20260709 13:05:38.685184 15195 rpcz_store.cc:276] 0709 13:05:37.610720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.684148 (+1073428us) service_pool.cc:224] Handling call
0709 13:05:38.684420 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.684572 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.684595 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.684631 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:38.684669 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.684715 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.684794 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.686719 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2886) took 1046 ms. Trace:
I20260709 13:05:38.683385 15189 rpcz_store.cc:276] 0709 13:05:37.558831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.682141 (+1123310us) service_pool.cc:224] Handling call
0709 13:05:38.682453 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.682620 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.682644 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.682684 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:38.682722 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.682771 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.682881 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.687023 15195 rpcz_store.cc:276] 0709 13:05:37.639881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.686059 (+1046178us) service_pool.cc:224] Handling call
0709 13:05:38.686322 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.686461 (+   139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.686483 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.686520 (+    37us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:38.686547 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.686590 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.686672 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:38.698058 15238 leader_election.cc:336] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 2.226s (SENT)
W20260709 13:05:38.683262 15193 rpcz_store.cc:269] 0709 13:05:37.124417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.124513 (+    96us) service_pool.cc:224] Handling call
0709 13:05:38.678933 (+1554420us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003e71d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.679108 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453801344}
I20260709 13:05:38.698612 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.708994 18938 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.695786 15194 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:38.711989 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2881) took 1154 ms. Trace:
I20260709 13:05:38.665235 15197 rpcz_store.cc:276] 0709 13:05:37.524662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.686725 (+162063us) service_pool.cc:224] Handling call
0709 13:05:37.687020 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.157594 (+470574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.664593 (+506999us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400226fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:38.664777 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073266560}
I20260709 13:05:38.657481 20673 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.712584 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.719298 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.720534 18938 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:38.712545 15194 rpcz_store.cc:276] 0709 13:05:37.557726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.652479 (+1094753us) service_pool.cc:224] Handling call
0709 13:05:38.652731 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.711757 (+ 59026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.711936 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.689947 15272 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
W20260709 13:05:38.714243 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 124405us
I20260709 13:05:38.688763 15190 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:38.671679 20598 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.720858 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.721796 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:38.721014 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:38.724347 15190 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:38.725457 15190 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:05:38.731362 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:38.732244 15869 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:38.733553 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:38.736112 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2805) took 1609 ms. Trace:
I20260709 13:05:38.671943 20604 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.736429 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.742939 15263 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:38.736476 15346 rpcz_store.cc:276] 0709 13:05:37.126556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.126682 (+   126us) service_pool.cc:224] Handling call
0709 13:05:37.127001 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.557688 (+1430687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.735917 (+178229us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000b7054. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:38.736058 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3268779264}
I20260709 13:05:38.749594 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.758206 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:38.718039 20590 consensus_meta.cc:287] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.088s	user 0.006s	sys 0.014s
I20260709 13:05:38.702280 20536 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:38.758247 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:38.759243 15268 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.762557 20432 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:38.776429 20412 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:38.777113 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:38.777774 15868 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:38.779407 20590 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.782214 20615 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:38.784237 15194 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:38.762750 20513 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:05:38.766387 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:38.786275 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:38.730873 20701 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:38.792399 15268 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:38.735176 20665 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:38.800519 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.782402 20451 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.745116 20045 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:38.802124 15270 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:38.760114 20087 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:38.797446 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 75080.1us
I20260709 13:05:38.759747 20657 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:38.803730 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.818905 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.783744 20603 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:38.808297 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.795061 15868 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:38.774390 20432 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:38.691936 20669 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:38.861059 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 380) took 1713 ms. Trace:
I20260709 13:05:38.861508 15188 rpcz_store.cc:276] 0709 13:05:37.147280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.175511 (+ 28231us) service_pool.cc:224] Handling call
0709 13:05:38.178697 (+1003186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.282292 (+103595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.282350 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.282391 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:38.282422 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.732830 (+450408us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540023a5d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:38.732877 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.860900 (+128023us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540023a5d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:38.861005 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2544003200}
I20260709 13:05:38.839154 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:38.863271 15197 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:38.867616 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:38.821257 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 146407us
I20260709 13:05:38.814580 15264 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:38.826828 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:38.828599 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:38.793602 20511 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:38.877250 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.879446 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:38.807333 20045 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:38.880102 15188 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:05:38.889195 15188 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:38.890573 15188 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:38.883404 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.891956 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.884282 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.885157 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.893424 15344 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:38.807847 20602 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.899295 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.900355 15343 raft_consensus.cc:2410] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:05:38.895718 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.881274 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:38.896777 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70022.2us
I20260709 13:05:38.903839 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:38.906637 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.907673 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.910012 15189 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:38.911181 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.920207 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.921195 15346 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:38.922091 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.923563 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.924471 15345 raft_consensus.cc:2368] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:38.926036 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.927384 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.928893 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.935421 15268 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:38.933907 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.815713 20536 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:38.940531 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:38.941736 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:38.897236 20645 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:38.904457 20593 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.965176 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:38.948269 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:38.949470 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:38.819622 20087 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:38.950347 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73177.5us
I20260709 13:05:38.897755 20045 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:38.952275 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:38.938853 20429 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:05:38.943984 20665 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:39.005793 15265 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:38.955920 15343 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:38.944815 20660 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:38.871582 20672 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.962914 15345 raft_consensus.cc:2368] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:39.011020 20672 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:38.969542 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:38.954785 20628 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:38.973009 15162 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:38.983973 15269 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:38.958436 20663 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:05:38.964346 20708 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:05:38.958581 20433 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:05:38.991153 20705 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:38.972590 20569 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.722s	user 0.009s	sys 0.002s
I20260709 13:05:38.992179 15338 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:38.962774 20600 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:38.992764 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:39.006107 20657 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:39.003422 15339 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:05:39.047781 15339 pending_rounds.cc:85] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 10
I20260709 13:05:39.048089 15339 pending_rounds.cc:107] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:05:39.048404 15339 raft_consensus.cc:2889] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:39.011775 15188 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:05:38.963228 15340 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:39.013823 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:39.018617 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 66444.6us
I20260709 13:05:39.012780 20665 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:39.052224 15346 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:05:39.052140 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:39.036880 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 248151us
I20260709 13:05:39.012581 20660 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:39.037294 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64382.6us
I20260709 13:05:39.055743 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.034564 20266 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:39.041169 20717 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:38.972148 20593 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:39.112159 15189 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:39.036564 20412 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:39.051578 20569 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:39.152899 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 44162.7us
W20260709 13:05:39.154269 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 98608us
I20260709 13:05:39.037835 20451 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:39.055087 20665 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:39.172899 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:39.114315 20649 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:39.056092 20660 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:39.057155 20628 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:39.172340 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:39.166945 15143 auto_rebalancer.cc:893] Removing replace marker failed: Replica f4ca86ee1d194023b1414bbe226f4798 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:05:39.246529 15143 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:05:39.173772 20663 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:05:39.174265 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 123534us
W20260709 13:05:39.248178 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75917.9us
I20260709 13:05:39.249481 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.177454 20705 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:39.161055 15337 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:39.013928 20429 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.059275 20657 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.147540 20604 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:39.212728 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.152343 20673 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:39.213517 15268 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
W20260709 13:05:39.288153 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 75553.1us
W20260709 13:05:39.254436 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 359635us
I20260709 13:05:39.289108 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.220523 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2612) took 1013 ms. Trace:
I20260709 13:05:39.259647 20664 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.260404 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2894) took 1160 ms. Trace:
I20260709 13:05:39.292927 15194 rpcz_store.cc:276] 0709 13:05:38.099907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.721371 (+621464us) service_pool.cc:224] Handling call
0709 13:05:38.721709 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.796659 (+ 74950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.260182 (+463523us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b54000c03d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:39.260344 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143321984}
I20260709 13:05:39.294229 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:39.260900 20663 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:39.295287 20663 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:39.263643 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2617) took 1055 ms. Trace:
I20260709 13:05:39.295962 15264 rpcz_store.cc:276] 0709 13:05:38.208307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.276195 (+ 67888us) service_pool.cc:224] Handling call
0709 13:05:39.263423 (+987228us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b54001d97d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:39.263567 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135787776}
I20260709 13:05:39.267603 15192 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:05:39.246912 15143 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:05:39.277330 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:39.303926 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:39.305266 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:39.306418 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:39.277460 20432 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:39.278556 20721 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:05:39.278688 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.310006 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2619) took 1101 ms. Trace:
I20260709 13:05:39.310460 15271 rpcz_store.cc:276] 0709 13:05:38.208820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.670583 (+461763us) service_pool.cc:224] Handling call
0709 13:05:38.670891 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:38.680124 (+  9233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.680154 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:38.680753 (+   599us) log.cc:844] Serialized 52 byte log entry
0709 13:05:38.816299 (+135546us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:39.155266 (+338967us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.156488 (+  1222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.156582 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.309762 (+153180us) raft_consensus.cc:1685] finished
0709 13:05:39.309789 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.309941 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9272,"raft.queue_time_us":26472,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":20255,"thread_start_us":420437,"threads_started":2,"wal-append.queue_time_us":338779}
I20260709 13:05:39.280864 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.284364 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:39.284925 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.314352 15346 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:39.214679 20708 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:39.191444 20266 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.210922 20718 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:05:39.280014 20384 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.613s	user 0.006s	sys 0.003s
I20260709 13:05:39.260224 20636 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.289938 15265 rpcz_store.cc:276] 0709 13:05:38.206884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.635617 (+428733us) service_pool.cc:224] Handling call
0709 13:05:38.635880 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.006254 (+370374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.220226 (+213972us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54000d6954. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:39.220453 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":849880320}
I20260709 13:05:39.316993 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.318890 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.320426 15237 leader_election.cc:400] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:39.333196 15237 leader_election.cc:403] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:39.229339 20649 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:39.227722 20666 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 13:05:39.338455 15312 leader_election.cc:400] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16.
I20260709 13:05:39.338820 15312 leader_election.cc:403] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:39.285686 20536 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:39.328934 15344 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:39.333837 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.325577 20511 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:39.335351 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.289886 20555 raft_consensus.cc:2764] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:05:39.324702 20600 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:39.352144 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:39.344626 15265 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:39.352957 15162 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.347922 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:39.317559 20705 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:39.345532 20591 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:39.328079 20718 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.360526 15162 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.334719 20512 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:39.364111 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.336788 20432 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:39.324088 20664 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.363204 20717 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:39.365195 20616 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:05:39.338845 20673 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:39.354383 20437 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16.
I20260709 13:05:39.348289 20725 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:39.368191 20722 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:05:39.334944 20384 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:39.377221 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:39.367671 20511 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:39.339303 20636 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.370262 20705 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:39.358752 20599 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:05:39.359148 20087 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:39.370774 20669 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:39.374571 20628 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:39.390900 15342 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:39.374571 20591 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:39.375857 20536 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:39.378717 20593 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:39.380219 20432 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:39.393134 15189 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:39.412006 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2602) took 2018 ms. Trace:
I20260709 13:05:39.387238 20703 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:39.379940 20600 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:05:39.412457 15267 rpcz_store.cc:276] 0709 13:05:37.393439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.900087 (+506648us) service_pool.cc:224] Handling call
0709 13:05:37.910259 (+ 10172us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.912120 (+  1861us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.912147 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.912563 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.692202 (+779639us) spinlock_profiling.cc:243] Waited 3.19 ms on lock 0x7b180039e920. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:38.910480 (+218278us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:38.910541 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.910644 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.404002 (+493358us) raft_consensus.cc:1685] finished
0709 13:05:39.404020 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.411924 (+  7904us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1713,"raft.queue_time_us":153,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5153,"spinlock_wait_cycles":7337728,"thread_start_us":218033,"threads_started":1,"wal-append.queue_time_us":1166287}
W20260709 13:05:39.405061 20716 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:05:39.382567 20511 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:39.403774 20705 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.387097 20437 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:05:39.408061 20669 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:39.374321 20649 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:05:39.425693 20715 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:05:39.435456 20511 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:39.382645 20266 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.406693 20450 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:05:39.422369 20569 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:39.434584 20432 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:39.501965 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.401191 20718 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.456805 20591 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:39.438827 20703 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.480443 20649 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:39.467335 20657 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:39.497880 20716 log.cc:927] Time spent T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:39.416476 20673 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:39.522874 20730 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:05:39.516098 20659 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:39.526751 20703 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.528805 20590 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:39.531625 20732 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:05:39.539017 20713 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:05:39.523715 20723 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 13:05:39.561792 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 241544us
I20260709 13:05:39.563807 15237 leader_election.cc:400] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:39.550956 20604 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:39.551102 20718 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:39.571182 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 187086us
I20260709 13:05:39.577693 15312 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.550956 20659 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.493372 15189 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:39.523398 20591 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.507048 20432 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:39.637603 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.558668 20664 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:39.556438 20713 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:39.751773 18938 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.752362 18938 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.753664 20611 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:39.754087 20611 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.754383 18938 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:39.755211 20591 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:39.754912 20611 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.756206 20611 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:39.539629 20665 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:39.644932 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 69325.5us
I20260709 13:05:39.757539 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.758567 20665 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:39.747991 20732 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:05:39.759199 20437 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:39.759773 20437 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.761976 20437 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:39.767189 20615 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:39.769474 20599 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:05:39.736727 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 372656us
W20260709 13:05:39.740566 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.769306 20713 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:39.646818 20733 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:05:39.770453 20713 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:39.770665 20555 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:39.771525 20555 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:39.771701 20665 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:39.772018 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.772383 20665 consensus_queue.cc:1243] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:05:39.772915 20555 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:39.773313 20555 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:39.773605 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2887) took 1676 ms. Trace:
W20260709 13:05:39.742874 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.774058 20555 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.717141 20384 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:39.773957 15195 rpcz_store.cc:276] 0709 13:05:38.097311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.711946 (+614635us) service_pool.cc:224] Handling call
0709 13:05:38.745377 (+ 33431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:38.835410 (+ 90033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.835440 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:38.869677 (+ 34237us) log.cc:844] Serialized 52 byte log entry
0709 13:05:39.215262 (+345585us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:39.244707 (+ 29445us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.331127 (+ 86420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.331198 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.773372 (+442174us) raft_consensus.cc:1685] finished
0709 13:05:39.773394 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.773550 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195671,"prepare.queue_time_us":29233,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":168637,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":45667,"thread_start_us":271487,"threads_started":1,"wal-append.queue_time_us":475332}
I20260709 13:05:39.776229 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:39.776394 20384 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:39.777290 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:39.777872 15195 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:39.778213 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:39.769872 20599 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.782814 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:39.638155 20661 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:39.730160 20636 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:39.799150 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.582374 20600 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.203s
W20260709 13:05:39.808444 20045 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.003s
I20260709 13:05:39.561180 20705 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:39.787678 20665 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.813762 20045 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.811910 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.656615 20657 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 13:05:39.787438 20664 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:39.787825 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:05:39.821434 20735 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.304s	user 0.000s	sys 0.001s
I20260709 13:05:39.844894 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:39.845634 15337 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:39.846014 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:39.855647 15344 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:39.856283 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:39.857004 15346 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:39.846370 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:39.846699 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:39.823990 20754 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.824136 20437 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:39.816237 20717 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 13:05:39.836795 20742 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:05:39.791905 20555 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:39.849212 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:39.850533 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:39.808091 20512 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:39.863866 15270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.042s
W20260709 13:05:39.875643 15270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.013s	sys 0.043s
I20260709 13:05:39.876013 15341 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:39.807978 20590 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:39.871512 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:39.881081 20045 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:39.882685 15340 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 12: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:39.883713 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:39.884186 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:39.862058 20603 consensus_meta.cc:287] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.993s	user 0.012s	sys 0.000s
W20260709 13:05:39.875231 20736 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.352s	user 0.000s	sys 0.001s
W20260709 13:05:39.895135 15238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.004s	sys 0.044s
W20260709 13:05:39.858254 20708 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.007s	sys 0.036s
I20260709 13:05:39.861325 20747 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:39.934928 15238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.008s	sys 0.044s
I20260709 13:05:39.882047 20412 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:39.935174 20755 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:39.940697 20745 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.953069 20745 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.919854 20450 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:39.956296 20739 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:05:39.955873 20450 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:39.892952 20599 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.875047 20604 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:39.877509 20437 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:39.808169 20659 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.970727 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:05:39.941473 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 607683us
W20260709 13:05:39.909291 15268 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.001s	sys 0.036s
I20260709 13:05:39.838135 20665 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.889539 20593 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:39.945077 20660 consensus_meta.cc:287] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.663s	user 0.014s	sys 0.004s
W20260709 13:05:39.977131 15268 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.003s	sys 0.042s
W20260709 13:05:39.990841 15193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.022s	sys 0.046s
W20260709 13:05:39.991649 15193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.022s	sys 0.046s
I20260709 13:05:39.928997 20045 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:39.956579 20536 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.553s	user 0.004s	sys 0.005s
I20260709 13:05:39.862394 20664 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.900822 20603 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:39.942687 20734 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:05:39.968093 20672 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:39.992584 20045 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.040968 20045 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:39.951750 20743 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:05:39.958917 20599 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:40.001588 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:40.003743 15264 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:40.045650 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2632) took 1139 ms. Trace:
I20260709 13:05:40.046108 15264 rpcz_store.cc:276] 0709 13:05:38.906483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.296846 (+390363us) service_pool.cc:224] Handling call
0709 13:05:39.297100 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.044052 (+746952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.045388 (+  1336us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54002f1cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:40.045591 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1624531840}
I20260709 13:05:39.976750 20604 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:39.879377 20754 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.939666 20708 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:39.962415 20432 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:39.960088 20429 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:40.038545 15197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.023s	sys 0.021s
I20260709 13:05:39.994930 20699 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:40.054246 15197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.023s	sys 0.022s
I20260709 13:05:39.941002 20666 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:39.894279 20512 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.050740 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:39.996415 20592 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:40.038292 20731 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.243s	user 0.004s	sys 0.000s
I20260709 13:05:39.976724 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:39.998173 20536 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15.
I20260709 13:05:40.057926 15264 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:39.990329 20593 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.059499 20045 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:39.990358 20660 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.039233 20672 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:39.986681 20412 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:39.960892 20717 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:05:40.066452 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2633) took 1159 ms. Trace:
I20260709 13:05:39.967303 20663 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.066841 15271 rpcz_store.cc:276] 0709 13:05:38.906762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.312379 (+405617us) service_pool.cc:224] Handling call
0709 13:05:39.312720 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.312944 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:39.570129 (+257185us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.060471 (+490342us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.066122 (+  5651us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.066176 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:40.066220 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.066284 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.066389 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55350,"prepare.queue_time_us":55718,"prepare.run_cpu_time_us":190,"prepare.run_wall_time_us":190,"thread_start_us":695936,"threads_started":2}
W20260709 13:05:40.067795 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 293643us
I20260709 13:05:40.068485 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:40.068706 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:40.062974 20045 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.038826 20450 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:39.943075 20755 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.064368 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.056746 20745 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.118079 15271 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:40.120157 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.058627 20437 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.122121 20665 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.122478 20266 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:40.123181 20468 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:40.124006 20569 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:40.182757 20569 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:40.183250 20729 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:40.183655 20569 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.184332 20729 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:40.184723 20729 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:40.184904 20569 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:40.185619 20729 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.133194 20725 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.187243 20725 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:40.134473 20512 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:40.135627 20718 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:40.137915 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.191735 15342 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
W20260709 13:05:40.148170 20669 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.003s
I20260709 13:05:40.140437 20593 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.141466 20412 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.141992 20660 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:40.143416 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.194870 20412 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:40.195291 20433 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:40.060113 20603 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.195840 20433 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:40.196022 20603 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.197952 20659 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.198201 20603 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.145247 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:40.056393 20666 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.181210 20045 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.181756 20437 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:40.139245 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:40.061365 20699 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.195374 20412 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.144168 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.139274 20664 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.186811 20729 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.200424 20045 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.144122 20451 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:05:40.145802 20536 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.180649 20663 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:40.198902 20603 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.179152 20749 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.194896 20592 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.201692 20666 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:40.203655 20669 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:40.204872 20660 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.120223 20708 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.144187 20604 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.222549 20603 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.224447 20592 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:40.201857 20672 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.231753 20754 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:40.223793 20749 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.253787 20749 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.254284 20699 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.243546 20672 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.251765 20755 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:40.261922 20725 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.264101 20725 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.138250 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2900) took 1666 ms. Trace:
I20260709 13:05:40.307227 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2888) took 2209 ms. Trace:
I20260709 13:05:40.132043 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2061) took 1966 ms. Trace:
I20260709 13:05:40.127651 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2885) took 2514 ms. Trace:
I20260709 13:05:40.144970 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2902) took 1672 ms. Trace:
I20260709 13:05:40.308604 15196 rpcz_store.cc:276] 0709 13:05:37.613566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.684842 (+1071276us) service_pool.cc:224] Handling call
0709 13:05:38.685156 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:38.829021 (+143865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.829067 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:38.872317 (+ 43250us) log.cc:844] Serialized 52 byte log entry
0709 13:05:39.265733 (+393416us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b18002f2660. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:39.481627 (+215894us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:40.126963 (+645336us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.127224 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.127299 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.127343 (+    44us) raft_consensus.cc:1685] finished
0709 13:05:40.127429 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.127586 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":812445,"prepare.queue_time_us":646560,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":144311,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":33626,"spinlock_wait_cycles":17814400,"thread_start_us":215661,"threads_started":1,"wal-append.queue_time_us":913323}
I20260709 13:05:40.312531 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:40.308225 15190 rpcz_store.cc:276] 0709 13:05:38.166060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.726095 (+560035us) service_pool.cc:224] Handling call
0709 13:05:38.726350 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.802700 (+ 76350us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:39.154165 (+351465us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.390339 (+236174us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.410670 (+ 20331us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.410852 (+   182us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:39.955776 (+544924us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:40.131271 (+175495us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.131532 (+   261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.131635 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.131781 (+   146us) raft_consensus.cc:1685] finished
0709 13:05:40.131801 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.131972 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":840600,"prepare.queue_time_us":1093806,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":88760,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":18332,"spinlock_wait_cycles":18494848,"thread_start_us":500928,"threads_started":2,"wal-append.queue_time_us":398799}
I20260709 13:05:40.314196 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:40.314582 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:40.306762 15188 rpcz_store.cc:276] 0709 13:05:38.471691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.902788 (+431097us) service_pool.cc:224] Handling call
0709 13:05:38.903077 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.049702 (+146625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.138043 (+1088341us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400211bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:40.138199 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249419136}
I20260709 13:05:40.316181 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:40.316934 15196 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:40.317665 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2913) took 1042 ms. Trace:
I20260709 13:05:40.318106 15188 rpcz_store.cc:276] 0709 13:05:39.274848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.316334 (+1041486us) service_pool.cc:224] Handling call
0709 13:05:40.316817 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.317238 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.317286 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.317369 (+    83us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:40.317419 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.317490 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.317596 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.132519 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2069) took 1945 ms. Trace:
I20260709 13:05:40.319585 15197 rpcz_store.cc:276] 0709 13:05:38.186905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.881601 (+694696us) service_pool.cc:224] Handling call
0709 13:05:38.882090 (+   489us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:38.919224 (+ 37134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.919256 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:38.919839 (+   583us) log.cc:844] Serialized 52 byte log entry
0709 13:05:39.285343 (+365504us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:39.328241 (+ 42898us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.954733 (+626492us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:40.054744 (+100011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.054846 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.070606 (+ 15760us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b180046a2c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f
0709 13:05:40.124524 (+ 53918us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b180046a2c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e95e158f 00007f36e2620571 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd
0709 13:05:40.132312 (+  7788us) raft_consensus.cc:1685] finished
0709 13:05:40.132334 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.132459 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48582,"prepare.queue_time_us":44372,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":75499,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9669,"spinlock_wait_cycles":55728896,"thread_start_us":1046067,"threads_started":2,"wal-append.queue_time_us":630675}
I20260709 13:05:40.322743 15197 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:40.307802 15193 rpcz_store.cc:276] 0709 13:05:38.097664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.711291 (+613627us) service_pool.cc:224] Handling call
0709 13:05:38.711641 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.859214 (+147573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.859265 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.873057 (+ 13792us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.278855 (+405798us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b1800354d00. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:05:39.992032 (+713177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:39.992081 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.992172 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.306389 (+314217us) raft_consensus.cc:1685] finished
0709 13:05:40.306471 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.306956 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154691,"raft.queue_time_us":157244,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":17393,"spinlock_wait_cycles":16662912,"thread_start_us":712990,"threads_started":1,"wal-append.queue_time_us":1314167}
I20260709 13:05:40.308943 15191 rpcz_store.cc:276] 0709 13:05:38.472229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.966607 (+494378us) service_pool.cc:224] Handling call
0709 13:05:38.974084 (+  7477us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:38.974778 (+   694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.974828 (+    50us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:38.976169 (+  1341us) log.cc:844] Serialized 78 byte log entry
0709 13:05:39.441946 (+465777us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:40.129123 (+687177us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.129515 (+   392us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.129715 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.129820 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.144745 (+ 14925us) raft_consensus.cc:1685] finished
0709 13:05:40.144764 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.144914 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":686793,"prepare.queue_time_us":696647,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":26641,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":242,"thread_start_us":397675,"threads_started":1,"wal-append.queue_time_us":501573}
I20260709 13:05:40.327988 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 385) took 1035 ms. Trace:
I20260709 13:05:40.329727 15197 rpcz_store.cc:276] 0709 13:05:39.293098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.322038 (+1028940us) service_pool.cc:224] Handling call
0709 13:05:40.322450 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.327666 (+  5216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.327903 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.328960 15190 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:40.332717 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.118641 15263 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:40.339623 15264 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
W20260709 13:05:40.340570 15267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.017s
W20260709 13:05:40.346443 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.346695 15267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.007s	sys 0.017s
I20260709 13:05:40.348011 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:40.350148 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.350706 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.351660 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.351725 15267 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:40.353214 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:40.353345 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.354060 15267 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:40.138152 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2624) took 1234 ms. Trace:
I20260709 13:05:40.331797 15188 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:40.201764 15340 raft_consensus.cc:2368] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:40.359539 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2626) took 1455 ms. Trace:
I20260709 13:05:40.386358 15269 rpcz_store.cc:276] 0709 13:05:38.904460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.273845 (+369385us) service_pool.cc:224] Handling call
0709 13:05:39.274159 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.274348 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.274370 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.274786 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.504092 (+229306us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:39.521700 (+ 17608us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.521901 (+   201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.521987 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.358937 (+836950us) raft_consensus.cc:1685] finished
0709 13:05:40.358996 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.359329 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19309,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":18848,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11648,"thread_start_us":223987,"threads_started":1,"wal-append.queue_time_us":454009}
I20260709 13:05:40.389490 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:40.390314 15269 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:40.384966 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.372020 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 178151us
I20260709 13:05:40.392880 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:40.393734 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:40.359965 15270 rpcz_store.cc:276] 0709 13:05:38.903887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.259279 (+355392us) service_pool.cc:224] Handling call
0709 13:05:39.259649 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.285618 (+ 25969us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:39.285650 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.315085 (+ 29435us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.891234 (+576149us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:39.891302 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.891404 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.137952 (+246548us) raft_consensus.cc:1685] finished
0709 13:05:40.137972 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.138097 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19388,"raft.queue_time_us":20308,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4144,"thread_start_us":550436,"threads_started":1,"wal-append.queue_time_us":728996}
I20260709 13:05:40.397513 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:40.398404 15270 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:40.384984 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.400072 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.401840 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.403342 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.404816 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:40.406709 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:40.317705 15196 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:40.411571 15196 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:40.418453 15188 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:40.213112 20045 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.422451 20045 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.423614 20045 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.424357 20045 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.427143 20045 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.355007 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.429458 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.201164 20266 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:40.205731 20412 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:40.431814 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.435251 20450 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:40.440119 20468 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:40.440685 20511 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.960s	user 0.003s	sys 0.007s
I20260709 13:05:40.220148 20536 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.227375 20660 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.442353 20593 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.444205 20598 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:40.441586 20428 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:40.446314 20087 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.508445 20266 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.508911 20087 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.510041 20603 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.447278 20591 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:40.511507 20591 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.512079 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 387) took 1057 ms. Trace:
I20260709 13:05:40.513300 20598 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.514506 20591 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.450047 15270 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:40.515884 20598 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:40.515884 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.520159 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.520893 15270 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:40.521399 15270 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:40.522332 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.523813 20536 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.527272 20593 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.527894 15188 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:40.530126 20593 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.493992 20511 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.533252 20511 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.533932 20468 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.534245 15266 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:40.534688 20468 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.535202 20702 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:40.535444 20660 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:40.535741 20702 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:40.536290 20713 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:40.537026 20468 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:40.537232 20702 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.538009 20713 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:40.538487 20713 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:40.480639 15267 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:40.476265 15264 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:40.494669 15269 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:40.501148 20451 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:40.501417 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2907) took 1227 ms. Trace:
I20260709 13:05:40.504465 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:40.508104 15196 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:40.540019 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.530918 20087 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.538669 20428 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:40.543591 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:40.544312 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:40.512629 15197 rpcz_store.cc:276] 0709 13:05:39.454291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.344363 (+890072us) service_pool.cc:224] Handling call
0709 13:05:40.412009 (+ 67646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.412238 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.412265 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.412327 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:40.412361 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.412418 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.511820 (+ 99402us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b5400226ad0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:40.511971 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154442496}
W20260709 13:05:40.492614 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 83216.2us
I20260709 13:05:40.543231 15271 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:40.546499 15192 rpcz_store.cc:276] 0709 13:05:39.273544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.041700 (+768156us) service_pool.cc:224] Handling call
0709 13:05:40.042022 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.053373 (+ 11351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.053410 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.053455 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:40.053491 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.500898 (+447407us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b54002116d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:40.500980 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.501236 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25610112}
I20260709 13:05:40.554026 15267 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:40.559100 15190 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:40.539000 20702 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:40.566867 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.568039 15267 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:40.570869 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.579174 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.578820 20593 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:40.583832 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 440106us
W20260709 13:05:40.584172 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 51892.6us
I20260709 13:05:40.584342 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.585300 15267 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:40.586834 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.587229 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2911) took 1270 ms. Trace:
I20260709 13:05:40.588634 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.574131 20598 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:05:40.589761 15267 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:40.584277 20593 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.593152 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:40.594244 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.595182 15263 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:40.597054 20451 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:40.597612 20451 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.522769 20433 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.599045 20433 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:40.599506 20428 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.601900 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.602557 15270 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:40.603668 20661 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:40.604144 20661 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.604497 20661 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:40.605113 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:40.605962 15269 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:40.608219 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:40.609076 15868 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:40.587919 15189 rpcz_store.cc:276] 0709 13:05:39.274417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.136746 (+862329us) service_pool.cc:224] Handling call
0709 13:05:40.541958 (+405212us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:05:40.542363 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.542784 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.542831 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.542903 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:40.542953 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.544417 (+  1464us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.544731 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391884672}
I20260709 13:05:40.611747 15269 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:40.570650 20592 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:40.617713 20555 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.685s	user 0.006s	sys 0.011s
W20260709 13:05:40.618795 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.619424 20432 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:40.621852 20666 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.619561 20592 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.623128 15264 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:40.616223 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:40.629011 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.631734 20649 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.072s	user 0.014s	sys 0.000s
I20260709 13:05:40.633715 20713 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.635667 15190 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:40.638840 15194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.002s	sys 0.015s
W20260709 13:05:40.646307 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 164519us
I20260709 13:05:40.647585 20649 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.648247 20649 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.650439 20649 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.651296 20438 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:40.651921 20713 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:40.629945 20593 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:40.659267 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 115886us
I20260709 13:05:40.660303 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:40.661934 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:40.662572 20591 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:40.663362 20591 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:40.664853 20591 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.667522 20758 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:40.668179 20758 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.668423 15265 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:40.668674 20758 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:40.670388 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 77559.4us
I20260709 13:05:40.671298 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:40.672642 20665 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.672782 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:40.673512 20665 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.674415 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:40.675318 20592 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:40.675945 20672 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:05:40.677273 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.678879 15263 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
W20260709 13:05:40.680265 15194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.003s	sys 0.015s
W20260709 13:05:40.681258 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 704481us
I20260709 13:05:40.683249 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:40.684105 20649 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:40.685695 20437 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:40.686131 20437 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.686506 20437 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.691641 15269 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:40.695822 20666 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.697443 20665 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.699275 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:40.704696 15265 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:05:40.706717 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:40.707516 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2600) took 1959 ms. Trace:
I20260709 13:05:40.708957 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:40.707929 15272 rpcz_store.cc:276] 0709 13:05:38.748193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.016650 (+268457us) service_pool.cc:224] Handling call
0709 13:05:39.036674 (+ 20024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.328963 (+292289us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:39.566023 (+237060us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.652661 (+1086638us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.669447 (+ 16786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.669510 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:40.669620 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.707170 (+ 37550us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54001b4254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:40.707213 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.707367 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19598,"prepare.queue_time_us":74030,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":119,"raft.queue_time_us":154378,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"spinlock_wait_cycles":671739264,"thread_start_us":1133092,"threads_started":3,"wal-append.queue_time_us":649757}
I20260709 13:05:40.709887 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 66) took 5528 ms. Trace:
I20260709 13:05:39.329361 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:40.711117 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2630) took 1673 ms. Trace:
I20260709 13:05:40.711556 15268 rpcz_store.cc:276] 0709 13:05:38.905877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.289148 (+383271us) service_pool.cc:224] Handling call
0709 13:05:39.289421 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.991448 (+702027us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.991492 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.048768 (+ 57276us) log.cc:844] Serialized 26 byte log entry
0709 13:05:40.498163 (+449395us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:40.547190 (+ 49027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.561507 (+ 14317us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.566172 (+  4665us) raft_consensus.cc:1685] finished
0709 13:05:40.566227 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.579578 (+ 13351us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25401,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8063,"thread_start_us":1114725,"threads_started":2,"wal-append.queue_time_us":412894}
I20260709 13:05:40.715585 20555 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.716178 20555 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.718317 20555 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.719300 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:40.721473 15237 leader_election.cc:400] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:40.721818 15237 leader_election.cc:403] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:05:40.722467 20771 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:05:40.724152 15263 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:40.725030 20759 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:40.725553 20759 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:40.727608 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:40.728998 20536 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:40.729429 20536 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.729848 20536 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:40.733475 20659 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.001s
I20260709 13:05:40.735193 20555 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:40.722684 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:40.740574 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:40.741911 20438 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:40.742398 20438 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.742769 20438 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:40.745353 20432 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:40.746129 20432 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:40.747160 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 72837.4us
I20260709 13:05:40.730939 15271 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:40.754833 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:40.754441 15268 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:40.760761 15341 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:40.761754 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.763530 18938 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:40.766388 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:40.710392 15093 rpcz_store.cc:276] 0709 13:05:35.181429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.190052 (+  8623us) service_pool.cc:224] Handling call
0709 13:05:40.709607 (+5519555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:36.983554 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:37.027779 (+ 44225us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:37.027833 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:05:37.027860 (+    27us) tablet.cc:662] Decoding operations
0709 13:05:37.028629 (+   769us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:37.028710 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:37.028750 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:37.029243 (+   493us) tablet.cc:701] Row locks acquired
0709 13:05:37.029255 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:05:37.029420 (+   165us) write_op.cc:270] Start()
0709 13:05:37.029558 (+   138us) write_op.cc:276] Timestamp: P: 1783602337029360 usec, L: 0
0709 13:05:37.029588 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:05:37.030418 (+   830us) log.cc:844] Serialized 1673 byte log entry
0709 13:05:37.848489 (+818071us) op_driver.cc:464] REPLICATION: finished
0709 13:05:37.978591 (+130102us) write_op.cc:301] APPLY: starting
0709 13:05:37.985279 (+  6688us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:38.493322 (+508043us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:38.516221 (+ 22899us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:38.694553 (+178332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:38.694851 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:05:38.694919 (+    68us) write_op.cc:312] APPLY: finished
0709 13:05:38.783695 (+ 88776us) log.cc:844] Serialized 48 byte log entry
0709 13:05:38.808960 (+ 25265us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:38.820645 (+ 11685us) write_op.cc:454] Released schema lock
0709 13:05:38.823351 (+  2706us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:38.946469 (+123118us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:38.949965 (+  3496us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":107732,"apply.run_cpu_time_us":19970,"apply.run_wall_time_us":933606,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":229398,"prepare.run_cpu_time_us":67912,"prepare.run_wall_time_us":359286,"raft.queue_time_us":143341,"raft.run_cpu_time_us":8272,"raft.run_wall_time_us":67714,"replication_time_us":818677,"thread_start_us":611991,"threads_started":4,"wal-append.queue_time_us":347790,"wal-append.run_cpu_time_us":46321,"wal-append.run_wall_time_us":2612520}]]}
I20260709 13:05:40.767174 15263 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:40.791811 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:40.752696 20412 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.756870 20536 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.817658 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2920) took 1052 ms. Trace:
I20260709 13:05:40.820411 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:40.726883 20759 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.818300 15188 rpcz_store.cc:276] 0709 13:05:39.765096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.528670 (+763574us) service_pool.cc:224] Handling call
0709 13:05:40.529059 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.529469 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:40.574774 (+ 45305us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.817148 (+242374us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.817213 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:40.817276 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.817446 (+   170us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.817590 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16363,"prepare.queue_time_us":45767,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"thread_start_us":170116,"threads_started":1}
I20260709 13:05:40.826596 15868 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:40.808596 20665 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.820336 20555 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.827909 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 144784us
I20260709 13:05:40.830200 20428 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:40.831125 15309 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:40.808156 20661 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.839906 20384 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.836814 20603 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.840265 20428 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:40.854401 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2904) took 1581 ms. Trace:
I20260709 13:05:40.856792 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2905) took 1583 ms. Trace:
I20260709 13:05:40.856185 15194 rpcz_store.cc:276] 0709 13:05:39.272833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.364327 (+ 91494us) service_pool.cc:224] Handling call
0709 13:05:39.364725 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:39.746024 (+381299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.746069 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:39.946345 (+200276us) spinlock_profiling.cc:243] Waited 37 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:39.946945 (+   600us) log.cc:844] Serialized 52 byte log entry
0709 13:05:40.721439 (+774494us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:40.743296 (+ 21857us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:40.743344 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.743456 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.850141 (+106685us) raft_consensus.cc:1685] finished
0709 13:05:40.850162 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.854338 (+  4176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11142,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3112,"spinlock_wait_cycles":118616832,"thread_start_us":1114080,"threads_started":2,"wal-append.queue_time_us":598799}
I20260709 13:05:40.857616 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.858098 20603 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.858670 15337 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:40.848996 20759 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:40.868168 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 46870.6us
W20260709 13:05:40.876331 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.867578 20665 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.878919 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:40.879734 20665 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.880247 18938 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:40.880426 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.882030 20604 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:40.883384 20429 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.884171 20429 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.889686 15197 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:40.892444 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.857396 15195 rpcz_store.cc:276] 0709 13:05:39.273095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.779470 (+506375us) service_pool.cc:224] Handling call
0709 13:05:39.779761 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.789039 (+  9278us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:40.127877 (+338838us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.629777 (+501900us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b1800494440. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a
0709 13:05:40.659730 (+ 29953us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.659994 (+   264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:40.660080 (+    86us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:40.660228 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.855445 (+195217us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b54002364d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:40.855498 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.856620 (+  1122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":357820,"prepare.queue_time_us":341039,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":95,"raft.queue_time_us":21665,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":211,"spinlock_wait_cycles":23644288,"thread_start_us":360598,"threads_started":1,"wal-append.queue_time_us":357333}
I20260709 13:05:40.895951 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.845463 20437 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:40.861119 20603 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.900839 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:40.932030 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61512us
I20260709 13:05:40.886754 20429 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:40.894354 20758 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.903229 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.855405 20555 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.903829 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.909230 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 2922) took 1143 ms. Trace:
I20260709 13:05:40.856722 20384 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:40.911845 20787 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:05:40.913530 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:40.915480 20569 consensus_meta.cc:287] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.009s
I20260709 13:05:40.919957 15267 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:40.920630 20437 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:40.921286 15339 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:40.922290 20087 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:40.922461 20432 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:40.923697 20672 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.923568 20593 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:40.924103 20666 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:40.929240 20702 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:40.930150 20600 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:40.930946 20749 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.938409 15162 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:40.939754 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.943485 20708 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.943859 20438 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.945695 20451 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:40.947564 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.947319 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.949196 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.930966 20785 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:05:40.951627 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:40.952584 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:40.953171 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:40.955466 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:40.958335 15338 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:40.933463 20649 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:40.965027 18938 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:40.967952 15196 rpcz_store.cc:276] 0709 13:05:39.765526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.549724 (+784198us) service_pool.cc:224] Handling call
0709 13:05:40.567341 (+ 17617us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:40.610071 (+ 42730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.610113 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:40.610901 (+   788us) log.cc:844] Serialized 52 byte log entry
0709 13:05:40.791622 (+180721us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:40.802735 (+ 11113us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.803107 (+   372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.806166 (+  3059us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.884153 (+ 77987us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180041f440. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:40.893611 (+  9458us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b180041f440. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620522 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:40.909007 (+ 15396us) raft_consensus.cc:1685] finished
0709 13:05:40.909032 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.909176 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7457,"prepare.queue_time_us":10826,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":48337,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":2696,"spinlock_wait_cycles":24971904,"thread_start_us":180165,"threads_started":1,"wal-append.queue_time_us":267455}
I20260709 13:05:40.918803 20536 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.975456 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2644) took 1194 ms. Trace:
I20260709 13:05:41.000732 15267 rpcz_store.cc:276] 0709 13:05:39.781316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.919356 (+1138040us) service_pool.cc:224] Handling call
0709 13:05:40.919771 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.974882 (+ 55111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.975352 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:40.976459 15868 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:40.979274 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:41.002856 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 70128.5us
I20260709 13:05:41.003090 15341 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:05:40.979758 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.967468 20764 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:41.004537 20451 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.004933 20764 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:40.987807 20087 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.005511 20764 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:41.005865 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.006455 15264 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.007328 20087 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.007787 20555 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.987462 20603 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:41.011157 20672 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.013489 20438 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.014376 15190 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:41.014559 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:40.992998 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.994554 20749 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.995767 20384 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:40.995544 20666 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:40.996269 20591 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:41.033032 15197 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:40.996167 20623 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:05:40.996810 20708 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.019831 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.036820 15267 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:41.020769 15094 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 5 to 9, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 9 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.021560 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:41.004760 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.022675 15196 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:40.989845 20412 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:41.023687 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 110263us
W20260709 13:05:41.023844 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 85585us
I20260709 13:05:40.982885 15337 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:41.027719 15272 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:41.029047 15344 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.003239 20432 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:41.036854 15195 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:41.042959 20661 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.013499 20672 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:40.978140 20428 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.035734 20451 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:41.048234 15265 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:41.047211 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.049192 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:41.051636 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.032478 20758 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.032518 20591 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:41.059909 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.060724 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:41.065130 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.033362 20438 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:05:41.071482 20591 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.072113 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:41.073518 20755 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:41.074476 20666 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.052451 20759 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.060742 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:41.079535 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.077742 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:41.080636 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.083218 15269 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:41.076781 20555 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:41.083472 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62001us
I20260709 13:05:41.083877 15195 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:41.061605 20672 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:41.087678 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.089514 15263 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:41.088521 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.087990 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.091523 15871 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:41.091694 20555 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.077095 20702 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:41.077941 20758 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:41.102021 15197 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:41.104136 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 46030.8us
I20260709 13:05:41.106560 15267 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:41.108294 20663 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.111404 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.108847 20663 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.095275 20708 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.085865 20759 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.112283 20432 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:41.102420 20758 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:41.132352 15312 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:41.115607 20591 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.103598 20412 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:41.143563 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77812.8us
I20260709 13:05:41.116155 20702 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:41.142946 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:41.119210 20087 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:41.150843 15263 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:41.102689 20623 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:05:41.117115 20749 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.112540 20451 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:05:41.157164 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:41.127632 20432 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:41.129312 20758 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:41.168570 15270 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:05:41.168883 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.172921 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.173290 15263 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:41.169406 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.164387 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:41.166252 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:41.172205 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.169955 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.175768 15338 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:41.173071 15270 pending_rounds.cc:85] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 8
I20260709 13:05:41.128613 20666 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:05:41.179108 15340 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:41.128439 20384 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:05:41.157874 20592 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:41.162031 20429 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:41.190654 20429 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.191200 20429 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:41.191279 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:41.177333 15270 pending_rounds.cc:107] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:05:41.145659 20661 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:05:41.195283 15270 raft_consensus.cc:2889] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.195627 20661 consensus_queue.cc:1243] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:41.196195 20661 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:41.196489 20661 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:41.197124 20663 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.197417 20661 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:41.198511 20796 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:05:41.189823 15339 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:41.199892 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.201040 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.200433 20702 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.201609 15339 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:41.179551 20749 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:41.177402 20593 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.202859 20749 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:41.202915 20593 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.203999 20749 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.202194 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.205122 20593 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:41.205684 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.195302 20412 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:41.206789 20412 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:41.207609 20412 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.171720 20600 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.179284 20428 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:41.212438 20428 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.212967 20428 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:41.198845 20661 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:41.222361 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.145325 20266 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:05:41.225311 20659 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:41.225761 20659 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:41.226589 20759 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.227638 15337 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:41.226756 20659 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.229876 20659 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:41.232707 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61371.1us
I20260709 13:05:41.233680 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:41.164245 20764 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.190534 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.174028 20432 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.183245 15269 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:41.238793 15265 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:41.246425 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2648) took 1454 ms. Trace:
I20260709 13:05:41.247002 15270 rpcz_store.cc:276] 0709 13:05:39.792263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.664986 (+872723us) service_pool.cc:224] Handling call
0709 13:05:40.665354 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.196002 (+530648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.246092 (+ 50090us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54001d9cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:41.246343 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1122297216}
W20260709 13:05:41.248868 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.250867 15197 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:41.253512 15344 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:41.251686 15094 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:41.256134 15094 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:41.276961 20592 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:41.277601 20616 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:41.280009 20701 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:41.284878 15264 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:41.289229 15191 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:41.277645 20592 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.297554 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.298465 15337 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:41.278923 20616 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:05:41.302919 15268 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:41.309592 15271 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:41.312395 15265 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:41.290493 20785 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:41.319780 15266 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:41.326784 20087 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:41.327587 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.340312 15267 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:41.329118 20703 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:41.331956 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.334211 20713 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:41.337466 20729 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.298303 20384 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:41.353060 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.348783 15264 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:41.358759 15194 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:41.367911 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.368439 15270 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:41.351769 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.313540 20604 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:41.374154 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.342638 20703 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:41.381908 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.359282 20384 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:41.395581 18938 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.396054 18938 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.398167 18938 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.397595 20703 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.367614 20785 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:41.400096 20785 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.375950 20412 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:41.402197 20412 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.403481 20746 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:41.404036 20746 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.404371 20412 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.405653 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:41.406046 20746 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.407871 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.408702 15265 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 15: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:41.409498 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.371481 20729 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.412918 20729 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.415582 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.416549 15267 raft_consensus.cc:2410] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:05:41.379578 20623 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.419494 20623 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.421823 20623 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.428107 15195 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:41.425789 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.430992 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.429005 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.431546 15196 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.436082 15338 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:41.439967 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.440595 15270 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:41.440079 15265 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
W20260709 13:05:41.447589 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54507.5us
W20260709 13:05:41.447978 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.451049 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:41.451474 20801 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:05:41.452399 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:41.453109 20802 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:05:41.453970 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.454319 20703 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:41.454982 20805 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:41.455250 20666 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.457254 15192 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:05:41.458231 15162 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.458563 20384 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.459638 20666 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:41.460036 15272 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:41.462211 15272 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:05:41.465270 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.469385 20592 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.387991 20555 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:41.471371 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.447454 20604 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.472679 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.452181 20429 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.470631 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.478202 15341 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:41.478317 18938 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.478912 18938 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.479398 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.453161 15189 raft_consensus.cc:2368] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:41.474936 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.437485 20755 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.483829 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.481360 15267 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:05:41.489741 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.445569 20764 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.497902 15195 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:41.466591 20428 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.498603 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.501560 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.504277 18938 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.505817 15346 raft_consensus.cc:2368] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:41.505541 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.507997 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.505498 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.516964 15337 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:41.517531 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.481124 20087 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.485555 20755 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.522115 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.523793 15270 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:41.525339 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.505072 20749 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:41.502303 20661 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.532176 20661 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.532613 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.532366 20808 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260709 13:05:41.519558 20603 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:05:41.542150 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.516597 20438 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:41.546005 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.546669 15267 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:41.548067 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.498826 20591 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:05:41.544657 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.549841 15270 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:41.554414 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.554805 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:41.557073 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.557950 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.560624 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.561801 15338 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:41.550246 20603 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:41.574038 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.575592 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.554703 20555 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.578297 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.583302 15191 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:41.558931 20604 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.540696 20087 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.587682 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.596278 20592 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.596644 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.597676 20591 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:05:41.569729 20598 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:41.611312 15194 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:41.611841 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.607422 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:41.609615 15189 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:41.560179 20708 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:05:41.625784 15195 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:05:41.627497 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.628289 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.631882 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.611009 20604 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:41.643363 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:41.644855 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.628618 20598 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:41.649029 15189 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:41.670879 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:41.675285 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67914.6us
I20260709 13:05:41.679224 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:41.679937 15868 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:41.621296 20555 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.661301 20429 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.693994 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.697044 15340 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:05:41.691182 15196 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:05:41.701256 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.701653 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.703217 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:41.700090 15340 pending_rounds.cc:85] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 9
I20260709 13:05:41.705190 15340 pending_rounds.cc:107] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:05:41.705547 15340 raft_consensus.cc:2889] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.669564 20598 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:41.701073 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.699468 15343 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:41.716777 20705 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:41.717172 20705 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:41.718137 20811 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:05:41.720062 20814 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:05:41.659354 20604 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.723134 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.697772 20428 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.737732 20432 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.739164 20592 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:05:41.739871 20758 consensus_meta.cc:287] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.007s
I20260709 13:05:41.740091 20598 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.679226 20807 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.179s
I20260709 13:05:41.742471 15197 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:41.738786 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.713088 20593 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:41.722467 20661 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.729079 20536 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.756455 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:41.758050 20815 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:41.758443 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.718163 20705 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.759567 20604 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:41.759938 20829 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:41.760661 20087 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:41.762444 20810 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:05:41.788738 20755 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.768208 20828 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:41.769483 20569 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:05:41.789894 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 317260us
I20260709 13:05:41.790118 20569 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:41.790927 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:41.791708 15337 raft_consensus.cc:2368] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:41.780197 20536 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.794727 20536 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:41.795135 20705 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.795385 20569 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.796837 20569 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:41.769758 20803 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.418s	user 0.003s	sys 0.001s
I20260709 13:05:41.770289 20672 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:41.754863 20758 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.769748 20666 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:41.762830 20749 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:41.772178 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.802404 20758 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.772591 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.804440 20432 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:41.774871 15340 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:41.807363 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:41.807695 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.808869 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.809916 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.751204 20593 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.811163 20593 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:41.813030 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.813230 20832 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.813799 20832 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.814278 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.781556 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:41.771384 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:41.785156 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.800455 20672 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:41.815008 15345 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:41.788448 20555 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:41.822149 15338 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:41.825445 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.829027 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:41.829922 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:41.839356 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.840626 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.841667 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.842649 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.839337 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:41.850428 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.827855 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56573.7us
I20260709 13:05:41.851377 15871 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
W20260709 13:05:41.851662 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.852837 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:41.852159 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.845827 15345 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:05:41.857901 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:41.858682 15338 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:41.824569 20829 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:41.859614 20829 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.859982 20829 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:41.863384 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:41.868093 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.855643 20432 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:41.870647 20432 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:41.871337 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.872468 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:41.873003 20432 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.873598 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.874176 15345 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:41.875260 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.875831 15338 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:05:41.877785 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:41.877856 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.873039 20592 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:41.884586 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.885954 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:41.887763 15868 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:41.861696 20087 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:41.895871 20672 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.897152 20672 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.897369 20832 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.879914 20713 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.899441 20758 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:41.899379 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.900081 20758 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:41.900950 20758 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:41.903944 20087 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:41.904907 20087 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:41.879954 20666 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:41.909849 20666 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.910255 20666 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:41.913188 20755 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:41.910737 15337 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:41.928063 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.928718 15268 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:41.934310 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:41.935168 15337 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:41.937212 15338 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:41.940490 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.941115 15271 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:41.941977 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.952831 15263 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:41.955399 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.956017 15266 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:41.956179 20384 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:41.956516 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.935994 20701 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.958877 15271 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:41.959267 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.959795 15272 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:41.960740 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.961284 15268 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:41.961848 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.958763 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:41.975390 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:41.978210 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.966456 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:41.995553 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:42.001428 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:42.002302 15189 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:42.004776 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:41.999747 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.004492 20759 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:42.011317 15190 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:42.005777 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:41.964434 20536 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:41.963323 20758 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.011564 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:41.976969 20438 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.970497 20713 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.007791 20592 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:42.017040 20592 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.017406 20592 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.001668 20703 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:05:42.020566 20758 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.020784 20438 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.024112 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:42.024758 15344 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:42.025210 20807 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:42.025825 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.027053 20438 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.027433 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.028218 20412 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:42.028714 20603 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:42.028824 20412 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:42.029485 20603 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:42.029863 20603 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:42.030269 20603 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:42.029950 20412 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.034693 20807 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:42.037643 20758 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.020733 20663 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:41.973186 20829 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:42.040181 20729 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:42.040596 20729 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:42.040660 20829 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.040827 20432 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.042727 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:42.043572 15344 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
W20260709 13:05:42.043464 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109243us
I20260709 13:05:42.044575 15871 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:42.038349 20593 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:42.014729 20837 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 13:05:42.048493 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.052685 20703 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.053227 20663 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:42.053390 15197 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:42.053689 20663 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.054108 20663 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.055198 20659 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:42.055590 20659 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:42.056401 20659 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.049386 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.011068 20759 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:41.966742 20599 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:05:42.062422 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.060880 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:42.067878 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.068035 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.068732 15344 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:42.048085 20831 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:41.976564 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:42.043016 20432 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:41.997741 20701 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.074561 15188 raft_consensus.cc:606] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.075497 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.088383 15265 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:42.076771 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:42.089308 15188 raft_consensus.cc:614] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:42.131660 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.132028 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.115006 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.133806 15265 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.134953 15272 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:42.065466 20759 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:42.070855 20659 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:42.153210 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.050513 20746 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:05:42.075591 20818 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:42.137902 20764 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:05:42.137789 20713 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:42.136879 20702 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.158545 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:42.159263 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:42.159381 20701 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:42.117762 20817 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
I20260709 13:05:42.163182 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:42.181185 15190 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:42.169970 15195 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.074167 20705 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.120618 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75704.7us
I20260709 13:05:42.202368 15238 leader_election.cc:400] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12.
I20260709 13:05:42.112686 20825 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:42.201028 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:42.167011 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.073987 20831 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:42.203120 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:42.215349 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48416.8us
I20260709 13:05:42.218214 15272 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:42.215233 15189 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:42.118800 20437 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:05:42.165321 20713 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.162986 20703 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.224608 15265 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:42.227697 15264 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:42.169821 20749 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:42.199865 20818 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:42.235940 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 122512us
W20260709 13:05:42.221463 20827 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:42.237478 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.240685 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.112174 20835 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.284s
I20260709 13:05:42.168490 20603 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.167707 20702 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.167415 20592 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.211764 20604 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:42.222106 20807 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:42.233431 20713 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:42.212749 20705 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.219997 20701 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:05:42.259120 15190 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:42.245440 20598 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:42.260412 20604 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.234838 20432 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:05:42.251731 15268 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:42.267424 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:42.272778 15190 raft_consensus.cc:606] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.273136 15190 raft_consensus.cc:614] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:42.267530 20705 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.239152 20666 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.238292 20749 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.259001 20818 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:42.262262 20807 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:42.287109 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63282.6us
W20260709 13:05:42.308284 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.315754 20818 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.263509 20831 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.320320 20831 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.324429 20666 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.314988 15195 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:42.325472 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.326299 20592 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.327333 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.327886 20603 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.328044 15268 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.329602 20604 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.331332 20749 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.275781 20598 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:42.344868 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.345769 15269 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:42.357820 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 120112us
I20260709 13:05:42.366607 15268 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:05:42.369544 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.371112 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.372949 18938 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:42.373484 18938 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.373908 18938 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:42.373725 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:42.381311 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.367354 20433 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:05:42.391636 15345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:05:42.384473 20701 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:42.391705 20857 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:42.392328 20701 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:42.392911 20701 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.394333 20663 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.396770 20663 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.397480 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.398065 15269 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.400672 18938 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.402442 18938 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.408942 20808 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:42.409425 20808 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:42.410919 20701 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.417385 20701 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.418478 20824 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:42.423393 20824 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:42.423401 20433 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:42.383996 20807 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.392369 15345 raft_consensus.cc:606] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.420961 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.422060 15269 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:05:42.388782 20702 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.424633 20856 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:05:42.429869 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet b1d89f71244148538087b141a709ec50: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:42.410331 20808 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.439833 20862 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:42.440120 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.440320 20862 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.441239 20862 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.441285 20713 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:42.444263 20860 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:42.444741 20860 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.445099 20860 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:42.380236 20598 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:42.441252 20808 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.447551 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:42.448201 15196 raft_consensus.cc:606] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.448537 15196 raft_consensus.cc:614] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:42.451924 20759 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.424377 20824 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.453677 20824 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.454078 20759 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.457459 15266 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:42.459241 15196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be765c8e55da41e98042904983ca70dd"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:42.459863 15196 raft_consensus.cc:606] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:42.459266 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 218676us
I20260709 13:05:42.461526 20412 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:42.461972 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.462229 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.463193 20412 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:42.463338 20729 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:42.464052 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.464852 20649 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:42.465674 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.466748 20604 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:42.467988 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.468633 15266 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:42.470396 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:42.463373 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.470934 15193 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:42.467924 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:42.471939 15190 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:05:42.472693 15196 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:42.465677 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.494905 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:42.495795 15196 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:42.502050 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:42.502825 20825 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:42.502835 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.506939 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:42.508574 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.509052 15189 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: [15.7-15.7]
I20260709 13:05:42.509878 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:42.510743 15194 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:42.486367 20746 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:42.519553 20713 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.525070 20862 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.517665 20825 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:42.464874 20729 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:42.529546 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:42.534044 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67454.1us
I20260709 13:05:42.535192 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.535809 15237 leader_election.cc:400] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:42.536291 15237 leader_election.cc:403] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:42.468556 20663 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.536860 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:42.538252 15195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:42.538981 15195 raft_consensus.cc:606] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.539443 15195 raft_consensus.cc:614] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:42.550598 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.515596 20759 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:42.559960 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.553128 20825 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:42.581590 15270 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:42.586247 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:42.556555 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.547051 20663 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.588230 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:42.593916 15868 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:05:42.591792 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.600021 15271 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:05:42.587100 20604 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:42.584934 20555 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:42.604051 20592 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:42.630620 20825 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:42.630810 20592 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.631721 20825 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:42.632097 20825 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:42.632877 20825 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:42.633580 20592 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.634052 20825 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:42.593971 20705 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.637355 20705 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.638926 20593 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:42.639571 20705 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.644615 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.645314 15264 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.654639 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.656173 20468 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:42.656502 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.603689 20862 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.607091 20857 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.656016 20764 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:42.614454 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.659925 15263 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:42.614776 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.660948 15267 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:42.661159 15343 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
W20260709 13:05:42.611434 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51220.4us
I20260709 13:05:42.623564 15193 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:42.623656 15196 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:05:42.627537 20821 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:42.590762 20759 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:42.629364 20860 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.668329 15264 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
W20260709 13:05:42.657910 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.615442 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.662326 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.606433 20663 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.663848 20857 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.670411 20850 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:42.670607 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.672461 20764 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:42.657217 20701 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:42.676331 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.676843 15343 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:42.677981 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.686127 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.687058 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.680454 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.688006 15340 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.689086 20857 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.689862 15342 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:05:42.690446 20854 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.292s	user 0.003s	sys 0.000s
W20260709 13:05:42.680492 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.681238 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:42.691306 15345 raft_consensus.cc:2368] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:05:42.682536 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:42.682662 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:42.685653 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:42.693568 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.693754 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.695151 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.695420 15870 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:42.697144 20623 raft_consensus.cc:993] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:42.692027 15346 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:42.697697 20623 raft_consensus.cc:1081] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:42.698269 20862 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:42.698518 20860 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:42.698899 20862 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:42.700024 20759 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.699831 20862 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.697428 20764 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.678946 20603 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:42.702430 15162 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.706739 20438 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.685794 20701 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.714587 15340 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:42.722976 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.724521 15160 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.724980 15265 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:42.725901 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:42.729163 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.731050 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.731639 15267 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:42.727267 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.737882 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.736240 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.741456 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.734596 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.748080 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.747695 15162 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.711256 20661 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:42.710971 20603 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:42.755275 15237 leader_election.cc:400] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:05:42.753590 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:42.758440 15237 leader_election.cc:403] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:05:42.717959 20701 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:42.757879 15162 leader_election.cc:400] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:42.735131 20759 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:42.751201 20854 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 13:05:42.742626 20821 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.761492 15162 leader_election.cc:403] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:42.743548 20831 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:42.747357 20598 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:42.747763 20729 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:42.765606 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.758790 15272 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:42.748991 20785 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.756417 20749 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:42.750663 20807 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:05:42.779326 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:42.755770 20850 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:42.778087 20555 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:05:42.771957 20808 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:05:42.802390 20592 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:42.755956 20661 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.805372 20661 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.806361 20604 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14.
I20260709 13:05:42.803287 20785 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:42.753199 20432 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:42.811249 20432 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.778733 20746 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:42.811677 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:42.812013 20746 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:42.812175 15263 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:42.811720 20432 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.813052 20746 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.756260 20438 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:42.765987 20825 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:42.792496 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:42.816385 20818 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:42.816793 20818 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.817118 20818 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:42.820323 20785 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:42.812345 15868 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
W20260709 13:05:42.821777 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56231.8us
I20260709 13:05:42.824294 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.826261 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.845387 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:42.847434 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67055.2us
I20260709 13:05:42.804436 15272 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45862
I20260709 13:05:42.859477 15272 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:42.859936 15272 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.803823 20759 raft_consensus.cc:2764] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:05:42.863617 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.865027 20432 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.866406 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.847293 20555 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:42.867861 20603 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:42.868150 20555 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.869804 20807 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:42.870146 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.871374 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:42.870272 20807 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:42.872175 20437 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:42.872581 20437 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.872946 20437 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.872774 20807 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.874226 20807 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:42.845532 20438 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:42.880757 20432 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:42.881163 20438 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.883260 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:42.822361 20729 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:42.888481 15272 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:05:42.925343 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 59169.5us
I20260709 13:05:42.929982 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.931823 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.932668 20437 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:42.935497 20437 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:42.932756 20598 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:42.936986 20598 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.944622 15340 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:42.946099 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:42.844907 20850 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:42.820222 20661 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:42.950137 15272 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:42.860903 20412 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.950754 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.955399 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:42.957141 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:42.961921 15340 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:42.961980 15342 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.960011 15870 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:42.962459 15340 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:42.962146 15868 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.943522 20759 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:42.949046 20825 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:42.970783 15340 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:42.980455 15340 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.948581 20555 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:42.960386 20603 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:43.041309 15340 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:43.013904 20824 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.050424 15272 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:43.022378 20880 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:43.024857 20831 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:43.021963 20412 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:43.054329 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 107328us
I20260709 13:05:43.047719 20882 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:43.026675 20729 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:43.073937 20882 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.068195 20880 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.056336 20824 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.046777 20850 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.063081 20881 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:05:43.072961 20087 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:05:43.072582 20412 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.093590 15342 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:43.080952 20882 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:43.109558 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:43.110910 15272 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:43.093950 20877 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:05:43.113619 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 354793us
I20260709 13:05:43.114989 20437 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.117923 15870 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:43.092419 20598 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.118817 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:43.122470 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:43.123224 15268 raft_consensus.cc:2410] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:05:43.081076 20878 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:05:43.126613 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:43.125510 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:43.135610 20713 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.136229 20569 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:43.134899 20598 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.142375 20598 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.137585 20087 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:43.118270 20884 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:43.126401 20876 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 13:05:43.085363 20880 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.162606 15191 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:43.163620 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.127315 20881 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:43.165616 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.170253 15193 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:43.133878 20661 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:43.149699 20884 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:43.176077 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.156349 20666 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.176666 15193 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:43.179656 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.187659 15191 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:43.126943 20437 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.162266 20087 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.123850 20831 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.189805 15868 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:43.158200 20432 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:05:43.182583 20891 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.197866 20849 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:43.198294 20849 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:43.173681 20818 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.189643 20749 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.187173 20666 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.199126 20849 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.210412 20849 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:43.215210 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:43.192821 20087 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.222563 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:43.201246 20891 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.225498 20433 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:43.226589 20649 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.215149 20824 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.229229 15196 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:43.228127 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:43.208192 20749 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.228780 20433 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:43.248157 20880 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.248059 20433 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.223987 20599 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:43.248672 20749 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.250197 20437 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:43.230918 20649 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:43.233704 20666 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.239152 20857 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.240497 20818 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:43.240566 15312 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:43.230159 20428 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:05:43.243628 20412 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.245292 20087 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.212929 20884 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:43.276707 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.224805 20850 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:43.285223 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44738.3us
I20260709 13:05:43.254395 20882 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:43.298847 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:43.293383 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.262981 20701 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.291854 20884 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:43.289215 20857 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:43.291421 20437 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.282413 20649 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.292155 20850 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:43.329628 20872 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.484s	user 0.004s	sys 0.000s
I20260709 13:05:43.334492 20850 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:43.335733 20882 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.336118 20701 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:43.338395 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:43.339244 20412 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:43.339852 20412 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:43.341027 20412 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:43.346264 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:43.339800 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:43.348773 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:43.358598 20592 raft_consensus.cc:993] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:43.359146 20649 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.359335 20824 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:43.360189 20824 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.360743 20824 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:43.318674 20437 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:43.347636 20593 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:43.374604 15340 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:43.374608 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.375645 15345 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:43.376114 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.376480 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.378197 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.380227 15341 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:05:43.383512 15343 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:43.366403 20857 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:43.386482 20857 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:43.380579 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.387745 20857 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:43.359225 20592 raft_consensus.cc:1081] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:05:43.364398 20729 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.394074 20729 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:43.395674 20703 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:43.396605 20661 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:43.396991 20661 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:43.397058 20729 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:43.397902 20661 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.398365 20807 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.398624 20666 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.399291 20569 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.415014 20666 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.419448 20666 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.415316 20569 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.420498 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:43.421072 15266 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:43.421996 20569 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.390878 20891 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.424369 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:43.426753 15191 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:43.427546 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.428103 15196 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:43.428288 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.430094 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.398994 20807 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.400614 20883 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.401460 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:43.401856 20437 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:43.371773 20593 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:43.458714 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.407769 20433 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.408931 15193 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:43.411921 15269 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:43.411986 15268 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:05:43.412508 20888 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.230s	user 0.001s	sys 0.001s
I20260709 13:05:43.460912 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:43.442426 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:43.461067 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.443981 15191 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:43.444834 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.461324 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.447798 15337 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:43.451540 15340 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:43.444082 15271 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:05:43.454180 15196 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:43.414431 20661 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:43.464107 15195 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:43.465510 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:43.466126 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.450508 15345 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:43.466174 15270 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:43.462874 15190 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:43.474702 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.474961 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.477023 15189 raft_consensus.cc:2368] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:43.480237 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.481595 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:43.482245 15265 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:43.484978 15267 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:43.489148 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:43.489925 15263 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:43.489959 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.490561 15189 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:43.487849 15839 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:43.498202 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.498965 15193 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:43.500470 20891 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.500985 20891 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.502197 15238 leader_election.cc:400] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:43.502620 15238 leader_election.cc:403] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:43.504521 15194 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:43.506356 15190 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:43.496798 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.507611 15343 raft_consensus.cc:2368] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:43.510636 15193 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:43.503470 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.517793 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:43.518642 15269 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:43.522182 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.523795 15345 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:43.524797 15192 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:43.475433 20666 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.539521 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.486722 20850 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.459360 20593 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.542280 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.542567 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:43.546080 15194 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:43.545419 15269 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:43.534709 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.549715 15193 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:43.473201 20764 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:05:43.551822 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.514535 20729 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:43.562062 15265 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:43.553359 15193 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:43.483518 20433 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.566784 15270 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:43.474009 20883 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.564932 15237 leader_election.cc:400] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:43.521515 20746 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:43.571085 15237 leader_election.cc:403] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:43.575863 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:43.576675 15870 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:43.577519 15270 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:43.578465 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:43.585398 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.587363 15196 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:43.589367 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:43.590200 15344 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:43.563712 20536 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:43.566615 20412 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:43.569595 20891 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:43.602644 15266 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:43.554313 20821 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:05:43.563697 20729 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.604192 20825 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.544976 20666 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:43.605458 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:43.553684 20850 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.579322 20857 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.579720 20603 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:43.612371 15270 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
W20260709 13:05:43.663061 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.685272 20451 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:43.572033 20604 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:05:43.768294 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:43.612802 20729 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:43.771715 15345 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:43.765347 15191 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:05:43.776854 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:43.779203 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.841807 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:43.697118 20451 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.863515 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:43.610013 20536 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.679167 20825 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:43.877408 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 111218us
W20260709 13:05:43.873296 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 106785us
I20260709 13:05:43.881435 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:43.697624 20857 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:43.931548 15269 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:43.853461 20649 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.861682 20451 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:43.861903 20412 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.964864 15265 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:43.959645 20764 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.959975 20904 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:05:43.870857 20807 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:43.960757 20909 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:05:43.891399 20603 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:05:43.963580 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:43.869953 20593 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.972083 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.029670 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:44.030344 15264 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:05:43.960610 20911 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:05:43.986506 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:43.949520 20821 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:44.035753 15339 consensus_meta.cc:287] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.611s	user 0.011s	sys 0.000s
I20260709 13:05:44.062037 15339 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:44.050906 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:44.066318 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:44.057766 15271 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be765c8e55da41e98042904983ca70dd"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:05:44.058470 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:44.073227 15263 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:44.076896 20908 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
W20260709 13:05:44.078725 20910 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:05:44.080797 20912 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:05:44.083767 20433 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:44.088896 15189 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.005s
I20260709 13:05:43.898280 20891 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
I20260709 13:05:44.076548 20428 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:44.063169 20593 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.105717 15189 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:44.151157 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:44.087430 20874 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:05:44.159373 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93145.7us
I20260709 13:05:44.206284 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:44.206981 15271 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:44.207423 15271 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:44.210382 15264 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:44.071996 20821 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:43.973914 20649 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.211511 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.216017 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.219976 15263 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:43.987432 20412 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.205302 20914 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:43.998391 20764 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:44.223834 20883 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.205248 20603 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.244361 15197 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:05:44.221274 20705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.063s	sys 0.111s
I20260709 13:05:44.218894 20821 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:44.246030 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 364655us
I20260709 13:05:44.224014 20468 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:44.248457 20705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.063s	sys 0.112s
I20260709 13:05:44.271185 15271 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:44.290342 15310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.034s
W20260709 13:05:44.291774 15310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.007s	sys 0.034s
I20260709 13:05:44.236518 20928 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:44.285811 20824 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.012s
I20260709 13:05:44.285451 20468 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.224255 20923 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 13:05:44.296687 20666 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:44.273452 20603 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:44.303586 20857 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:44.320327 20433 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.320829 20468 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:44.315155 20934 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:44.317235 20599 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:44.378042 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 157965us
I20260709 13:05:44.305404 20914 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:05:44.315491 20824 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.362715 20891 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.305205 20928 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:44.319466 20428 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:05:44.373553 20536 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.377802 20599 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.410648 20599 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:44.397430 20412 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.377389 20433 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.398952 20593 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.415498 20412 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.400195 20891 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:44.415982 20661 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.940s	user 0.013s	sys 0.011s
W20260709 13:05:44.454420 20937 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:05:44.455552 20433 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:44.437391 20920 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.220s	user 0.001s	sys 0.001s
I20260709 13:05:44.458956 20891 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:44.460117 20896 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 1.140s	user 0.018s	sys 0.028s
W20260709 13:05:44.460217 20919 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:44.465272 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3000) took 1037 ms. Trace:
I20260709 13:05:44.497159 15197 rpcz_store.cc:276] 0709 13:05:43.427657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.429811 (+  2154us) service_pool.cc:224] Handling call
0709 13:05:43.491785 (+ 61974us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:05:44.239969 (+748184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.244905 (+  4936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.465035 (+220130us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54000fa5d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:44.465202 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1728619520}
I20260709 13:05:44.467267 20412 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:44.468045 20764 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:44.470695 20922 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:44.472379 20824 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.476871 20604 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.478597 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2927) took 1023 ms. Trace:
I20260709 13:05:44.479830 20603 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:44.487597 20928 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.410722 20536 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.492862 15271 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.502439 15338 rpcz_store.cc:276] 0709 13:05:43.454886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.455072 (+   186us) service_pool.cc:224] Handling call
0709 13:05:43.483379 (+ 28307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.588503 (+105124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.588549 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:43.588603 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:43.588657 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.478369 (+889712us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54003df754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:44.478413 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.478537 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236283648}
I20260709 13:05:44.500025 20922 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:44.518097 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.520253 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.520929 15339 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:44.522883 15271 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:05:44.524883 15271 pending_rounds.cc:85] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 11
I20260709 13:05:44.525338 15271 pending_rounds.cc:107] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:05:44.526803 15271 raft_consensus.cc:2889] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:44.529412 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.530154 15271 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:44.530927 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.535676 20862 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.536363 20862 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:44.537635 20451 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.005s
I20260709 13:05:44.538051 20451 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:44.539289 20862 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:44.540259 20451 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:44.540110 20705 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.539901 20936 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:05:44.519160 20729 consensus_meta.cc:287] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.000s
I20260709 13:05:44.522471 20603 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.510046 20604 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.557147 20604 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.558086 20412 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:44.566183 20746 consensus_meta.cc:287] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.985s	user 0.006s	sys 0.006s
I20260709 13:05:44.566231 20818 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:44.549886 20729 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:44.574828 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:44.581044 20468 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.541184 20705 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.594264 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.525949 20943 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.517897 20536 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.595184 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:44.597955 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 219227us
I20260709 13:05:44.598716 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:44.600059 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.591926 20891 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.604265 15874 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:44.606989 15874 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:44.593909 20746 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16.
I20260709 13:05:44.597899 20764 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:44.602017 20849 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:44.590391 20603 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.605334 20604 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:44.605747 20939 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:44.623750 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:44.605391 20934 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:44.636246 20934 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.640693 20468 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:44.599290 20943 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.622463 20604 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.622727 20764 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:44.611179 20891 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.626783 20849 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:44.631232 20536 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.600426 20922 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.659006 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.660044 15268 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:44.638684 20821 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.664168 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.648087 20604 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:44.664930 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.667598 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:44.672803 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.661289 20945 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.674597 20945 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.661485 20882 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.675776 20947 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:44.676240 20882 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.676801 20945 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:44.677403 20945 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:44.677654 20891 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.677736 20945 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.678179 20945 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:44.678333 20882 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:44.679183 20942 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:44.679550 20943 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.679917 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.680549 15270 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:44.681383 20705 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:44.684856 20592 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.685952 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 198155us
I20260709 13:05:44.672724 20663 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.682442 20764 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.681384 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.711009 15270 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:44.664245 20931 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:44.663106 20087 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.715276 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.713797 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.716657 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:44.712531 15270 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:44.694041 15268 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:44.721066 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.721095 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.722124 20944 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:44.721271 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.722553 20944 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.723292 20944 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:44.723635 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.725069 15268 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:44.725991 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:44.726567 15268 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:44.724448 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.727398 15270 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:44.728334 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.731660 15270 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:44.732542 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:44.731336 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.710098 20592 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:44.799312 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55976.1us
I20260709 13:05:44.797345 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:44.796891 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.798998 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.808666 15191 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:44.809715 15189 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:44.796423 15188 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:44.791244 20883 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:05:44.812996 20883 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:44.813444 20883 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:44.818884 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:44.819267 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:44.711697 20891 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:44.822305 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91049.5us
I20260709 13:05:44.823114 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.824225 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.825438 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.826282 15342 raft_consensus.cc:2368] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:05:44.825557 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.826395 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.827363 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.714692 20884 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.827956 15339 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:44.795264 20882 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.740036 20808 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:44.796132 20949 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.845536 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:44.851683 15268 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:44.713668 20599 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.850911 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.846144 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.882243 15237 leader_election.cc:400] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:05:44.845829 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:44.882588 15237 leader_election.cc:403] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:44.883332 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.883687 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.866289 15195 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:44.866237 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.741593 20947 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:44.885823 15268 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:44.885896 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.834761 20705 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:44.791524 20936 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:44.842682 20536 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.873313 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.873494 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:44.874179 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.896873 15269 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:44.874364 15337 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:44.709987 20878 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 13:05:44.830364 20384 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:44.884384 15194 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:44.887001 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.914440 15189 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:44.882004 15188 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:44.868729 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:44.885964 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:44.917409 15195 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:44.736336 20087 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.887595 15268 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:44.782709 20944 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.884377 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:44.890012 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.820760 20649 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.890635 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:44.891649 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.814426 20883 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.831224 20891 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:44.894616 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:44.845592 20468 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.736343 20663 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.871953 20746 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:44.867933 20808 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.901805 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.898707 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:44.869310 20729 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:44.923671 15269 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:05:44.820976 20807 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:05:44.834331 20432 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:05:44.716869 20931 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.800854 20849 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.866976 20884 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.959501 15267 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:44.927542 20384 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.888233 20412 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:05:44.888947 20947 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:44.947096 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 129061us
I20260709 13:05:44.890395 20705 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:44.952569 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 58019.2us
I20260709 13:05:44.891180 20824 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:44.871134 20882 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.948252 20592 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:44.995460 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 126158us
I20260709 13:05:44.883603 20949 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.010113 15342 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:45.020300 20384 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.034170 20599 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.036345 20663 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.037114 20412 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.037710 20412 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.039690 20412 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.040323 15263 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:05:44.913308 20666 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:45.041949 15263 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:45.040386 20412 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.042906 20412 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.043648 20930 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.928323 20946 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.044327 20930 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.045374 20944 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.045437 15338 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:45.045136 20412 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.046499 20930 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.047137 20935 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.047672 20882 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:44.901863 20936 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.005435 20808 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:45.050292 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.043745 20087 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.052927 15191 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:05:44.957252 20649 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.024147 20705 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:45.088269 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:44.914283 20536 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.058063 15193 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:44.998040 20878 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.026557 20929 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:44.958772 20764 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:45.080554 15268 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:45.020597 20947 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:45.099766 20384 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:44.959605 20438 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
W20260709 13:05:45.103250 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 82092.6us
I20260709 13:05:45.008669 20883 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:44.958029 20468 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.027339 20824 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.108542 20824 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:45.110347 15343 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:45.027099 20603 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.102701 20384 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.118115 20592 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:45.118376 20955 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.111s
W20260709 13:05:45.119802 20952 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:05:45.120095 20970 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.120580 20970 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:45.121927 20953 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:05:45.076265 20703 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:05:45.093165 20666 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:45.122870 20764 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:45.134771 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 84560.8us
I20260709 13:05:45.135730 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.138617 20930 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.139328 20930 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:45.142091 20930 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:45.047645 20935 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:45.221860 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83934.3us
I20260709 13:05:45.097852 20649 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.045398 20946 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.134106 20825 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.155323 20087 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:45.116513 20929 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.309754 20825 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.309866 20974 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.276229 20882 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:05:45.318568 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.257763 20972 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.142803 20930 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:05:45.114660 20878 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.155571 20592 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.151s
I20260709 13:05:45.281354 20603 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.308315 20412 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.362562 20536 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.363138 20536 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.363596 20536 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.365579 20536 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.366060 20536 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.367333 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:45.366510 20536 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.370429 20536 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:45.343652 20964 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:05:45.379900 20967 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:05:45.380239 20949 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.356437 20603 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.381577 20663 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.381816 20935 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.382126 20663 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.382546 20603 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:45.375315 20965 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:05:45.384292 20663 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:45.326005 20825 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.385838 20931 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.386452 20468 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.388674 20649 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.389197 20878 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.390082 20878 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:45.356305 20980 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.391569 20980 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.347497 20666 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.393061 20412 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.393926 20980 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.395644 20412 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.396217 15873 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:45.396535 20884 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.376459 20936 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:45.378527 20604 consensus_meta.cc:287] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.680s	user 0.004s	sys 0.008s
I20260709 13:05:45.386459 20825 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.333971 20974 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.397830 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.442356 15269 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:05:45.449081 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:45.450129 20975 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.338546 20972 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.372277 20891 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:45.446359 20970 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:45.409111 20945 consensus_meta.cc:287] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
W20260709 13:05:45.456333 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.475283 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.475801 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.477056 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.480495 15340 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:45.395689 20979 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:45.467182 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 148669us
I20260709 13:05:45.460520 20922 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:45.486310 15264 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.016s	sys 0.065s
W20260709 13:05:45.488780 15264 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.016s	sys 0.065s
I20260709 13:05:45.487493 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.490100 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.497144 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.498018 15346 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:45.502169 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.503135 15341 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
W20260709 13:05:45.504930 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 400749us
I20260709 13:05:45.506517 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.492534 20825 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.508062 20884 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:45.509991 20825 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.509306 20943 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:45.512476 20825 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.509454 20988 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:45.509634 20968 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.513935 20971 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:05:45.514366 20968 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.487730 20946 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.493858 20970 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.516801 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.486667 20945 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.458750 20604 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.507364 20979 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.527020 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.527587 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.527953 15842 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.528746 20884 raft_consensus.cc:2764] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:05:45.528895 15269 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:45.532106 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:45.532686 15271 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:45.532707 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:45.533535 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.533828 15263 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.534386 15266 raft_consensus.cc:2410] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:05:45.408247 20764 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.553333 15842 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:45.555101 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:45.556149 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.557930 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.553638 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.554011 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:45.555696 15195 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:45.554423 15269 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:45.560318 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.519913 20943 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:45.562450 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.501950 20918 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 13:05:45.568813 20974 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.569460 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:45.570032 15272 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.571990 20592 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:45.559643 20412 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.576982 20412 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.577901 15272 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:45.578917 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.525498 20988 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.579763 20988 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.566226 20980 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:05:45.581398 15272 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:45.581845 20977 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.582327 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.582402 20977 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:45.583725 15345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2931) took 2015 ms (client timeout 2210 ms). Trace:
W20260709 13:05:45.584126 15345 rpcz_store.cc:269] 0709 13:05:43.568595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.568775 (+   180us) service_pool.cc:224] Handling call
0709 13:05:45.583550 (+2014775us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400271fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:45.583648 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424611072}
I20260709 13:05:45.584815 20977 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.559778 20946 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:45.585687 20825 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:45.586009 20946 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:45.564693 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.590153 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.590888 15266 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:45.507216 20808 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.464109 20975 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.518581 20878 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:05:45.594062 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.562383 20936 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:45.596228 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.612004 15264 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:45.614487 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:45.615477 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.616039 15263 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:45.617599 15271 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
W20260709 13:05:45.619071 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet 155d48b4318a4f7da7c4bc8ef9b73267: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:45.522073 20970 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.595705 20943 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:45.622040 15272 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:05:45.622155 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 59357.4us
I20260709 13:05:45.622680 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.582434 20988 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:45.627378 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.627928 15272 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
W20260709 13:05:45.629392 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 76123.5us
I20260709 13:05:45.554755 20824 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.631882 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.587554 20729 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:05:45.605130 20980 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:45.633019 15272 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:45.621214 20825 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:45.633742 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.636515 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.623819 20412 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.638428 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:45.626642 20943 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.628019 20936 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:45.634505 20883 consensus_meta.cc:287] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.003s
I20260709 13:05:45.643085 15271 raft_consensus.cc:2410] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:05:45.601011 20947 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.643317 20599 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.643505 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.642659 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.679757 15339 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:05:45.638825 20825 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:45.646926 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet fc42a0ccf8934477a1ae58b60a2b2b07: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:45.636054 20980 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.649921 20970 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:45.651889 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:45.631341 20977 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:45.655704 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.690608 20977 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.656385 20412 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.690923 20987 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:05:45.691082 20977 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:45.679070 20968 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.691284 20412 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.681996 20599 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.688706 20944 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:05:45.693526 20412 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.656658 20946 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.657538 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.694504 20946 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.695456 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.690968 15340 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:45.657668 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.663383 20943 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:45.663851 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.664417 20993 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:45.698958 20604 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.699646 20946 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.665083 20914 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:45.700424 20831 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:45.700716 20914 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:45.700814 20831 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:45.701201 20914 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:45.701455 20850 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.679819 20978 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.701741 20831 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.702098 20914 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.702262 20978 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.702951 20975 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.667142 20990 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:05:45.668375 20746 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.708003 20746 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:45.669263 20945 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.709580 20978 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.670459 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.687633 20825 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:45.711511 15343 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:45.712090 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.712378 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.713230 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.713333 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.713526 20914 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.713860 15343 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:45.714253 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.642882 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:45.716066 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 52313.2us
I20260709 13:05:45.717006 15342 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:45.717146 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.717418 20990 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:45.718308 20990 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:45.718796 20968 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:45.719184 20968 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:45.719363 20883 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.719933 20883 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.721009 20972 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.722024 20968 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.688930 20980 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:45.723325 20968 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.724295 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.725035 15345 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:45.634804 20918 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.726234 20918 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.702852 20831 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:45.684952 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.729161 15264 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:45.730111 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.648375 20979 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:45.686092 20994 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.637305 20976 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.687736 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.695566 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.731866 15341 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:45.696931 15337 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:45.658249 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.706100 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.732723 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.714701 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.707511 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2761) took 1045 ms. Trace:
I20260709 13:05:45.718523 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:45.722507 20883 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:45.637002 20705 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 13:05:45.733726 15267 rpcz_store.cc:276] 0709 13:05:44.662328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.021327 (+358999us) service_pool.cc:224] Handling call
0709 13:05:45.021667 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.125569 (+103902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.125608 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.135075 (+  9467us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.485538 (+350463us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:45.485600 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.485682 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.707300 (+221618us) raft_consensus.cc:1685] finished
0709 13:05:45.707321 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.707458 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24776,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":453167,"threads_started":2,"wal-append.queue_time_us":432715}
W20260709 13:05:45.741966 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet 7df15ef5ed244e05887f9af5ba36331a: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:45.694857 20824 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.701038 20947 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.757575 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:45.761847 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.764204 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:45.767705 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.749082 20878 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:45.775877 15264 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:05:45.777417 20808 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.753445 20994 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.780647 20994 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:45.753088 20705 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.783555 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:45.784417 15188 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
W20260709 13:05:45.789321 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 107043us
I20260709 13:05:45.796051 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.797973 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.798985 20972 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:45.799408 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.799611 20975 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.799413 20972 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.800694 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.800920 20972 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:45.801877 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:45.807008 15338 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:45.808151 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.808346 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.809966 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:45.809999 20975 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.747699 20976 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.782930 20878 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.813925 20878 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:45.771782 20936 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:45.786301 20970 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.815815 20936 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:45.817219 20705 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.818944 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.822219 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:45.811905 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:45.835505 20975 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:45.836027 20975 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.836403 20975 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:45.838989 20994 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:45.839660 20994 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.840238 20994 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:45.846601 15162 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.210s (SENT) [suppressed 12 similar messages]
I20260709 13:05:45.848631 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2118) took 1054 ms. Trace:
I20260709 13:05:45.849208 15196 rpcz_store.cc:276] 0709 13:05:44.794331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.797496 (+  3165us) service_pool.cc:224] Handling call
0709 13:05:44.797865 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.798307 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.798348 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.723349 (+925001us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b180043db60. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a
0709 13:05:45.723755 (+   406us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:05:45.724248 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.783446 (+ 59198us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:45.783479 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.783567 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.848382 (+ 64815us) raft_consensus.cc:1685] finished
0709 13:05:45.848413 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.848571 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5707,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12721,"spinlock_wait_cycles":45134592,"thread_start_us":58730,"threads_started":1,"wal-append.queue_time_us":113538}
I20260709 13:05:43.777384 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:45.898566 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 86771.3us
I20260709 13:05:45.899405 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.899600 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:45.900285 15342 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:45.901140 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:45.902712 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80611.6us
I20260709 13:05:45.900964 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.868597 15093 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 15 to 17, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 17 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:45.904662 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.919206 21004 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.922644 20976 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:45.912542 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.919834 21004 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.901717 15342 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:45.931345 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:45.931548 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.931955 15264 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:45.932583 15338 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:45.923522 20946 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:45.927171 20604 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:45.927526 20974 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:45.949798 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:45.950680 15264 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:45.929759 20412 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:45.951946 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.959632 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.960116 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.966691 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.967883 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.961895 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.968977 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:45.975171 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 128599us
I20260709 13:05:45.971621 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.943091 20946 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.947547 20604 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:45.960022 20412 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:45.937211 20980 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.954392 20974 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.993429 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:45.968820 20993 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:45.938782 20746 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:45.963832 20978 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:45.989882 20764 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:46.004516 15264 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:05:45.980329 20924 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:45.978459 20702 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:45.947275 20825 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.033600 20825 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.009512 20666 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.013758 20412 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.014190 20974 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:46.015374 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.041813 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:45.988626 20914 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:45.982493 20883 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:46.005530 20946 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:46.005424 20988 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:46.010703 20604 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:46.029042 20924 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:46.015244 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.019402 20824 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:45.991986 20947 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:05:46.018968 20993 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:46.047318 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:46.078269 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:46.020896 20884 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:46.050799 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.056142 15263 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:46.030804 20980 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:46.057101 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 125643us
I20260709 13:05:46.074831 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:46.081348 15267 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.079730 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:46.080386 20884 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.084075 20884 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.085844 20831 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:46.082798 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.080173 20993 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:46.088549 20831 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:46.089010 20831 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:46.089429 20831 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.048178 20883 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.051798 20882 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:46.054580 20988 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.051147 20978 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:46.081256 20702 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:46.100631 20729 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:46.093287 20972 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.099550 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:46.092867 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.108498 20729 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:46.108757 20702 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.113670 20884 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.076522 20924 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:46.121691 15264 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.077251 20824 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.092113 20432 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:46.129215 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.105824 20825 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:46.093956 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.134500 15267 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:46.101632 20883 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.051853 20666 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.118990 20988 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:46.163141 21007 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:05:46.163261 21009 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:05:46.164927 20746 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.135318 20824 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:46.167346 20729 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.159017 20914 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:46.171448 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.172168 15191 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:05:46.172080 20914 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.170953 20974 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.145018 15266 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:05:46.118006 20764 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:46.119228 20978 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:46.158733 15264 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:46.136248 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.183511 20978 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:46.184059 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47903.3us
I20260709 13:05:46.183815 20764 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.184980 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.188076 20746 raft_consensus.cc:2764] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:05:46.189003 20746 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:46.189635 20746 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:46.191453 20978 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.190867 20746 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.193732 20978 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.178882 20604 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.175182 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:46.182185 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 107918us
I20260709 13:05:46.180918 20972 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.196089 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:46.196988 15264 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:05:46.197885 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:46.146415 20980 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:46.199646 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 77272.9us
I20260709 13:05:46.181159 21012 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:46.142742 20977 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.158205 20825 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.214610 20980 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:46.218586 21012 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:46.207525 20943 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.236058 21012 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:46.239058 20975 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.248514 20604 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.256445 20946 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.257803 20883 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.266425 20824 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.270233 20974 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.225178 21004 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.272821 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:46.277544 20825 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.279227 20943 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.282207 20878 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.302628 20988 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.311784 20878 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.312033 20988 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.283937 20977 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.284173 20884 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.285266 20412 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.341145 20701 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:46.287742 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2124) took 1463 ms. Trace:
I20260709 13:05:46.341938 15193 rpcz_store.cc:276] 0709 13:05:44.823860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.823972 (+   112us) service_pool.cc:224] Handling call
0709 13:05:46.287405 (+1463433us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000c1cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:46.287598 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517680512}
I20260709 13:05:46.289094 20980 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.342981 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2757) took 1682 ms. Trace:
I20260709 13:05:46.343443 15268 rpcz_store.cc:276] 0709 13:05:44.660760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.928781 (+268021us) service_pool.cc:224] Handling call
0709 13:05:44.929287 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.099758 (+170471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.342744 (+1242986us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000d7854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:46.342924 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346798976}
I20260709 13:05:46.290768 20824 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.291522 15267 raft_consensus.cc:2368] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:05:46.290791 20666 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.353066 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.294442 20946 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.295225 20972 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:46.304107 21000 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:46.305333 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.305333 20821 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.306173 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:46.308607 20975 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.283130 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.316689 20994 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:46.318027 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:46.319240 20831 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:46.320879 15874 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58404 (request call id 484) took 1732 ms (client timeout 1833 ms). Trace:
I20260709 13:05:46.321133 20924 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.328819 21012 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.334162 15269 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:46.373870 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.341450 20412 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.288540 20993 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.293049 20883 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.367014 20437 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:46.380152 15868 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:05:46.367754 21000 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:46.381129 20831 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.369251 20946 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:46.361742 15265 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.365710 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.368932 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:46.369580 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86586.2us
W20260709 13:05:46.371240 15874 rpcz_store.cc:269] 0709 13:05:44.588082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.588919 (+   837us) service_pool.cc:224] Handling call
0709 13:05:46.320656 (+1731737us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b54000e51d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:46.320781 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14775168}
I20260709 13:05:46.355937 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.385102 15263 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:46.386989 15342 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:46.386989 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.387836 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.388695 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.388856 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.389279 15197 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:46.389362 15196 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 10.
I20260709 13:05:46.389421 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.390295 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.390514 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.390789 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.391067 15189 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:46.391429 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.376070 20988 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:46.401970 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.402709 15340 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:46.393024 15197 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:46.393404 15195 raft_consensus.cc:2410] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:46.398061 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.405144 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.399441 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.360972 20972 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:46.407297 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.409389 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.412829 15188 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:46.410544 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.371806 20666 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:05:46.414355 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.372754 20884 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:05:46.393299 20946 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.413724 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.419075 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.422665 20994 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.423061 20924 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:46.426580 15197 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:46.427212 15194 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:46.397365 20991 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:46.412742 21012 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.436342 15271 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:46.436834 15265 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:46.436985 20993 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.437583 15271 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:46.438586 21000 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.438723 15271 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:46.420099 20988 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:46.411716 20437 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:46.439380 20913 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:46.431792 20862 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:05:46.440192 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.435227 20946 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.448971 15271 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:46.449925 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.457970 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.458233 15190 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:46.450276 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.458783 15194 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:46.458925 15338 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:46.458932 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:46.460222 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 143963us
I20260709 13:05:46.461570 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:46.462980 21028 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:46.463411 21028 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:46.463670 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:46.463761 21028 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:46.455578 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.468829 20972 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:46.469883 20913 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:46.470289 20913 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:46.473204 15188 raft_consensus.cc:2368] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:46.473479 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:46.475927 15338 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
W20260709 13:05:46.484301 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.478096 20437 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.477178 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.482640 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.487255 20972 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:46.487746 20972 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:46.488217 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.488576 20972 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.489332 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.491818 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.492889 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.493906 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.494376 15346 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.467005 20991 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:46.495666 20991 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.476670 20913 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.497143 20913 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:46.497238 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.497853 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2753) took 1838 ms. Trace:
I20260709 13:05:46.498025 15338 raft_consensus.cc:2368] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:46.498775 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.477686 20988 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.499801 20663 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:46.499869 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.500380 20663 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:46.501145 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.501717 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.502228 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.502405 15190 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:46.503050 15189 raft_consensus.cc:2410] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:46.503335 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.503791 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.504004 15190 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.504377 15189 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:46.505682 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:46.478852 20929 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:46.506686 21000 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:46.506882 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.511178 20666 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:46.506717 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.488865 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.498219 15270 rpcz_store.cc:276] 0709 13:05:44.659564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.739111 (+ 79547us) service_pool.cc:224] Handling call
0709 13:05:44.744438 (+  5327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.005093 (+260655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.005128 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.005167 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:45.005198 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.497633 (+1492435us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400290254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:46.497677 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.497804 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599013760}
I20260709 13:05:46.514048 15339 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:46.514393 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.505707 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.515508 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.515699 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.518052 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.522389 15271 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:46.501187 20663 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.526738 20663 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:46.528878 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.530557 20087 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.531680 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.532246 15237 leader_election.cc:400] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:46.532509 15195 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:46.532563 15237 leader_election.cc:403] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:46.511911 20666 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.533262 15194 raft_consensus.cc:2410] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:46.533262 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.534368 15162 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:46.535181 15189 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:46.536521 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.537288 15189 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:46.538293 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.541710 15193 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:46.550762 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.544705 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.499424 15338 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.552335 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.552878 15188 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:46.543632 15340 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:05:46.556006 15193 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:46.556521 15341 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:46.551805 15189 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.559755 15189 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:46.560163 15311 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:46.563817 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.553962 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.582602 15195 raft_consensus.cc:2410] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:46.565804 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.582923 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.531005 20087 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.566572 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.567317 15190 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:46.585032 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.587308 15341 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:46.570633 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.552047 20979 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:46.544420 20946 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:46.576773 15193 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:46.593014 15190 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:46.551880 20993 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:46.589733 15195 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:46.588425 15189 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:46.564777 20746 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:46.591614 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.591296 15270 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:46.591125 15338 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:46.582955 20929 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.622298 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.624665 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.626837 15190 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:46.564356 20857 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:46.553371 20947 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:05:46.628533 15194 raft_consensus.cc:2410] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:46.590970 20980 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:46.649704 15268 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:46.659570 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.670958 15341 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
W20260709 13:05:46.677057 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.632057 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.626350 20946 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:46.688782 15195 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:05:46.692255 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.692860 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.693054 15265 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:46.693499 15195 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.693745 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.693869 20946 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:46.695257 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.696621 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:46.692260 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.691506 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.697899 15193 raft_consensus.cc:2368] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:46.701201 15195 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:46.703153 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.704195 21000 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:46.584034 21025 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:46.704833 15197 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:46.705021 21025 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:46.705518 21025 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.706122 15197 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:46.704825 15190 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:46.703123 15189 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:46.706779 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.707819 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.708564 15194 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [15.10-18.12]
I20260709 13:05:46.710672 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.712239 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.712818 15339 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.712963 15190 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:05:46.707617 21001 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:46.714792 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.686235 20857 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:46.713060 20997 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:46.702991 20993 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:46.724327 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.724985 15189 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:46.707247 20980 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:46.727898 15188 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:46.730412 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:46.716113 20821 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.717608 20972 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:46.741606 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.742470 15193 raft_consensus.cc:2410] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:46.742913 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.743517 15341 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:46.744424 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.749986 15339 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:46.751142 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:46.740974 15268 raft_consensus.cc:2955] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 4 to 11, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:46.727576 20946 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:46.761101 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.731784 20666 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.763082 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.763260 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.764232 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.761972 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.766439 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.767467 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.768949 15346 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:46.768766 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.771433 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.778373 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.778610 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.754892 20972 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:46.769639 20988 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.746138 20821 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.787089 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:46.770850 20918 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:46.799732 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.803359 15192 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:46.776669 20946 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:46.806912 15341 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:46.803938 15192 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:46.816723 20821 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.791193 20666 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:05:46.823916 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.823886 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.826038 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.799189 20970 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:46.797286 20087 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.835299 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.835969 15190 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:46.837879 20981 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.322s	user 0.004s	sys 0.002s
I20260709 13:05:46.846099 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2725) took 1033 ms. Trace:
I20260709 13:05:46.849431 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.850062 15346 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:05:46.858937 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.859644 15342 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.860196 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.846496 15266 rpcz_store.cc:276] 0709 13:05:45.902072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.923701 (+ 21629us) service_pool.cc:224] Handling call
0709 13:05:45.924135 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:46.182969 (+258834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.845872 (+662903us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400087d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:46.846048 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507084544}
I20260709 13:05:46.861207 15341 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:46.861501 15346 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:05:46.862695 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.797151 20988 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.819247 20884 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:05:46.826939 21004 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:05:46.913341 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.915412 15842 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.823457 20883 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:05:46.787778 20857 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.788862 20980 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.880640 21028 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:46.865844 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:46.883569 20946 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:46.884505 15342 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:46.886358 15341 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:05:46.888993 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.891657 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.893097 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.895807 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.942091 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.896114 15339 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 18. Ops: []
W20260709 13:05:46.903671 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.904033 20705 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:46.905365 20988 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:46.905838 15193 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.911684 15196 raft_consensus.cc:2368] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:46.922040 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.925025 15338 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:46.902712 20929 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:46.929241 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.932614 15346 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:46.947285 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.947679 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.948146 15194 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:46.948973 15197 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:46.944584 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.949901 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.950729 15191 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:46.945396 15190 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
W20260709 13:05:46.951936 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 63068.3us
I20260709 13:05:46.951757 15345 raft_consensus.cc:2410] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:05:46.955242 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.959210 15346 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:46.929914 21000 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:46.953703 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.964576 15874 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:46.967265 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.967557 15346 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:46.968389 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.968904 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.969295 15191 raft_consensus.cc:2376] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15. Re-sending same reply.
I20260709 13:05:46.969704 15197 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.972021 15337 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:46.972738 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:46.967140 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.970783 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.980396 15191 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:46.984030 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.985101 15191 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:46.986167 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.988018 15191 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:46.995913 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:46.996485 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:46.998529 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 50978.6us
I20260709 13:05:46.999697 15337 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:05:47.001349 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:46.977602 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:47.005924 15337 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:05:47.007810 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.004840 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.960817 20979 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:47.011664 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:47.010731 15337 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:46.946255 20705 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:47.014358 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:47.128038 15337 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:47.128520 15193 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
W20260709 13:05:47.125591 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 120868us
I20260709 13:05:47.016227 15197 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:47.129629 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:46.964453 20891 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:47.129875 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.130658 20891 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:47.130868 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:46.966339 21000 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.004066 20977 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:05:47.064141 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.873842 20972 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.005703 20412 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:46.930390 20998 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:05:47.005565 20975 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:47.011430 21015 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:47.015944 20746 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:47.012777 20599 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:47.069410 20825 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:47.119654 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 164609us
I20260709 13:05:47.121567 21025 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.134840 21028 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:47.131203 20891 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:47.122596 20663 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.001s
I20260709 13:05:47.125499 15196 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:05:47.243422 15196 pending_rounds.cc:85] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 7
I20260709 13:05:47.243898 15196 pending_rounds.cc:107] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:05:47.244216 15196 raft_consensus.cc:2889] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.127151 20994 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:47.128914 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.249933 15191 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.250643 15191 raft_consensus.cc:2393] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:46.960875 20821 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:47.128031 20705 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.016563 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.131004 15337 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: [17.12-18.13]
I20260709 13:05:47.133126 15197 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:47.081112 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2716) took 1443 ms. Trace:
I20260709 13:05:47.255802 15272 rpcz_store.cc:276] 0709 13:05:45.638018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.638955 (+   937us) service_pool.cc:224] Handling call
0709 13:05:45.639267 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.639578 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.639605 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.675668 (+ 36063us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.929233 (+253565us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:45.947369 (+ 18136us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.848105 (+900736us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b180046fb40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:05:47.069394 (+221289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.069497 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.069549 (+    52us) raft_consensus.cc:1685] finished
0709 13:05:47.080848 (+ 11299us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.081038 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17947,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":2304,"raft.queue_time_us":86961,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":24492,"spinlock_wait_cycles":15581952,"thread_start_us":361768,"threads_started":2,"wal-append.queue_time_us":303307,"wal-append.run_cpu_time_us":3442,"wal-append.run_wall_time_us":1179093}
I20260709 13:05:47.251314 15189 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:47.136344 15194 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:47.138607 15339 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:47.133278 20943 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:47.212550 15343 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:05:47.131675 21000 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:47.133216 20592 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:47.189369 20746 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:47.235105 21034 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.431s	user 0.004s	sys 0.003s
W20260709 13:05:47.233320 21036 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.480s	user 0.002s	sys 0.000s
I20260709 13:05:47.306928 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.311160 15339 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 23. Ops: []
I20260709 13:05:47.313448 15190 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:05:47.252373 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 240768us
I20260709 13:05:47.164222 20975 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.264273 15337 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:47.213356 20998 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:47.231187 21046 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:47.319629 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.320631 15189 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:05:47.277704 20705 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:47.270462 20994 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:47.324877 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:47.308919 20746 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.273484 20592 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:47.253486 20821 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.262214 20433 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:47.251197 20934 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:05:47.263372 21028 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:05:47.336054 15190 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:47.324375 20998 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:47.309702 20943 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:47.320350 21050 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:47.310129 21004 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.270010 20979 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:47.328847 20976 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:05:47.340080 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.323639 20975 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:47.326049 20940 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:47.269909 20941 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:05:47.337378 20972 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:47.318979 20913 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:05:47.328819 20702 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:05:47.351796 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.376514 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:47.405637 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 61333.5us
I20260709 13:05:47.342325 20821 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:47.407675 15194 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:47.336676 20412 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:47.414225 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:47.384472 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 119004us
I20260709 13:05:47.331118 21046 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:47.416302 20825 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:47.416893 20825 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.417431 20825 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:47.419190 20998 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:47.420539 20998 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:47.413292 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.346174 20891 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.423338 20943 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:47.432049 21051 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:47.436204 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.442222 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:47.440461 21042 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.111s	user 0.001s	sys 0.001s
I20260709 13:05:47.406514 21045 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:47.465214 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 52012us
I20260709 13:05:47.466773 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.400326 21004 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:47.471565 15194 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:05:47.473667 15194 pending_rounds.cc:85] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 11
I20260709 13:05:47.473960 15194 pending_rounds.cc:107] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:05:47.444689 20934 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.471596 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.445719 21050 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:47.474251 15194 raft_consensus.cc:2889] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.471632 15238 leader_election.cc:400] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:47.443271 20592 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:47.482896 21044 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:05:47.449644 20994 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:47.483326 20592 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:47.475366 21015 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:47.477072 15188 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:47.450234 21053 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:47.482069 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:47.470710 20929 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:47.468844 21056 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.487046 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.491537 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.494802 15194 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:05:47.498872 15194 pending_rounds.cc:85] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 10
I20260709 13:05:47.499305 15194 pending_rounds.cc:107] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:05:47.493605 21025 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:47.503188 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.480235 21050 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.499583 15194 raft_consensus.cc:2889] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.487249 20702 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:47.533854 21055 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:05:47.525098 21004 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:47.536408 21015 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.520471 20913 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:47.525038 21046 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:47.489558 20821 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.485586 20934 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.521821 21050 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:47.544183 20944 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:47.544641 20944 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:47.545729 20934 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:47.476879 20979 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.546605 21054 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.547384 21054 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.549814 20412 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.550334 21054 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:47.543296 20821 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:47.545492 20944 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.552327 20944 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:47.554363 20940 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:47.490636 21053 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.556742 20821 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:47.558480 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.519657 21025 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:47.557024 21054 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:47.556169 20940 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:47.566411 15874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58400 (request call id 386) took 1018 ms. Trace:
I20260709 13:05:47.568639 15874 rpcz_store.cc:276] 0709 13:05:46.548191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.548448 (+   257us) service_pool.cc:224] Handling call
0709 13:05:46.580353 (+ 31905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.966655 (+386302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.566160 (+599505us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54006301d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:47.566349 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":875129728}
I20260709 13:05:47.562438 20941 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.560042 21053 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:47.568019 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.579648 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.582374 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:47.571431 21054 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:47.576987 20934 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:47.594311 20975 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.599668 20976 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:47.599368 20975 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:47.603083 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.584813 20941 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:47.595137 20940 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:47.616319 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 124919us
I20260709 13:05:47.619809 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:47.624209 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.591311 20428 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:47.628893 15238 leader_election.cc:400] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:47.607787 20663 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.629869 21025 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:47.634298 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.636070 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.639091 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.640638 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:47.641331 15267 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.641790 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:47.642612 15188 raft_consensus.cc:2376] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20. Re-sending same reply.
I20260709 13:05:47.644016 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.645562 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:47.642640 15266 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:47.648404 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.652002 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.650668 15271 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:47.657342 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:47.658262 15188 raft_consensus.cc:2376] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15. Re-sending same reply.
I20260709 13:05:47.663296 15194 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:47.663839 15264 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:47.664546 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:47.666981 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.667454 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:47.672734 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:47.673645 15195 raft_consensus.cc:2376] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17. Re-sending same reply.
I20260709 13:05:47.682087 15271 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
W20260709 13:05:47.687531 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.687358 15271 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:47.656437 20821 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:47.646876 20663 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.628933 20976 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:05:47.658102 21025 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:47.745163 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.745751 15271 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:47.702751 15267 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:47.703235 15264 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:05:47.681910 20977 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.005s	sys 0.025s
I20260709 13:05:47.706954 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2134) took 1284 ms. Trace:
W20260709 13:05:47.732558 21043 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:05:47.712939 15197 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:47.719713 20948 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:47.727623 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2729) took 1431 ms. Trace:
I20260709 13:05:47.734198 15193 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [15.10-18.12]
I20260709 13:05:47.735124 20918 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:47.738230 20970 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:47.730449 21058 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 13:05:47.710251 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:47.768930 15342 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:47.731454 21052 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
I20260709 13:05:47.724572 15093 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 4 to 11, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New cstate: current_term: 15 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:47.741039 15194 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:47.740635 15192 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.743044 20663 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:47.746326 15191 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:47.671538 20946 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:47.679874 20825 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.751703 20412 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.647599 20941 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:05:47.700536 20975 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:47.677438 21063 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:47.786363 20825 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:47.756176 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.759174 15265 rpcz_store.cc:276] 0709 13:05:46.296179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.437483 (+141304us) service_pool.cc:224] Handling call
0709 13:05:46.513062 (+ 75579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.693622 (+180560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.857881 (+164259us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001d8dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:47.727363 (+869482us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54001d8dd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:47.727546 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":586659328}
W20260709 13:05:47.749408 20977 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.005s	sys 0.025s
I20260709 13:05:47.791894 20977 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:47.792778 20977 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.781260 15263 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:47.749814 15338 rpcz_store.cc:276] 0709 13:05:46.422691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.691979 (+269288us) service_pool.cc:224] Handling call
0709 13:05:47.706721 (+1014742us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54001748d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:47.706869 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441317632}
I20260709 13:05:47.749732 20821 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:47.769471 20918 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:47.767356 20701 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.691090 21054 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.758975 20948 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:47.800889 15263 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:05:47.801003 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 133635us
W20260709 13:05:47.790030 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.809315 15238 leader_election.cc:400] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:05:47.809434 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:47.768069 20970 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:47.794299 20746 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.810175 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.824970 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:47.826102 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:47.826375 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:47.780853 20946 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.810650 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:47.847225 20946 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:47.848035 21065 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:47.848210 21015 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:47.810106 15263 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:47.849459 21015 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:47.849831 21015 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:47.849723 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:47.818707 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.820056 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:47.850606 21015 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.824281 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:47.803771 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:47.852137 15338 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:47.852003 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:47.853860 21063 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:47.854465 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:47.854389 20975 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.855151 20975 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.815445 21025 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.855774 15263 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:47.856630 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:47.857344 20975 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:47.854385 21063 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:47.860023 21063 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:47.863174 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:47.863832 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:47.865021 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:47.865747 15263 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:47.866459 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:47.867372 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:47.868170 15345 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:05:47.868507 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:47.871551 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:47.879406 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51716.3us
W20260709 13:05:47.880517 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70406.5us
I20260709 13:05:47.881253 20857 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:47.883005 20703 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:47.827838 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:47.828999 15346 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:47.829052 15339 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:47.787484 20433 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:05:47.831869 15266 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:47.833437 20746 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:47.829147 20948 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.836784 21072 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.787590 20468 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:05:47.843235 20825 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.843976 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.848522 21065 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.768278 20998 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:05:47.851918 21015 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:47.929172 21045 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:47.894804 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.837821 21062 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:05:47.787024 20976 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:05:47.878309 21050 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.941934 15271 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:47.796192 21000 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:47.807701 20988 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:05:47.910956 21012 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.807921 20701 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.821103 20913 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:05:47.911315 20980 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:47.931869 21065 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:47.915449 20437 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:05:47.962814 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 81957.6us
I20260709 13:05:47.974323 15870 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:47.950035 20948 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:47.977407 15309 leader_election.cc:400] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:05:47.977957 15309 leader_election.cc:403] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.917619 21072 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:47.986265 21072 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:47.992935 20972 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.589s	user 0.012s	sys 0.000s
I20260709 13:05:47.993670 20972 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.997287 20701 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:47.931550 20825 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.019404 15267 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:48.028095 21053 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.924911 20918 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:47.919911 20821 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.029583 15265 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:47.961627 21012 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.031474 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 148042us
I20260709 13:05:48.012966 20944 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:05:48.005100 21000 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.016185 21028 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:48.041308 21053 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.043004 15192 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:48.045756 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:48.039258 20918 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.046420 15266 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.048338 20991 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:48.048784 20991 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:48.049674 20991 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.051371 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.050711 20991 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:48.055636 21012 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.055891 20940 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:48.059916 21050 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.060245 15192 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:48.060503 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:48.060953 15192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2126) took 3236 ms (client timeout 1539 ms). Trace:
I20260709 13:05:48.060880 20934 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:48.061769 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:48.062243 20944 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:48.062649 20944 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:48.064082 20593 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:05:48.063679 20944 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.065018 20944 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:48.061545 15192 rpcz_store.cc:269] 0709 13:05:44.824504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.835017 (+ 10513us) service_pool.cc:224] Handling call
0709 13:05:46.803235 (+1968218us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54005017a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5684dc0 00007f36e5710e18 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:47.740296 (+937061us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54005017a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e568b06f 00007f36e5703f60 00007f36e57057de 00007f36e571127c 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2
0709 13:05:48.042532 (+302236us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5800a4dbd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e56690aa 00007f36e56eb447 00007f36e5703fe7 00007f36e57057de 00007f36e571127c 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c
0709 13:05:48.060814 (+ 18282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170464000}
W20260709 13:05:48.066574 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.062803 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:48.074211 15266 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
I20260709 13:05:47.963618 20980 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.077574 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.066540 20433 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:05:48.078279 20934 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:48.077061 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:48.081303 15263 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:48.081902 21000 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:48.082511 21000 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:48.082633 21082 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:48.083819 21000 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:48.088552 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:48.050535 20946 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.089318 21083 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:48.091718 15270 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:48.092608 21083 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:48.093195 21083 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:48.094113 21083 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.090008 20976 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:48.095757 20825 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.066336 21028 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:48.097235 21065 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.037001 20857 consensus_queue.cc:1175] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ca86ee1d194023b1414bbe226f4798" responder_term: 19 status { last_received { term: 18 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:48.100464 21082 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:48.103206 21082 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:48.102603 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:48.110191 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:48.111415 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:48.111996 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.113071 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:48.114624 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:48.111163 20991 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:05:48.175236 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:48.177273 15266 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 23. Ops: []
I20260709 13:05:48.179388 15266 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:05:48.182264 15266 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:48.102623 21056 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.581s	user 0.010s	sys 0.000s
I20260709 13:05:48.204542 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:48.204689 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.210583 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.216933 15271 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:48.226902 15271 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:05:48.111630 20825 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.229682 15271 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:48.235250 15269 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:48.239317 15264 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:48.178835 20976 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:48.254807 15266 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:05:48.118818 20913 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:05:48.218417 21056 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:48.218963 21060 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.229132 21054 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:48.255543 20976 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.265951 20976 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.265691 21054 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.266175 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2965) took 1776 ms (client timeout 1942 ms). Trace:
W20260709 13:05:48.266801 15340 rpcz_store.cc:269] 0709 13:05:46.489523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.566335 (+ 76812us) service_pool.cc:224] Handling call
0709 13:05:48.265981 (+1699646us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400244854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:48.266114 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2814750080}
I20260709 13:05:48.268086 21054 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.175783 20934 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:05:48.230880 21046 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:48.282241 15264 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:48.275638 21028 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.240465 20891 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:48.302013 20891 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:48.304308 20891 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:48.264647 21065 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.295997 15268 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:48.308599 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 496994us
I20260709 13:05:48.310786 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.311097 20913 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:48.255275 20825 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.339502 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 535772us
I20260709 13:05:48.351217 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.311520 20913 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:48.333081 20663 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:48.332548 20592 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:48.362232 20976 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.340644 21088 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:48.362597 20970 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.363731 20970 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:48.364789 20976 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:48.324153 20593 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:05:48.335425 21092 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:05:48.365267 21082 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.343626 20988 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:48.316579 21004 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:05:48.381052 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.384846 20913 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.387185 20988 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:48.390383 20663 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:48.399770 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.407389 20884 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:48.375809 21082 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.420554 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:48.412094 20884 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:48.418733 20913 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:48.421326 20592 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:48.426067 15162 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:48.438194 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.441056 21082 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:48.430099 20593 consensus_queue.cc:1243] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:48.425336 21098 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:48.430796 20884 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.468125 21101 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.468751 21101 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.470894 21101 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.485666 21004 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:48.522470 20929 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:48.252233 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.539762 21004 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:48.540189 20929 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:48.540573 20929 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:48.540791 21004 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.524253 15093 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 8 to 13, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 13 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:48.547629 15093 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 15 to 16, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:48.541486 20929 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:48.550199 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.526999 15272 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:48.551283 20929 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:48.488011 21098 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:48.483372 20593 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:48.552686 20593 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.553217 20593 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.531597 20988 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.555339 21028 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:05:48.559195 20940 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
I20260709 13:05:48.562002 21060 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:48.532851 15094 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 170) took 45019 ms (client timeout 15000 ms). Trace:
W20260709 13:05:48.589146 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 151088us
I20260709 13:05:48.590402 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.591897 15192 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:48.592053 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.597468 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:48.597839 15196 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:48.598109 15189 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:48.599120 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:48.600627 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:48.606033 15196 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:05:48.613336 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:48.615712 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.619004 15192 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:48.619562 15192 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:48.620554 15192 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.621750 15192 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:48.603489 20988 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:48.624132 20988 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.625296 20850 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:48.626394 20988 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.628041 21099 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:48.628476 21099 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:48.603628 21101 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:48.629263 21099 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.629851 21101 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.630684 21099 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:48.605535 21098 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:48.618240 20913 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:48.631546 20913 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.631891 20913 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:48.632099 21101 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:48.636708 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44783.2us
I20260709 13:05:48.637892 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:48.640959 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:48.653393 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 227438us
W20260709 13:05:48.565001 15094 rpcz_store.cc:269] 0709 13:05:03.513942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.514192 (+   250us) service_pool.cc:224] Handling call
0709 13:05:48.532679 (+45018487us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:41.720645 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:41.721378 (+   733us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:41.721430 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:05:41.721453 (+    23us) tablet.cc:662] Decoding operations
0709 13:05:41.778789 (+ 57336us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:41.803937 (+ 25148us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:41.803978 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:05:41.804485 (+   507us) tablet.cc:701] Row locks acquired
0709 13:05:41.804534 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:05:41.804688 (+   154us) write_op.cc:270] Start()
0709 13:05:41.804827 (+   139us) write_op.cc:276] Timestamp: P: 1783602341804628 usec, L: 0
0709 13:05:41.804863 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:05:41.805525 (+   662us) log.cc:844] Serialized 1307 byte log entry
0709 13:05:42.358872 (+553347us) op_driver.cc:464] REPLICATION: finished
0709 13:05:42.627294 (+268422us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e9143ef0
0709 13:05:42.802928 (+175634us) write_op.cc:301] APPLY: starting
0709 13:05:42.845335 (+ 42407us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:43.088290 (+242955us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:43.097431 (+  9141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:43.168861 (+ 71430us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:43.203238 (+ 34377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:05:43.206252 (+  3014us) write_op.cc:312] APPLY: finished
0709 13:05:43.232852 (+ 26600us) log.cc:844] Serialized 40 byte log entry
0709 13:05:43.388718 (+155866us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b
0709 13:05:43.554769 (+166051us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.566895 (+ 12126us) write_op.cc:454] Released schema lock
0709 13:05:43.571722 (+  4827us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:43.690380 (+118658us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:43.697225 (+  6845us) write_op.cc:454] Released schema lock
0709 13:05:45.368484 (+1671259us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b180008b720. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
Metrics: {"mutex_wait_us":687604,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":385465,"apply.run_cpu_time_us":30408,"apply.run_wall_time_us":832450,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":227344,"prepare.run_cpu_time_us":18307,"prepare.run_wall_time_us":176711,"raft.queue_time_us":211905,"raft.run_cpu_time_us":30247,"raft.run_wall_time_us":472791,"replication_time_us":481817,"spinlock_wait_cycles":85686016,"thread_start_us":971868,"threads_started":5,"wal-append.queue_time_us":504111,"wal-append.run_cpu_time_us":30416,"wal-append.run_wall_time_us":2354344}]]}
I20260709 13:05:48.635116 20940 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:05:48.625728 20850 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:48.674777 15192 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:05:48.678229 15192 pending_rounds.cc:85] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 7
I20260709 13:05:48.678517 15192 pending_rounds.cc:107] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:05:48.678778 15192 raft_consensus.cc:2889] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.679140 15192 pending_rounds.cc:107] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:05:48.679420 15192 raft_consensus.cc:2889] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.684823 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:48.685616 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:48.685979 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:48.686654 15268 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:48.686791 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:48.687543 15266 raft_consensus.cc:2393] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:48.687994 21097 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:48.688447 21097 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:48.689248 21097 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:48.690784 21097 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.669934 21098 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:48.655493 20593 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.708047 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 43610us
I20260709 13:05:48.705101 21113 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:05:48.709811 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 872600us
I20260709 13:05:48.712332 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:48.713033 20988 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:48.715644 21050 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:48.716125 21050 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.716524 21050 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.716759 21098 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:48.676687 20592 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:05:48.707935 21111 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:05:48.938163 15196 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:05:48.945317 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.942965 20593 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.944952 20913 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:48.945952 21107 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.337s	user 0.000s	sys 0.008s
W20260709 13:05:48.946338 21115 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.333s	user 0.000s	sys 0.012s
I20260709 13:05:48.947001 21050 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.699307 20941 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.693315 20991 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:05:48.723579 20850 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:48.957157 20988 consensus_queue.cc:1243] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 19.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:05:48.957722 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 248995us
W20260709 13:05:48.958575 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.965332 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:48.958117 21114 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:05:48.979629 15189 raft_consensus.cc:2410] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:05:48.980372 20825 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.981277 21050 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.982033 20980 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.008153 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.009075 15189 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:49.010897 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.984650 20946 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:48.986064 20993 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:05:48.989530 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 51444.4us
I20260709 13:05:48.990002 20850 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.991153 20913 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:48.992492 21071 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:48.998955 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2816) took 1297 ms. Trace:
I20260709 13:05:49.000361 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2818) took 1246 ms. Trace:
I20260709 13:05:49.004702 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:49.041374 15267 rpcz_store.cc:276] 0709 13:05:47.753743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.754214 (+   471us) service_pool.cc:224] Handling call
0709 13:05:47.755803 (+  1589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.019894 (+264091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.999982 (+980088us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54004155d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:49.000267 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605733760}
I20260709 13:05:49.032958 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:49.033185 15189 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
I20260709 13:05:49.041307 15269 rpcz_store.cc:276] 0709 13:05:47.701073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.701189 (+   116us) service_pool.cc:224] Handling call
0709 13:05:47.701427 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.246839 (+545412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.995008 (+748169us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b54000d7354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:48.998861 (+  3853us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227265920}
I20260709 13:05:49.044526 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.045837 15189 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:49.046797 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.008424 20979 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:49.047551 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.057574 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:49.057046 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.060226 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:49.061331 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.061947 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.061383 15266 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:49.047905 21113 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:48.976068 20941 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.067123 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.059707 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:49.070055 15189 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:49.019780 21097 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:49.028597 21110 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.075096 15270 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:49.068099 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:49.078519 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73876.1us
I20260709 13:05:49.029516 21120 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.077149 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.079087 15265 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:49.027537 20705 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.082858 20705 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.048027 20913 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.080240 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.046247 21098 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.079607 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:49.065690 20980 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.088678 15189 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 11.
I20260709 13:05:49.068095 21050 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.092535 15189 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:49.047709 20979 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.085091 20988 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:49.110405 15162 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:49.103195 15868 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:49.078528 21111 consensus_queue.cc:1243] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:05:49.104861 15346 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:49.105715 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.106227 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.107482 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.106568 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.110569 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.115396 21122 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.082239 21097 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.116700 20979 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.086697 21120 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.074929 21113 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.119931 15340 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:05:49.097263 20980 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.120990 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:49.121742 20705 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:49.121951 21108 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.654s	user 0.012s	sys 0.000s
I20260709 13:05:49.101835 15189 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:05:49.300922 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.108990 20970 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:49.125497 15344 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:49.131539 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.132582 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:49.120000 21117 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:05:49.204886 20979 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.210027 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.327170 15340 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:49.213673 21111 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:49.216562 21099 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:49.230541 21000 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.277146 20944 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.290594 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.297690 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet 49393a249e3f433db3840189ee7dc630: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:49.302296 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.337347 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:49.325315 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.128584 21101 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.202s
I20260709 13:05:49.328019 15269 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:05:49.295382 20825 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.083946 21110 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.108259 21050 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.324890 21071 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.089741 20913 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.338244 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.384994 15189 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:49.345511 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:49.387208 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:49.388641 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:49.390054 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:49.345757 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.346148 20884 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:49.346791 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:49.347543 15265 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:05:49.392169 15265 pending_rounds.cc:85] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 10
I20260709 13:05:49.392500 15265 pending_rounds.cc:107] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:05:49.392843 15265 raft_consensus.cc:2889] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.349654 20593 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:49.350462 21100 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:49.357168 20940 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.358307 20941 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:49.359894 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2830) took 1212 ms. Trace:
I20260709 13:05:49.360267 21113 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.325181 21073 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.338213 21000 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:49.362325 21097 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.365011 20980 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.373378 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:49.378142 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:49.096306 21098 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:49.330849 20979 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.366518 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:49.379372 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.396296 20412 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:49.392513 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.127907 21122 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.401698 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.405956 15267 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
W20260709 13:05:49.437413 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 70968.6us
W20260709 13:05:49.406399 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 346706us
I20260709 13:05:49.335752 20998 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:49.383489 20663 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:49.410068 15271 rpcz_store.cc:276] 0709 13:05:48.147630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.346381 (+198751us) service_pool.cc:224] Handling call
0709 13:05:48.346785 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.347473 (+   688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.347514 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:48.375305 (+ 27791us) log.cc:844] Serialized 26 byte log entry
0709 13:05:48.422832 (+ 47527us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:48.422867 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.423166 (+   299us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.065927 (+642761us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:49.359529 (+293602us) raft_consensus.cc:1685] finished
0709 13:05:49.359550 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.359823 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9783,"spinlock_wait_cycles":11318656,"thread_start_us":11900,"threads_started":1,"wal-append.queue_time_us":66037}
I20260709 13:05:49.471601 15193 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:49.426147 15191 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:49.381229 15868 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:49.396466 21072 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:05:49.427639 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49496.6us
I20260709 13:05:49.492318 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.492636 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.399593 21045 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:05:49.493356 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.494153 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.494807 15193 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.415647 21099 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.396647 20593 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:49.499399 21099 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:49.500115 20593 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:49.502005 20593 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.468515 20998 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:49.504660 20998 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.505648 20998 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:49.505985 20979 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:49.506500 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.506752 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.507546 15341 raft_consensus.cc:2368] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:49.507848 15345 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:49.508461 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.405408 20946 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:49.463168 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.400413 21100 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:49.510514 15162 leader_election.cc:400] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:49.510538 15342 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:49.366919 20944 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.511096 15162 leader_election.cc:403] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:49.511345 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:49.511925 15191 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:49.512079 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:49.512400 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.512755 20944 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:49.440471 15188 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:49.468503 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:49.513195 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:49.469542 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:49.475152 20913 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:49.383299 20825 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.481138 21122 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.482195 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.520658 15338 raft_consensus.cc:2410] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:05:49.482851 21000 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.466944 21113 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:49.485360 21050 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.485734 21097 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:49.471509 20663 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:49.487193 21110 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.418511 20941 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.395810 21071 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:49.488276 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:49.415978 20940 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.489624 20991 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.490466 21120 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:49.467463 20980 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.491160 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.425446 21073 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.410326 21012 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:05:49.492796 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:49.618661 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 125942us
W20260709 13:05:49.622545 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.513854 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.514132 15343 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:49.529484 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.624119 15196 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:49.621394 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:49.543833 21054 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:49.502460 21099 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:49.533933 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 64521.5us
I20260709 13:05:49.536185 15191 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:49.650341 15191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:49.650933 15191 raft_consensus.cc:606] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:49.651268 15191 raft_consensus.cc:614] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:49.510991 21100 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.510473 20946 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:49.559612 15189 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:49.749998 15189 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:49.518900 15193 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:49.752213 15193 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:05:49.581398 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.523193 21121 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:49.530275 20970 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:49.531009 20979 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:49.587332 20985 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:05:49.643703 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.539760 21097 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:49.580353 20663 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.618230 20980 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:49.434324 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 427595us
W20260709 13:05:49.625196 21074 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.560s	user 0.018s	sys 0.016s
I20260709 13:05:49.633843 21120 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:49.805651 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.590793 20941 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.590241 20991 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.791994 21045 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.819401 15337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.033s	sys 0.019s
W20260709 13:05:49.815611 15190 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.012s	sys 0.072s
I20260709 13:05:49.642486 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:49.861531 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:49.899814 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:49.599176 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.927832 15190 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.013s	sys 0.077s
W20260709 13:05:49.880090 21123 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:05:49.928011 15271 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
W20260709 13:05:49.928256 15337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.036s	sys 0.021s
I20260709 13:05:49.946450 15338 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:49.739913 21050 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.803684 20934 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.941385 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.799520 20970 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:49.791891 21121 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:49.879313 21097 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:49.799719 20979 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:49.791692 21130 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:49.799304 20412 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.897544 20428 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:49.880251 21054 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.814074 21113 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:49.741132 21000 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.196s
W20260709 13:05:49.996987 21128 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.038s	sys 0.064s
I20260709 13:05:50.002526 15195 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:05:50.030864 15195 pending_rounds.cc:85] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 8
I20260709 13:05:50.031155 15195 pending_rounds.cc:107] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:05:50.031440 15195 raft_consensus.cc:2889] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.926512 21072 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:50.014792 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.997895 20970 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:50.034178 15197 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.022s	sys 0.043s
I20260709 13:05:49.973326 21110 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.805683 21132 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.210s
W20260709 13:05:50.060289 15310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.011s	sys 0.054s
W20260709 13:05:50.060828 15310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.011s	sys 0.054s
W20260709 13:05:50.062760 15340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.020s	sys 0.042s
W20260709 13:05:50.063293 15340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.020s	sys 0.042s
W20260709 13:05:50.059270 15197 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.022s	sys 0.043s
W20260709 13:05:50.075577 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.030607 21128 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.038s	sys 0.065s
I20260709 13:05:50.104187 15195 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:50.007871 20979 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:50.006726 20985 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.008922 20948 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.927450 20913 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.952050 21045 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:49.996488 21050 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.136344 15235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.014s	sys 0.027s
W20260709 13:05:50.156543 15235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.027s
I20260709 13:05:50.079705 21012 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:50.137672 21123 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:05:50.161043 15192 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.046s	sys 0.070s
W20260709 13:05:50.161464 15192 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.046s	sys 0.070s
I20260709 13:05:50.037133 20412 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.046095 20428 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.036355 21054 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.170043 15842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.013s	sys 0.050s
W20260709 13:05:50.172304 15842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.013s	sys 0.051s
W20260709 13:05:50.172791 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 797932us
I20260709 13:05:50.059940 21072 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.156050 20825 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:50.180542 15841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.018s	sys 0.059s
W20260709 13:05:50.186878 15841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.018s	sys 0.059s
I20260709 13:05:50.098500 21110 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.123782 20934 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.150403 21113 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:05:50.174337 20705 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.027s	sys 0.047s
I20260709 13:05:50.162186 20940 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.038172 20946 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.155354 20913 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.212150 20934 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.213827 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:50.205310 21132 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.153419 21121 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.217746 20884 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.818s	user 0.003s	sys 0.007s
I20260709 13:05:50.219206 20940 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.204994 20705 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.027s	sys 0.047s
I20260709 13:05:50.220652 20428 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.221889 21045 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.224903 20703 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.204659 20599 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:50.151379 20985 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.151268 20948 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.229393 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:50.185527 21073 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.168715 21012 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:50.205152 21094 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.010s	sys 0.009s
I20260709 13:05:50.292816 15188 raft_consensus.cc:2410] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 25 because replica has last-logged OpId of term: 23 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 13:05:50.292533 15868 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:50.209198 21071 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.310175 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:50.298007 20412 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.296172 20884 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.299291 20599 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:50.324124 15309 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.018s
W20260709 13:05:50.327152 15309 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.006s	sys 0.018s
I20260709 13:05:50.305549 21121 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:50.326390 15194 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.038s	sys 0.012s
W20260709 13:05:50.321719 15339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.009s	sys 0.021s
W20260709 13:05:50.309073 21094 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.010s	sys 0.009s
W20260709 13:05:50.331652 15194 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.038s	sys 0.012s
W20260709 13:05:50.331889 15339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.009s	sys 0.021s
I20260709 13:05:50.340965 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3103) took 1747 ms. Trace:
W20260709 13:05:50.329427 15163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.025s	sys 0.025s
I20260709 13:05:50.292152 20940 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.338825 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.342250 15163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.025s	sys 0.026s
W20260709 13:05:50.347586 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.341450 15194 rpcz_store.cc:276] 0709 13:05:48.593700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.593865 (+   165us) service_pool.cc:224] Handling call
0709 13:05:48.627202 (+ 33337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:48.660159 (+ 32957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.660189 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:48.670623 (+ 10434us) log.cc:844] Serialized 52 byte log entry
0709 13:05:49.113951 (+443328us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:49.626661 (+512710us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.627261 (+   600us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.340465 (+713204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.340561 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.340614 (+    53us) raft_consensus.cc:1685] finished
0709 13:05:50.340630 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.340805 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62616,"prepare.queue_time_us":246470,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":6013,"raft.queue_time_us":276586,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":14302,"spinlock_wait_cycles":139914752,"thread_start_us":1457084,"threads_started":3,"wal-append.queue_time_us":663111}
I20260709 13:05:50.313671 20991 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.322315 20701 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:50.350780 15344 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:50.352242 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.367204 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.369462 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.353753 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:50.350824 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 708383us
I20260709 13:05:50.325002 20980 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.373495 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:50.374377 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.356099 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:50.356372 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.301501 20703 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.380051 15160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.000s	sys 0.066s
W20260709 13:05:50.380385 15160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.000s	sys 0.066s
I20260709 13:05:50.329389 20599 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:50.378561 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:50.381012 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 759672us
I20260709 13:05:50.381486 15342 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:50.383935 15344 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:50.385156 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:50.347013 20428 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.392894 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 447784us
I20260709 13:05:50.299093 21132 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.341972 21113 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.350206 21144 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:50.395573 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:50.337946 20884 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.379796 20991 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.407680 15342 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:50.418596 15343 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:05:50.410024 20468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.023s	sys 0.030s
I20260709 13:05:50.446799 15343 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:50.384604 20701 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:50.429936 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 256106us
W20260709 13:05:50.438179 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.441071 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.455147 21111 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.456086 21111 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.466614 20988 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.467451 20988 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.471278 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.419665 20883 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:50.399842 20428 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.405666 21113 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.492619 15194 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:50.428966 21072 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.446605 21054 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.502889 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2208) took 1376 ms. Trace:
I20260709 13:05:50.506629 15194 rpcz_store.cc:276] 0709 13:05:49.126550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.430984 (+1304434us) service_pool.cc:224] Handling call
0709 13:05:50.487636 (+ 56652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.502530 (+ 14894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.502817 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.503369 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.507483 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.508606 15344 raft_consensus.cc:2410] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:50.504437 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:50.451547 20701 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:50.420337 20991 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.485518 21110 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.495340 20980 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:50.522414 15342 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:05:50.487018 20883 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:50.408439 21144 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.490983 21156 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.538174 15344 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:50.501039 20913 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:50.523773 21136 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:05:50.523380 21165 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.558275 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.492015 21097 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.568244 20883 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.569609 20883 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:50.571415 20884 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.571781 15338 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:50.572633 21152 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.572854 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:50.573256 21152 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.575246 21133 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:50.575776 21133 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.575453 21165 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.576223 21133 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:50.574183 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.577996 15338 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
W20260709 13:05:50.578230 21149 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:50.578415 15196 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:05:50.578820 15196 pending_rounds.cc:85] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 12
I20260709 13:05:50.579187 15196 pending_rounds.cc:107] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:05:50.579421 15196 raft_consensus.cc:2889] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:50.579545 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2990) took 1118 ms. Trace:
I20260709 13:05:50.580497 20883 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.580972 21100 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:50.581058 20883 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.581992 20998 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.076s	user 0.015s	sys 0.000s
I20260709 13:05:50.582633 15346 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:50.584471 21099 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.585052 21099 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.585544 20593 consensus_meta.cc:287] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.083s	user 0.010s	sys 0.000s
I20260709 13:05:50.574618 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:50.553741 20703 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.539989 21162 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.589318 15341 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:50.589424 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.579943 15339 rpcz_store.cc:276] 0709 13:05:49.461399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.461820 (+   421us) service_pool.cc:224] Handling call
0709 13:05:49.489189 (+ 27369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:49.502074 (+ 12885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.502105 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:49.502579 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:05:50.341444 (+838865us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:50.341588 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.341766 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.579319 (+237553us) raft_consensus.cc:1685] finished
0709 13:05:50.579340 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.579465 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12418,"raft.queue_time_us":13538,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":838285,"threads_started":1,"wal-append.queue_time_us":919806}
I20260709 13:05:50.578900 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.591289 15344 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:50.588601 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:50.544047 20985 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.607270 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:50.612176 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 216679us
I20260709 13:05:50.614392 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:50.614712 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:50.618675 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:50.624866 15341 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:05:50.586503 21142 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:05:50.626641 15189 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:50.550992 21012 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.554677 21151 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.542960 20980 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:50.635972 20970 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.000s
I20260709 13:05:50.650174 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 419) took 1645 ms. Trace:
I20260709 13:05:50.655886 15192 rpcz_store.cc:276] 0709 13:05:49.004969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.082728 (+ 77759us) service_pool.cc:224] Handling call
0709 13:05:49.082999 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.083221 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:50.161958 (+1078737us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.649761 (+487803us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.649823 (+    62us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:50.649887 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.649964 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.650109 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10210,"prepare.queue_time_us":276878,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":156245,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1547666,"threads_started":3,"wal-append.queue_time_us":387955}
I20260709 13:05:50.624787 20703 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:50.632810 20883 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.638912 21150 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:50.639125 20940 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.545944 21156 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.644737 21110 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.703002 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:50.703794 15192 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:50.700762 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2985) took 1595 ms. Trace:
I20260709 13:05:50.644492 20884 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.646225 20593 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:50.655649 21004 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:50.723325 15193 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:50.716352 15340 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 2989) took 1379 ms. Trace:
I20260709 13:05:50.725549 15340 rpcz_store.cc:276] 0709 13:05:49.336766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.336900 (+   134us) service_pool.cc:224] Handling call
0709 13:05:49.339911 (+  3011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:49.340232 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.340259 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:49.340708 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:05:50.063877 (+723169us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:50.063938 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.064028 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.716077 (+652049us) raft_consensus.cc:1685] finished
0709 13:05:50.716108 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.716273 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1349,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":720483,"threads_started":1,"wal-append.queue_time_us":1002493}
I20260709 13:05:50.690959 21163 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.696841 21150 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.731003 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:50.706044 15337 rpcz_store.cc:276] 0709 13:05:49.105546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.106876 (+  1330us) service_pool.cc:224] Handling call
0709 13:05:49.107276 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:49.107732 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.107772 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:49.108368 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.944897 (+836529us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:50.422626 (+477729us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.699907 (+277281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.700004 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.700049 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:50.700063 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.700676 (+   613us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10897,"prepare.queue_time_us":405643,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":66123,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":13916,"thread_start_us":1509146,"threads_started":3,"wal-append.queue_time_us":1080838}
I20260709 13:05:50.625921 21162 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.713111 20883 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.680156 20970 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.704187 21174 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.744875 21174 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.734404 21150 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:50.747586 21160 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:05:50.752269 15342 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:50.752700 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2200) took 1635 ms. Trace:
I20260709 13:05:50.753242 15189 rpcz_store.cc:276] 0709 13:05:49.117157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.800841 (+683684us) service_pool.cc:224] Handling call
0709 13:05:49.801207 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.636904 (+835697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.752407 (+115503us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b54000c03d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:50.752623 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1897873152}
I20260709 13:05:50.734947 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.755513 21111 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.756927 21156 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.757181 21050 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.758504 20980 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.715049 20703 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:50.647598 21151 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.759636 20703 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.761036 21152 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.735847 21173 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:50.762817 21173 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.765440 21173 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.766541 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2834) took 1710 ms. Trace:
I20260709 13:05:50.766975 15269 rpcz_store.cc:276] 0709 13:05:49.055709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.063119 (+  7410us) service_pool.cc:224] Handling call
0709 13:05:49.063370 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.366432 (+303062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.766288 (+1399856us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400348854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:50.766478 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607891200}
I20260709 13:05:50.734974 21132 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.725780 20884 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:50.740244 21154 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:05:50.741986 20663 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.844s	user 0.014s	sys 0.001s
I20260709 13:05:50.725492 21165 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.743862 20428 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.744038 21144 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:50.739009 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:50.769348 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 2994) took 1281 ms. Trace:
I20260709 13:05:50.769279 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:50.815869 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47929.8us
W20260709 13:05:50.781545 21127 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.664s	user 0.006s	sys 0.020s
I20260709 13:05:50.782603 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:50.734051 21120 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.835s	user 0.006s	sys 0.011s
I20260709 13:05:50.768920 20883 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.815263 15346 rpcz_store.cc:276] 0709 13:05:49.487889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.488010 (+   121us) service_pool.cc:224] Handling call
0709 13:05:50.769186 (+1281176us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400096ad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:50.769292 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2302671232}
I20260709 13:05:50.725332 21110 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.790370 20948 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.792972 20991 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.801075 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:50.742921 21133 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.801852 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:50.728586 21100 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:50.777770 20979 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.634s	user 0.009s	sys 0.002s
I20260709 13:05:50.815128 20663 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:50.826584 20599 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.828846 20701 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.829862 21150 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.831285 20941 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:50.823323 21120 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:50.841506 20979 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:50.736092 21163 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:50.845263 21133 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:50.864049 21163 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:50.867980 21158 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.327s	user 0.003s	sys 0.000s
I20260709 13:05:50.913183 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3099) took 2322 ms. Trace:
I20260709 13:05:50.914390 15190 rpcz_store.cc:276] 0709 13:05:48.590180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.590657 (+   477us) service_pool.cc:224] Handling call
0709 13:05:48.628051 (+ 37394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:48.716972 (+ 88921us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b480021c258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:05:48.939180 (+222208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.939209 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:48.939740 (+   531us) log.cc:844] Serialized 52 byte log entry
0709 13:05:48.976394 (+ 36654us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:49.928433 (+952039us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.942872 (+ 14439us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.754004 (+811132us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b180011c0e0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e52c3d70 00007f36e52b7293 00007f36e52accea 00007f36e52ad23a 00007f36e5717a2a 00007f36e57270bf 00007f36e5727038
0709 13:05:50.911658 (+157654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.911967 (+   309us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:50.912165 (+   198us) raft_consensus.cc:1685] finished
0709 13:05:50.912217 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.912685 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":870165,"prepare.queue_time_us":398014,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":196138,"raft.run_cpu_time_us":2475,"raft.run_wall_time_us":50602,"spinlock_wait_cycles":34929280,"thread_start_us":1205855,"threads_started":3,"wal-append.queue_time_us":105585}
I20260709 13:05:50.919387 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:50.914759 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 3134) took 1392 ms. Trace:
I20260709 13:05:50.920931 15190 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:05:50.921033 15188 rpcz_store.cc:276] 0709 13:05:49.522126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.643327 (+121201us) service_pool.cc:224] Handling call
0709 13:05:50.914164 (+1270837us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54001e64d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:50.914535 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938071296}
I20260709 13:05:50.923666 15191 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:50.925138 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2192) took 1826 ms. Trace:
I20260709 13:05:50.925530 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2186) took 1907 ms. Trace:
I20260709 13:05:50.926028 15191 rpcz_store.cc:276] 0709 13:05:49.018215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.651978 (+633763us) service_pool.cc:224] Handling call
0709 13:05:49.764648 (+112670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.924369 (+1159721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.925200 (+   831us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000f87d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:50.925453 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663778176}
I20260709 13:05:50.925876 15193 rpcz_store.cc:276] 0709 13:05:49.098378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.753081 (+654703us) service_pool.cc:224] Handling call
0709 13:05:49.753398 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.725143 (+971745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.924264 (+199121us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400409554. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:50.924843 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2229716736}
I20260709 13:05:50.929637 15191 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:50.930069 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:50.933724 15194 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:50.934517 15188 raft_consensus.cc:606] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:50.769279 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3119) took 2075 ms. Trace:
I20260709 13:05:50.935457 15189 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:50.936430 15195 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:05:50.936906 15195 pending_rounds.cc:85] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 11
I20260709 13:05:50.936949 15190 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:50.937484 15195 pending_rounds.cc:107] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:05:50.795853 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2209) took 1667 ms. Trace:
I20260709 13:05:50.937784 15195 raft_consensus.cc:2889] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:50.938098 15196 rpcz_store.cc:276] 0709 13:05:49.128409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.461951 (+1333542us) service_pool.cc:224] Handling call
0709 13:05:50.462343 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.579878 (+117535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.795573 (+215695us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002251d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:50.795782 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266153856}
I20260709 13:05:50.940304 15196 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:50.940472 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2206) took 1821 ms. Trace:
I20260709 13:05:50.940961 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2214) took 1599 ms. Trace:
I20260709 13:05:50.932576 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3121) took 1601 ms. Trace:
I20260709 13:05:50.940925 15195 rpcz_store.cc:276] 0709 13:05:49.118757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.105090 (+986333us) service_pool.cc:224] Handling call
0709 13:05:50.935488 (+830398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.938579 (+  3091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.940211 (+  1632us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54001e64d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:50.940394 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1908644736}
I20260709 13:05:50.941861 15192 rpcz_store.cc:276] 0709 13:05:49.330935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.930806 (+1599871us) service_pool.cc:224] Handling call
0709 13:05:50.931413 (+   607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.931938 (+   525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.931983 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.932068 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:50.932117 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.932194 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.932348 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.943288 15195 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:50.935746 15197 rpcz_store.cc:276] 0709 13:05:48.693798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.997842 (+304044us) service_pool.cc:224] Handling call
0709 13:05:48.998134 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.998277 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:50.076594 (+1078317us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.765604 (+689010us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b1800273ee0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:05:50.765731 (+   127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.765780 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:50.765825 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.765891 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.769219 (+  3328us) inbound_call.cc:177] Queueing success response
0709 13:05:50.866521 (+ 97302us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b1800273ee0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e25ee2a6 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db
0709 13:05:50.867496 (+   975us) spinlock_profiling.cc:243] Waited 6.45 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
Metrics: {"mutex_wait_us":39107,"prepare.queue_time_us":361657,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":154820,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":30114,"spinlock_wait_cycles":70074368,"thread_start_us":1458031,"threads_started":3,"wal-append.queue_time_us":419108}
I20260709 13:05:50.943980 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2215) took 1602 ms. Trace:
I20260709 13:05:50.944558 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3125) took 1537 ms. Trace:
I20260709 13:05:50.945044 15192 rpcz_store.cc:276] 0709 13:05:49.407353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.943395 (+1536042us) service_pool.cc:224] Handling call
0709 13:05:50.943837 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.944204 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.944236 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.944302 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:50.944337 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.944392 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.944496 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.941601 15196 rpcz_store.cc:276] 0709 13:05:49.341160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.939326 (+1598166us) service_pool.cc:224] Handling call
0709 13:05:50.939825 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.940700 (+   875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.940916 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.944380 15195 rpcz_store.cc:276] 0709 13:05:49.341443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.942356 (+1600913us) service_pool.cc:224] Handling call
0709 13:05:50.942806 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.943716 (+   910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.943926 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.952593 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2210) took 1625 ms. Trace:
I20260709 13:05:50.953238 15194 rpcz_store.cc:276] 0709 13:05:49.327215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.507769 (+1180554us) service_pool.cc:224] Handling call
0709 13:05:50.540579 (+ 32810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.934852 (+394273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.952085 (+ 17233us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b54002256d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:50.952485 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":902766336}
I20260709 13:05:50.933698 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3123) took 1602 ms. Trace:
I20260709 13:05:50.958238 15191 rpcz_store.cc:276] 0709 13:05:49.331495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.928651 (+1597156us) service_pool.cc:224] Handling call
0709 13:05:50.929263 (+   612us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.933408 (+  4145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.933618 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.960067 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3131) took 1550 ms. Trace:
I20260709 13:05:50.961035 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3133) took 1551 ms. Trace:
I20260709 13:05:50.937772 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2212) took 1597 ms. Trace:
I20260709 13:05:50.966743 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3128) took 1558 ms. Trace:
I20260709 13:05:50.966369 15190 rpcz_store.cc:276] 0709 13:05:49.340598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.935903 (+1595305us) service_pool.cc:224] Handling call
0709 13:05:50.936482 (+   579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.937499 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.937719 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.967480 15192 rpcz_store.cc:276] 0709 13:05:49.408251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.946073 (+1537822us) service_pool.cc:224] Handling call
0709 13:05:50.946604 (+   531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.946920 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.946945 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.947012 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:50.966423 (+ 19411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.966527 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.966663 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.935163 15188 raft_consensus.cc:614] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:50.960601 15194 rpcz_store.cc:276] 0709 13:05:49.409168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.954732 (+1545564us) service_pool.cc:224] Handling call
0709 13:05:50.959278 (+  4546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.959653 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.959680 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.959740 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:50.959808 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.959876 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.960001 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:50.803248 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2760) took 1459 ms. Trace:
I20260709 13:05:50.971498 15267 rpcz_store.cc:276] 0709 13:05:49.343457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.346167 (+  2710us) service_pool.cc:224] Handling call
0709 13:05:49.346514 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.440912 (+ 94398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.786826 (+1345914us) spinlock_profiling.cc:243] Waited 59 ms on lock 0x7b5400011654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:50.787020 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135776640}
I20260709 13:05:50.972164 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.973227 15268 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:50.973227 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.974642 15267 raft_consensus.cc:2410] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:05:50.975066 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.976179 15266 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:50.976059 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.977454 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.974830 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.977784 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.978263 15266 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:50.978497 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.978574 15268 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:50.978806 15271 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
W20260709 13:05:50.980335 15238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.968s (SENT) [suppressed 15 similar messages]
I20260709 13:05:50.985054 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.985882 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:50.980264 15264 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:50.985083 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:50.996414 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.996781 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
W20260709 13:05:50.997519 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.997689 15345 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:50.999377 15265 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:51.007897 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:51.008651 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.966082 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 67) took 10041 ms. Trace:
I20260709 13:05:51.010154 15264 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:50.966197 15191 rpcz_store.cc:276] 0709 13:05:49.409689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.959858 (+1550169us) service_pool.cc:224] Handling call
0709 13:05:50.960333 (+   475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.960628 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.960665 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.960718 (+    53us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:50.960772 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.960845 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.960965 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.043289 15161 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.020s
I20260709 13:05:51.043628 15270 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:51.043807 15161 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.004s	sys 0.020s
I20260709 13:05:51.043296 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.045650 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.046603 15265 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:50.848217 20929 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:51.048239 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.055838 15269 raft_consensus.cc:2368] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:51.057782 15189 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:51.065976 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3124) took 1726 ms. Trace:
I20260709 13:05:51.067134 15189 rpcz_store.cc:276] 0709 13:05:49.331736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.934234 (+1602498us) service_pool.cc:224] Handling call
0709 13:05:50.934943 (+   709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.058328 (+123385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.058586 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.075278 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.077595 21112 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:51.084820 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.093354 20428 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:51.094426 20428 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.095247 21111 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.096158 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:51.096285 21111 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.097630 20428 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.098272 20929 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:50.844414 21100 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.099821 20929 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.101357 20929 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:51.101970 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.102490 20993 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.103293 20993 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.083696 20592 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.105996 20857 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:05:51.111681 21004 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.106882 20592 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:51.112622 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 93193.8us
I20260709 13:05:51.112798 20940 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:05:51.113950 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:51.105415 21144 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:51.115211 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 118927us
I20260709 13:05:51.115741 21156 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:51.117291 21163 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:51.117964 21163 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.117729 20702 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:05:51.118573 21163 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:51.078866 20948 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:51.115484 21094 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:51.086457 20941 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:05:51.123754 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.120008 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46344 (request call id 81) took 1094 ms. Trace:
I20260709 13:05:51.128558 21101 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.114522 20940 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:05:51.130414 20946 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.131161 21120 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:51.131636 20980 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:51.134357 15194 rpcz_store.cc:276] 0709 13:05:49.997371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.034024 (+1036653us) service_pool.cc:224] Handling call
0709 13:05:51.091706 (+ 57682us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:51.141055 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.144021 21101 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.152521 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.135422 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.133530 21094 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:51.126689 15264 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.147348 20599 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.146016 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3130) took 1727 ms. Trace:
W20260709 13:05:51.169624 21190 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 13:05:51.115510 21144 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.180027 15189 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:51.181134 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3136) took 1658 ms. Trace:
I20260709 13:05:51.184432 20948 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.236760 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.239128 15189 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:51.236515 15192 rpcz_store.cc:276] 0709 13:05:49.522719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.968829 (+1446110us) service_pool.cc:224] Handling call
0709 13:05:50.969424 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.042849 (+ 73425us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:51.124692 (+ 81843us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.180652 (+ 55960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.180728 (+    76us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:51.180805 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.180896 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.181060 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45203,"prepare.queue_time_us":45760,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":39499,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":4327,"thread_start_us":66018,"threads_started":2,"wal-append.queue_time_us":77722}
I20260709 13:05:51.242707 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.243306 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.243551 15342 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:05:51.243572 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.244071 15189 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:51.244565 15192 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:51.244904 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.245111 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.245551 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.245811 15189 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:51.246223 15192 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:51.247306 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.248580 15192 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:51.249550 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.250270 15192 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:51.250723 21050 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.251173 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.251380 21050 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.251950 15192 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:51.254554 21050 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.256457 21162 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.185967 20940 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:51.256944 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.257265 20940 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:51.257738 15192 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:51.258709 20940 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.260402 20940 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:51.186877 20850 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:51.263468 20850 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:51.188030 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.264192 15188 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:51.258862 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:51.264719 20850 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.265408 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:51.266523 15188 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:51.266486 20850 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:51.112646 21004 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.268922 21113 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.269299 21004 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.187352 20702 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:51.270147 20702 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:51.190228 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76544.1us
I20260709 13:05:51.189203 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.196157 21144 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.206183 21000 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.284356 21111 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.284945 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.284812 21000 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:51.285804 15188 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:51.286214 20663 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.206933 21094 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.286835 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.287979 15188 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:51.288014 21094 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:51.288390 21174 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.289021 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.289909 15188 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
W20260709 13:05:51.210361 15082 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:05:51.291332 15082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 81223.4us
I20260709 13:05:51.292057 21174 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:51.293650 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.294603 15343 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:51.294757 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:51.212606 21101 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.296707 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:51.206974 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3127) took 1799 ms. Trace:
I20260709 13:05:51.297047 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.297731 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.298017 15337 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:51.298218 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.297240 21101 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:51.297433 15197 rpcz_store.cc:276] 0709 13:05:49.407966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.944243 (+1536277us) service_pool.cc:224] Handling call
0709 13:05:50.944668 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:50.945223 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.945252 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:50.945840 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.033333 (+ 87493us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:51.033394 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.033528 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.206737 (+173209us) raft_consensus.cc:1685] finished
0709 13:05:51.206766 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.206907 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132946,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":149,"thread_start_us":86947,"threads_started":1,"wal-append.queue_time_us":86880}
I20260709 13:05:51.300549 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.301086 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.169827 15195 rpcz_store.cc:276] 0709 13:05:49.408891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.948211 (+1539320us) service_pool.cc:224] Handling call
0709 13:05:50.948912 (+   701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.949581 (+   669us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:50.950142 (+   561us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.136383 (+186241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.136435 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:51.136478 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.136549 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.136679 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40689,"prepare.queue_time_us":79023,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":59363,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":13689,"spinlock_wait_cycles":11136,"thread_start_us":130149,"threads_started":1}
I20260709 13:05:51.302590 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.300388 21183 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:51.221551 21150 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.300501 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.223048 20988 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.224138 20946 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.303906 20979 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.303992 15197 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:51.305120 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.305305 20701 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:51.205448 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 78624.3us
I20260709 13:05:51.306365 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.307407 20883 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.309912 20883 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:51.225195 21110 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.227099 21097 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.228327 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3120) took 1898 ms. Trace:
I20260709 13:05:51.312587 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:51.228461 15870 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 507) took 1860 ms. Trace:
I20260709 13:05:51.297029 21099 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.313545 21097 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:51.314095 21097 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.314785 21097 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:51.313618 15870 rpcz_store.cc:276] 0709 13:05:49.367612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.367747 (+   135us) service_pool.cc:224] Handling call
0709 13:05:49.368038 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.483410 (+115372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:49.483439 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:49.483493 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:49.483526 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.228054 (+1744528us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540068f6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:51.228130 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.228268 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264870656}
I20260709 13:05:51.232942 21098 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:51.239555 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.316378 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:51.012367 15093 rpcz_store.cc:276] 0709 13:05:40.924649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.924831 (+   182us) service_pool.cc:224] Handling call
0709 13:05:50.965839 (+10041008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:48.718385 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:48.718946 (+   561us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:48.718975 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:05:48.718993 (+    18us) tablet.cc:662] Decoding operations
0709 13:05:48.948856 (+229863us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:48.948919 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:48.948945 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:48.949434 (+   489us) tablet.cc:701] Row locks acquired
0709 13:05:48.949453 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:05:48.949597 (+   144us) write_op.cc:270] Start()
0709 13:05:48.949706 (+   109us) write_op.cc:276] Timestamp: P: 1783602348949551 usec, L: 0
0709 13:05:48.949726 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:05:48.950407 (+   681us) log.cc:844] Serialized 1735 byte log entry
0709 13:05:50.489396 (+1538989us) op_driver.cc:464] REPLICATION: finished
0709 13:05:50.776936 (+287540us) write_op.cc:301] APPLY: starting
0709 13:05:50.777015 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:50.834309 (+ 57294us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:50.834529 (+   220us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:50.836988 (+  2459us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:50.837199 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:05:50.837260 (+    61us) write_op.cc:312] APPLY: finished
0709 13:05:50.863288 (+ 26028us) log.cc:844] Serialized 48 byte log entry
0709 13:05:50.870556 (+  7268us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:50.870639 (+    83us) write_op.cc:454] Released schema lock
0709 13:05:50.870674 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:50.871110 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:50.871143 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3959976,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":282502,"apply.run_cpu_time_us":7597,"apply.run_wall_time_us":94124,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20871,"num_ops":4,"prepare.queue_time_us":127420,"prepare.run_cpu_time_us":25812,"prepare.run_wall_time_us":290336,"raft.queue_time_us":1407973,"raft.run_cpu_time_us":23369,"raft.run_wall_time_us":311366,"replication_time_us":1474080,"thread_start_us":1395265,"threads_started":4,"wal-append.queue_time_us":41140}]]}
I20260709 13:05:51.239976 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.240765 20948 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.241184 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.245973 15339 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:51.320569 20946 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.312364 15193 rpcz_store.cc:276] 0709 13:05:49.330293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.928199 (+1597906us) service_pool.cc:224] Handling call
0709 13:05:50.928936 (+   737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:50.929802 (+   866us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.929851 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:50.930849 (+   998us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.054139 (+123290us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:51.054172 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.054257 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:51.228109 (+173852us) raft_consensus.cc:1685] finished
0709 13:05:51.228130 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.228268 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146059,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":210,"thread_start_us":122783,"threads_started":1,"wal-append.queue_time_us":294565}
I20260709 13:05:51.322872 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.323674 15193 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:51.324709 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.325394 15193 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:51.326398 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.246764 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.265296 15192 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:51.187399 20980 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:51.186296 21120 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:51.203451 15264 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:51.272460 20884 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.239192 21100 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.273017 20702 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.275707 20970 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.279006 20993 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.281105 21151 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.282629 20592 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.283345 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:51.283953 15194 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:51.303545 21183 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:51.311364 21000 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.327298 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.327564 15193 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:05:51.327931 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 347746us
I20260709 13:05:51.334126 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.360514 21183 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.362236 21183 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:51.363405 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.364506 15339 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:51.367439 21120 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:51.367959 20946 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.368680 20946 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:51.369769 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86578.4us
I20260709 13:05:51.375299 20948 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:51.375669 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.376273 20948 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:51.377528 15266 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:51.377856 20944 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:05:51.380510 20980 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:51.380805 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:51.391914 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 79428.5us
I20260709 13:05:51.399765 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.403898 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.412058 20946 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.415596 15267 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:51.409160 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.418278 15339 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 11.
I20260709 13:05:51.419763 15195 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:51.421155 15195 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:05:51.423377 15194 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [15.7-16.8]
I20260709 13:05:51.424535 20702 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:51.426321 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.427140 15272 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
I20260709 13:05:51.408248 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.449280 15188 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:51.452893 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57902 (request call id 2) took 2071 ms. Trace:
I20260709 13:05:51.447500 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.463532 15264 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:05:51.464216 15264 pending_rounds.cc:85] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 11
I20260709 13:05:51.463917 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.453601 15195 rpcz_store.cc:276] 0709 13:05:49.376807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.422034 (+2045227us) service_pool.cc:224] Handling call
0709 13:05:51.448016 (+ 25982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:51.466841 15264 pending_rounds.cc:107] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:05:51.467658 15264 raft_consensus.cc:2889] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:51.467135 15339 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
W20260709 13:05:51.471434 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.400853 21097 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.484475 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.442113 20948 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:05:51.501842 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.502645 15263 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
W20260709 13:05:51.503046 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.501871 20940 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:51.500610 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 90854.1us
I20260709 13:05:51.506981 20946 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.503780 20940 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.523967 20940 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:51.516534 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.527786 15346 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:05:51.537179 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.539768 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.540310 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.512239 21097 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.543205 15264 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:05:51.541239 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 138978us
I20260709 13:05:51.547642 15192 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:51.547668 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.549216 15267 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:05:51.553062 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43995.4us
I20260709 13:05:51.551898 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3129) took 2143 ms. Trace:
I20260709 13:05:51.514659 20946 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:51.563760 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.548174 20663 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.564529 15346 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:51.564739 20663 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:51.565315 20946 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:51.557916 21204 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.569474 21204 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.569810 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:51.570911 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:51.571841 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:51.572127 21204 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.572702 21050 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:51.573325 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:51.573912 21050 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:51.568783 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.575155 15264 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 11.
I20260709 13:05:51.576222 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.576838 15263 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:05:51.571548 20946 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:51.579659 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.580760 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.581664 20948 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:51.581811 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.582173 20948 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.582588 20948 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:51.582850 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 143402us
I20260709 13:05:51.583843 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:51.585345 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:51.586236 21204 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:51.586714 21204 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.587131 21204 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:51.587349 20944 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:51.587636 21097 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:51.587787 20944 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.588047 21097 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.588178 20944 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:51.588483 21097 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:51.587234 21120 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:51.589893 21120 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:51.590287 21120 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:51.553869 15196 rpcz_store.cc:276] 0709 13:05:49.408590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.955098 (+1546508us) service_pool.cc:224] Handling call
0709 13:05:50.955662 (+   564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.100713 (+145051us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:51.158712 (+ 57999us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.466645 (+307933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.467751 (+  1106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:51.467847 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.551686 (+ 83839us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54000f9bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:51.551731 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.551856 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11202,"prepare.queue_time_us":103537,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":21666,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":3841,"spinlock_wait_cycles":332683648,"thread_start_us":246615,"threads_started":2,"wal-append.queue_time_us":347754}
I20260709 13:05:51.591969 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.594137 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:51.595463 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.595899 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.596052 21050 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:51.596935 20980 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:51.615259 20980 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:51.615638 20948 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.597571 20663 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:51.600296 15090 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 8 to 9, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 9 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:51.601553 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 176277us
I20260709 13:05:51.510749 21163 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:51.603940 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.610170 21097 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.595938 20940 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.613088 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.613823 15263 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:51.616315 20980 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.614413 20946 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:51.624564 15267 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:51.625053 20980 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:51.625440 21094 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:51.625891 21094 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.626209 20946 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:51.619470 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3135) took 2097 ms. Trace:
I20260709 13:05:51.621096 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.605926 15339 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:51.626276 21094 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:51.611016 21183 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:51.622319 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:51.622684 21203 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:05:51.634446 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.627440 15190 rpcz_store.cc:276] 0709 13:05:49.522443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.968261 (+1445818us) service_pool.cc:224] Handling call
0709 13:05:50.968802 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.047308 (+ 78506us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:51.330287 (+282979us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.547946 (+217659us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.547999 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:51.551246 (+  3247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.619227 (+ 67981us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b5400235fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:51.619279 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.619418 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37490,"prepare.queue_time_us":98043,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":1698,"raft.queue_time_us":4703,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":289,"spinlock_wait_cycles":94501632,"thread_start_us":471694,"threads_started":2,"wal-append.queue_time_us":258713}
I20260709 13:05:51.633901 15869 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:51.646665 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:51.647718 20663 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:51.648175 20663 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.648695 20663 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:51.651146 15346 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:51.652500 21050 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:51.627063 20946 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:51.658252 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 64225.3us
I20260709 13:05:51.658532 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.639544 21183 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.660661 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.661296 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:51.666657 15870 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 12: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:51.668588 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.663339 21183 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:51.673074 21153 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:51.680913 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.670588 21120 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.674518 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.679388 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.679664 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.680171 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.680862 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.673418 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:51.712581 15263 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 11.
I20260709 13:05:51.711295 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:51.714119 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 52193.9us
I20260709 13:05:51.659595 21050 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:05:51.718472 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.719283 15264 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:51.721218 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:51.720749 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:51.682835 21153 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.723311 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.698782 21165 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.702124 21132 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.682706 20948 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.710239 21097 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.710239 21163 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.726073 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.690641 20702 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.728847 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45598.8us
I20260709 13:05:51.727792 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.725591 20993 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:51.732064 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.732167 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.733196 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.734462 20850 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:51.735221 20850 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:51.735361 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.728232 21204 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.736101 20929 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:51.736353 21144 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:51.736563 20929 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.736765 21144 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.736971 20929 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:51.737522 15268 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:51.737941 21204 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.738837 21144 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:51.739612 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.740564 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.735683 20850 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:51.741899 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.727022 21153 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:51.749318 15346 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:05:51.778560 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.751569 20940 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.753175 21211 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:51.755201 15263 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:05:51.717164 20944 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.756336 15090 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 8 to 10, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 10 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:51.757784 21120 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.758194 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.758916 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.759373 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.761356 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:51.794662 15869 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:51.767952 21144 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.796564 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.797407 15337 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:51.777938 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:51.798254 21144 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.771214 21134 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:51.791432 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.783281 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.793578 15340 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:51.746227 21132 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.783187 20702 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:51.799005 21134 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:51.800688 20944 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:51.806679 21211 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:51.802970 15345 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:51.804510 21152 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.808836 21152 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.809814 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:51.810230 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.800798 15339 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:51.811909 20944 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:51.811820 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.805517 21132 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.805850 20702 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:51.799638 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.817938 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.818887 21152 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:51.734287 20946 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.799816 21097 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:51.822484 21097 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.745476 21204 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:05:51.823086 21097 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:51.806712 21134 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:51.825670 21204 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:51.826172 21204 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.812577 20944 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.826538 21204 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:51.826880 20944 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:51.796664 21212 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:05:51.802345 15090 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 8 to 11, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 11 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:51.838584 20993 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:51.839318 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:51.839639 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 166423us
I20260709 13:05:51.843818 15268 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 8. (term mismatch)
I20260709 13:05:51.844445 15268 pending_rounds.cc:85] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 7
I20260709 13:05:51.844762 15268 pending_rounds.cc:107] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:05:51.845090 15268 raft_consensus.cc:2889] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:51.731230 21165 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.848860 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.849682 15339 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:51.846516 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:51.852197 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.853448 20948 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:51.854001 20948 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:51.839174 21132 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:51.839102 20993 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.885129 20850 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.887427 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:51.897805 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.837939 21183 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:51.899426 15869 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:51.914031 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:51.914747 15196 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:51.879177 21132 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.950807 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.878638 20993 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:51.842509 20929 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:51.956897 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 275733us
W20260709 13:05:51.951045 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 232561us
I20260709 13:05:51.970458 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:51.971361 15192 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:51.977217 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.982491 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:51.983965 15195 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:51.951273 21152 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:51.987253 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.987800 15346 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:51.962252 21132 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:51.992635 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 110272us
I20260709 13:05:51.994692 15343 raft_consensus.cc:2410] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:51.995157 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:51.998333 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:51.999185 15188 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:52.006358 21215 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:05:52.017450 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:52.019490 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:51.879422 20948 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:52.022606 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:52.001343 20850 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.026985 21152 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.027570 21152 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.029726 21152 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.033843 21204 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.036242 21204 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.036293 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:52.039440 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 179186us
I20260709 13:05:52.040374 15160 leader_election.cc:400] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:52.041204 15237 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:52.042220 21212 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:52.042994 21183 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.043661 21212 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:52.046108 21050 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:52.047597 21094 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.049729 21094 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.049973 21134 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.026029 21215 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:05:52.051525 21215 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:52.051915 21215 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:52.052744 21215 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.054136 21215 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:52.055545 21165 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.055817 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:52.056553 15090 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:52.057464 15345 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:52.058804 21132 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:52.061208 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:52.061476 21132 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:52.062135 15342 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:52.007359 20980 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:05:52.062698 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.065725 21097 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.056591 15340 raft_consensus.cc:2368] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:52.071023 15196 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
W20260709 13:05:52.075379 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.074431 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47764.6us
I20260709 13:05:52.075259 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:51.987146 20663 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:52.075477 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.109547 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:52.111960 15188 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:52.112509 15192 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:52.058475 15090 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 12 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 15 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:52.122191 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.121776 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:52.123700 15192 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:52.062145 21132 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:52.125334 15340 raft_consensus.cc:2368] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:52.121264 21213 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 13:05:52.067615 21212 consensus_queue.cc:1175] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" responder_term: 16 status { last_received { term: 16 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 16 index: 10 } }
I20260709 13:05:52.130755 15342 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:52.118161 21094 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:52.143770 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:52.125694 21152 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:52.115106 20980 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:05:52.148813 15345 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:52.114521 21204 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:05:52.149533 21132 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:05:52.153582 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:52.143575 21211 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:05:52.154840 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:52.155356 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:52.156194 21211 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:52.156347 21204 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:52.156872 15268 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:05:52.159209 20663 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:52.159886 20663 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:52.160233 20663 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:52.160638 20663 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:52.152031 21213 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:52.155207 21212 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:52.164692 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.165351 15268 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:05:52.157966 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.167052 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.167788 15265 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:52.168503 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.169463 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.169981 15265 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:52.170680 15339 pending_rounds.cc:85] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 13
I20260709 13:05:52.171013 15339 pending_rounds.cc:107] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:05:52.171286 15339 raft_consensus.cc:2889] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.171388 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.172801 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.157857 21204 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:52.173935 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.174038 21204 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:52.174504 15263 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:52.174942 21204 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.179502 15340 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:52.180877 21134 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.176653 21204 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:52.181787 20929 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.184267 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:52.185199 20929 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:52.188333 21097 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.145331 21152 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.195511 21152 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:52.174629 15268 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:52.201124 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.204566 15263 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:52.205492 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.114820 21153 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.208740 15265 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:52.224444 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:52.207883 15090 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 15 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.229434 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.234411 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.236234 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.212049 21211 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:05:52.243471 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet 659b62cebe2e47e793145022f6eed4ba: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:52.243621 21211 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:52.245012 21211 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:52.246676 21211 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:52.247442 15341 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:52.248869 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.249858 15342 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:05:52.251574 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:52.253090 15195 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:52.254179 21165 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:52.266633 20929 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:52.265033 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:52.271659 21204 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:52.272171 21204 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:52.272680 21204 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:52.272833 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:52.217839 21094 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.276679 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:52.236478 20944 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:52.272900 21214 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.230s	user 0.003s	sys 0.000s
I20260709 13:05:52.283063 15345 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 12.
W20260709 13:05:52.281344 15272 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.001s	sys 0.022s
W20260709 13:05:52.285053 15272 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.001s	sys 0.022s
I20260709 13:05:52.285332 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:52.268939 15263 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:52.301580 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:52.304601 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.308391 15333 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e75f905ad042d89b465e6461b29a5d with delete_type TABLET_DATA_TOMBSTONED (TS 9d785ccef0634edd9f0fbb52fa1c8d27 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:34528
I20260709 13:05:52.309990 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.314011 15090 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 17, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 17 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:52.315654 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:05:52.316861 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:52.317878 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:52.318626 21213 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:52.319043 21212 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:52.319074 21213 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.319665 21212 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:52.319783 21213 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:52.320286 21212 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:52.295115 20929 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:52.328656 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:52.331408 15195 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:52.333033 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:52.337291 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 64539.7us
I20260709 13:05:52.338357 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.339336 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.317108 15090 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 14, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 14 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:05:52.335724 15264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.026s	sys 0.000s
I20260709 13:05:52.327864 21120 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:05:52.345775 15264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.026s	sys 0.000s
I20260709 13:05:52.342552 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:52.300938 20993 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.329597 20929 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:52.333771 20946 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:52.354123 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.347600 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:52.346225 15271 raft_consensus.cc:2368] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:52.365290 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.366338 15188 raft_consensus.cc:2368] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:52.367983 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.368999 15194 raft_consensus.cc:2368] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:52.369565 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.371080 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:52.372799 15267 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.055s	sys 0.173s
W20260709 13:05:52.373196 15267 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.055s	sys 0.173s
I20260709 13:05:52.373445 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.345451 20980 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:52.377324 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.378834 15189 raft_consensus.cc:2376] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21. Re-sending same reply.
I20260709 13:05:52.386190 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.387390 15189 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:52.388772 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:52.384632 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 343483us
I20260709 13:05:52.356029 20929 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:52.354419 20946 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:52.375285 20701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.009s	sys 0.065s
I20260709 13:05:52.396792 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.400102 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:52.401320 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:52.403854 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65741.5us
I20260709 13:05:52.369580 21094 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.364353 21153 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.376601 20980 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.421222 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.422057 15193 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:52.415374 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:52.416671 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.424113 15194 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:52.406286 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.354761 21120 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.429649 15188 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:52.431246 15311 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:52.403401 20985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.012s	sys 0.058s
W20260709 13:05:52.405416 20701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.010s	sys 0.065s
I20260709 13:05:52.426612 20980 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:52.372953 20663 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.440156 15189 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:52.441112 20663 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.441277 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.441951 15189 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:52.447966 20980 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.405679 20946 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:52.461364 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.450474 20980 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.465049 15189 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
W20260709 13:05:52.453050 20985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.012s	sys 0.058s
I20260709 13:05:52.452608 20944 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:52.467476 21229 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:05:52.468549 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62380.1us
I20260709 13:05:52.469033 20985 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:52.469262 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.469769 20985 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:52.470418 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.471298 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.471599 21094 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:52.472352 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.472594 21094 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:52.474010 20944 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:52.474566 20944 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:52.473855 21094 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.455369 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.495477 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.497457 20701 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:52.501261 20701 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:52.501780 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.502408 15189 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:52.412796 21213 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.475262 21144 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:52.507784 15197 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:52.468575 21229 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.518051 15197 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:05:52.519687 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:52.520525 15197 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:52.498574 21183 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:52.522279 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:52.511230 15271 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:52.512141 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:52.526510 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 285130us
I20260709 13:05:52.526715 15188 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:52.460855 21152 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.533454 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.532050 15311 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:05:52.542687 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 133634us
I20260709 13:05:52.542833 15195 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:52.502472 20701 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.539175 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.543159 15193 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:52.549976 15869 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:52.554270 15196 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:52.555862 15195 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:05:52.525751 21229 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:52.525588 21183 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:05:52.567270 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 491843us
I20260709 13:05:52.531410 21144 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:52.568356 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.480252 20985 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.548962 20702 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:52.587349 15193 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:05:52.602082 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:52.605010 15189 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:52.600962 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.631618 15271 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:05:52.632974 15188 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:52.635389 15268 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:05:52.635888 15189 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:05:52.636420 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 68180.5us
I20260709 13:05:52.637776 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.475517 20944 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.578174 21183 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:52.642268 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 98330.2us
I20260709 13:05:52.646065 15193 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [15.9-16.10]
I20260709 13:05:52.657541 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:52.642377 20663 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:52.667582 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.668318 15189 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [15.10-19.13]
I20260709 13:05:52.578030 20948 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:05:52.677367 15193 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:52.642204 21165 raft_consensus.cc:2764] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:52.638881 20993 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.689930 15238 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:52.696300 20934 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:52.696681 21228 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:52.697259 21152 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:52.697557 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 370755us
I20260709 13:05:52.699276 21120 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:52.700606 20948 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:52.704113 15238 leader_election.cc:400] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:52.704434 15189 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:05:52.704782 15238 leader_election.cc:403] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:52.646800 21097 raft_consensus.cc:2764] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:05:52.709017 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.690129 21234 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:05:52.712993 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 111004us
I20260709 13:05:52.652606 21215 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:05:52.736554 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.553639 15090 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 12 to 19. New cstate: current_term: 19 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:52.697316 21228 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:52.643932 15162 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.692020 20663 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.759367 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:52.768257 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.768111 21225 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
W20260709 13:05:52.769822 21226 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:05:52.742318 20993 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:52.812894 20993 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:52.709398 21144 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:52.727491 21204 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:52.808492 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 164665us
I20260709 13:05:52.775022 21234 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:52.811379 15268 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:52.838655 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 179374us
I20260709 13:05:52.800428 21213 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:52.863554 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 283279us
W20260709 13:05:52.901856 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44952.7us
I20260709 13:05:52.907966 15271 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:52.911865 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:52.912011 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 152760us
I20260709 13:05:52.914381 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:52.915436 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45926.8us
I20260709 13:05:52.913125 15268 raft_consensus.cc:2368] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:52.840873 21234 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.838977 21232 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:52.913681 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2870) took 1177 ms. Trace:
I20260709 13:05:52.918107 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.910481 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:52.864388 20940 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.932494 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.927999 15267 rpcz_store.cc:276] 0709 13:05:51.713259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.714081 (+   822us) service_pool.cc:224] Handling call
0709 13:05:51.725742 (+ 11661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.749959 (+ 24217us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:52.373634 (+623675us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.887961 (+514327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.888015 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:52.888068 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.888138 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.888296 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52204,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"thread_start_us":1025835,"threads_started":2}
I20260709 13:05:52.932746 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.900373 21050 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:52.865083 21235 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:05:52.941197 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 242009us
I20260709 13:05:52.940577 15312 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:52.950059 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:52.947404 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 371359us
I20260709 13:05:52.942081 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:52.937361 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:52.900720 21120 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:52.943689 15869 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:52.941500 15194 consensus_meta.cc:287] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.004s
I20260709 13:05:52.915469 21242 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 12. Current term is 13.
I20260709 13:05:52.917970 20702 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:52.927685 21234 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:52.953002 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49335.2us
W20260709 13:05:52.954032 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 217416us
I20260709 13:05:52.942821 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2868) took 1260 ms. Trace:
I20260709 13:05:52.932653 21231 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:52.933939 21094 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:52.969461 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2867) took 1287 ms. Trace:
I20260709 13:05:52.943168 21132 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:52.972361 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2873) took 1252 ms. Trace:
I20260709 13:05:52.993436 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:52.965031 21204 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:53.000568 15194 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:52.943369 20940 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.005955 15268 raft_consensus.cc:2376] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13. Re-sending same reply.
I20260709 13:05:53.023006 15197 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [15.11-16.12]
W20260709 13:05:53.025578 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 321644us
I20260709 13:05:52.986682 21134 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:53.005237 21246 tablet_replica.cc:333] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:05:52.983568 21217 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:52.983386 20663 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.008714 15272 rpcz_store.cc:276] 0709 13:05:51.710616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.714383 (+  3767us) service_pool.cc:224] Handling call
0709 13:05:51.716943 (+  2560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.720770 (+  3827us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:52.286225 (+565455us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.942374 (+656149us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.942446 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:52.942506 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.942604 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.942758 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5151,"prepare.queue_time_us":57006,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":178857,"spinlock_wait_cycles":36936704,"thread_start_us":1154364,"threads_started":3,"wal-append.queue_time_us":589520}
I20260709 13:05:53.019740 15264 rpcz_store.cc:276] 0709 13:05:51.719629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.720078 (+   449us) service_pool.cc:224] Handling call
0709 13:05:51.727645 (+  7567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.750394 (+ 22749us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:52.349288 (+598894us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.971761 (+622473us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.971983 (+   222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.972035 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:52.972088 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.972163 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.972284 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5625,"prepare.queue_time_us":53073,"prepare.run_cpu_time_us":833,"prepare.run_wall_time_us":10652,"raft.queue_time_us":176785,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12436,"thread_start_us":1171999,"threads_started":3,"wal-append.queue_time_us":568270}
I20260709 13:05:53.013561 21235 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:53.055130 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:53.042721 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 105439us
I20260709 13:05:53.004769 21152 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:53.038995 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:53.054932 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47158.7us
I20260709 13:05:53.023725 21132 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:53.060784 15162 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:53.016067 15270 rpcz_store.cc:276] 0709 13:05:51.682232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.682348 (+   116us) service_pool.cc:224] Handling call
0709 13:05:51.715216 (+ 32868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.723320 (+  8104us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:52.149819 (+426499us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.968944 (+819125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.969014 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:52.969133 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.969245 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.969394 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9113,"prepare.queue_time_us":77672,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":87789,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":1074457,"threads_started":3,"wal-append.queue_time_us":666548}
I20260709 13:05:52.944026 21228 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.003284 20702 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.037856 21134 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.057346 21232 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:53.067931 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:53.083626 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 141621us
I20260709 13:05:53.071964 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.020676 21120 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.077402 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.057367 21235 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:53.085319 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 131962us
I20260709 13:05:53.085201 15160 leader_election.cc:400] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:53.067193 21132 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:53.093155 15160 leader_election.cc:403] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:53.085033 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 146187us
I20260709 13:05:53.096306 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:53.054123 21094 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.043907 21253 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
W20260709 13:05:53.103500 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72459.1us
I20260709 13:05:53.080732 21231 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:53.081148 21152 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:53.105254 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.119645 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:05:53.094465 21255 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:05:53.129745 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:53.121347 15869 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:53.119645 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:53.128890 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43850.4us
I20260709 13:05:53.139807 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.140182 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.141130 15272 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:53.142217 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.095400 21235 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:53.165359 21248 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:05:53.125293 21262 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:05:53.126308 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:53.168157 15870 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:53.170181 15238 leader_election.cc:400] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:53.171770 15238 leader_election.cc:403] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:53.172178 15272 raft_consensus.cc:2410] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:53.092456 20993 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:53.087634 21216 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:53.179260 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51998.4us
I20260709 13:05:53.114733 20663 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:53.188912 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.190945 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.098567 21257 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:53.104869 21266 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.198098 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.166303 21264 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:53.115020 21268 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:53.199429 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 122127us
W20260709 13:05:53.191376 21183 consensus_meta.cc:287] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.001s
I20260709 13:05:53.052310 15090 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 13, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 13 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:53.122529 21231 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:53.207409 15270 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:53.192864 21212 consensus_meta.cc:287] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.872s	user 0.014s	sys 0.000s
W20260709 13:05:53.210915 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71196.5us
I20260709 13:05:53.212177 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.202574 21213 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:53.210141 21183 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.238946 20940 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:53.213976 21268 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.197203 21165 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:53.238154 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.246172 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.238607 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:53.210392 21231 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:53.251529 15269 raft_consensus.cc:1813] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Handling vote request from an unknown peer 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.250469 21213 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:53.255157 21239 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.339s	user 0.000s	sys 0.002s
I20260709 13:05:53.256129 21094 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:53.255954 21213 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.244379 20663 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:53.257145 21256 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:05:53.257328 20663 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:53.258543 21236 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
W20260709 13:05:53.259171 21244 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
I20260709 13:05:53.259375 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 403) took 1106 ms. Trace:
I20260709 13:05:53.259558 20663 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:53.260111 21251 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:05:53.259779 15339 rpcz_store.cc:276] 0709 13:05:52.152880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.170103 (+ 17223us) service_pool.cc:224] Handling call
0709 13:05:52.170473 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.171935 (+  1462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.171964 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.172374 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.535396 (+363022us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:52.535431 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.535506 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.259112 (+723606us) raft_consensus.cc:1685] finished
0709 13:05:53.259142 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.259291 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":362648,"threads_started":1,"wal-append.queue_time_us":589968}
W20260709 13:05:53.260972 21211 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.992s	user 0.012s	sys 0.000s
I20260709 13:05:53.261193 20663 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:53.262181 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:53.262423 21217 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:53.262976 21217 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:53.263484 20985 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:05:53.237242 21250 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:05:53.265511 15269 raft_consensus.cc:2410] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:53.237718 21263 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:53.210821 21262 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:53.272825 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 75215.4us
I20260709 13:05:53.210387 20993 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.274466 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2883) took 1109 ms. Trace:
I20260709 13:05:53.288234 15269 rpcz_store.cc:276] 0709 13:05:52.164839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.213676 (+1048837us) service_pool.cc:224] Handling call
0709 13:05:53.274387 (+ 60711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:53.243870 21097 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:53.237887 21264 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
W20260709 13:05:53.291198 21243 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.267s	user 0.000s	sys 0.002s
W20260709 13:05:53.291808 21245 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:05:53.196762 21134 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.292821 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2885) took 1127 ms. Trace:
I20260709 13:05:53.293260 21134 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:53.295794 21120 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:53.296916 20702 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:53.237512 15090 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:53.208437 21275 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:53.274966 21263 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:53.280483 21094 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:53.213349 21212 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.302561 21094 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.303565 21094 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.304299 21268 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.305147 20985 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.306047 20985 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.253402 21152 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.286635 15265 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:53.291388 21097 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:53.322037 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83527.6us
I20260709 13:05:53.323412 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.293303 15270 rpcz_store.cc:276] 0709 13:05:52.165305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.264000 (+1098695us) service_pool.cc:224] Handling call
0709 13:05:53.282717 (+ 18717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.292395 (+  9678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.292423 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.292467 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:53.292528 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.292594 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.292731 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:53.301909 21263 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:53.291384 21249 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:05:53.342398 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:53.209051 21266 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.346731 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.345645 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:53.310287 21211 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:53.349994 21262 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:53.266299 21165 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.356581 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.354992 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:53.357998 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 228358us
I20260709 13:05:53.213894 21232 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:53.359771 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.347532 20934 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:53.365267 15272 raft_consensus.cc:2410] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 18 because replica has last-logged OpId of term: 15 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:05:53.286604 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:53.365875 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.352140 21211 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.373375 15346 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:53.300114 15090 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 6 to 9, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 9 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:53.377197 21270 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:53.371407 20702 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:05:53.379662 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2242) took 1007 ms. Trace:
I20260709 13:05:53.381884 15197 rpcz_store.cc:276] 0709 13:05:52.371991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.530013 (+158022us) service_pool.cc:224] Handling call
0709 13:05:53.022550 (+492537us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:53.028708 (+  6158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.379474 (+350766us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b54000f91d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:53.379602 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1120776064}
I20260709 13:05:53.380321 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:53.352300 21257 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:53.365971 20929 consensus_meta.cc:287] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.914s	user 0.014s	sys 0.005s
I20260709 13:05:53.386654 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:53.392728 15343 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:53.387496 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:53.388100 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:53.388801 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:53.389421 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:53.401378 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:53.401625 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:53.402833 15339 raft_consensus.cc:2410] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:53.393642 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:53.359464 21286 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:53.347867 20993 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.415303 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:53.416290 15191 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:53.418550 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:53.419770 15193 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:53.423103 15189 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:53.423712 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:53.428682 15191 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:05:53.391878 21263 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:53.441205 20934 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:53.441792 20934 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.442682 20934 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:53.446492 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 234445us
I20260709 13:05:53.447544 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:53.447755 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 62207.9us
W20260709 13:05:53.449148 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51377.3us
I20260709 13:05:53.449074 15342 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:53.382105 21211 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:53.477559 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:53.488862 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:53.489115 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:53.488286 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 371821us
I20260709 13:05:53.491669 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:53.492080 15192 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:53.491521 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:53.446434 21262 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:53.361971 21235 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.456403 21144 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:53.378312 20944 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
W20260709 13:05:53.495395 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 129969us
I20260709 13:05:53.411345 21286 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:53.502646 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:53.505934 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.480427 21152 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:53.510474 15339 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:53.511139 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:53.512485 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2809) took 1119 ms. Trace:
I20260709 13:05:53.518213 15272 rpcz_store.cc:276] 0709 13:05:52.392694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.187403 (+794709us) service_pool.cc:224] Handling call
0709 13:05:53.512267 (+324864us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54001b4c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:53.512416 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379839744}
I20260709 13:05:53.513535 15188 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:53.407409 20929 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.489086 21120 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:53.515002 15341 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:53.524637 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.527187 21278 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:53.528131 21274 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.528672 21274 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.529681 15345 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
W20260709 13:05:53.530803 21283 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:53.378013 15090 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:53.531097 21265 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:53.531397 21258 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.502s	user 0.008s	sys 0.001s
I20260709 13:05:53.531978 21265 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:53.532979 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2246) took 1123 ms. Trace:
W20260709 13:05:53.535270 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 85331.9us
I20260709 13:05:53.535743 15344 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
W20260709 13:05:53.536142 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 44710.8us
I20260709 13:05:53.533444 15196 rpcz_store.cc:276] 0709 13:05:52.409854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.556854 (+147000us) service_pool.cc:224] Handling call
0709 13:05:52.560550 (+  3696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.604128 (+ 43578us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:52.604173 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.639478 (+ 35305us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.701447 (+ 61969us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b480021c258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:05:52.840823 (+139376us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:52.840885 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.840977 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.530687 (+689710us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:53.532771 (+  2084us) raft_consensus.cc:1685] finished
0709 13:05:53.532796 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.532921 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43047,"raft.queue_time_us":75441,"raft.run_cpu_time_us":2447,"raft.run_wall_time_us":62400,"spinlock_wait_cycles":35561728,"thread_start_us":149056,"threads_started":1,"wal-append.queue_time_us":307301}
I20260709 13:05:53.544241 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.507915 21144 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.566341 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:53.567370 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.524710 21275 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:53.511883 21286 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:53.530937 21274 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:53.605293 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:53.511546 21293 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:05:53.614393 15160 leader_election.cc:400] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:53.621832 15160 leader_election.cc:403] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:53.582798 20946 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.063s	user 0.004s	sys 0.016s
I20260709 13:05:53.629786 15343 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:05:53.630241 15870 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:53.532115 15090 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 9 to 12, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 12 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:53.633193 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
W20260709 13:05:53.592747 21229 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.001s	user 0.020s	sys 0.000s
I20260709 13:05:53.556151 21183 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:53.555737 21212 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:53.632472 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 94553.9us
W20260709 13:05:53.633291 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 89836.7us
I20260709 13:05:53.543221 21120 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.549234 21265 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:05:53.642629 21289 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:53.643061 21165 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:53.643069 21212 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:53.644304 21212 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:53.645192 21212 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.630653 21213 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:53.603005 21253 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 13:05:53.648065 21280 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:05:53.580691 21257 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.648473 20850 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:53.648833 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.633104 21298 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:53.649195 21287 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:05:53.649502 21298 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:53.650183 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.650382 21298 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.651430 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.651736 21298 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:53.652609 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.653306 15270 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:53.648942 20850 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.653908 21285 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:53.654601 20850 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.634246 20946 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.655861 20850 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:53.657058 20946 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.657387 21235 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.657859 15263 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:53.631022 21232 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:53.659376 15272 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:53.643129 21289 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.660207 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:53.672663 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.679579 15339 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:05:53.733803 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2796) took 1408 ms. Trace:
W20260709 13:05:53.736119 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 239794us
W20260709 13:05:53.737319 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 187192us
I20260709 13:05:53.737702 21213 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:53.739085 21213 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:53.740240 21213 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:53.739863 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:53.740729 21213 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:53.742417 21213 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.744771 21213 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:53.641901 20663 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:53.748423 20663 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:53.758131 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 85533.8us
I20260709 13:05:53.759074 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.734941 15263 rpcz_store.cc:276] 0709 13:05:52.260290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.508328 (+248038us) service_pool.cc:224] Handling call
0709 13:05:53.658812 (+1150484us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003291d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:53.658967 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583892864}
W20260709 13:05:53.760664 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 122214us
I20260709 13:05:53.761332 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.632675 21275 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:53.751277 20663 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.734387 21272 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:53.653954 21293 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:53.784741 15339 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:53.784684 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:53.733901 20946 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:53.788285 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.752871 21232 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:53.734172 21289 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:53.762570 21285 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:05:53.795012 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55487.2us
I20260709 13:05:53.770190 21165 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:53.798113 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:53.804131 21253 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:53.807499 21235 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:53.809557 21307 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:53.810165 21307 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.811851 21275 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.814360 21307 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:53.815162 21307 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:53.763778 21266 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.686973 21144 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.639113 21229 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.816224 15090 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 9 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 15 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:53.817801 21296 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:53.819542 21229 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:53.820587 15340 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:53.791465 21152 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:53.824817 21253 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.825415 21253 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.770087 21153 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:05:53.790093 21183 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:53.815730 21307 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:53.805104 21279 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:53.845099 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.849114 15263 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:53.790215 21293 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:53.790752 20946 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:53.811844 21295 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:05:53.816327 21266 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:53.833796 21132 consensus_meta.cc:287] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.007s
I20260709 13:05:53.877879 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.880324 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.888980 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2802) took 1589 ms. Trace:
W20260709 13:05:53.887880 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 89839.9us
I20260709 13:05:53.896687 15237 leader_election.cc:400] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:53.897811 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.858062 21183 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:53.892663 15269 rpcz_store.cc:276] 0709 13:05:52.299546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.289218 (+989672us) service_pool.cc:224] Handling call
0709 13:05:53.289599 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.290017 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.290050 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:53.290589 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.436584 (+145995us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:53.601411 (+164827us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.888740 (+287329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.888801 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.888831 (+    30us) raft_consensus.cc:1685] finished
0709 13:05:53.888838 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.888934 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13358,"raft.queue_time_us":47290,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":175,"thread_start_us":531618,"threads_started":3,"wal-append.queue_time_us":231904}
W20260709 13:05:53.891798 21234 consensus_meta.cc:287] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.852s	user 0.014s	sys 0.003s
I20260709 13:05:53.906111 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.908804 15237 leader_election.cc:400] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:53.909617 15237 leader_election.cc:403] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
W20260709 13:05:53.895166 21217 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 13:05:53.880853 21132 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.916749 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.919535 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:53.884164 21266 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:53.914661 21134 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.002s
I20260709 13:05:53.928761 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.914810 20934 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.930845 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:53.933946 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.924985 21303 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:53.898891 21293 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.944480 21120 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.944841 21311 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.916821 21232 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:53.945467 21311 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.905675 20946 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.947757 20946 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:53.942658 20934 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.950404 20934 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:53.952175 21183 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:53.924413 21309 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.131s
I20260709 13:05:53.955792 21309 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:53.956224 21309 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:53.944527 21229 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:53.916421 20929 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:53.950814 21262 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:53.958186 21152 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19.
I20260709 13:05:53.959383 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.960880 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:53.961627 15263 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:53.967908 15264 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:53.921336 21225 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:53.944985 21293 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:53.942986 21267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.002s
I20260709 13:05:53.971011 21253 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:53.915550 21217 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.926000 21212 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:53.973908 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 76180.4us
W20260709 13:05:53.975384 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 187158us
I20260709 13:05:53.929937 21279 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:53.957144 21309 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.984341 21309 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:53.986346 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2865) took 2304 ms. Trace:
I20260709 13:05:53.987190 15266 rpcz_store.cc:276] 0709 13:05:51.681484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.710860 (+ 29376us) service_pool.cc:224] Handling call
0709 13:05:51.716124 (+  5264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.726765 (+ 10641us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:52.227084 (+500319us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.985697 (+1758613us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b180046f300. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:05:53.985800 (+   103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.985851 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:53.985900 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.985982 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.986247 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2417,"prepare.queue_time_us":70807,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":91065,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"spinlock_wait_cycles":9214848,"thread_start_us":1155776,"threads_started":3,"wal-append.queue_time_us":673458}
W20260709 13:05:53.980472 21267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.010s	sys 0.002s
W20260709 13:05:53.994459 15268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2786) took 1807 ms (client timeout 2200 ms). Trace:
W20260709 13:05:53.994903 15268 rpcz_store.cc:269] 0709 13:05:52.187079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.936055 (+748976us) service_pool.cc:224] Handling call
0709 13:05:53.994267 (+1058212us) spinlock_profiling.cc:243] Waited 55 ms on lock 0x7b5400328cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:53.994403 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126420352}
I20260709 13:05:53.995446 21311 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.995553 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:53.996433 15190 raft_consensus.cc:606] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:53.996657 15270 raft_consensus.cc:2410] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:53.909111 21234 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:53.996857 15190 raft_consensus.cc:614] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:53.997434 21213 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:53.998594 21234 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.999446 15271 raft_consensus.cc:2368] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21.
W20260709 13:05:54.001029 15271 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2783) took 1814 ms (client timeout 2189 ms). Trace:
W20260709 13:05:54.001426 15271 rpcz_store.cc:269] 0709 13:05:52.186318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.910065 (+723747us) service_pool.cc:224] Handling call
0709 13:05:54.000841 (+1090776us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001d92d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:54.000970 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2454415616}
I20260709 13:05:53.996667 15268 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:54.004276 21264 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:54.005451 21264 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:54.005868 21264 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:53.921589 21307 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.007537 21264 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.008812 21264 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:53.945467 21204 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:05:54.009889 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.009944 21289 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.014050 15271 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:05:53.991961 20980 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:54.019270 15272 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:53.942806 21134 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:53.993054 20940 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:53.993039 15266 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:53.993799 21217 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:53.994757 21050 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:53.979110 21216 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:54.010522 15346 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:53.991591 15090 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 11 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 15 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:53.977577 15263 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:53.929643 21286 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:54.040275 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.043062 15266 raft_consensus.cc:1240] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:54.048900 15272 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:54.050371 15271 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:54.048431 15263 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:53.998624 21213 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:54.062589 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.063582 15342 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:54.073850 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.031716 20940 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:54.074998 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:54.052241 21211 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.552s	user 0.005s	sys 0.009s
I20260709 13:05:54.077050 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.046722 21216 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.078729 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.039659 21050 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:54.078567 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.081023 15341 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:54.083115 15196 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:54.085649 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.046346 21183 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:54.080363 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 57842.4us
I20260709 13:05:54.049846 21165 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.083693 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.084137 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.089527 15194 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.086241 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.055521 21213 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:54.089618 15192 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:54.086772 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.090747 15189 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:54.046137 21311 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:05:54.093765 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.075448 21120 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:54.096969 21120 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.097473 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.098910 15090 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 8 to 16, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 16 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.093654 21165 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.101318 15090 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 13, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 13 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.081168 21289 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:54.110515 21294 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:54.111169 21294 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.113353 21294 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:54.115746 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.115679 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.080899 21320 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:54.116868 21320 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.117391 15189 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:05:54.120839 15191 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:54.095523 21263 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.655s	user 0.012s	sys 0.001s
I20260709 13:05:54.122391 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.125524 15194 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:54.092144 21307 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:54.121903 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 121119us
I20260709 13:05:54.128154 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.104178 20980 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:54.126012 15346 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:54.131650 15344 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:05:54.132431 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:54.133137 15870 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:54.133009 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:54.129611 15190 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:54.102892 21266 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:54.091233 21211 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.135232 21320 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:54.135346 21228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.013s	sys 0.000s
I20260709 13:05:54.095898 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:54.135838 21228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.014s	sys 0.000s
I20260709 13:05:54.137509 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.138332 21286 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:54.118979 21264 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:05:54.143290 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.143652 15194 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:54.143905 15346 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:54.130852 21231 consensus_meta.cc:287] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.856s	user 0.007s	sys 0.007s
I20260709 13:05:54.146540 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:54.091454 21183 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.148901 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:54.153976 15190 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:54.154080 15346 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:54.154592 15189 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:54.155251 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.154570 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:54.149461 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.130498 20980 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:54.156631 15195 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:54.157505 21132 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.134692 21307 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.126226 21050 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.161226 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:54.161958 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.134032 21311 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:54.164911 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.104866 20940 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.160472 21234 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:54.181759 21234 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.153750 21231 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.171619 21050 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.184201 21231 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.164112 21267 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.189993 21216 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.190598 15263 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:05:54.191058 15263 pending_rounds.cc:85] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 9
I20260709 13:05:54.184502 15090 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 4 to 11, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 11 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.192376 15190 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:54.192286 15090 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 8 to 11, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:54.194074 21213 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.173409 21183 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:54.151571 21266 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:54.173800 21316 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:54.163811 21264 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.182231 21234 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.191277 15263 pending_rounds.cc:107] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:05:54.195415 21213 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.171432 21307 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.175591 15346 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:54.197971 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.227977 15195 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:54.228130 15190 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:54.228860 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.229405 15195 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.168991 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:54.218737 15263 raft_consensus.cc:2889] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:54.194058 15090 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:54.220329 21282 consensus_queue.cc:1059] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:54.223146 21225 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:54.224179 21279 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:54.235074 21322 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:05:54.235157 15090 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:54.236907 15090 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:54.239063 21307 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.240315 21183 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:54.231820 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62922.8us
I20260709 13:05:54.240931 21183 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.241324 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:54.242250 21307 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.230304 15191 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:54.204741 21252 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:54.246649 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:54.238401 15090 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:54.249753 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.250172 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:54.250803 15190 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:05:54.259212 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 126881us
I20260709 13:05:54.263332 15343 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:54.203266 21311 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.247700 21097 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.285789 15195 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:54.248883 21252 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:54.263562 21265 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:54.287774 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.263459 21307 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:54.303495 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:54.308771 21277 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.008s	user 0.005s	sys 0.000s
W20260709 13:05:54.309703 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.296991 21322 raft_consensus.cc:3055] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:54.313119 15189 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:54.292862 21134 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:54.315303 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 220127us
I20260709 13:05:54.315622 15195 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:54.317695 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.318427 15190 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:54.302205 21265 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:54.325380 15312 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:54.339439 21265 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:54.340832 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:54.342089 20850 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:54.342497 20850 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.342895 20850 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.342644 20944 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:54.344254 20944 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:54.345899 20944 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:54.347666 15265 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2795) took 2115 ms (client timeout 1552 ms). Trace:
I20260709 13:05:54.348356 15870 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:54.348959 21304 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:54.316329 21307 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:54.350800 21307 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.355229 21286 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:54.357618 21216 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.358575 15337 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:05:54.323335 21134 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.361210 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.362304 21293 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:54.331295 21289 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:54.332388 21311 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:54.332136 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.369149 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:54.371188 20980 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.373683 20980 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.369374 15197 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:54.332851 15190 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:54.334227 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.315582 21328 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:54.313413 21322 raft_consensus.cc:740] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:54.338152 21252 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:54.348088 15265 rpcz_store.cc:269] 0709 13:05:52.232362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.248557 (+ 16195us) service_pool.cc:224] Handling call
0709 13:05:54.346965 (+2098408us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001d83d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:54.347569 (+   604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327294208}
W20260709 13:05:54.368407 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.388854 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.376889 15270 raft_consensus.cc:2410] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:05:54.378644 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:54.381961 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.349812 20944 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.392531 15268 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:54.383013 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:54.396977 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.397056 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.399827 15870 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:54.390195 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.402661 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.404088 15271 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:54.405359 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:54.406673 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:54.369792 21134 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:54.409329 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.410606 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.420282 15265 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:54.412797 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.421814 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.384653 21328 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:54.412667 21305 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:05:54.424665 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:54.420679 21094 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:54.411794 15342 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
W20260709 13:05:54.426779 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 61817.2us
I20260709 13:05:54.422544 15272 raft_consensus.cc:2368] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:54.429678 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:54.403249 20944 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.432972 15265 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:54.433291 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:54.428828 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:54.427592 15270 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:54.368350 15090 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 6 to 9, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 9 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:54.391784 21286 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:05:54.427803 21288 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:54.436474 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.409296 21211 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.413179 21229 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:05:54.431840 21094 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:54.438386 15270 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:54.414541 21216 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.427129 21252 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:54.436367 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.467576 15271 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:54.435334 15265 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:05:54.467978 15265 pending_rounds.cc:85] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 12
I20260709 13:05:54.468209 15265 pending_rounds.cc:107] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:05:54.468502 15265 raft_consensus.cc:2889] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:54.398119 21234 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.453475 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:54.470691 15869 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:05:54.426002 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.456902 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:54.468248 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.412513 20948 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:05:54.429842 21134 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:05:54.469290 15342 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:05:54.472214 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:54.466043 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.429313 21333 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:05:54.482630 15265 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:05:54.482777 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.483443 21276 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.220s	user 0.004s	sys 0.000s
I20260709 13:05:54.485471 15265 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:05:54.487468 21328 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.488335 15265 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:54.478365 15272 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:54.488801 21328 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.490852 21234 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.491595 21094 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.488826 21335 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:54.495102 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:54.500898 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.500159 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 86475.3us
I20260709 13:05:54.507661 21289 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:54.510197 20702 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:05:54.514587 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:54.517639 21289 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:54.518128 21289 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.518543 21289 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:54.475138 21288 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:54.573769 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 49774.9us
I20260709 13:05:54.574927 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:54.473368 21216 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.583292 20663 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.573323 21234 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:54.584439 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.447822 21322 consensus_queue.cc:260] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:54.585265 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.590580 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 110936us
W20260709 13:05:54.592571 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 178359us
W20260709 13:05:54.593370 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91599us
I20260709 13:05:54.602397 15841 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.611328 21347 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:54.611215 21289 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.646970 21289 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:54.614627 21306 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.723s	user 0.002s	sys 0.000s
I20260709 13:05:54.615195 21132 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.649183 21132 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.623795 21349 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:54.623865 20948 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:05:54.625241 15311 consensus_peers.cc:597] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6056d49d08dc4130887dbf154edc6675. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:54.626917 15346 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:05:54.627218 21343 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:54.630641 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.669067 15272 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:54.631316 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.635021 15191 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:54.636293 21288 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.673879 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:54.674962 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:54.675629 15265 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:05:54.638325 21144 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.676362 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.638638 21216 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.632112 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:54.640745 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3052) took 1255 ms. Trace:
I20260709 13:05:54.592034 20663 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.592952 21234 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.653204 15197 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:54.661490 15189 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:54.694046 15197 raft_consensus.cc:606] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.680966 15338 rpcz_store.cc:276] 0709 13:05:53.384986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.505020 (+120034us) service_pool.cc:224] Handling call
0709 13:05:53.522165 (+ 17145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.534138 (+ 11973us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.534170 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.534211 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:53.534241 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.640495 (+1106254us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b54000b7054. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:54.640541 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.640688 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27042176}
I20260709 13:05:54.651636 21132 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.666522 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.696557 15190 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:54.668109 21349 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.669903 21337 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:05:54.672746 21338 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:54.664712 20948 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.673214 21165 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:54.684701 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.681353 21246 raft_consensus.cc:2243] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:54.694460 15197 raft_consensus.cc:614] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:54.695917 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 93634.8us
W20260709 13:05:54.697155 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65118.7us
I20260709 13:05:54.707458 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.708271 15338 raft_consensus.cc:2368] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:54.692804 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.708760 15272 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:54.709683 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:54.708037 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:05:54.700088 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 66153.4us
I20260709 13:05:54.719599 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.709518 20948 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:54.721273 15189 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:54.720047 15238 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:54.703213 21309 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:05:54.724644 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 131168us
I20260709 13:05:54.728513 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:54.729754 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.718544 21216 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.729358 15338 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:54.733454 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.723207 21215 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:54.727061 21050 raft_consensus.cc:2804] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:54.744508 21305 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:54.731468 21357 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:05:54.780123 21286 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:54.785907 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.786679 21349 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:54.786859 15345 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:54.745261 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.745574 20663 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.717404 20850 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.787858 15338 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:05:54.788678 15345 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:54.789333 20850 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:54.746062 21348 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:05:54.748926 21343 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:54.749747 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.790802 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:54.750969 21358 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.756333 15160 leader_election.cc:400] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21.
I20260709 13:05:54.757074 21265 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.758105 21215 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:54.768746 21234 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.771287 20944 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.772338 21246 raft_consensus.cc:2272] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:54.776784 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.792742 15342 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:54.793166 21252 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:54.801882 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 92770.5us
W20260709 13:05:54.807219 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51097.3us
I20260709 13:05:54.794313 21050 raft_consensus.cc:697] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:54.816973 15346 raft_consensus.cc:2368] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
I20260709 13:05:54.806093 21265 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:54.817001 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:54.821950 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.823240 15345 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:54.814844 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:54.813467 21307 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:54.827128 15160 leader_election.cc:400] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:54.801018 21358 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.831660 21358 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.828423 15160 leader_election.cc:403] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:54.827021 15189 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:54.832927 21358 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:54.833990 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.834316 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.835706 21358 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:54.836423 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.838860 15189 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:54.839320 21358 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:54.842100 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.844199 15188 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:54.844364 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.845096 20944 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:54.845337 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.845580 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:54.846092 15188 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:54.846154 15189 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.847074 21281 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:54.847633 21281 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:54.848691 21281 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.849440 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:54.849941 21281 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:54.852782 21050 consensus_queue.cc:237] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.825664 21165 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.855419 21307 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:54.857326 21216 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:54.858336 21307 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:54.858901 21310 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.933s	user 0.002s	sys 0.000s
W20260709 13:05:54.837461 21312 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.893s	user 0.000s	sys 0.005s
I20260709 13:05:54.859742 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2893) took 1197 ms. Trace:
I20260709 13:05:54.860116 15269 rpcz_store.cc:276] 0709 13:05:53.662171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.907552 (+245381us) service_pool.cc:224] Handling call
0709 13:05:53.908299 (+   747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.943960 (+ 35661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.969878 (+ 25918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.969942 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:53.969982 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.859516 (+889534us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b5400290254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:54.859560 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.859684 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81330560}
I20260709 13:05:54.860915 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.861550 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3053) took 1476 ms. Trace:
I20260709 13:05:54.862207 15191 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:54.861923 15341 rpcz_store.cc:276] 0709 13:05:53.385277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.543502 (+158225us) service_pool.cc:224] Handling call
0709 13:05:53.566418 (+ 22916us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.088819 (+522401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.861353 (+772534us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54003ded54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:54.861500 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179834624}
I20260709 13:05:54.863473 21293 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:54.863966 21293 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:54.864410 15269 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:54.864970 21293 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:54.867837 21308 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.924s	user 0.003s	sys 0.000s
I20260709 13:05:54.869026 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2815) took 2192 ms. Trace:
I20260709 13:05:54.869390 15267 rpcz_store.cc:276] 0709 13:05:52.676142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.379972 (+703830us) service_pool.cc:224] Handling call
0709 13:05:53.402963 (+ 22991us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.448120 (+ 45157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.448159 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:53.448712 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.831644 (+382932us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:54.006281 (+174637us) log.cc:844] Serialized 14 byte log entry
0709 13:05:54.006492 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.006564 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:54.867211 (+860647us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:05:54.868733 (+  1522us) raft_consensus.cc:1685] finished
0709 13:05:54.868849 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.868971 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":174253,"prepare.queue_time_us":174960,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":52820,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":190,"spinlock_wait_cycles":29307776,"thread_start_us":327199,"threads_started":1,"wal-append.queue_time_us":438817}
I20260709 13:05:54.825620 20663 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:54.871711 20663 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:54.872228 20663 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:54.846832 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.874250 21212 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.874830 21212 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.875348 21314 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:54.875790 21314 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:54.876649 21314 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.877148 21212 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:54.877693 21314 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:54.877981 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.879886 21215 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:54.880627 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.880867 21291 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:54.880947 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:54.881420 21291 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:54.881482 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.882210 15267 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:54.882302 21291 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.883121 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.883553 21291 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.883721 15268 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:54.885177 15337 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:05:54.881625 15269 raft_consensus.cc:2376] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19. Re-sending same reply.
W20260709 13:05:54.867866 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 3040) took 1499 ms (client timeout 1755 ms). Trace:
I20260709 13:05:54.889106 15269 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:54.890820 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.892387 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:54.892964 15195 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:54.893397 15189 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:54.882381 21351 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
W20260709 13:05:54.886405 15340 rpcz_store.cc:269] 0709 13:05:53.368384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.368529 (+   145us) service_pool.cc:224] Handling call
0709 13:05:54.867625 (+1499096us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400245c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:54.867774 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":974304000}
W20260709 13:05:54.894942 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.896340 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:54.897202 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.897333 21212 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:54.898064 21212 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:54.898241 15195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:05:54.898607 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:54.899441 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.899560 21216 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:54.900068 21216 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.898895 15195 raft_consensus.cc:606] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:54.898986 21212 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.900278 15337 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:05:54.843636 21352 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:05:54.887172 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:54.901094 15195 raft_consensus.cc:614] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:54.902557 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.905647 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.906919 15272 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:05:54.909356 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.910787 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.911480 15337 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 14: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:54.894323 21265 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:54.902982 21216 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:54.936560 15197 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: [15.11-16.12]
I20260709 13:05:54.938364 15197 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:54.926004 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:54.940204 15197 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:54.941114 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:54.941953 15340 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.944957 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:54.947242 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:54.947851 21183 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:54.947952 21050 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:05:54.956055 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.958601 21246 ts_tablet_manager.cc:1916] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:05:54.963318 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 148579us
W20260709 13:05:54.981149 21361 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:54.982391 15194 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:54.980083 15344 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:05:54.992388 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:54.910156 20948 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:55.006675 15264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 2895) took 1344 ms (client timeout 1716 ms). Trace:
W20260709 13:05:55.007411 15264 rpcz_store.cc:269] 0709 13:05:53.662567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.858926 (+196359us) service_pool.cc:224] Handling call
0709 13:05:55.006424 (+1147498us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b54002f1cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:55.006575 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205268224}
I20260709 13:05:54.978447 21365 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:54.955147 21265 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:54.955017 20663 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.011016 21345 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:55.023671 21345 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:55.024686 21345 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.029748 15338 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:55.019815 21365 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.016479 21358 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:55.031349 21097 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.038765 15197 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:05:55.047290 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:55.049945 15192 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:55.018170 21050 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:05:55.018329 21213 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:05:55.037815 20944 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.058142 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:55.046396 21365 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:55.061707 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.077297 21322 raft_consensus.cc:3060] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:55.078902 15192 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:55.083499 15192 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:05:55.084161 21339 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.473s	user 0.003s	sys 0.000s
I20260709 13:05:55.086329 21050 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.088967 21050 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:55.091928 21050 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:55.094128 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2235) took 1004 ms. Trace:
I20260709 13:05:55.094713 15338 rpcz_store.cc:276] 0709 13:05:54.089834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.788477 (+698643us) service_pool.cc:224] Handling call
0709 13:05:54.788756 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.032296 (+243540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.093860 (+ 61564us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54001770d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:55.094056 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552093568}
W20260709 13:05:55.094861 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.148819 15340 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:55.099264 20993 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.053637 21097 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.050838 21358 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:55.111941 20948 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.150245 21204 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.065099 20944 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:55.197679 15870 raft_consensus.cc:2468] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:05:55.203827 21204 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.221099 21358 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:55.221521 21204 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.224381 21216 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.225939 21305 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:55.226552 21216 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.227308 20944 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:55.227339 21265 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:55.229576 21144 consensus_meta.cc:287] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.004s
I20260709 13:05:55.226832 20663 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.240051 21097 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.244740 20929 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.245304 20929 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.248883 21120 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.249383 21365 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.249679 20701 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:55.251974 20701 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:55.262907 21365 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.264603 21246 ts_tablet_manager.cc:1929] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:05:55.268895 21246 log.cc:1199] T 35e75f905ad042d89b465e6461b29a5d P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/wals/35e75f905ad042d89b465e6461b29a5d
I20260709 13:05:55.268306 20701 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.270066 20701 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:55.270860 21246 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34528 (request call id 80) took 2994 ms. Trace:
I20260709 13:05:55.271364 21246 rpcz_store.cc:276] 0709 13:05:52.297362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.308029 (+ 10667us) service_pool.cc:224] Handling call
0709 13:05:52.939893 (+631864us) ts_tablet_manager.cc:1151] Deleting tablet 35e75f905ad042d89b465e6461b29a5d
0709 13:05:52.965677 (+ 25784us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:05:55.188413 (+2222736us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:55.264446 (+ 76033us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:55.270753 (+  6307us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1620077,"tablet-delete.queue_time_us":602273,"thread_start_us":405009,"threads_started":1}
W20260709 13:05:55.282884 21376 log.cc:927] Time spent T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:05:55.287122 21377 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 13:05:55.302683 21351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42774 (request call id 2) took 3049 ms. Trace:
I20260709 13:05:55.303565 21351 rpcz_store.cc:276] 0709 13:05:52.247616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.247781 (+   165us) service_pool.cc:224] Handling call
0709 13:05:52.259770 (+ 11989us) log.cc:844] Serialized 499 byte log entry
0709 13:05:53.613278 (+1353508us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b1800289180. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:53.656194 (+ 42916us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b2c00136ac8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4015a0a 00007f36e4015693 00007f36e4015631 00007f36e5749b52 00007f36e5749cf5 00007f36e5686691 00007f36e5666eaa 00007f36e566dd53 00007f36e566dcd9 00007f36e566dc69
0709 13:05:55.296679 (+1640485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23147,"raft.queue_time_us":199024,"raft.run_cpu_time_us":4170,"raft.run_wall_time_us":233066,"spinlock_wait_cycles":74306688,"thread_start_us":474744,"threads_started":1,"wal-append.queue_time_us":661653,"wal-append.run_cpu_time_us":3925,"wal-append.run_wall_time_us":1361202}
I20260709 13:05:55.322310 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.490410 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:55.495735 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.575798 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2229) took 1495 ms. Trace:
I20260709 13:05:55.581833 21359 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:55.582531 21359 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:55.583899 21359 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.587702 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:55.588466 15194 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:55.589008 21132 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.589498 21132 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.591620 21132 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.601979 15265 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:55.603543 15265 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:05:55.607271 15344 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:55.608021 15264 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:05:55.608183 15194 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:05:55.608424 15264 pending_rounds.cc:85] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 8
I20260709 13:05:55.608727 15264 pending_rounds.cc:107] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:05:55.608958 15264 raft_consensus.cc:2889] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.611708 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:55.621616 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:55.624089 15339 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:55.625589 15271 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:05:55.627151 21345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.001s
W20260709 13:05:55.627521 21345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.005s	sys 0.001s
I20260709 13:05:55.628051 21345 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:55.628592 15272 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:55.629909 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:55.631433 15263 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:55.630201 15193 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:55.630657 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:55.576287 15342 rpcz_store.cc:276] 0709 13:05:54.080532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.499321 (+418789us) service_pool.cc:224] Handling call
0709 13:05:54.499710 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.811562 (+311852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.575189 (+763627us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54002738d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:55.575718 (+   529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673516416}
W20260709 13:05:55.636550 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.637876 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.638372 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:55.638796 21144 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:55.640738 21144 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.643600 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:55.643930 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.645650 21144 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.645885 21382 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:55.646476 21382 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.647195 21144 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.647517 21313 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.647812 21144 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.648098 21313 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.648555 21382 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.649509 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:55.650141 21144 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.650707 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.652432 15272 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:55.654932 15270 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
W20260709 13:05:55.656337 15188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.012s	sys 0.003s
W20260709 13:05:55.656713 15188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.012s	sys 0.003s
I20260709 13:05:55.650878 21144 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:55.650161 21313 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:55.661788 15263 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:05:55.664985 15263 pending_rounds.cc:85] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 11
I20260709 13:05:55.665352 15263 pending_rounds.cc:107] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:05:55.660959 21385 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:05:55.662169 15270 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:55.666301 15263 raft_consensus.cc:2889] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.683264 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:55.683516 15309 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:55.673898 21144 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:55.686792 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:55.730204 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:55.733260 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:55.734421 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:55.686333 21389 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:55.739722 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:55.789610 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:55.789347 21144 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.698918 21257 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:05:55.798758 15270 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:55.784457 20944 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:05:55.815088 21252 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:55.818327 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.787319 21389 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:05:55.803540 20701 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:05:55.827939 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.832284 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:55.840452 15312 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:55.843566 21405 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:55.845165 21252 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:55.846093 21252 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:55.847148 21252 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:55.854362 20944 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:55.854936 20944 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.851428 21389 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.864395 21252 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:55.864814 21389 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.866515 21252 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:55.831650 21349 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:05:55.866992 21389 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.867209 21252 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:55.904022 21409 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:55.883551 20701 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:55.914340 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.916368 15192 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
W20260709 13:05:55.911796 21407 log.cc:927] Time spent T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:05:55.918429 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:55.928730 15188 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:55.929539 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:55.930208 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:55.932256 20944 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.909852 20701 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:55.940646 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:55.943240 20944 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:55.945061 21252 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:55.946739 21286 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:55.943893 20944 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.947532 20944 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:55.947656 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:55.948451 15193 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 25: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:55.950918 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:55.951246 21286 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.958635 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:55.970882 21372 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.903s	user 0.002s	sys 0.000s
W20260709 13:05:55.978657 15870 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58398 (request call id 341) took 1545 ms (client timeout 1577 ms). Trace:
W20260709 13:05:55.981786 15870 rpcz_store.cc:269] 0709 13:05:54.432958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.433070 (+   112us) service_pool.cc:224] Handling call
0709 13:05:55.978334 (+1545264us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b54006301d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:55.978526 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1706217344}
W20260709 13:05:55.986436 15311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.037s	sys 0.021s
W20260709 13:05:55.986805 15311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.037s	sys 0.021s
I20260709 13:05:55.987340 20944 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.990443 20944 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:55.991660 21313 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.992309 21282 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.992165 21313 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:55.992764 21282 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:55.994776 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:55.995416 15264 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:55.997020 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:55.997448 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:55.997896 15870 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:56.003979 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:56.004640 15188 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:56.006227 21313 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.007211 21282 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.007606 15081 catalog_manager.cc:5028] TS 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): tablet 35e75f905ad042d89b465e6461b29a5d (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:05:56.011010 21359 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:56.011425 21359 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:56.012182 21359 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.013954 21359 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.015174 15188 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:05:56.015797 20701 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.016175 15312 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:56.016788 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:56.017477 20701 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:56.020236 15264 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:05:56.020566 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.024518 15264 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:56.033576 21286 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:56.057641 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.058988 21286 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:56.061348 21286 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:56.063753 21286 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:56.062698 21252 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:56.066989 21252 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.069774 21252 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:56.070415 21183 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:56.065894 21286 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.097790 15193 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:05:56.102663 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 82152.5us
W20260709 13:05:56.104992 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 88288.7us
W20260709 13:05:56.105607 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.107879 15870 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:56.109539 20944 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:05:56.136701 15346 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 3054) took 1471 ms (client timeout 1600 ms). Trace:
W20260709 13:05:56.137425 15346 rpcz_store.cc:269] 0709 13:05:54.665398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.666090 (+   692us) service_pool.cc:224] Handling call
0709 13:05:56.132520 (+1466430us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400340154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:56.136599 (+  4079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248523520}
I20260709 13:05:56.140165 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.145953 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.127874 21314 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.135846 21367 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:56.155946 21359 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:56.156451 20929 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.163179 21367 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.165445 21367 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.168118 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.168753 15267 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:56.169651 20944 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.170202 20944 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.157637 21314 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.173645 21314 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.146432 21432 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:56.174612 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.179896 21429 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.181859 15337 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:56.183171 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.129594 21288 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:05:56.186172 21434 ts_tablet_manager.cc:933] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.191711 21432 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:56.193593 20944 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.196430 20934 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:56.196938 20934 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.197345 20934 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.204144 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.205044 15270 raft_consensus.cc:2410] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:05:56.211465 21241 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.214195 21241 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.236127 21241 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.264729 21434 tablet_copy_client.cc:323] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.3:46145
I20260709 13:05:56.275914 21314 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:56.263365 21257 consensus_queue.cc:1175] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f4ca86ee1d194023b1414bbe226f4798" responder_term: 19 status { last_received { term: 16 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.12-18.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:56.276635 21314 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.284369 20993 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.284931 20993 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.286933 21367 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.288820 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:56.289443 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.291533 15160 leader_election.cc:400] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:05:56.291843 15160 leader_election.cc:403] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:56.292599 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.292754 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.294744 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.301316 21231 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:05:56.302388 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3244) took 1280 ms. Trace:
I20260709 13:05:56.288164 20993 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.302800 15191 rpcz_store.cc:276] 0709 13:05:55.021538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.064781 (+ 43243us) service_pool.cc:224] Handling call
0709 13:05:55.065131 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.485530 (+420399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.485555 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:55.485688 (+   133us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:55.485786 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.302144 (+816358us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b54002364d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:56.302191 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.302324 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966319360}
I20260709 13:05:56.305423 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3058) took 1638 ms. Trace:
I20260709 13:05:56.305734 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.308861 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.288008 21367 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.305770 15345 rpcz_store.cc:276] 0709 13:05:54.666696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.799203 (+132507us) service_pool.cc:224] Handling call
0709 13:05:54.799649 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.823688 (+ 24039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.304319 (+1480631us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b54000b6654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:56.305356 (+  1037us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53593856}
I20260709 13:05:56.310353 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:56.309439 20993 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:05:56.312604 21120 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:56.311434 21097 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:56.324800 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.323812 21241 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:56.326870 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.315654 21231 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:56.327752 15193 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:05:56.322942 21120 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:56.326692 21241 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.330046 15191 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:05:56.329712 21120 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.332283 21241 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.332315 21367 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.333914 21367 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:56.334862 21367 consensus_queue.cc:1243] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 21.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:56.328567 21097 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:56.345288 21097 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:56.346151 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:05:56.315864 21314 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:56.347213 21282 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:56.349159 21282 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.349624 21282 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:56.353052 21050 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.353633 21050 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.354722 21252 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.355826 21050 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.356385 15341 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:56.356925 21252 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:56.315363 20934 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:56.357929 15341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2247) took 1454 ms (client timeout 1639 ms). Trace:
W20260709 13:05:56.358325 15341 rpcz_store.cc:269] 0709 13:05:54.904599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.905342 (+   743us) service_pool.cc:224] Handling call
0709 13:05:56.357774 (+1452432us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003aacd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:56.357874 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335093120}
I20260709 13:05:56.348660 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:56.361897 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.362223 15264 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:56.363166 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:56.363729 15868 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:56.364457 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:56.364858 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.369421 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.371887 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.373306 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:56.373809 15194 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:56.362707 21216 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.375519 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.383533 15264 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:56.384502 15191 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:56.389952 15191 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:56.370173 21314 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.400784 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.405169 15193 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:05:56.386433 21231 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:05:56.402186 15367 debug-util.cc:398] Leaking SignalData structure 0x7b08002aae80 after lost signal to thread 14039
I20260709 13:05:56.402490 15196 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:56.403574 15190 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:56.412417 15196 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:56.401517 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.413089 15191 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:05:56.404345 15194 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:56.414633 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.413147 15196 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.416540 15196 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.423127 15340 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:56.423555 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.425312 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:56.426290 15870 raft_consensus.cc:2393] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:56.415464 15191 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:05:56.433321 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:56.433959 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:56.434492 15345 raft_consensus.cc:2368] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
W20260709 13:05:56.435930 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65461.7us
I20260709 13:05:56.435823 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.433220 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:56.439541 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.440587 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.440949 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.441584 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.386193 21216 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:56.443018 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.444579 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.446759 15338 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:56.445338 15191 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:05:56.444700 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.449235 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.452355 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.453392 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.440189 21050 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.453990 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:56.452104 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.414717 21314 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.500975 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:56.506410 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:56.507504 15271 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.466876 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.508386 15874 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:05:56.455157 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.464119 15196 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:05:56.505515 21447 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:05:56.508873 21050 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.493882 20934 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:56.439997 15162 connection.cc:256] RPC call timeout handler was delayed by -1.9169119239999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260709 13:05:56.511008 15196 pending_rounds.cc:85] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 11
W20260709 13:05:56.512267 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.496568 21231 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:56.517947 15271 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:56.523533 15196 pending_rounds.cc:107] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 20.12
W20260709 13:05:56.523447 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71432.3us
I20260709 13:05:56.523952 15196 raft_consensus.cc:2889] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:56.516633 15264 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:56.525269 21367 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.525494 21232 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:56.526015 21232 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.525803 21367 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.526535 21232 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.528100 21367 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.529556 15868 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:05:56.530292 15870 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:56.531440 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.531467 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.532320 15338 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:56.532409 15191 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:56.493983 21120 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.535568 21050 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.538314 15191 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:56.539885 15338 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:56.539489 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.540478 15194 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 12.
W20260709 13:05:56.541501 15162 connection.cc:256] RPC call timeout handler was delayed by -1.9061119240000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 13:05:56.541913 15162 connection.cc:256] RPC call timeout handler was delayed by -1.7702119239999092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
W20260709 13:05:56.542266 15162 connection.cc:256] RPC call timeout handler was delayed by -1.7552900839999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260709 13:05:56.544356 15194 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
W20260709 13:05:56.542852 15162 connection.cc:256] RPC call timeout handler was delayed by -1.6109119239999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 13:05:56.550297 15162 connection.cc:256] RPC call timeout handler was delayed by -1.5992119239999738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 13:05:56.550642 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:56.551204 15162 connection.cc:256] RPC call timeout handler was delayed by -1.5398119239999914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
I20260709 13:05:56.550145 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:56.551827 15162 connection.cc:256] RPC call timeout handler was delayed by -1.5232902039999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 13:05:56.552582 15191 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:56.552994 15162 connection.cc:256] RPC call timeout handler was delayed by -1.4705119239999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 13:05:56.545702 21232 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.546083 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:56.554296 15162 connection.cc:256] RPC call timeout handler was delayed by -1.4336119239999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:05:56.557253 15162 connection.cc:256] RPC call timeout handler was delayed by -1.4291119239999261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 13:05:56.557693 15162 connection.cc:256] RPC call timeout handler was delayed by -1.3598119239999278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 13:05:56.558080 15162 connection.cc:256] RPC call timeout handler was delayed by -1.3382119240000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
W20260709 13:05:56.558439 15162 connection.cc:256] RPC call timeout handler was delayed by -1.2179840999999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
I20260709 13:05:56.522732 21366 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:56.566983 15343 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:56.455308 21443 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:56.572568 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.572732 15190 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:56.574363 21443 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.575197 21443 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.576993 21432 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:56.577580 21432 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.579298 21368 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.579820 21368 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.580884 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.581817 21368 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.582492 21430 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:56.582903 21430 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.583325 21430 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:56.586018 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:56.587229 21274 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:56.589056 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.589846 21431 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.590080 21274 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:56.590526 21274 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:56.590410 21431 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.591446 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.592226 15188 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:56.593008 21431 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:56.590096 20929 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:56.594067 20929 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:56.589849 15192 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:56.595489 21443 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.595225 20929 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.596648 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.597625 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.598280 15263 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:56.597904 21368 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:56.597666 15271 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:05:56.600278 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.539494 21120 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.601056 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.523990 20850 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:05:56.553931 21229 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:05:56.616289 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54983.2us
W20260709 13:05:56.606186 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60831.3us
I20260709 13:05:56.560645 21050 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:05:56.606225 21366 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.614760 21232 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.556536 21449 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:56.617064 15162 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:56.618618 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.625537 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:56.628508 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:56.619377 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.620148 15191 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:56.622061 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.629662 15271 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:56.629971 15194 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:05:56.633822 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.634089 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.546631 21097 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.614760 21314 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.638757 21216 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:56.638896 20944 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:56.626636 21094 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:05:56.639441 20944 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:05:56.639837 21448 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:05:56.640000 20944 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:56.626744 21449 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:56.643613 21453 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:56.618098 21318 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.636441 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 95322.7us
I20260709 13:05:56.637336 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.627305 21368 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:56.646034 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:56.643883 21445 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:05:56.647887 21443 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.642464 21449 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.651413 15341 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:05:56.630692 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:56.653759 21231 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:05:56.655558 21097 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.656486 21366 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.632018 21229 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:56.659265 15271 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:56.661068 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.634883 21432 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.664152 15264 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.676260 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:56.676905 15868 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:56.622437 21274 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.677654 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:56.677963 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:56.678567 15271 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.657667 21368 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.675015 15238 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:05:56.679143 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.680694 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.663642 21431 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:56.681773 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.682037 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.681613 15194 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:56.679728 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.677987 21456 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:56.670076 20850 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.691847 21446 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:56.702294 20850 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.675468 21213 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:56.703281 21213 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.703650 21213 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:56.704799 20850 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.657792 21453 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.705283 21446 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.705703 21446 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:56.706751 21453 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.663898 21318 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.710206 21318 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:56.667734 21314 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:05:56.679262 20980 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:05:56.711632 21314 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:56.712108 21458 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:56.683916 21097 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.712698 21458 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:56.713112 21458 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.713925 21430 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.712118 21314 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:56.715925 21314 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.716957 21314 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.692940 21274 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.702404 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2267) took 1953 ms. Trace:
I20260709 13:05:56.688342 15191 raft_consensus.cc:2410] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:05:56.691758 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.682320 21449 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:56.691622 21216 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:56.692587 21229 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.688652 15264 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:56.720739 15195 rpcz_store.cc:276] 0709 13:05:54.748861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.920760 (+171899us) service_pool.cc:224] Handling call
0709 13:05:54.921101 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:54.928259 (+  7158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:54.928305 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:54.965547 (+ 37242us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.093595 (+128048us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:55.093634 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.093698 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.702202 (+1608504us) raft_consensus.cc:1685] finished
0709 13:05:56.702223 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.702348 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44941,"raft.queue_time_us":98,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":16321,"thread_start_us":94903,"threads_started":1,"wal-append.queue_time_us":192584,"wal-append.run_cpu_time_us":1986,"wal-append.run_wall_time_us":1028758}
I20260709 13:05:56.689050 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.724875 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:56.681449 20929 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
W20260709 13:05:56.741014 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet 40f6ff8071574893b4031710ebd49b6d: Illegal state: Replica 5e6eed5c7a6b4571b5f898002fc990d2 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:05:56.742004 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:56.754155 15869 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:56.745273 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.755430 15191 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:56.746929 15192 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:56.748010 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:56.729441 21120 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.688007 21368 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.755905 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.750288 15194 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:05:56.755457 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 66457.1us
I20260709 13:05:56.739413 21216 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.757742 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:56.766009 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.767055 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.767907 15271 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:56.771495 21446 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.774164 21446 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.776614 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2926) took 1176 ms. Trace:
I20260709 13:05:56.777169 15268 rpcz_store.cc:276] 0709 13:05:55.600305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.654132 (+1053827us) service_pool.cc:224] Handling call
0709 13:05:56.654642 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.654957 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.654984 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.655870 (+   886us) log.cc:844] Serialized 499 byte log entry
0709 13:05:56.672431 (+ 16561us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:56.672466 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.672546 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.776325 (+103779us) raft_consensus.cc:1685] finished
0709 13:05:56.776357 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.776537 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":15987,"threads_started":1,"wal-append.queue_time_us":115442}
I20260709 13:05:56.779392 21454 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:56.780371 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.780779 21459 raft_consensus.cc:2764] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
I20260709 13:05:56.781544 21459 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:56.782193 21459 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:56.783201 20850 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:56.783598 20850 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.783972 20850 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:56.784427 15339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2236) took 2690 ms (client timeout 1720 ms). Trace:
W20260709 13:05:56.784807 15339 rpcz_store.cc:269] 0709 13:05:54.094392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.097231 (+  2839us) service_pool.cc:224] Handling call
0709 13:05:56.784227 (+2686996us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54000b6b54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:56.784333 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3478996736}
I20260709 13:05:56.786913 21307 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:56.787490 21307 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:56.788373 21307 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.790607 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.781491 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.792532 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:56.794548 15194 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:56.755079 21241 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.796980 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.822731 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.824357 15162 leader_election.cc:400] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14.
I20260709 13:05:56.765760 20663 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:56.789242 21353 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.829916 21232 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:56.831090 21358 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:56.809567 20980 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:56.820513 21253 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.832063 21431 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:56.816959 21446 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:05:56.813930 21213 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.834950 21455 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:56.820896 21454 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:56.827586 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:56.770498 21456 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:56.767634 21268 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.770082 21216 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:56.835281 21313 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:56.843585 15367 debug-util.cc:398] Leaking SignalData structure 0x7b0800257bc0 after lost signal to thread 15129
W20260709 13:05:56.874181 15367 debug-util.cc:398] Leaking SignalData structure 0x7b080035cb60 after lost signal to thread 15221
W20260709 13:05:56.874630 15367 debug-util.cc:398] Leaking SignalData structure 0x7b080022bf60 after lost signal to thread 15222
I20260709 13:05:56.847419 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.848474 15344 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:56.851590 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.877511 15338 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:56.789336 21307 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:56.854879 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:56.883368 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.854760 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:56.856936 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.885524 15343 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:56.886616 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.890338 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.886071 21216 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.843914 20980 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.837661 21232 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:56.787249 21257 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:05:56.839541 21351 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.875757 15367 debug-util.cc:398] Leaking SignalData structure 0x7b08003559a0 after lost signal to thread 15296
I20260709 13:05:56.901327 15190 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:05:56.840406 21282 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.888347 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.889060 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.855580 21279 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.817556 21429 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:05:56.861553 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.866947 15194 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:56.911487 15344 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:56.899698 21307 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:56.871985 20663 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:56.878715 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:56.924000 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:56.909303 15367 debug-util.cc:398] Leaking SignalData structure 0x7b0800314000 after lost signal to thread 15297
W20260709 13:05:56.925836 15367 debug-util.cc:398] Leaking SignalData structure 0x7b080024fc20 after lost signal to thread 15370
I20260709 13:05:56.926580 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:56.927119 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 65659.2us
I20260709 13:05:56.827095 21241 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.901221 21293 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:56.927186 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:56.936034 21120 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.938228 21282 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.939961 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.855307 21253 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.941238 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.941946 15346 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:56.942255 21253 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.942649 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.930714 15338 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:56.945755 21241 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.946157 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:56.928138 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:56.925768 21351 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.948561 21453 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:56.949028 21453 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:56.949401 21453 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.942785 15341 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:56.950001 21351 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:56.953111 21213 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:56.875237 21313 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.954022 21313 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:56.954465 20993 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260709 13:05:56.875644 21268 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.954969 20993 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:56.955516 20940 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:56.956667 21268 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:56.957238 21443 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:56.957653 21443 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:56.958773 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.958876 21443 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.959663 15268 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:56.961141 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:56.943989 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:56.961934 15190 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:56.961079 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.962960 15160 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:56.927644 21367 raft_consensus.cc:2764] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:05:56.845757 21358 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:56.966166 15162 leader_election.cc:400] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
I20260709 13:05:56.966522 15162 leader_election.cc:403] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:56.967239 21120 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:56.968194 21358 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:56.969444 21132 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:56.930972 21279 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.970207 15871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:56.971329 21231 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
I20260709 13:05:56.921895 21232 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.908921 20980 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:56.976485 15341 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:05:56.976877 15190 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:05:56.933559 21307 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.933350 21366 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:56.870780 21455 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:56.984304 15344 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:56.985456 15868 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:05:56.928210 15237 connection.cc:256] RPC call timeout handler was delayed by -1.3800540319999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:05:56.840987 21353 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.869020 21456 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:56.961905 15869 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:56.970223 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2951) took 1125 ms. Trace:
W20260709 13:05:56.993302 15367 debug-util.cc:398] Leaking SignalData structure 0x7b080028a060 after lost signal to thread 15900
I20260709 13:05:56.993796 15338 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:05:56.995009 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 168862us
W20260709 13:05:57.112309 15367 debug-util.cc:398] Leaking SignalData structure 0x7b080036d400 after lost signal to thread 15901
I20260709 13:05:57.111145 15272 rpcz_store.cc:276] 0709 13:05:55.844722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.844878 (+   156us) service_pool.cc:224] Handling call
0709 13:05:55.845198 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.845557 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:55.908359 (+ 62802us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.938825 (+ 30466us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.942531 (+  3706us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.955929 (+ 13398us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:55.956122 (+   193us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.956312 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.956407 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.963222 (+1006815us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b18003cbf20. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:56.969991 (+  6769us) raft_consensus.cc:1685] finished
0709 13:05:56.970017 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.970162 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7249,"prepare.queue_time_us":7972,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":40893,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":11231,"spinlock_wait_cycles":105414400,"thread_start_us":71383,"threads_started":2,"wal-append.queue_time_us":46556}
I20260709 13:05:57.113932 15343 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
W20260709 13:05:57.114233 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.114647 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.997038 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.115206 15269 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
W20260709 13:05:57.111160 15237 connection.cc:256] RPC call timeout handler was delayed by -1.2792540320000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:05:56.999190 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:56.828058 21459 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:56.909425 21430 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.069649 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:57.144479 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.145155 15271 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 13: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:57.146677 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.148087 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:05:57.019114 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.929316 20663 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:57.110714 15868 raft_consensus.cc:2393] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:05:57.116060 15237 connection.cc:256] RPC call timeout handler was delayed by -1.2513540319999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 13:05:56.974887 21457 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:56.981321 21313 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.123685 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:05:57.124277 21463 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:05:57.125999 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3265) took 1455 ms. Trace:
I20260709 13:05:57.165501 15197 rpcz_store.cc:276] 0709 13:05:55.670410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.838459 (+168049us) service_pool.cc:224] Handling call
0709 13:05:55.851654 (+ 13195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.851867 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:55.885283 (+ 33416us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.885713 (+   430us) log.cc:844] Serialized 14 byte log entry
0709 13:05:56.966997 (+1081284us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b1800227ce0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:57.125217 (+158220us) spinlock_profiling.cc:243] Waited 872 us on lock 0x7b1800227ce0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e52c3d70 00007f36e52b7293 00007f36e52accea 00007f36e52ad23a 00007f36e5717a2a 00007f36e57270bf 00007f36e5727038
0709 13:05:57.125531 (+   314us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:57.125597 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:57.125667 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.125757 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.125926 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9729,"prepare.queue_time_us":67485,"prepare.run_cpu_time_us":5971,"prepare.run_wall_time_us":13129,"raft.queue_time_us":22810,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":153,"spinlock_wait_cycles":5292544}
I20260709 13:05:57.129158 21279 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.130272 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:57.072050 21366 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:57.113613 21456 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:57.071593 21132 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:57.137291 21353 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.138229 21455 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.174669 21366 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:57.142867 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.143011 15342 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:57.143640 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:57.134690 21307 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:57.190142 21313 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:57.190819 15872 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:57.191627 15340 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:05:57.158179 20663 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:56.929948 21458 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.208642 21458 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:57.210841 21453 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.193826 21286 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.213047 21453 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:57.212916 21286 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.171995 21204 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:57.202335 21368 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:57.171259 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.170462 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.169790 15876 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:05:57.172801 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.157706 21457 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:57.176155 15356 tablet_copy_service.cc:140] P 9d785ccef0634edd9f0fbb52fa1c8d27: Received BeginTabletCopySession request for tablet 6056d49d08dc4130887dbf154edc6675 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:48112)
I20260709 13:05:57.183662 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.183662 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:57.194744 15869 raft_consensus.cc:1275] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:05:57.195282 15271 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:57.196669 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2243) took 2294 ms. Trace:
I20260709 13:05:57.199713 21132 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.200734 21443 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:57.145648 21454 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.202183 21216 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:57.203951 20944 consensus_meta.cc:287] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.000s
I20260709 13:05:57.225698 21204 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:05:57.232499 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62122.2us
I20260709 13:05:57.233560 15356 tablet_copy_service.cc:161] P 9d785ccef0634edd9f0fbb52fa1c8d27: Beginning new tablet copy session on tablet 6056d49d08dc4130887dbf154edc6675 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:48112: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-6056d49d08dc4130887dbf154edc6675
I20260709 13:05:57.241551 21241 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:57.232756 21215 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:57.249557 20944 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.252332 15264 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:05:57.347525 15264 pending_rounds.cc:85] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 12
I20260709 13:05:57.229106 15339 raft_consensus.cc:2368] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:57.231710 15265 raft_consensus.cc:2393] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:57.256510 21286 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.269061 20663 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:57.351430 21286 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.272010 21232 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.351969 21286 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.353628 15356 tablet_copy_source_session.cc:215] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:57.353742 21232 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:57.350917 20663 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:57.355625 21286 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.356504 20944 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:57.233982 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 50403.8us
I20260709 13:05:57.358219 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.234733 15345 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:57.359287 21385 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.359817 21385 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.234977 15337 rpcz_store.cc:276] 0709 13:05:54.902234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.957610 (+ 55376us) service_pool.cc:224] Handling call
0709 13:05:56.181673 (+1224063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.182310 (+   637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.196455 (+1014145us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400340150. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:57.196583 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2814190848}
W20260709 13:05:57.240867 21274 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:05:57.347810 15264 pending_rounds.cc:107] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:05:57.360387 15265 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:05:57.361979 15264 raft_consensus.cc:2889] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:57.363794 21241 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:57.327265 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.365453 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:57.366238 15266 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 25: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:57.366492 21241 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:57.367108 21241 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:57.233260 21457 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.368718 21457 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:57.368422 21241 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:57.239073 21094 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:57.371570 21094 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:57.371975 21274 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.372602 21274 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.372784 21094 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.373921 21094 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:57.328382 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.375782 21274 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.345335 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.377272 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.378094 21282 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:57.378515 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.379336 21282 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:57.379423 21216 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:57.341717 21204 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:57.384402 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.385677 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:05:57.326409 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.391330 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.394393 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.396577 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.397408 15194 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:57.399796 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.401031 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:56.995641 21304 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.401571 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.405378 15191 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:57.402993 15272 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:05:57.408404 15272 pending_rounds.cc:85] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 13
I20260709 13:05:57.408788 15272 pending_rounds.cc:107] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:05:57.409160 15272 raft_consensus.cc:2889] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:57.399183 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:57.414090 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 448022us
I20260709 13:05:57.416435 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:57.417052 15263 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.039s	sys 0.070s
W20260709 13:05:57.418874 15263 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.039s	sys 0.070s
I20260709 13:05:57.424278 15237 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:57.424782 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.425518 15188 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:57.427774 15197 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:05:57.421211 15270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.042s	sys 0.067s
W20260709 13:05:57.430240 15270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.042s	sys 0.067s
I20260709 13:05:57.441416 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:57.443984 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.403759 21215 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:57.087244 20850 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.423537 21204 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:57.411563 21050 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:57.420801 21314 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:57.460107 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3253) took 1830 ms. Trace:
I20260709 13:05:57.461162 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.441109 20944 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:57.465318 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48958.2us
I20260709 13:05:57.489820 15162 leader_election.cc:400] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:05:57.453378 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:57.317828 21366 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.219003 20980 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.487404 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.486829 15189 rpcz_store.cc:276] 0709 13:05:55.634971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.932706 (+1297735us) service_pool.cc:224] Handling call
0709 13:05:56.933062 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.933257 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:57.062819 (+129562us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.459678 (+396859us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:57.459747 (+    69us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:57.459804 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.459893 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.460045 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":133607,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":3978,"thread_start_us":396431,"threads_started":1}
I20260709 13:05:57.491161 15263 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:57.420367 21274 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:05:57.449971 21434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6056d49d08dc4130887dbf154edc6675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:57.492777 15188 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:57.493575 15346 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:57.506701 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.507251 15272 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:57.496447 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.497574 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.500725 21366 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:57.501772 15268 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:57.426734 21367 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:05:57.504880 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.446648 21265 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:05:57.510459 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:57.525211 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:57.526047 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.514292 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:57.446245 21449 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:05:57.519397 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.534914 15272 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:05:57.487174 21447 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:57.529428 15263 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:57.529950 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:57.538321 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:57.530308 15309 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.490886 21314 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:57.490702 21212 raft_consensus.cc:2764] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 13:05:57.549970 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.420559 21304 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.539323 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:57.502789 21313 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:57.521821 21050 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:57.538422 21447 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:57.566362 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:57.566838 21447 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:57.547303 21286 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:57.508312 20944 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:57.551649 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.541414 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.539402 21367 consensus_queue.cc:1243] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:57.572165 15193 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 13.
I20260709 13:05:57.564425 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.562525 21366 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:57.565954 21232 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:57.566150 21443 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:57.547894 20980 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:57.510298 21456 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.574044 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:57.558476 21314 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:57.577791 15162 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.557770 21265 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:57.561892 21389 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:57.591198 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.592588 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.566792 15093 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 13 to 15, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 15 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:05:57.569936 21228 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:57.512128 21468 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:05:57.569416 21286 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.589821 15874 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:57.571671 21351 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:57.580127 21313 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:57.596772 15160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.019s	sys 0.048s
I20260709 13:05:57.590418 21265 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.590829 21367 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:57.590560 21466 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:57.609079 15160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.019s	sys 0.049s
I20260709 13:05:57.604635 15162 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.591557 21050 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:57.603194 15189 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:57.611730 15162 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.594285 20993 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:57.606750 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.4:42201 timed out after 1.577s (SENT) [suppressed 20 similar messages]
I20260709 13:05:57.596114 21228 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.575312 21153 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:05:57.615986 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:57.633833 15870 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:57.637605 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.637900 21293 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:57.639242 21429 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:05:57.619838 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 656900us
I20260709 13:05:57.617461 21358 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:57.620631 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.620543 20850 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.654106 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:57.654239 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:57.621740 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:57.623508 20944 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.601363 21453 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:05:57.607925 21366 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:57.601411 21458 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:57.613301 21265 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:57.604862 21120 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.030s	sys 0.050s
I20260709 13:05:57.631732 21474 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:57.603399 21286 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:57.603813 21351 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.618934 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:57.605063 20940 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.645808 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:57.677745 15338 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:57.646481 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:57.667268 21120 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.031s	sys 0.050s
I20260709 13:05:57.648255 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:57.598043 21304 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:57.651547 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:57.694160 15263 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:05:57.695683 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:57.652400 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:57.659646 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:57.660521 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:57.661398 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:57.661648 15191 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:57.660831 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.614382 21231 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:57.649052 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:57.707518 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 92492.8us
I20260709 13:05:57.716135 15265 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:57.672746 21366 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:57.718324 15162 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.723435 15343 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:05:57.708889 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.731979 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:05:57.721952 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 61207.6us
I20260709 13:05:57.663477 15870 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:05:57.640875 21228 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:57.667299 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.667709 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:57.601061 20980 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:05:57.640332 21050 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:57.671227 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:57.673316 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:57.771242 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:57.675196 21351 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:57.775955 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:57.776732 15343 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:57.675827 15872 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:05:57.776810 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63361.2us
I20260709 13:05:57.647403 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:57.680466 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:57.692031 15341 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:57.739799 21478 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:57.748241 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:57.747109 21232 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:57.764750 15311 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:57.765671 15162 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:57.767424 15194 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:57.795998 15194 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:57.693622 20940 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.771512 15340 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:57.772183 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:57.772888 15195 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:57.691732 21458 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:57.666712 21144 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:05:57.775115 15344 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:05:57.691385 21120 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:57.788905 15341 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:57.790113 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:57.813906 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:57.793334 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 84539.2us
I20260709 13:05:57.678925 21253 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 13:05:57.800297 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:57.804235 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 52631.8us
I20260709 13:05:57.804883 15195 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
W20260709 13:05:57.805095 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 54985.3us
I20260709 13:05:58.240489 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:57.806627 15197 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:58.241119 15195 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:57.808041 15191 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:57.797014 15194 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:57.912571 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.911517 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:57.908998 15342 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
W20260709 13:05:58.240521 15338 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.561s	user 0.010s	sys 0.000s
I20260709 13:05:58.244155 15338 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:05:57.798761 21478 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:05:57.918562 21427 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:57.926874 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:57.927614 21458 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.928268 15343 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:57.928838 21153 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.926524 21120 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.930421 21359 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.931136 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:58.262333 15269 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.024s	sys 0.032s
W20260709 13:05:58.262691 15269 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.024s	sys 0.032s
I20260709 13:05:57.931963 15188 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:57.814321 21288 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:57.811269 21231 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:57.937323 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2966) took 1766 ms. Trace:
I20260709 13:05:58.272994 15267 rpcz_store.cc:276] 0709 13:05:56.170436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.170574 (+   138us) service_pool.cc:224] Handling call
0709 13:05:56.170910 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.171233 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.171263 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.171716 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.199646 (+ 27930us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:56.199683 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.199729 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.927854 (+1728125us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b2400110138. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e24a69c4 00007f36e24a4acb 00007f36e265fdc9 00007f36e265fa55 00007f36e265efb0 00007f36e52d5488 00007f36e52d5be8 00007f36e52ad398 00007f36e52a876a 00007f36e52a7bb6
0709 13:05:57.931555 (+  3701us) raft_consensus.cc:1685] finished
0709 13:05:57.931575 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.937232 (+  5657us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2366,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":5120384,"thread_start_us":27561,"threads_started":1,"wal-append.queue_time_us":41304}
I20260709 13:05:57.941237 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:05:58.276463 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 335307us
W20260709 13:05:57.971956 21471 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:05:57.919206 21293 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:57.933548 21134 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.014305 21204 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.122516 15190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.035s	sys 0.115s
I20260709 13:05:57.982110 21432 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:05:58.124907 15237 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.044s	sys 0.111s
W20260709 13:05:58.302667 15237 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.044s	sys 0.111s
I20260709 13:05:57.881433 21291 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:58.122423 21357 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:58.291268 20980 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:05:58.304273 21357 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.282985 21359 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.938797 21366 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:57.973192 21050 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.170826 21385 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.175443 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2249) took 1329 ms. Trace:
I20260709 13:05:58.317790 15339 rpcz_store.cc:276] 0709 13:05:56.846358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.854477 (+  8119us) service_pool.cc:224] Handling call
0709 13:05:58.175171 (+1320694us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003ab6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:58.175358 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790669568}
I20260709 13:05:58.177327 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3004) took 1001 ms. Trace:
I20260709 13:05:58.319243 15271 rpcz_store.cc:276] 0709 13:05:57.175463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.175580 (+   117us) service_pool.cc:224] Handling call
0709 13:05:57.175860 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.240603 (+ 64743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.176991 (+936388us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b54002f1cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:58.177252 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44154112}
I20260709 13:05:58.179268 21368 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:58.192759 21307 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:58.148686 21213 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:58.149056 21468 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:57.879714 15337 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:58.245350 15341 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:58.248162 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:58.330919 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:58.331650 15191 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:58.249042 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 336564us
I20260709 13:05:58.219187 21443 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:58.333930 21288 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:05:58.354123 15192 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.027s	sys 0.057s
W20260709 13:05:58.354477 15192 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.027s	sys 0.057s
I20260709 13:05:58.261612 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:58.267189 15195 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
W20260709 13:05:58.271454 21228 consensus_meta.cc:287] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:05:58.287111 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:58.330039 21307 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:05:58.296906 15190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.036s	sys 0.116s
I20260709 13:05:58.360514 20663 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:58.254715 21358 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:58.303107 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 696346us
I20260709 13:05:58.284260 20940 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.311265 21204 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.272776 21231 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:58.317447 21432 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:58.286790 21453 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:58.340804 15339 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:58.342437 15341 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:58.315917 21291 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.275234 21153 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.349592 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2861) took 1656 ms. Trace:
I20260709 13:05:58.393527 15270 rpcz_store.cc:276] 0709 13:05:56.693468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.695496 (+  2028us) service_pool.cc:224] Handling call
0709 13:05:56.695908 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.696152 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.696188 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.696721 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.432946 (+736225us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:57.433002 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.433090 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.349303 (+916213us) raft_consensus.cc:1685] finished
0709 13:05:58.349335 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.349517 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":678317,"threads_started":1,"wal-append.queue_time_us":1037176}
I20260709 13:05:58.255692 21427 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.263712 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 2999) took 1141 ms. Trace:
W20260709 13:05:58.379662 21313 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.768s	user 0.004s	sys 0.008s
W20260709 13:05:58.265920 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 354502us
I20260709 13:05:58.406561 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:58.355297 15197 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:05:58.410152 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:58.410877 15197 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:58.412272 15197 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:58.355814 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:58.288765 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:58.415412 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 126769us
I20260709 13:05:58.358120 15189 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:05:58.418586 21282 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:58.300282 21134 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.296936 21454 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:05:58.362850 15191 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:05:58.419956 21454 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:58.287249 21459 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:58.420917 21459 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:58.421200 21134 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.421387 21459 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:58.422261 20850 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:58.333213 21213 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.424520 20850 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:58.359373 21359 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.339941 21468 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.359046 21228 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:58.396770 15196 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.005s	sys 0.014s
W20260709 13:05:58.436416 15196 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.005s	sys 0.014s
I20260709 13:05:58.399859 15269 rpcz_store.cc:276] 0709 13:05:57.122497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.122656 (+   159us) service_pool.cc:224] Handling call
0709 13:05:57.123156 (+   500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:57.171275 (+ 48119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.171329 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:57.183112 (+ 11783us) log.cc:844] Serialized 52 byte log entry
0709 13:05:57.644052 (+460940us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:58.263015 (+618963us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.263411 (+   396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.263481 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.263519 (+    38us) raft_consensus.cc:1685] finished
0709 13:05:58.263531 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.263651 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47621,"prepare.queue_time_us":741223,"raft.queue_time_us":50703,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":43320,"thread_start_us":1028583,"threads_started":2,"wal-append.queue_time_us":600175}
I20260709 13:05:58.287685 21449 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:05:58.377302 21231 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:58.391666 21291 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:58.404697 15270 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:05:58.428359 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:58.356050 21443 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.430401 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:58.349786 21357 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.444048 15265 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:05:58.447602 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:58.518024 15267 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:58.518522 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:58.352237 21478 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:58.383661 21453 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.555575 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:05:58.435889 21265 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.759s	user 0.003s	sys 0.007s
I20260709 13:05:58.466375 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:58.520169 15263 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:58.467960 15340 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:58.572130 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:58.567183 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 192667us
I20260709 13:05:58.573403 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:58.433683 21313 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:58.577023 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:58.571389 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:05:58.574400 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 278617us
I20260709 13:05:58.579268 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:58.433367 21213 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:58.584893 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:58.585989 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:58.588433 15265 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:05:58.579569 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:58.577175 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:58.522058 21449 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:58.592633 21449 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:58.592671 15237 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:58.597465 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:58.602721 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:58.439263 21288 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:58.586663 21134 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.640336 15340 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:05:58.641646 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:58.645802 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:58.559491 20980 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:05:58.592196 21313 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:05:58.647663 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70533.1us
I20260709 13:05:58.573613 21265 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:58.653273 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:05:58.646921 21213 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:58.677067 15264 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:58.652297 21313 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:58.604871 21120 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:05:58.658567 20702 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:58.694540 21204 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:58.695274 21204 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:58.695760 21204 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:58.696651 21204 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.698411 21468 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:58.700021 21468 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:58.703889 21488 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:05:58.691107 21432 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:05:58.705340 21447 consensus_meta.cc:287] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.138s	user 0.012s	sys 0.001s
I20260709 13:05:58.706022 21228 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.705816 21447 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.706794 21500 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:58.706988 15342 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:58.707537 21500 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:58.708104 21485 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.320s	user 0.001s	sys 0.001s
I20260709 13:05:58.709066 21494 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.709450 21314 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.110s	user 0.005s	sys 0.006s
I20260709 13:05:58.709584 21494 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.709988 21314 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.711884 21494 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.713200 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2305) took 1044 ms. Trace:
I20260709 13:05:58.725226 15196 rpcz_store.cc:276] 0709 13:05:57.668634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.668775 (+   141us) service_pool.cc:224] Handling call
0709 13:05:57.693801 (+ 25026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.698500 (+  4699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.698533 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.698991 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.436823 (+737832us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:58.436868 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.436935 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.712934 (+275999us) raft_consensus.cc:1685] finished
0709 13:05:58.712961 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.713132 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4289,"raft.queue_time_us":17849,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":15351,"thread_start_us":737500,"threads_started":1,"wal-append.queue_time_us":869141}
I20260709 13:05:58.713883 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3313) took 1320 ms. Trace:
I20260709 13:05:58.727725 15190 rpcz_store.cc:276] 0709 13:05:57.393183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.393474 (+   291us) service_pool.cc:224] Handling call
0709 13:05:57.393804 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.394162 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.394190 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.394634 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.360293 (+965659us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:58.360330 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.360402 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.713646 (+353244us) raft_consensus.cc:1685] finished
0709 13:05:58.713672 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.713822 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4434,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":18127,"thread_start_us":903897,"threads_started":1,"wal-append.queue_time_us":842188}
I20260709 13:05:58.673481 21213 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:58.674057 21357 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:05:58.689532 21484 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:05:58.744088 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:58.651189 21134 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:58.786789 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 141053us
W20260709 13:05:58.723932 21489 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:05:58.724088 21490 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:05:58.791682 15162 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:58.792054 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 199454us
I20260709 13:05:58.723922 21499 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:58.746287 21491 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:58.724027 21504 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:58.751751 21213 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:58.790360 21286 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.111s	user 0.009s	sys 0.003s
I20260709 13:05:58.820379 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:58.823241 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:58.828433 15190 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:05:58.825389 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:58.825999 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:58.830286 15869 raft_consensus.cc:2368] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:58.789263 21507 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:58.791460 21153 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.794924 21357 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:58.845012 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:05:58.834730 21351 consensus_meta.cc:287] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.033s	user 0.007s	sys 0.005s
I20260709 13:05:58.723744 21496 consensus_queue.cc:1048] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.166s
I20260709 13:05:58.875079 21505 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:58.875226 21458 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:58.853071 15872 raft_consensus.cc:2376] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21. Re-sending same reply.
I20260709 13:05:58.875887 21505 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:58.841506 21502 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:05:58.831517 20944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.010s	sys 0.025s
I20260709 13:05:58.823307 21491 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.862437 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:58.826231 21475 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:58.874974 21495 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:58.889148 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 235991us
I20260709 13:05:58.892573 15267 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:58.875998 21468 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:58.898844 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:58.903371 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 71100.9us
I20260709 13:05:58.904408 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2312) took 1130 ms. Trace:
I20260709 13:05:58.904778 15193 rpcz_store.cc:276] 0709 13:05:57.773993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.791874 (+ 17881us) service_pool.cc:224] Handling call
0709 13:05:57.792236 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.799408 (+  7172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.799453 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.813253 (+ 13800us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.256009 (+442756us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:58.256057 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.256137 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.904178 (+648041us) raft_consensus.cc:1685] finished
0709 13:05:58.904203 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.904343 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16134,"raft.queue_time_us":10186,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6226,"thread_start_us":329141,"threads_started":1,"wal-append.queue_time_us":526256}
I20260709 13:05:58.870087 21453 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:58.804098 21313 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.912227 15193 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:58.843737 21286 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:58.887669 21491 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:58.857695 21120 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:05:58.874963 21351 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.927460 21313 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:58.909684 21475 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:58.849606 21507 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:58.958146 21366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.032s	sys 0.049s
I20260709 13:05:58.932018 21447 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:58.943567 21494 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:58.959682 21357 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.942513 21453 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:05:58.911438 21468 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.005722 15344 raft_consensus.cc:2368] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
W20260709 13:05:59.016530 21520 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:05:59.004709 21366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.032s	sys 0.049s
W20260709 13:05:58.998301 21429 consensus_meta.cc:287] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.358s	user 0.008s	sys 0.003s
I20260709 13:05:59.049984 15341 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:59.009212 21494 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.051522 21513 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.023005 21231 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:58.909608 21495 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:59.058877 15345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 3073) took 2630 ms (client timeout 3348 ms). Trace:
W20260709 13:05:59.069051 15345 rpcz_store.cc:269] 0709 13:05:56.428628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.449025 (+ 20397us) service_pool.cc:224] Handling call
0709 13:05:59.058668 (+2609643us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b5400271fd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:59.058801 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1805179136}
I20260709 13:05:59.007097 21265 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:59.062009 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2263) took 2208 ms. Trace:
I20260709 13:05:58.991679 21314 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:58.975996 21501 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:59.065615 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 155961us
I20260709 13:05:58.955205 21228 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:05:59.084198 21522 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:05:59.071681 15346 rpcz_store.cc:276] 0709 13:05:56.853249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.942418 (+ 89169us) service_pool.cc:224] Handling call
0709 13:05:59.061766 (+2119348us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b5400244854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:59.061933 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256730496}
W20260709 13:05:59.073011 15268 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 3001) took 1912 ms (client timeout 1734 ms). Trace:
I20260709 13:05:59.085415 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3342) took 1167 ms. Trace:
W20260709 13:05:59.085597 15268 rpcz_store.cc:269] 0709 13:05:57.160658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.160799 (+   141us) service_pool.cc:224] Handling call
0709 13:05:59.072781 (+1911982us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54002a94d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:59.072937 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618483456}
I20260709 13:05:58.968971 21515 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 13:05:59.085798 15191 rpcz_store.cc:276] 0709 13:05:57.917669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.422482 (+504813us) service_pool.cc:224] Handling call
0709 13:05:58.422783 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.614522 (+191739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.614554 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.615023 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.803646 (+188623us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:58.803698 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.803791 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.085206 (+281415us) raft_consensus.cc:1685] finished
0709 13:05:59.085227 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.085360 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168041,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":7832,"thread_start_us":339213,"threads_started":2,"wal-append.queue_time_us":249367}
W20260709 13:05:59.073771 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.027583 21134 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:58.996394 21291 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.063853 21494 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.067947 21429 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:05:59.066069 21504 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:59.097890 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:59.109954 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 442017us
I20260709 13:05:59.114624 15338 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:58.999922 21475 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.099095 21265 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.108386 21314 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:59.121660 21459 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.002s
I20260709 13:05:59.123282 21506 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.123960 21511 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:05:59.124907 21524 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:59.126408 21291 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:59.127496 21453 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.133585 15237 leader_election.cc:400] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:59.121096 21120 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:59.144399 15237 leader_election.cc:403] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:05:59.133865 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.070145 21513 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:05:59.093017 21501 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.140185 21459 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:59.148284 21453 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.138216 21265 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:05:59.155224 15237 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:05:59.159485 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2304) took 1491 ms. Trace:
I20260709 13:05:59.166035 15188 rpcz_store.cc:276] 0709 13:05:57.668300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.668473 (+   173us) service_pool.cc:224] Handling call
0709 13:05:57.931795 (+263322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.263091 (+331296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.159223 (+896132us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54001a4350. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:59.159409 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549523328}
I20260709 13:05:59.143698 21351 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:59.154646 21120 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.181501 15193 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:59.179854 20944 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:05:59.189824 21512 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 13:05:59.191256 21531 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:59.138733 21314 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.181207 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:05:59.200518 21476 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.469s	user 0.007s	sys 0.008s
I20260709 13:05:59.199903 21314 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.208290 15343 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:05:59.210541 20948 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:59.211123 20948 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:59.212185 20948 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.213454 20948 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.215425 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:59.216821 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:05:59.180779 21120 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:59.183516 21313 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:59.141940 21506 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.222615 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:59.228600 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:59.229727 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:59.230341 15269 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:05:59.231477 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:59.199708 21286 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:59.235443 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:59.234344 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:59.236285 15263 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:59.234994 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:59.215885 21351 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:59.146713 21511 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.217425 21291 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:59.246224 15268 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:05:59.217447 21314 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:59.215329 21534 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18.
I20260709 13:05:59.240451 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:59.241166 21495 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.240825 21536 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:59.243681 21511 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.161157 21504 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.226562 21231 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.242796 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:59.237166 21531 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:59.239570 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:59.248153 21496 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:59.254819 15263 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:59.248258 21204 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:05:59.270767 21434 consensus_meta.cc:287] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:05:59.236097 21313 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.285393 21050 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:59.286587 21050 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:59.287190 21050 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:59.288160 21050 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.290172 21434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58404 (request call id 530) took 3183 ms. Trace:
W20260709 13:05:59.303824 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.305707 15343 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:05:59.307663 15343 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:05:59.272284 21468 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.276086 21511 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:59.318012 15263 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:59.258011 21314 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.309118 21507 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.322255 21050 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:59.344491 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:59.357089 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:59.360131 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:59.360535 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:59.361483 15268 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:59.361632 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:05:59.344367 21459 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:59.373027 21286 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:59.360513 21357 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:59.364398 21432 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:59.361017 21265 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:59.373039 21213 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.005s
I20260709 13:05:59.367313 21501 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.359076 21534 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:05:59.359606 21507 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:05:59.381961 21357 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.381171 21432 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.382269 21513 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:05:59.388121 21286 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:05:59.303467 21434 rpcz_store.cc:276] 0709 13:05:56.106542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.106673 (+   131us) service_pool.cc:224] Handling call
0709 13:05:56.195107 (+ 88434us) ts_tablet_manager.cc:934] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
0709 13:05:57.380773 (+1185666us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:58.679151 (+1298378us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:58.679274 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:59.289254 (+609980us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:59.289612 (+   358us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:59.289988 (+   376us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:59.290057 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":22245,"tablet-copy.queue_time_us":78758,"thread_start_us":70279,"threads_started":2}
I20260709 13:05:59.411644 21357 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:59.419953 21432 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:59.396210 21213 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:59.434650 21506 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.454794 21314 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.458250 21213 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:59.445490 21434 tablet_copy_client.cc:806] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:59.467304 21434 tablet_copy_client.cc:670] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:59.445120 21286 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:59.478360 15344 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 3087) took 1825 ms (client timeout 2213 ms). Trace:
I20260709 13:05:59.479347 15342 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:59.484465 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.486109 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.488255 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3337) took 1574 ms. Trace:
I20260709 13:05:59.498544 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 3041) took 1013 ms. Trace:
I20260709 13:05:59.499120 15265 rpcz_store.cc:276] 0709 13:05:58.485145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.518310 (+ 33165us) service_pool.cc:224] Handling call
0709 13:05:59.498325 (+980015us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400011654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:59.498463 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158958976}
W20260709 13:05:59.512375 21491 consensus_meta.cc:287] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.521s	user 0.005s	sys 0.006s
I20260709 13:05:59.544302 21491 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.512962 21357 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.482342 21494 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.547997 21494 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:59.523154 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:59.548254 21357 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:59.540205 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.488811 15195 rpcz_store.cc:276] 0709 13:05:57.913813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.414246 (+500433us) service_pool.cc:224] Handling call
0709 13:05:58.414537 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.584560 (+170023us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:58.749845 (+165285us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.877498 (+127653us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.877640 (+   142us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.877682 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:58.877727 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.373431 (+495704us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b1800355ae0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:05:59.487964 (+114533us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002260d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:59.488034 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.488183 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12992,"prepare.queue_time_us":642321,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":18134,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":11191,"spinlock_wait_cycles":395903744,"thread_start_us":280130,"threads_started":2,"wal-append.queue_time_us":249907}
I20260709 13:05:59.541630 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:59.551170 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.551929 15345 raft_consensus.cc:2368] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:05:59.552747 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.553519 15345 raft_consensus.cc:2393] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:59.554293 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.555280 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:59.556272 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.555958 21357 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.560002 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.558234 21357 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.565220 15345 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:59.565431 21491 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:05:59.478991 15344 rpcz_store.cc:269] 0709 13:05:57.653383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.813646 (+160263us) service_pool.cc:224] Handling call
0709 13:05:59.478085 (+1664439us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54003df254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:05:59.478282 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2596476288}
I20260709 13:05:59.572373 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:59.573146 15344 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:59.577807 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:05:59.581929 15344 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:05:59.582787 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:59.583572 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 210333us
I20260709 13:05:59.584277 15344 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 26: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:05:59.586086 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:59.587815 15162 leader_election.cc:400] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
I20260709 13:05:59.588207 15162 leader_election.cc:403] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:59.587395 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:05:59.641521 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 120020us
I20260709 13:05:59.638419 21134 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.643708 21134 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.645874 21134 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:59.648272 21120 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.650524 21120 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:05:59.648330 21551 log.cc:927] Time spent T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:05:59.652660 21357 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:59.645823 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2302) took 1983 ms. Trace:
I20260709 13:05:59.654368 15192 rpcz_store.cc:276] 0709 13:05:57.662633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.662773 (+   140us) service_pool.cc:224] Handling call
0709 13:05:57.663062 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.679563 (+ 16501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.692617 (+ 13054us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.713755 (+ 21138us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.354818 (+641063us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:58.354860 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.645347 (+1290487us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b54000fafd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:59.645402 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.645449 (+    47us) raft_consensus.cc:1685] finished
0709 13:05:59.645464 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.645760 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2400,"raft.queue_time_us":2601,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7224,"spinlock_wait_cycles":31418752,"thread_start_us":632896,"threads_started":1,"wal-append.queue_time_us":715701}
I20260709 13:05:59.657543 15093 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.659371 15093 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 17 to 20, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 20 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.661023 15093 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:59.666186 21215 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:59.666702 21215 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:05:59.667502 21215 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.668560 21215 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:59.674098 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:05:59.676438 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.677556 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.587826 21231 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:05:59.694352 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:59.700445 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.642450 21504 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:59.757136 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.757802 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.680485 21359 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:59.771977 21359 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.772423 21359 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:59.770371 21459 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.773497 21459 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.777611 21529 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:05:59.778360 21529 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.780145 21515 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:05:59.780489 21529 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:59.780711 21515 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.775796 21459 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.777690 21455 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:05:59.784117 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.784209 21455 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:59.785264 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:59.785719 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3336) took 1872 ms. Trace:
I20260709 13:05:59.786373 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.665809 21432 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.788794 15344 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:59.786233 15197 rpcz_store.cc:276] 0709 13:05:57.913518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.413050 (+499532us) service_pool.cc:224] Handling call
0709 13:05:58.413332 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.570575 (+157243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.570606 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.570648 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:58.570684 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.785402 (+1214718us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54000f8cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:05:59.785472 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.785649 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361141120}
I20260709 13:05:59.782876 21515 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.802124 15346 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:59.763825 21132 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.786243 21455 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:59.809840 21132 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.815915 21132 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.822755 21432 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:05:59.843830 21519 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.844466 21519 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:05:59.846793 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.840080 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 253014us
I20260709 13:05:59.847553 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:05:59.848368 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.848260 15197 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:05:59.850400 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:59.851353 15197 raft_consensus.cc:2410] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:05:59.854133 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:59.855077 15197 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:59.850558 21455 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.848075 21265 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.850659 21496 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.862249 21496 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.861467 21455 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:05:59.865548 21453 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.865985 21455 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:05:59.866465 21313 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.868379 21367 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:59.868801 21367 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:05:59.869576 21367 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.870730 21367 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:59.849357 21132 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.853809 21213 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.872259 21213 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.874317 21213 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.875053 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:59.877063 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:05:59.881523 21519 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.880625 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:59.884584 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:59.886649 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:59.875051 21132 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.895541 15266 pending_rounds.cc:85] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 8
I20260709 13:05:59.896167 15266 pending_rounds.cc:107] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:05:59.896486 15266 raft_consensus.cc:2889] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:59.878852 21265 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.911350 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:59.912031 15265 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.915519 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:59.916123 15195 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:59.923954 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:59.923918 15195 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:59.924640 15270 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:05:59.934967 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:59.918191 15237 leader_election.cc:400] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:05:59.935772 15197 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:05:59.944191 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:59.943303 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:59.936398 15237 leader_election.cc:403] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:59.952967 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:59.950071 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:59.950107 15271 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:59.955674 15268 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:59.940707 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:05:59.946753 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:05:59.958221 15270 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:59.940402 15346 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:05:59.940831 15265 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:05:59.950244 15264 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:05:59.951988 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:59.934577 21231 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:05:59.963426 21213 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:05:59.963819 21231 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:05:59.965500 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:05:59.968349 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:05:59.970528 15270 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:05:59.912998 21504 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
W20260709 13:05:59.941737 21561 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:05:59.975759 21456 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.976491 21434 tablet_copy_client.cc:538] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:59.941668 21562 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.935494 21385 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:00.008957 15268 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:05:59.981665 20980 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:59.995561 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:05:59.968274 21496 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:05:59.998381 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.021298 15193 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:00.021564 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:59.999548 15270 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:05:59.999085 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:05:59.980219 21313 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:06:00.000427 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.030236 15191 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:05:59.979828 21506 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:06:00.032233 15271 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:00.001163 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.001964 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:05:59.969420 15265 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:05:59.997494 21265 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.042768 15193 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:00.044397 21519 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:00.046368 21571 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:00.059749 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.020750 21385 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.063482 21385 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:00.063959 21571 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.065536 15093 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:00.061057 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.068030 15346 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:00.068908 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.069979 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.071702 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.066798 21571 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:00.078163 15341 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2271) took 1508 ms (client timeout 1846 ms). Trace:
W20260709 13:06:00.078670 15341 rpcz_store.cc:269] 0709 13:05:58.569871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.573164 (+  3293us) service_pool.cc:224] Handling call
0709 13:06:00.077925 (+1504761us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400423e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:00.078094 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039805312}
I20260709 13:06:00.081254 15346 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:00.087445 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 417) took 1516 ms. Trace:
I20260709 13:06:00.087846 15342 rpcz_store.cc:276] 0709 13:05:58.570655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.708730 (+138075us) service_pool.cc:224] Handling call
0709 13:05:59.479150 (+770420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.479785 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.087232 (+607447us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54003df250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:00.087377 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771212160}
I20260709 13:06:00.092604 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:00.051751 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.096001 20980 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:00.098990 21215 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:00.100041 21215 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.100375 21215 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:00.053529 21359 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.103094 15872 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58404 (request call id 550) took 1170 ms. Trace:
I20260709 13:06:00.020009 21562 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.106679 15188 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:00.099455 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.111277 15271 raft_consensus.cc:2393] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:00.103598 15872 rpcz_store.cc:276] 0709 13:05:58.932243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.932442 (+   199us) service_pool.cc:224] Handling call
0709 13:05:58.962947 (+ 30505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.963213 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:05:59.063270 (+100057us) log.cc:844] Serialized 14 byte log entry
0709 13:05:59.063830 (+   560us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.102356 (+1038526us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b1800454e40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e52c3d70 00007f36e52b7293 00007f36e52accea 00007f36e52ad23a 00007f36e5717a2a 00007f36e57270bf 00007f36e5727038
0709 13:06:00.102646 (+   290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.102708 (+    62us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:00.102770 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.102864 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.103006 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4048,"prepare.queue_time_us":225936,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":127,"raft.queue_time_us":790,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":1953,"spinlock_wait_cycles":2682112,"thread_start_us":46829,"threads_started":1}
W20260709 13:06:00.118758 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 368896us
I20260709 13:06:00.123584 21443 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:00.144894 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.148026 15337 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 3090) took 2475 ms (client timeout 1753 ms). Trace:
W20260709 13:06:00.148486 15337 rpcz_store.cc:269] 0709 13:05:57.672536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.770867 (+ 98331us) service_pool.cc:224] Handling call
0709 13:06:00.147798 (+2376931us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002724d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:00.147956 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247400704}
I20260709 13:06:00.149564 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.151351 15343 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:06:00.175850 21534 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.175962 21575 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:06:00.176533 21534 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.102946 21359 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:00.181833 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:00.182416 15271 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:00.147310 21562 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.182576 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.186028 15195 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:06:00.177070 21575 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:00.190182 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:00.191610 15271 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
I20260709 13:06:00.179659 21132 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.194840 15337 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:06:00.194177 21348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.843s	user 0.000s	sys 0.017s
I20260709 13:06:00.191136 21307 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.209664 21307 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:00.216450 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.217015 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3094) took 2499 ms. Trace:
I20260709 13:06:00.217557 15338 rpcz_store.cc:276] 0709 13:05:57.717154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.244730 (+527576us) service_pool.cc:224] Handling call
0709 13:05:58.245044 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.115063 (+870019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.216755 (+1101692us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54002729d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:00.216941 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1999462784}
I20260709 13:06:00.220022 15271 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:00.221218 21534 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.191226 21575 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:00.222427 21575 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.222990 21505 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.223707 21575 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:00.226135 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.217664 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.233767 15344 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 25. Current term is 26. Ops: [25.13-25.13]
I20260709 13:06:00.197019 21144 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.231573 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.196058 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:00.235952 15337 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:00.218989 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.241189 15338 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:06:00.241361 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.243230 15344 raft_consensus.cc:1217] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Deduplicated request from leader. Original: 17.12->[18.13-21.14]   Dedup: 21.14->[]
I20260709 13:06:00.245653 15343 raft_consensus.cc:2368] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22.
I20260709 13:06:00.247156 21231 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.248589 21144 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.251024 15194 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:00.255630 15839 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.257126 21571 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:00.260178 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 51798.4us
I20260709 13:06:00.260643 21144 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:00.263765 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.266389 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.267628 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.268649 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.268669 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.269886 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:00.270557 15343 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:00.270792 15344 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: [18.13-21.14]
I20260709 13:06:00.271135 21215 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:00.236451 21348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.888s	user 0.000s	sys 0.018s
I20260709 13:06:00.273358 21215 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.275520 15267 raft_consensus.cc:2410] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:06:00.277719 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 3048) took 1049 ms. Trace:
I20260709 13:06:00.278126 15267 rpcz_store.cc:276] 0709 13:05:59.228743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.231182 (+  2439us) service_pool.cc:224] Handling call
0709 13:06:00.277456 (+1046274us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001da6d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:00.277642 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398395136}
I20260709 13:06:00.281391 15237 leader_election.cc:400] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22.
I20260709 13:06:00.281721 15237 leader_election.cc:403] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:00.248916 21501 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:00.286309 15194 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:00.289314 20663 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.289698 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.289772 20663 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.290426 15267 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:00.291960 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3328) took 2857 ms. Trace:
I20260709 13:06:00.292284 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:00.292951 15344 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:00.292395 15194 rpcz_store.cc:276] 0709 13:05:57.434937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.435070 (+   133us) service_pool.cc:224] Handling call
0709 13:05:57.748464 (+313394us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800000c98. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e8a22 00007f36eb501c09 00007f36ea65bee0 00007f36ea7250ab 00007f36ea725131 00007f36ea6e6fc0 00007f36ea6d1929 00007f36ea6d13d2 00007f36e3c48bd4
0709 13:05:57.767257 (+ 18793us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.250688 (+2483431us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b58009eb4d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e56690aa 00007f36e56eb447 00007f36e5703fe7 00007f36e57057de 00007f36e570fb49 00007f36e5710416 00007f36e570cd8f 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4
0709 13:06:00.289194 (+ 38506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.291906 (+  2712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3786480256}
I20260709 13:06:00.295959 15267 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:00.287799 21511 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.308064 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.301682 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.311753 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.314652 15267 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:00.288388 21501 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:06:00.300806 21097 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:06:00.291431 21215 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22.
I20260709 13:06:00.325986 15267 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:00.329411 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.309896 21535 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.345991 15267 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:00.353955 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.354635 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:00.355511 15267 raft_consensus.cc:2368] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:06:00.355422 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.356043 15192 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:00.356377 15344 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:06:00.357471 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.300930 21562 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:06:00.316010 21458 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.364776 15194 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:00.365422 15196 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:00.366283 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.303069 21571 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:06:00.376596 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:00.323917 21213 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:00.380939 15271 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:00.368103 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.368532 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:00.304842 21500 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:06:00.313270 21511 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.312542 21231 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:06:00.377058 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.315712 21472 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:00.327833 21456 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:06:00.372680 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.388732 15269 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:00.391891 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.389848 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:00.398326 15271 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:00.382579 15338 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:00.371403 21367 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.352276 21307 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:06:00.367534 21569 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.385233 15192 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:00.409525 15196 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:06:00.410734 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.409621 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.387362 21567 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.395473 21453 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.394238 21265 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:00.436046 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.436609 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.439584 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.441812 15267 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:00.440156 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.379640 21458 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.443527 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.391285 21535 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:06:00.446442 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.448226 15267 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:00.449839 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.453315 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.458122 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.386853 21449 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.413344 21367 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.461884 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.450557 21475 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:00.455258 21568 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:00.468679 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.462270 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.448333 21564 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.448889 21265 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:00.458802 15192 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:00.460752 21521 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.448000 21443 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:00.470359 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.469853 15191 raft_consensus.cc:2368] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
W20260709 13:06:00.466197 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 98438us
I20260709 13:06:00.444643 21453 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.477540 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.478524 15194 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:00.460983 21504 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:00.464895 21571 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.479200 21443 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:00.484156 21571 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.484807 21443 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.486059 21443 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:00.486380 21571 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.440421 21567 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.490044 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.491950 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.495563 15263 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:00.471362 21568 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:00.476048 21535 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:00.467209 21475 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:00.478873 21449 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:00.510066 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.508831 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.478950 21500 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.510913 15192 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:06:00.512148 15197 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 12.
I20260709 13:06:00.486402 21427 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:00.513645 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 3085) took 2860 ms (client timeout 2197 ms). Trace:
I20260709 13:06:00.513733 15339 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
W20260709 13:06:00.513976 15340 rpcz_store.cc:269] 0709 13:05:57.652745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.814433 (+161688us) service_pool.cc:224] Handling call
0709 13:06:00.513449 (+2699016us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b5400059e54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:00.513568 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496884608}
I20260709 13:06:00.515484 21500 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.519930 21458 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.523737 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.507366 21535 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:00.481240 21521 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.488175 21504 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.531076 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.533289 21120 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:00.535940 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:00.536599 15263 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:00.480520 21564 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:00.535643 21120 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:00.549332 15196 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:00.553097 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.553825 15191 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:00.558074 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.558801 15191 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:00.532574 21265 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.539116 21475 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:00.589205 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.603453 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.538470 21568 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:00.698261 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.718060 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.553342 21535 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.582621 21367 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.555418 21120 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:00.721824 21504 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.725901 21434 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:06:00.735078 21475 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:00.734277 21453 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.740996 21568 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:00.745330 15194 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:00.756963 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.758284 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.742060 21567 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.759486 15191 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 22.
I20260709 13:06:00.776441 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.777172 15191 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:00.778184 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.778916 15344 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:00.778867 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.780449 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.782495 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.783172 15344 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 24: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:00.779649 15343 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
W20260709 13:06:00.792796 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 71271.3us
I20260709 13:06:00.795058 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.761559 21521 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.796753 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.796034 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:00.802052 20980 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:00.802656 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.799942 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:00.806512 20993 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.807011 21231 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:00.807365 20993 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.807770 21231 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.810077 21231 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:00.810600 21571 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:00.811054 21571 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.811436 21571 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:00.811463 20993 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.817607 21535 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:00.820801 21501 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.822278 21501 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:00.799173 21575 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:06:00.793249 21567 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:06:00.830104 21511 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.833463 21449 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.834357 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.834530 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.835368 15272 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:06:00.835722 15272 pending_rounds.cc:85] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 12
I20260709 13:06:00.835922 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.836513 15194 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:00.835934 15272 pending_rounds.cc:107] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:06:00.837999 15272 raft_consensus.cc:2889] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.844480 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.846330 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.850749 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.852051 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.852737 15343 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:00.853394 21050 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:00.852192 21511 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:00.857826 15344 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:00.855593 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.800760 21564 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.838719 21496 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.859668 15188 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:00.841780 21458 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:06:00.861055 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59832.7us
I20260709 13:06:00.847609 20980 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.865240 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.864945 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:00.867421 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.868252 15195 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:00.869850 15194 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
I20260709 13:06:00.849687 21505 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:06:00.860461 21575 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.859408 21449 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:00.864185 21458 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:00.877053 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 81082.3us
I20260709 13:06:00.861487 21215 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.879069 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.855962 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.883224 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:00.885371 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.875152 21475 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:00.887266 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.861675 21567 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:06:00.876031 21564 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:00.886792 21455 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:00.892717 21564 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:00.892983 21583 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.444s	user 0.004s	sys 0.001s
I20260709 13:06:00.893249 21564 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:00.885723 21215 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:00.888867 21050 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:00.885583 20980 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:00.896899 21215 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.897511 21215 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.898018 21215 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.878942 21505 consensus_queue.cc:1243] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:00.891266 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.891709 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2270) took 2322 ms. Trace:
I20260709 13:06:00.902133 15339 rpcz_store.cc:276] 0709 13:05:58.569613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.589367 (+ 19754us) service_pool.cc:224] Handling call
0709 13:06:00.513562 (+1924195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.514201 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.891531 (+377330us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b5400059e50. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:00.891655 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4424726912}
I20260709 13:06:00.902915 15160 leader_election.cc:400] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:06:00.903242 15160 leader_election.cc:403] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:06:00.883558 21458 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:00.902850 15238 leader_election.cc:400] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:06:00.904593 15271 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:00.905027 20993 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 14. Current term is 15.
I20260709 13:06:00.903882 21050 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.902832 21501 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:00.908541 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.909472 15194 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:00.909629 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.909816 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:00.865355 21496 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.879240 21568 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:06:00.911571 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.912892 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:00.913374 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.914793 21443 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:00.881577 21575 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.917373 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:00.917161 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.920656 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.921409 15195 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:00.922328 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:00.922648 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.925283 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.917644 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.927556 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.921248 21443 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.929234 21519 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:00.929695 21443 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:00.929790 21519 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.930191 21443 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.930325 21519 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:00.930656 21443 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:00.911381 21501 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:00.934424 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.936754 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.917132 20993 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.933096 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:00.942894 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.944725 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:00.945366 15195 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:00.945416 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:00.917894 21500 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:00.921729 21265 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:00.947758 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.922317 21215 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:00.932554 21567 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:00.931965 21455 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:00.953236 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:00.986598 21288 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.921623 21571 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:00.936419 21501 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:00.986527 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:00.948817 21050 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:00.943533 21505 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.948767 21231 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:00.947793 21132 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.968314 21500 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:00.949308 20980 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:01.079172 20980 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.079742 20980 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:00.946899 21348 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:00.985456 21511 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:06:01.057833 21571 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:01.058786 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72357.2us
I20260709 13:06:01.059249 15872 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:01.045018 21453 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:06:01.047933 21585 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.576s	user 0.000s	sys 0.011s
W20260709 13:06:01.012712 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65006.8us
I20260709 13:06:01.069480 21564 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.076411 21575 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.060966 21050 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.063957 21288 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:01.090029 15195 raft_consensus.cc:2410] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:01.091190 15194 raft_consensus.cc:2410] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:06:01.097397 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:01.098945 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.100907 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:01.103790 15270 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:06:01.104322 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:01.108124 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:01.115483 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:01.119570 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:01.086241 21348 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:01.098448 21477 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:01.123063 21348 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.123136 21477 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:01.121556 21535 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:01.125415 21231 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:01.126370 15195 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:01.126595 21231 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:01.127053 21231 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:01.127912 21231 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.129329 21231 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:01.131100 21581 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:01.131631 21581 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:01.131744 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.132572 21581 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.133504 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.121744 21097 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:01.134985 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.136489 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:01.130705 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.138068 15193 pending_rounds.cc:85] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 8
I20260709 13:06:01.138438 15193 pending_rounds.cc:107] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:06:01.138758 15193 raft_consensus.cc:2889] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:01.114380 21050 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:01.142953 21564 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:01.143702 21584 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.668s	user 0.008s	sys 0.011s
I20260709 13:06:01.145560 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2307) took 1107 ms. Trace:
I20260709 13:06:01.145974 21443 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.145915 15342 rpcz_store.cc:276] 0709 13:06:00.038056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.088860 (+ 50804us) service_pool.cc:224] Handling call
0709 13:06:00.089198 (+   338us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:00.188680 (+ 99482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.188709 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:00.193693 (+  4984us) log.cc:844] Serialized 52 byte log entry
0709 13:06:00.404252 (+210559us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:00.404291 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.404413 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.143131 (+738718us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:01.145172 (+  2041us) raft_consensus.cc:1685] finished
0709 13:06:01.145193 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.145497 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108013,"raft.queue_time_us":99616,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":3069,"spinlock_wait_cycles":27443072,"thread_start_us":141496,"threads_started":1,"wal-append.queue_time_us":237613}
I20260709 13:06:01.147207 21594 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.147812 21594 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.148293 21443 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.149983 21594 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.149817 21050 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.150172 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 508) took 1273 ms. Trace:
I20260709 13:06:01.150611 15272 rpcz_store.cc:276] 0709 13:05:59.876270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.876385 (+   115us) service_pool.cc:224] Handling call
0709 13:05:59.876655 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.838587 (+961932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.149950 (+311363us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54000140d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:01.150119 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204107136}
W20260709 13:06:01.153663 21579 log.cc:927] Time spent T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.721s	user 0.004s	sys 0.022s
I20260709 13:06:01.115588 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:01.158048 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:01.158345 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:01.095247 21453 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:01.158962 15192 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:01.176309 15192 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 23.
I20260709 13:06:01.177765 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.178750 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:01.130689 21591 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:06:01.136720 21575 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:01.136552 21500 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:01.186543 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:01.186667 20663 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:01.156733 21213 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:01.190752 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:01.160686 21449 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:01.170056 21511 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:01.137693 21501 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.194744 21594 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:01.189672 21575 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.191962 21517 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:01.193118 21505 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:01.191680 21213 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.168555 21571 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:06:01.209523 21575 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:01.218673 21213 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:01.219527 21517 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:01.204324 21453 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.253103 21519 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.259121 21594 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:01.259188 21517 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:01.317584 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.318853 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.323927 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 201347us
I20260709 13:06:01.347514 21050 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.347836 21581 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:06:01.354565 21458 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.358219 21458 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.364697 21453 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:01.371784 15188 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:01.393918 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65228.2us
I20260709 13:06:01.398861 21517 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:01.399255 21443 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.400279 21443 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.400125 21517 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:01.386548 21501 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.394346 21458 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.425580 21458 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.427323 21359 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.428216 21359 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.428996 21458 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.437520 15341 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:06:01.439841 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.440761 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.440984 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.441978 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:01.445905 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.451800 21504 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.454308 21504 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.455668 21519 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.456211 15342 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:01.456761 21050 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.457649 21050 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.459594 21359 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:01.461091 21594 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.461886 21594 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.463742 21496 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:01.467914 21594 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.470285 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 68) took 9742 ms. Trace:
I20260709 13:06:01.470278 21050 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.476322 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.477779 15193 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:06:01.478039 21504 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.479379 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:01.483017 21120 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:01.485363 21521 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:01.485924 21521 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:01.491955 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72619.5us
W20260709 13:06:01.498493 21582 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.053s	user 0.004s	sys 0.020s
I20260709 13:06:01.509411 21521 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.511107 21521 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:01.518599 21517 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.471720 15093 rpcz_store.cc:276] 0709 13:05:51.731512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.731735 (+   223us) service_pool.cc:224] Handling call
0709 13:06:01.469929 (+9738194us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:00.385919 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:00.403379 (+ 17460us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:00.404606 (+  1227us) write_op.cc:435] Acquired schema lock
0709 13:06:00.409218 (+  4612us) tablet.cc:662] Decoding operations
0709 13:06:00.507951 (+ 98733us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:00.510589 (+  2638us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:00.512207 (+  1618us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:00.557047 (+ 44840us) tablet.cc:701] Row locks acquired
0709 13:06:00.559291 (+  2244us) write_op.cc:260] PREPARE: finished
0709 13:06:00.571684 (+ 12393us) write_op.cc:270] Start()
0709 13:06:00.579271 (+  7587us) write_op.cc:276] Timestamp: P: 1783602360564088 usec, L: 0
0709 13:06:00.581415 (+  2144us) op_driver.cc:348] REPLICATION: starting
0709 13:06:00.740346 (+158931us) log.cc:844] Serialized 2053 byte log entry
0709 13:06:01.223552 (+483206us) op_driver.cc:464] REPLICATION: finished
0709 13:06:01.272790 (+ 49238us) write_op.cc:301] APPLY: starting
0709 13:06:01.272856 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:01.274846 (+  1990us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:01.274910 (+    64us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:01.278339 (+  3429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:01.278600 (+   261us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:06:01.278670 (+    70us) write_op.cc:312] APPLY: finished
0709 13:06:01.278932 (+   262us) log.cc:844] Serialized 56 byte log entry
0709 13:06:01.279138 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:01.279242 (+   104us) write_op.cc:454] Released schema lock
0709 13:06:01.279288 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:01.397315 (+118027us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:01.397404 (+    89us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2621249,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":47675,"apply.run_cpu_time_us":6791,"apply.run_wall_time_us":6865,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":302478,"prepare.run_cpu_time_us":43191,"prepare.run_wall_time_us":491603,"raft.queue_time_us":303587,"raft.run_cpu_time_us":38100,"raft.run_wall_time_us":69710,"replication_time_us":629763,"thread_start_us":573471,"threads_started":4,"wal-append.queue_time_us":150117}]]}
I20260709 13:06:01.525156 21443 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.531442 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2890) took 1108 ms. Trace:
I20260709 13:06:01.532045 15271 rpcz_store.cc:276] 0709 13:06:00.404217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.404615 (+   398us) service_pool.cc:224] Handling call
0709 13:06:00.404952 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.907949 (+502997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.512626 (+604677us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54001b4254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:01.512995 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148607360}
I20260709 13:06:01.535377 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2306) took 1504 ms. Trace:
I20260709 13:06:01.535805 15346 rpcz_store.cc:276] 0709 13:06:00.030948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.084015 (+ 53067us) service_pool.cc:224] Handling call
0709 13:06:00.084388 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:00.092121 (+  7733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.092158 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:00.094914 (+  2756us) log.cc:844] Serialized 52 byte log entry
0709 13:06:00.305925 (+211011us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:00.305979 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.306083 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:01.497216 (+1191133us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:01.534754 (+ 37538us) raft_consensus.cc:1685] finished
0709 13:06:01.534781 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.535158 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7400,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":95908096,"thread_start_us":121365,"threads_started":1,"wal-append.queue_time_us":216543}
W20260709 13:06:01.560773 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 63923.9us
I20260709 13:06:01.561611 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:01.569003 21477 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:01.560024 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43904.8us
I20260709 13:06:01.576253 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.576448 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.575714 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:01.576622 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:01.577250 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:01.576713 21288 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:01.586372 21596 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:06:01.601406 21594 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.601778 21596 consensus_queue.cc:1243] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:06:01.602257 21594 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.602895 15188 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:01.581305 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:01.584903 20980 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.016s
I20260709 13:06:01.570995 21477 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:01.574218 21443 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.605944 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:01.596874 21050 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.609669 15191 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:06:01.612368 21605 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:01.613319 21443 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:01.614282 21288 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:01.617468 21468 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.619167 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:01.620316 15340 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.620741 21562 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.626127 21562 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.627781 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:01.628587 21562 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.622911 21449 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.629017 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:01.629307 21509 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:01.629460 21449 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.633060 21449 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.635972 21443 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:01.636627 21050 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.638445 21594 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.639156 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:01.638871 21050 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.606935 21501 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.623660 21468 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:01.621109 21132 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.660766 21501 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.661221 21132 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.664394 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:01.667923 21608 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:01.668447 21608 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:01.668901 21608 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.674070 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.675261 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:01.675688 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.677704 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.678642 15338 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:01.675817 15342 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.680234 15345 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:06:01.682332 21468 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:01.687458 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.689409 15342 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:01.686898 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.695209 21519 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.695956 21519 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:01.696348 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.697288 15272 raft_consensus.cc:2376] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24. Re-sending same reply.
I20260709 13:06:01.699049 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.700228 15266 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:01.700415 21501 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.701531 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.703315 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.704118 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:01.704345 15263 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:01.703370 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:01.615751 20980 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.652379 21307 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.647964 21453 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:01.714936 21348 consensus_meta.cc:287] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.591s	user 0.017s	sys 0.000s
I20260709 13:06:01.658488 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:01.648696 21443 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.715443 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:01.761091 21348 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:01.764319 21443 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.765666 15344 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:01.772295 21443 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.717796 20980 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.719842 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:01.698832 21519 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:01.737658 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.718597 21307 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.731607 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.735616 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.736912 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:01.794893 15340 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:01.796213 15267 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 24: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:06:01.801481 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64763.4us
W20260709 13:06:01.796730 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 167859us
I20260709 13:06:01.719492 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.804320 15188 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:06:01.804916 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.808827 15263 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:01.736650 21132 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.753865 21288 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.811149 21359 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:01.737094 21562 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:06:01.743649 21453 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.809262 21443 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:01.820788 21359 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:01.828531 21359 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:01.721720 21581 consensus_queue.cc:1059] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.097s
I20260709 13:06:01.831061 15269 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 12.
I20260709 13:06:01.720880 21213 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:01.729339 21575 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:01.836421 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.824667 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:01.830581 21596 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:01.859498 21566 raft_consensus.cc:2764] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:06:01.846472 21443 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:01.864652 21443 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.875290 15266 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:01.886654 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.894295 15189 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:01.899856 21596 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:01.900910 21505 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.901595 21505 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.905591 21505 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.908442 15263 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:01.915989 21509 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:01.916448 21509 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:01.920641 21213 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:01.878649 21288 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.923460 21288 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:01.837662 21519 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:01.935820 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 216174us
I20260709 13:06:01.936921 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:01.939162 15094 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.941234 15094 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:01.917500 21509 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:01.943223 21509 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:01.942893 15094 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:01.944520 15094 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 20, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 20 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:06:01.950264 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.946834 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:01.954003 21456 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:01.955796 21359 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.962100 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:01.963138 15266 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.967075 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:01.951416 21213 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.954620 21456 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:01.964632 15094 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 24, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 24 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.966323 21458 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:01.982919 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 166163us
I20260709 13:06:01.963680 21517 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:06:01.994988 15272 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:01.995972 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:01.995134 15094 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 11 to 14, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 14 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:01.999100 15269 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:01.901500 21596 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.001689 21351 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:01.984982 21348 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:02.002842 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:01.971918 21519 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.002190 21581 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.028625 21307 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.032110 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:02.033660 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 96931.8us
I20260709 13:06:02.019474 21351 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.041118 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.043191 15340 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:02.043351 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.043780 21458 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:02.045644 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:02.024330 21517 consensus_queue.cc:1243] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:06:02.048303 21562 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.050818 21132 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.057687 21132 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.057790 21562 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.059262 21453 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.014166 21213 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.059204 15094 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 12 to 18, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 18 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.060348 21132 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.050953 21358 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.061120 21358 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.061156 15094 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:06:02.061887 21617 log.cc:927] Time spent T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:02.062652 15094 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 17, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.063136 21581 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.051333 21477 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.064126 21519 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.064386 21477 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:02.064666 15094 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 9 to 11, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:02.065450 21581 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:02.051522 15270 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:02.052071 15266 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:02.065833 21562 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.066519 21477 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.067147 21610 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:02.066841 15094 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.052654 21456 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:02.051946 15090 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 171) took 31390 ms (client timeout 15000 ms). Trace:
I20260709 13:06:02.069831 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.071187 21496 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:02.071580 21496 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:02.071794 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:02.072242 15189 pending_rounds.cc:85] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 13
I20260709 13:06:02.072567 15189 pending_rounds.cc:107] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:06:02.072846 15189 raft_consensus.cc:2889] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:02.071977 21496 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:02.075191 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.075338 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:02.075922 15188 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
I20260709 13:06:02.076035 15270 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.076987 21456 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.077320 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.077569 21456 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:02.013475 21608 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.078794 15337 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:02.074937 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.079639 21456 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.079720 15267 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:02.053166 21458 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:02.077838 21213 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.054550 21359 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:02.056965 21521 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:02.049041 21351 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:02.081346 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:02.063478 21358 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.091679 21213 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:02.096653 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:02.096628 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 149953us
I20260709 13:06:02.088928 15094 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 8 to 19. New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.100551 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.101186 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.080916 21509 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:02.079864 21608 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:02.102975 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:02.103559 15269 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:02.104171 15344 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:02.103724 21458 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.099047 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:02.108671 21575 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.098209 21358 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:06:02.115607 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.126936 15340 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
W20260709 13:06:02.069555 15090 rpcz_store.cc:269] 0709 13:05:30.639542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.699264 (+ 59722us) service_pool.cc:224] Handling call
0709 13:05:31.831814 (+1132550us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b5400002490. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e90b2 00007f36eb562a89 00007f36eb4fada6 00007f36eb4cc088 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc
0709 13:06:01.997929 (+30166115us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:55.111445 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:55.112185 (+   740us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:55.112237 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:05:55.112256 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:55.149132 (+ 36876us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:55.149255 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:55.149293 (+    38us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:05:55.258403 (+109110us) tablet.cc:701] Row locks acquired
0709 13:05:55.262540 (+  4137us) write_op.cc:260] PREPARE: finished
0709 13:05:55.271290 (+  8750us) write_op.cc:270] Start()
0709 13:05:55.271449 (+   159us) write_op.cc:276] Timestamp: P: 1783602355271211 usec, L: 0
0709 13:05:55.271489 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:05:55.272355 (+   866us) log.cc:844] Serialized 9778 byte log entry
0709 13:05:55.327845 (+ 55490us) op_driver.cc:464] REPLICATION: finished
0709 13:05:55.336707 (+  8862us) write_op.cc:301] APPLY: starting
0709 13:05:55.336793 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:55.361783 (+ 24990us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:55.361921 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:55.388198 (+ 26277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:55.388611 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:05:55.388664 (+    53us) write_op.cc:312] APPLY: finished
0709 13:05:55.389349 (+   685us) log.cc:844] Serialized 219 byte log entry
0709 13:05:55.390688 (+  1339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:55.390911 (+   223us) write_op.cc:454] Released schema lock
0709 13:05:55.391003 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:55.391477 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:55.391510 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":568997,"reported_tablets":56,"spinlock_wait_cycles":6344064,"child_traces":[["op",{"apply.queue_time_us":8478,"apply.run_cpu_time_us":31022,"apply.run_wall_time_us":54793,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108777,"num_ops":25,"prepare.queue_time_us":126173,"prepare.run_cpu_time_us":20378,"prepare.run_wall_time_us":195891,"raft.queue_time_us":7829,"raft.run_cpu_time_us":6992,"raft.run_wall_time_us":12097,"replication_time_us":56163,"thread_start_us":108189,"threads_started":4,"wal-append.queue_time_us":35183,"wal-append.run_cpu_time_us":7936,"wal-append.run_wall_time_us":1094723}]]}
I20260709 13:06:02.101223 15094 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 19 to 23, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 23 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:02.125918 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43560.1us
W20260709 13:06:02.102382 21434 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:06:02.107967 15238 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.165179 15270 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:02.168025 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.168707 15344 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:02.166414 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.169364 15337 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:02.169651 21624 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:02.170083 21624 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.170572 21624 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.173926 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:02.174220 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82167.4us
I20260709 13:06:02.175647 21608 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:02.175834 21213 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:02.176494 21213 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:02.180620 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:02.184948 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55870.1us
I20260709 13:06:02.184775 15094 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 16 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.185609 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:02.185714 15267 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:06:02.164845 21509 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:02.194991 15270 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:02.188477 21608 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:02.195722 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:02.196295 21622 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:06:02.196619 15191 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:06:02.196564 21608 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.191349 21521 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:06:02.198050 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.198185 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.198908 15188 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:02.199502 21213 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.166388 21351 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.199117 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:02.193442 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.221774 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.208022 15094 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 16, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 16 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:02.225203 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 130964us
I20260709 13:06:02.227655 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:02.227975 15194 raft_consensus.cc:2410] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260709 13:06:02.222462 15190 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:06:02.230046 15197 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.193178 21623 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:02.233608 15271 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:02.203649 21453 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.218271 21456 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:02.239199 15346 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:06:02.240092 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.263945 15094 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:02.276209 21615 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:06:02.279095 21496 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.281934 21351 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:02.278527 21120 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:02.284183 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:02.300531 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.299228 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:02.294757 21628 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:02.294673 21517 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:02.291651 21456 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.295783 15190 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:02.296589 21521 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.296525 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.291877 21453 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.301234 15197 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
W20260709 13:06:02.302501 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.302313 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:02.299226 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.305071 15266 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
W20260709 13:06:02.310716 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 146302us
I20260709 13:06:02.312426 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:02.316224 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.318370 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.315500 21562 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:02.305562 21456 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:02.323331 15094 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 14, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 14 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.325412 15269 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:02.327471 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:02.322468 21359 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:02.326614 21358 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.326577 21519 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.329919 15270 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:02.329448 21358 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.331668 21132 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:02.331990 21358 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.332147 21132 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.332640 21132 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:02.334050 21496 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.335970 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.336741 15265 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:02.338341 15266 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:02.304349 21120 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:02.338992 15263 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:06:02.343855 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60975.4us
I20260709 13:06:02.342931 15272 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:02.316361 20980 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.324358 21562 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.329432 21359 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:02.347743 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.357354 15094 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 12 to 15, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 15 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.359131 21509 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.361428 21358 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:02.362073 21358 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.364320 21358 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.364022 21120 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.365437 21120 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:02.367182 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.329602 21519 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.375171 15094 catalog_manager.cc:5697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 3 to 14, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 14 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.322260 21517 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:02.350641 21562 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:02.338224 21521 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.372258 21359 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.370999 21358 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:02.418426 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 106092us
I20260709 13:06:02.375803 20980 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.431005 21288 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:02.431921 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.417505 21453 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.435381 15094 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.437573 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:02.440429 15197 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:02.445201 21519 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.446008 20980 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.446725 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.447145 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:02.447402 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.447753 15192 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:02.448040 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.432542 21443 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:02.448735 21443 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:02.441323 15268 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:02.450698 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.451087 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.451366 15271 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:06:02.448114 15264 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:02.451992 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.451355 15193 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:02.448767 15189 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:02.418725 21581 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:06:02.454859 21519 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:02.454991 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.455534 21519 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:02.449841 21443 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.454147 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:02.459841 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.455822 15272 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:02.462312 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.463644 21496 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:02.461550 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.465088 15264 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:02.470796 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.441372 21288 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.459319 21519 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:02.512126 21213 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:02.512759 21213 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:02.513238 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.513671 21213 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.514675 21591 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:02.516342 21591 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:02.517584 15193 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 13:06:02.517972 15193 pending_rounds.cc:85] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 10
I20260709 13:06:02.517424 21591 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:02.518208 15193 pending_rounds.cc:107] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 21.11
I20260709 13:06:02.457818 21624 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:02.518533 15193 raft_consensus.cc:2889] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:02.515386 21307 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.519789 21307 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.520615 21624 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.521575 21443 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:02.451120 21358 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.460229 20980 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:02.523206 20980 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:02.523701 20980 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:02.527509 21307 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.527395 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:02.485715 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.535924 15271 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:02.537405 15192 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:02.544324 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.549010 15094 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.565194 15192 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:02.470420 21453 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:02.470351 21496 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.569192 21453 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.569300 21496 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:02.563766 15189 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:06:02.543864 21351 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:02.577894 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 133293us
I20260709 13:06:02.569770 21453 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.582204 15094 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 16 to 19, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.589301 15094 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 10 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 16 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.591679 15094 catalog_manager.cc:5697] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 7 to 18, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 18 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.598388 21132 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.604844 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.605343 21288 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:02.605629 15271 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:06:02.604955 15094 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 16, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.597889 21521 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:02.606912 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 79972.1us
I20260709 13:06:02.607812 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:02.609719 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:02.606603 15094 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.611579 15094 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.610951 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:02.612998 15839 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:02.606741 21132 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.621318 15094 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.625334 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.627969 15876 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:02.628264 21517 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.629158 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.631150 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.632387 15337 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:02.632586 15342 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:02.630074 15344 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:06:02.633872 21635 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:02.640781 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:02.610828 20980 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.650806 21651 raft_consensus.cc:2764] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:06:02.628014 21571 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:02.654872 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.663399 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:02.668825 21623 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.669508 21623 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:02.656050 21571 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:02.671402 21643 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:06:02.671900 21608 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:02.671707 21571 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:02.674482 15094 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.630978 21132 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:02.687615 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 102304us
I20260709 13:06:02.692004 21456 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.694581 21456 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.695147 21521 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:02.696502 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.671183 21359 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:02.698535 15094 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:02.703125 15094 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 16 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.712801 15195 raft_consensus.cc:1217] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 18.13->[20.14-22.15]   Dedup: 22.15->[]
I20260709 13:06:02.713649 15195 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: [20.14-22.15]
I20260709 13:06:02.715302 21358 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.717121 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:02.719022 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.719687 15267 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:06:02.721031 21623 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:02.709276 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.813s (SENT) [suppressed 17 similar messages]
I20260709 13:06:02.732060 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:02.733387 15197 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:06:02.735051 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 71806.9us
I20260709 13:06:02.735862 21453 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:02.737246 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:02.738117 21453 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:02.725119 21634 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:06:02.744017 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:02.770392 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 61159.9us
I20260709 13:06:02.772629 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:02.780058 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:02.781059 15869 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
W20260709 13:06:02.789348 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 50489.5us
I20260709 13:06:02.791597 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.777608 21351 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:02.730198 21359 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.777493 21456 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:02.812862 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.812743 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:02.816246 15340 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.783519 21443 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:02.833436 15266 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:02.838272 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:02.819510 21443 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.840853 21443 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.841321 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:02.841952 15268 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.843328 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.844471 15269 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:06:02.836844 15267 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:02.831486 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:02.846047 15196 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:06:02.856637 21636 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:06:02.859992 21509 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:02.889030 15268 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:02.860526 15266 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:02.852596 21648 raft_consensus.cc:2764] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:06:02.861260 21571 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:02.817137 21519 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.856786 21646 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.808619 21132 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:06:02.870805 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.911800 15270 raft_consensus.cc:2410] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 26 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:06:02.871172 15263 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:06:02.912089 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 301221us
I20260709 13:06:02.912662 15872 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:02.815176 21456 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.878221 15340 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:02.893208 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:02.915213 15265 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:02.895962 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 76161.3us
I20260709 13:06:02.899327 15272 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:02.829972 21562 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.906947 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:02.915328 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:02.918529 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 99841.3us
I20260709 13:06:02.921070 15269 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:02.950248 21358 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:02.951023 21358 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:02.952000 21358 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:02.954813 15345 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:06:02.955667 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.954627 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:02.958163 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:02.914158 21643 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.919184 21456 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:02.964679 21571 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:02.968693 21359 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:02.972003 15265 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:02.973569 21496 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.974381 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:02.975943 15264 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:02.977414 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.977803 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:02.977808 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:02.964074 15267 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:02.901259 21509 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:02.983431 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.047828 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.056047 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:02.986536 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.034228 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:03.034977 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.034374 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:02.986102 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.047721 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.120419 15344 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 25.
I20260709 13:06:03.108685 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:03.056080 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.127102 15263 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:06:02.959182 21288 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.061098 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.133621 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.134938 15192 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 26: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:03.135752 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.136694 15340 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.085804 21571 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.147583 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.142474 21288 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:03.159071 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 173545us
W20260709 13:06:03.159854 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.161183 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:03.046525 21575 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.065976 21635 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:03.176990 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.178328 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.023073 20980 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.183566 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.047361 21517 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.156160 21307 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:03.191084 15338 raft_consensus.cc:2393] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:03.157379 21132 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:03.192382 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 233461us
I20260709 13:06:03.156786 21213 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:02.978821 21646 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.114053 21443 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.203377 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:03.187956 21622 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:03.208714 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.185027 21655 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.022054 21643 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.224184 15192 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:03.226857 15193 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:03.200847 21132 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.221150 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.245175 15338 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:03.247172 15196 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:03.243155 15340 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:03.210450 21562 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.190639 21575 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.256559 15195 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:06:03.256832 15188 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:03.255865 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.274765 15192 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:03.259522 21456 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.261080 21509 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:03.261848 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 58602.8us
I20260709 13:06:03.261955 21443 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.198705 21517 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.252260 21132 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:03.267577 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:03.266687 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48491.7us
I20260709 13:06:03.270933 15191 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:03.271695 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.272446 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.187674 21660 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.196s
I20260709 13:06:03.264377 21351 consensus_queue.cc:1059] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:06:03.222886 21458 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:03.240198 21655 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.262980 21496 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.317466 15340 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.190968 21571 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.284845 15193 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:03.264186 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:03.285297 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.326623 15345 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:03.327134 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.353972 15189 raft_consensus.cc:2410] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:06:03.284845 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.334554 21351 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:03.336226 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.355068 15346 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:03.336982 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.337323 21434 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:03.337671 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.338583 21646 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.344336 21655 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.345006 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:03.360744 15869 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:03.363524 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.364840 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.365000 21581 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.365485 15343 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.367475 15342 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:03.367861 15342 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:03.368657 15342 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.369107 21575 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:03.369580 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:03.369779 21288 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:03.370903 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:03.372143 21655 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:03.375312 21643 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.348872 15340 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:03.377132 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.378548 15340 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:03.376598 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:03.380677 15340 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:03.382398 15338 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:03.391455 15341 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:03.399745 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.400997 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.396034 21646 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:03.407157 21646 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:03.407392 21663 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:06:03.407565 21646 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.414965 21434 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:03.415884 21434 ts_tablet_manager.cc:1403] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 2.839s	user 0.061s	sys 0.033s
I20260709 13:06:03.416716 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:06:03.417618 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 101198us
I20260709 13:06:03.417869 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.403460 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:03.349522 21517 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.376583 21351 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:03.425140 21120 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:03.422706 15869 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 21: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:03.365670 21581 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.444550 15162 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:03.396986 21521 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.437613 21635 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:06:03.463798 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 199679us
I20260709 13:06:03.467190 21458 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:03.467803 21458 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.469967 21458 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.473336 21635 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:03.416803 21132 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:03.490377 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 119448us
I20260709 13:06:03.447753 21562 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:06:03.451215 21581 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:03.493120 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.460534 21358 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:03.474426 21635 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.497725 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:03.503353 21571 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.507860 21351 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.517424 21351 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:03.518523 21132 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.483355 21496 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:06:03.513734 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.515879 15197 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:03.536058 15343 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21.
I20260709 13:06:03.539266 21120 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.539997 21120 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.542312 21120 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.544371 21655 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:03.530174 21519 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.548269 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.553684 20980 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:03.553748 21665 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:03.558145 21358 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:03.559901 21351 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:03.560189 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:03.574467 21358 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.575079 21351 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:03.575721 21351 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:03.563153 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:03.572556 21434 raft_consensus.cc:359] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:03.556700 21456 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.579001 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.580008 21351 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.589993 21351 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:03.591272 21566 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:03.592691 15160 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.556978 21496 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:03.594013 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.502866 21646 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.580322 20980 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.598124 20980 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.600096 21566 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:03.600693 21671 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.600955 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.601258 21671 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.602356 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.603256 21672 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:03.604060 21672 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.604707 15267 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:06:03.601769 15263 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:03.565280 21132 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.565547 21665 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:06:03.609285 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.609484 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.582768 21288 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:03.616180 15272 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:03.583252 21434 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
W20260709 13:06:03.613744 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 112484us
W20260709 13:06:03.614722 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 58922.5us
I20260709 13:06:03.610833 21519 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:03.619690 21678 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:06:03.619769 21519 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.621106 21679 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:06:03.621877 21519 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.610642 21562 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:03.608510 21213 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.623657 21562 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.624130 21562 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:03.614760 21443 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:06:03.614320 21653 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:03.613721 21132 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.624974 21653 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.626082 21581 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.613226 21675 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:03.628355 21453 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:03.628539 21671 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.628789 21453 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:03.623872 21213 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.618451 21288 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:03.613242 21608 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.618064 21456 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:03.600550 21566 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:03.600529 20980 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.636556 21434 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:03.637357 21566 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.638355 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:03.639379 21132 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.641319 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:03.642004 15872 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:06:03.643415 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.644392 21132 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:03.636088 21608 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.631948 21288 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.645268 21132 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.645797 21132 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.646369 21521 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:03.647119 21608 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.637174 21496 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.647297 21519 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:03.647784 21496 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.647943 21519 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.638814 21566 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:03.649637 21307 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.650187 21307 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.635948 21653 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.629674 21453 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.644536 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.656332 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.653126 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:03.657341 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.611900 21655 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:03.657822 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:03.658645 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.662417 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.663414 21505 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:03.663842 21505 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.664297 21505 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:03.666033 15272 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:06:03.666414 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.667006 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.667435 21682 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:03.667757 15263 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:06:03.668583 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.669358 21682 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:03.669776 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.669896 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.670579 15263 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:06:03.670503 21682 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:03.670974 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.671774 21682 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:03.672273 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.672994 21682 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:03.673058 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.676271 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.651499 21496 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.681811 21434 ts_tablet_manager.cc:1434] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.266s	user 0.011s	sys 0.000s
I20260709 13:06:03.682616 21670 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:03.682956 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:03.683970 21517 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:03.684391 21517 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.661509 21562 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.686107 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:03.673887 21675 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:03.687328 21670 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:03.687917 21670 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.688282 21670 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.680351 21610 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:03.651849 21456 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.689199 21610 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.689854 21456 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:03.661387 21655 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.691577 21655 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.678318 21443 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.696082 21443 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.696481 21443 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.696910 21581 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:03.698194 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45163.6us
I20260709 13:06:03.698444 21581 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:03.679530 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.682864 21213 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.687390 21675 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.699542 21458 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.699772 21675 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.700006 21458 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.700119 15312 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:03.700486 21458 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.702307 21681 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:03.699563 21453 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.703763 21681 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:03.704097 21307 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.705118 21646 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.707377 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:03.674754 20980 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:03.674062 21521 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:03.709462 21521 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.709867 21521 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:03.711268 21672 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.684800 21517 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:03.712453 21519 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:03.714481 15342 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:03.676682 21653 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:03.715291 21653 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.715670 21653 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:03.703202 21665 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.717020 21359 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:03.717478 21359 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:03.718113 21610 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:03.686925 21562 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.718303 21359 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.720033 21359 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:03.717502 21665 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.723415 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:03.724540 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45082.3us
I20260709 13:06:03.725083 15342 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:03.735882 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.739528 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.743341 15270 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:03.744908 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.680826 21120 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:03.736771 15272 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:03.754141 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:03.754832 15876 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:06:03.680229 21505 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.733489 21679 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:03.760533 21505 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.762799 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:03.763366 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:03.762799 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.765234 15270 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:03.733556 21496 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.766687 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:03.768314 15312 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:03.770104 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.770916 15272 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:03.751616 21120 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.764748 21672 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:03.774744 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:03.780426 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.781083 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.787312 15268 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 26: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:03.788153 21581 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:06:03.782809 21648 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:06:03.794796 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.803869 15264 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:03.788270 21566 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:06:03.805320 21566 consensus_queue.cc:1243] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:06:03.805809 21566 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:03.806133 21566 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:03.807050 21566 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.808193 21566 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:03.809011 21521 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.809430 21458 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.813086 21443 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.815070 21648 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:03.815204 21675 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.777947 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:03.816591 21458 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.847919 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 27.
I20260709 13:06:03.820540 21456 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.797403 21680 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:03.824154 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.824561 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.853717 15339 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:06:03.829329 15272 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:03.855067 15272 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.855635 21443 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.856392 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.856989 15341 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:06:03.858248 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.815671 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.773236 21120 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:03.830555 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:03.797772 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.849318 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.845979 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:03.850939 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 73134.3us
I20260709 13:06:03.776790 21505 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.852670 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.829802 21517 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.880378 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:03.859426 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.881429 15268 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:03.884738 15272 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:03.885196 15270 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:03.889318 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:03.890139 15337 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:03.783619 21288 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.892534 15193 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:03.894272 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:03.851599 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 236095us
I20260709 13:06:03.880265 15345 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:03.888051 15339 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
W20260709 13:06:03.896620 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 66193.9us
I20260709 13:06:03.771760 21496 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.897775 15270 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:06:03.887439 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.900324 15197 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:03.898850 15272 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:06:03.797180 21684 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:03.906257 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:03.858402 21519 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:03.817739 21655 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.788774 20980 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 13:06:03.858949 21521 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.892418 21288 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:03.910080 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:03.913111 21684 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.887836 21505 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.915347 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:03.919826 21496 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.920454 15271 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:03.888120 21670 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:03.921939 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:03.922196 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.923592 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:03.901119 21307 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:03.923334 21672 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:03.924997 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.925285 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.974092 15268 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:03.925891 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.926172 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.926542 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.927378 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:03.928050 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:03.928207 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:03.976039 15272 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.929288 15339 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:03.930154 21610 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:03.923373 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:03.923442 15193 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:03.796797 21653 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.953634 15265 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:06:03.956980 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:03.964815 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54783.8us
I20260709 13:06:03.852483 21132 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:03.928916 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:04.027343 15195 raft_consensus.cc:2393] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:03.933003 21675 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.981587 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.113466 15191 raft_consensus.cc:2368] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:06:04.115821 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.116667 15191 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.117924 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.114403 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:04.114552 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.028609 15190 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:03.955296 21288 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:04.056270 15272 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:06:04.121261 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 210412us
I20260709 13:06:03.955379 21505 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:04.125285 15872 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:04.122428 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.120812 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.028977 15194 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:06:04.126219 15197 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 13: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.126830 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.113339 15192 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.935949 21678 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.178s
I20260709 13:06:03.963917 21635 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:03.955551 21684 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:04.144476 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.142899 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.147533 15195 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:06:04.149013 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.124049 21453 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:03.974797 21648 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.172s
I20260709 13:06:03.933892 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:04.160790 15189 raft_consensus.cc:606] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.161307 15189 raft_consensus.cc:614] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:04.145161 21443 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:04.150616 21675 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:04.170059 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:04.177189 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46261.4us
I20260709 13:06:04.186240 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:04.187901 21213 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:06:04.191653 21692 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:06:04.192865 21351 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:04.194432 21358 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.194923 21646 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.198158 21691 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:04.199427 21653 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:03.967576 21307 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.202961 21521 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:04.206907 21675 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:04.149001 21635 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:04.214811 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51985.7us
I20260709 13:06:04.257329 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:04.222857 15192 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21.
I20260709 13:06:03.977985 21458 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:04.164237 21453 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.202047 21120 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.207772 21456 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.171764 21443 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.261467 15188 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:04.262759 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.224789 21351 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.258028 21307 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:04.281126 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.406956 21704 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:06:04.374466 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 260124us
I20260709 13:06:04.410591 21704 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:04.234426 21672 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:04.411368 21672 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.411813 21672 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:04.412783 21453 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:04.272465 21562 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:04.413775 21562 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:04.410761 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:04.414706 21706 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:04.415156 21706 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.415478 21706 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:04.416214 21443 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:04.416450 21686 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:04.271816 21655 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.416992 21686 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.268926 21670 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:04.236658 21646 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.418300 21686 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.419684 21646 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.420190 21635 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.272984 21675 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:04.420781 21704 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:04.421362 21675 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.423839 21706 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:04.268390 21687 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.306s	user 0.003s	sys 0.000s
I20260709 13:06:04.426071 21706 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:04.426895 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 164240us
I20260709 13:06:04.427851 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:04.425027 21505 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.428403 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.430640 21635 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:04.226817 21691 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.272765 21653 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.167s
I20260709 13:06:04.431915 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:04.305991 15196 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:04.436854 15270 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 22: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:06:04.449083 15312 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.013s
I20260709 13:06:04.467638 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:04.468688 15312 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.005s	sys 0.016s
I20260709 13:06:04.448758 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:04.470335 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 569074us
I20260709 13:06:04.430701 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:04.476308 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:06:04.274544 21359 consensus_meta.cc:287] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.001s
I20260709 13:06:04.480930 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:04.482005 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:04.387981 21702 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.469641 21458 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.467386 20980 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.438858 21684 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.487856 15876 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
W20260709 13:06:04.450647 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 433447us
I20260709 13:06:04.492482 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.490254 15195 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:04.364735 21213 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.469851 21519 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:04.426909 21706 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:04.498428 15341 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:06:04.426499 21288 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.432440 21691 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.498755 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:04.419703 21686 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:04.499467 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:04.431947 21456 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:04.253930 21517 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.542310 21132 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.547834 21351 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:04.549763 21351 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:04.520279 21702 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.551894 21704 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.519968 21443 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:04.554565 21691 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:04.554643 21443 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.493970 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.557684 21443 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.510386 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:04.512126 15190 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 26. Current term is 27. Ops: []
I20260709 13:06:04.530164 21453 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:04.512602 21705 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.559762 21453 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:04.560248 21705 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.513171 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.561120 21453 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.566435 21684 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.513870 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:04.568460 15343 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:04.514556 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.569559 15188 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.438879 21505 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.515158 15189 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:04.516336 21120 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.431268 21635 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:04.529032 21213 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.571399 21635 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.484001 15337 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:04.522760 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:04.494083 21646 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.524053 15267 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 17: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:04.525866 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 95283.7us
W20260709 13:06:04.526572 21680 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.001s	sys 0.019s
I20260709 13:06:04.505677 15196 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:04.414707 21562 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.587657 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.531414 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.483980 21699 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.570210 21307 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.439765 21711 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.087s
I20260709 13:06:04.534261 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:04.535400 15346 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:04.536428 15266 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:06:04.539373 21695 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:06:04.540053 21693 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:06:04.557791 15263 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:04.597754 21120 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:04.592595 21699 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.237468 21358 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.598732 21505 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.599258 21505 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.600298 21699 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.601054 21358 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:04.562012 15193 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 21: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:04.602628 15193 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
W20260709 13:06:04.513947 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.571416 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:04.573410 21213 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.577829 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.475479 21496 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.585136 21643 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:04.611508 21496 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.613015 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:04.613768 21496 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.614287 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.615195 21706 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:06:04.578006 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55367.4us
I20260709 13:06:04.580754 21443 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:04.580967 21646 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.530007 20980 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.587601 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.627281 15194 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:04.589309 15196 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:04.520419 21458 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:04.584213 21680 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.001s	sys 0.019s
W20260709 13:06:04.592820 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 58632.5us
I20260709 13:06:04.630544 21678 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:04.631690 21678 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:04.632377 21678 consensus_queue.cc:1243] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 27.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:04.632805 21678 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:04.633147 21678 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.634501 21509 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:06:04.634917 21509 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.635792 21509 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.636997 21509 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:04.638038 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:04.638731 15337 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:04.639508 21681 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:04.640033 21443 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:04.640396 21681 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:04.640743 21681 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.641240 21705 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.641548 21681 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.598320 21120 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:04.511363 15197 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:04.606176 15195 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:06:04.618006 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.624469 15346 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:04.625227 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.629760 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:04.639705 21707 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:06:04.675635 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45975us
I20260709 13:06:04.601300 21505 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.650270 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:04.694340 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:04.656445 15190 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:04.660316 15191 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:04.642758 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:04.669600 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51674.9us
I20260709 13:06:04.643458 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:04.639536 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:04.695878 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.620868 15263 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 14.
I20260709 13:06:04.642827 21681 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:04.673100 15196 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:04.700169 15191 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:04.622000 21643 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.674629 21519 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.684173 21288 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:04.651827 21702 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:04.617417 21699 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.624300 21672 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.621737 21706 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:04.677068 21120 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:04.706579 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:04.692664 15194 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:04.707588 15197 raft_consensus.cc:1240] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:04.671908 21680 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.697103 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.648806 15189 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:06:04.680670 21648 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:04.699643 15839 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:04.697772 21496 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:04.696785 21132 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:04.675197 21653 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:04.725348 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.723320 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.726642 15267 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:04.731213 15238 leader_election.cc:400] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:06:04.731601 15238 leader_election.cc:403] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.732616 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:04.733996 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:04.734141 21213 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:06:04.734721 21505 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:04.735222 21505 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.735275 21213 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:04.735757 21505 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:04.735869 21680 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.703738 21699 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.641894 21443 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:04.708163 15191 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:04.644693 20980 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:04.693234 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68084.1us
I20260709 13:06:04.695188 21704 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:04.748518 21213 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:04.749013 21213 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.749385 21213 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:04.700071 21686 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:06:04.699425 21359 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:04.723328 15263 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:04.720492 21562 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:04.714987 21706 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:04.741248 15266 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:06:04.744799 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:04.647737 21458 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:04.704334 21713 consensus_queue.cc:1175] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" responder_term: 13 status { last_received { term: 13 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 13 index: 9 } }
I20260709 13:06:04.757660 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:04.743285 21646 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.755082 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:04.704578 21581 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 13:06:04.653053 21678 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.758049 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.758432 15272 raft_consensus.cc:2393] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:04.724303 21571 raft_consensus.cc:2804] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:04.760774 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.754032 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:04.742604 21496 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.764096 21699 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.763450 21703 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:04.763213 21698 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:04.800961 15263 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:04.796484 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.807808 15195 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:04.803494 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.787240 15197 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:04.814635 15270 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:04.807821 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:04.816474 15267 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:04.816874 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:04.818238 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 64306.9us
I20260709 13:06:04.791344 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:04.820461 15237 leader_election.cc:336] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.670s (SENT)
I20260709 13:06:04.820990 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:04.821209 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.824136 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:04.824796 15196 raft_consensus.cc:2410] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:06:04.816309 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.826375 15263 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:04.830068 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:04.832005 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.833774 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.834362 15196 raft_consensus.cc:2376] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21. Re-sending same reply.
I20260709 13:06:04.834954 15192 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:06:04.834072 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.837720 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.838613 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:04.786520 21721 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:04.839871 15266 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:04.819481 21691 consensus_queue.cc:1059] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:06:04.843326 21671 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:04.831288 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:04.792907 21672 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.858390 15343 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:04.845431 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:04.848785 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.791247 21307 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:04.850806 15271 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:04.844246 21678 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:04.853856 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:04.860019 15264 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:06:04.831256 21699 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:04.863314 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.771250 21679 consensus_queue.cc:1059] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:06:04.840236 21571 raft_consensus.cc:697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:04.770951 21120 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.870141 21705 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:04.814548 21703 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:04.807988 21132 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:04.870687 15263 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:04.823294 21646 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:04.898413 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 89422us
I20260709 13:06:04.864598 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.837877 21443 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:04.866083 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.861670 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.900761 15196 raft_consensus.cc:2393] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.858209 21351 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.858523 21704 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:04.911690 15343 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:04.912292 15197 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:04.895020 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 98639.1us
I20260709 13:06:04.867142 15270 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:04.883422 21653 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:04.896941 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.914398 15189 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:06:04.870453 21562 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:04.882910 21699 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.781498 21643 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.898643 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.914146 15312 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:04.771659 21706 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.922879 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.926509 15271 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:04.930099 15195 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.934015 15189 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.912835 21288 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:04.917618 21653 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:04.917407 21705 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:04.922075 21699 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:04.960367 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45915.1us
W20260709 13:06:04.965567 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51480.1us
I20260709 13:06:04.966949 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.968189 15189 raft_consensus.cc:2393] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.951735 21566 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:06:04.969715 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:04.970281 15342 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:04.975358 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.977095 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:04.977856 15196 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:04.978730 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:04.979310 15192 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:04.983680 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:04.984647 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:04.975399 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:04.960765 21571 consensus_queue.cc:237] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:04.914655 21646 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.907811 21132 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:04.915638 21698 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:06:04.916795 21351 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.010669 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:05.024238 15263 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:05.011152 15266 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:05.011688 15264 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:04.922339 21581 consensus_queue.cc:1059] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:06:04.919785 21704 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:05.013319 15268 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
W20260709 13:06:04.994423 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.953054 21562 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:04.998714 21359 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:04.961750 21653 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.011222 21519 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:06:04.951723 21686 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:06:05.018643 21722 log.cc:927] Time spent T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:05.037171 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:05.007839 21670 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:05.058082 15342 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:05.027367 15266 raft_consensus.cc:1240] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:05.038836 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:05.066430 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:05.067971 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:05.042855 15192 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:05.073164 15266 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
I20260709 13:06:05.004897 21509 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:06:05.023401 21288 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.128062 15237 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.813s (SENT)
I20260709 13:06:05.128559 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:05.127223 21670 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:05.080730 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:05.043563 21703 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.137614 20980 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:05.151806 15266 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:05.153635 15266 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:05.155354 21496 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.156625 15263 raft_consensus.cc:1240] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:05.158353 15268 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:05.051472 21665 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:05.035265 21307 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:06:05.050632 21458 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:05.145488 21358 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.232318 15162 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:05.178833 21608 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:06:05.170542 21724 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:06:05.186333 21496 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.136090 21288 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.241447 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:05.263552 21608 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.170687 21679 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:06:05.277015 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.277902 15340 raft_consensus.cc:2368] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 14. Current term is 15.
I20260709 13:06:05.280191 15340 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:06:05.280571 15340 pending_rounds.cc:85] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 14
I20260709 13:06:05.280827 15340 pending_rounds.cc:107] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:06:05.281124 15340 raft_consensus.cc:2889] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.188436 21703 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:05.264235 21726 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:06:05.171483 21705 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.240406 21702 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:06:05.287249 15340 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
W20260709 13:06:05.284456 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 149251us
I20260709 13:06:05.264544 21566 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.329859 15841 leader_election.cc:336] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.760s (SENT)
I20260709 13:06:05.302991 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.330395 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:05.293844 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.186144 21727 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:06:05.264153 21359 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.261108 21711 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:05.237644 21358 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.337946 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.363171 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.363502 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.364184 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.401167 15346 raft_consensus.cc:2376] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21. Re-sending same reply.
I20260709 13:06:05.401353 15339 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:06:05.403235 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.328147 21505 consensus_meta.cc:287] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.592s	user 0.004s	sys 0.008s
W20260709 13:06:05.413448 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 83685.3us
W20260709 13:06:05.419344 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.426118 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.426846 15340 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:05.427778 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.304052 21456 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.432212 15343 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:05.240577 21610 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:05.432299 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.330046 21698 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.456579 21698 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:05.327407 21671 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:05.463403 21671 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.189409 21670 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:05.444243 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.444518 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.445144 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.357136 21725 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:06:05.448724 15339 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:05.443702 21610 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.451642 15356 tablet_copy_service.cc:342] P 9d785ccef0634edd9f0fbb52fa1c8d27: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-6056d49d08dc4130887dbf154edc6675 received from {username='slave'} at 127.0.0.1:48112
I20260709 13:06:05.337127 21566 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.451642 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.455389 21737 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.338574 21708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.009s	sys 0.002s
I20260709 13:06:05.261025 21665 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.154s
I20260709 13:06:05.468289 15345 raft_consensus.cc:2393] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:05.444070 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.354051 21675 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:05.466938 21680 raft_consensus.cc:3055] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:05.471539 15338 raft_consensus.cc:2376] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21. Re-sending same reply.
I20260709 13:06:05.278020 21707 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.150s
I20260709 13:06:05.286355 21496 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.355104 21635 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 13:06:05.188782 21562 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.469857 21704 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:05.532370 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.576711 15346 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:06:05.577564 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.432813 21517 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:05.530941 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 65044.4us
I20260709 13:06:05.499894 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.548664 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 77157.8us
I20260709 13:06:05.458853 21698 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:05.578756 15356 tablet_copy_service.cc:434] P 9d785ccef0634edd9f0fbb52fa1c8d27: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-6056d49d08dc4130887dbf154edc6675 on tablet 6056d49d08dc4130887dbf154edc6675 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:06:05.585526 21736 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
I20260709 13:06:05.585687 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.586808 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.587538 21696 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:05.587860 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.507562 15267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.011s
W20260709 13:06:05.588512 15267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.000s	sys 0.014s
I20260709 13:06:05.588737 21681 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:06:05.552245 15344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.007s	sys 0.007s
W20260709 13:06:05.589188 15344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.007s	sys 0.007s
I20260709 13:06:05.589075 21681 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.590008 21681 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.590567 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.591243 21681 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:05.591868 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.592700 15339 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:05.500046 15340 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:05.596261 21566 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:05.596336 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.597592 21732 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:05.434492 21646 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.434011 21351 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:05.433235 21608 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:05.507423 15842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.012s
W20260709 13:06:05.470392 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 192049us
I20260709 13:06:05.549695 21307 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.498380 21711 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:05.467374 21456 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.469146 21359 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:05.556175 21708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.011s	sys 0.013s
I20260709 13:06:05.580071 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.434190 21505 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.587934 21696 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:05.594280 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.434211 21743 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:06:05.507759 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 483999us
I20260709 13:06:05.599741 21358 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.766376 21711 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:05.768076 15842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.006s	sys 0.019s
W20260709 13:06:05.768756 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 784135us
W20260709 13:06:05.736517 15237 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.533s (SENT)
I20260709 13:06:05.606928 15341 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:06:05.770153 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:05.771189 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.653807 15267 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:05.606264 15343 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:06:05.772908 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.772274 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 132562us
I20260709 13:06:05.774345 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.772333 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.775509 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.777149 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:05.566425 21680 raft_consensus.cc:740] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.786530 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:05.791396 15841 leader_election.cc:336] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.819s (SENT)
I20260709 13:06:05.571655 21635 consensus_queue.cc:1243] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer f4ca86ee1d194023b1414bbe226f4798 log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:06:05.793874 15346 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:05.572523 21519 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:05.654121 21733 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:06:05.765239 21691 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:05.799767 15338 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:05.796000 15271 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:05.796650 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.795539 21351 consensus_queue.cc:1059] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:06:05.801492 15341 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:05.801385 21566 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:05.802561 21566 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:05.802955 21566 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.803220 15264 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:05.804108 21566 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.805578 21566 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:05.806725 21747 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.601365 21704 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.206s
I20260709 13:06:05.807453 21704 consensus_queue.cc:1243] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 26.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:05.811370 21680 consensus_queue.cc:260] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.813889 21496 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.817166 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:05.818621 15237 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.630s (SENT)
I20260709 13:06:05.818974 21671 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:05.821079 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.821585 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.822106 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.776744 21358 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.796941 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:05.836624 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59587.8us
W20260709 13:06:05.837394 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.838100 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:05.839545 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:05.798007 15346 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:06:05.654918 21288 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:05.779136 21672 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.802839 15341 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:05.797679 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.825110 21648 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:05.814752 21509 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:05.826351 21505 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.864203 15197 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:05.826838 21132 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.827519 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.870291 15338 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:05.828421 21351 raft_consensus.cc:3055] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:05.807350 21747 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:05.777124 21743 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:06:05.849354 15310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.009s	sys 0.005s
I20260709 13:06:05.855378 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:05.879459 15310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.010s	sys 0.005s
I20260709 13:06:05.880021 15193 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
W20260709 13:06:05.857877 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.859699 15192 raft_consensus.cc:1240] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:05.800109 21608 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:05.851509 21704 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:05.871374 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:05.849488 21509 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.580636 21610 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.835947 21680 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.875187 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:05.799908 21691 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.777354 21307 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.861929 21707 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:06:05.860427 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:05.911051 15189 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:05.849263 21648 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.851208 21710 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:05.914397 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:05.865595 21672 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.873175 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:05.920205 15195 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
W20260709 13:06:05.895156 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.894842 15876 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:05.872500 21351 raft_consensus.cc:740] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:05.876094 21496 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.899410 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.874775 21443 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.906183 15338 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:05.564209 21737 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:05.909199 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.914785 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 75312.6us
I20260709 13:06:05.936458 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:05.915920 21707 consensus_queue.cc:1243] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 22.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:06:05.938288 15160 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:05.938937 21120 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:05.927125 21132 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:05.939210 21443 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.941094 21672 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.941296 21443 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.943357 21509 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.943455 21351 consensus_queue.cc:260] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.944135 21747 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.944511 21509 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:05.944633 21351 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:05.937786 21646 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:05.946208 21646 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:05.946583 21646 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:05.934792 21610 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:05.884292 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61607us
W20260709 13:06:05.917717 21699 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.901s	user 0.007s	sys 0.004s
W20260709 13:06:05.917789 21758 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:06:05.923964 21735 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.925900 21307 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.959388 21735 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.951478 21691 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.960935 21691 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:05.961517 21735 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:05.920675 21671 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:05.963621 21671 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.964864 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3217) took 1144 ms. Trace:
I20260709 13:06:05.965291 21456 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.965806 21671 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:05.965221 15337 rpcz_store.cc:276] 0709 13:06:04.820484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.820625 (+   141us) service_pool.cc:224] Handling call
0709 13:06:04.820973 (+   348us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:04.858347 (+ 37374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.858375 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:04.873305 (+ 14930us) log.cc:844] Serialized 52 byte log entry
0709 13:06:05.214308 (+341003us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:05.214361 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.214454 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:05.964629 (+750175us) raft_consensus.cc:1685] finished
0709 13:06:05.964650 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.964808 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75152,"raft.queue_time_us":37260,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9055,"thread_start_us":305697,"threads_started":1,"wal-append.queue_time_us":395741}
W20260709 13:06:05.908167 21213 consensus_meta.cc:287] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.158s	user 0.013s	sys 0.000s
I20260709 13:06:05.824800 21519 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:05.955400 21749 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:05.955379 21699 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:05.919214 21696 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.987265 21696 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:05.959192 21743 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.968291 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:05.928953 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:05.971993 15194 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:06:05.993135 15338 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:05.993067 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:05.952405 21496 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:05.975929 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:05.994295 15190 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:05.994475 15346 raft_consensus.cc:2376] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14. Re-sending same reply.
I20260709 13:06:05.978176 15342 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:05.995960 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.996721 15342 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:05.997748 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.979413 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.979604 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:05.951411 21517 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:05.988952 15270 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 15: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:06.002094 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.002965 15160 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:05.989066 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:06.002966 15342 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:05.914064 21704 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:05.999785 15339 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:06.001122 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:06.006886 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.007539 15339 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:06:05.983741 21703 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.001s
I20260709 13:06:06.012225 15338 pending_rounds.cc:85] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 12
I20260709 13:06:06.012822 15338 pending_rounds.cc:107] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260709 13:06:06.013257 15338 raft_consensus.cc:2889] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.004979 15342 raft_consensus.cc:1217] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Deduplicated request from leader. Original: 21.11->[24.12-27.14]   Dedup: 24.12->[25.13-27.14]
I20260709 13:06:06.005632 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:06.007503 15346 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:06:05.991096 21678 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 1.112s	user 0.008s	sys 0.004s
I20260709 13:06:06.017422 15344 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:06.017545 15342 pending_rounds.cc:85] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 12
I20260709 13:06:06.018765 15342 pending_rounds.cc:107] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 26.13
I20260709 13:06:06.024019 15343 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:06.022861 15342 raft_consensus.cc:2889] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.028975 15872 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:06.032433 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.037701 15264 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:06.034749 15263 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:06.035710 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 2977) took 1048 ms. Trace:
I20260709 13:06:06.036095 15268 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:05.983635 21648 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.186674 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.009683 21747 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:05.984269 21213 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.057987 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:06.190059 15269 pending_rounds.cc:85] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 14
I20260709 13:06:06.002049 21749 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:06.108978 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.075084 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:06.123528 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.112740 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:06.020665 21655 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:06:06.171744 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.194279 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:06.195676 15346 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:06.184779 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.020747 21710 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:06.174489 15345 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:06.175796 15876 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:06.179829 15192 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:06.181746 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.199378 15196 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:06.182966 15872 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:06.115073 21699 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:06.203650 21737 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.203730 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.204408 15196 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:06.205199 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.205826 15196 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:06.123082 21706 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.232426 21710 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:06.233162 21706 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.039836 15270 rpcz_store.cc:276] 0709 13:06:04.974943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.975103 (+   160us) service_pool.cc:224] Handling call
0709 13:06:06.023555 (+1048452us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400328cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:06.023683 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2270502784}
W20260709 13:06:06.190368 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 184843us
I20260709 13:06:06.190387 15269 pending_rounds.cc:107] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260709 13:06:06.255738 15269 raft_consensus.cc:2889] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.256150 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.256767 15270 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
W20260709 13:06:06.115159 21653 consensus_meta.cc:287] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.033s	user 0.012s	sys 0.000s
I20260709 13:06:06.195011 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.197258 15343 raft_consensus.cc:2410] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:06:06.196602 15263 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:06.200731 21749 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.201648 21213 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.122258 21496 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.202133 15272 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:06.202023 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:06.188247 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.199643 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:06.270632 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 68682.7us
I20260709 13:06:06.271122 15192 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:06.271905 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.272040 21505 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:06.272514 15192 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:06.272598 21505 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:06.273723 15192 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23. Ops: [22.11-22.11]
I20260709 13:06:06.273512 21505 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.104101 21562 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:06.212103 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.275353 21562 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.276542 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.278053 21562 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.213527 21648 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:06.192286 21747 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:06.216693 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.295755 15267 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:06.195207 21623 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:06.117259 21704 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.220491 21735 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:06.221715 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 185715us
I20260709 13:06:06.321544 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:06.222339 21752 consensus_queue.cc:1059] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:06.224671 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:06.229501 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:06.324779 15339 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:06.325259 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 95849.8us
I20260709 13:06:06.230798 21737 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.327296 21702 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:06.327780 21702 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.328151 21702 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:06.311246 21623 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.332808 21706 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.333433 21623 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:06.333127 21737 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.333603 21706 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:06.233811 21710 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.327312 21752 raft_consensus.cc:3055] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:06.116029 21358 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:06.118094 21519 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.332690 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3129) took 1324 ms. Trace:
I20260709 13:06:06.337672 15197 raft_consensus.cc:1240] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:06.337880 15272 rpcz_store.cc:276] 0709 13:06:05.008491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.012080 (+  3589us) service_pool.cc:224] Handling call
0709 13:06:05.012461 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.270261 (+1257800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.332449 (+ 62188us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400011654. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:06.332628 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2735523584}
I20260709 13:06:06.240494 21132 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:06.243705 21741 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:06.339848 21132 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:06.244059 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.207367 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:06.309302 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.310320 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.323861 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:06.243988 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.325317 15194 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:06.345294 15196 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:06.340770 21675 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:06.340888 21735 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.336802 21752 raft_consensus.cc:740] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:06.347579 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.350477 15192 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 18 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:06:06.092115 21763 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.213s
W20260709 13:06:06.348730 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.350888 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.352722 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.353475 15343 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:06:06.354584 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.356772 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.359838 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:06.368594 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.380462 15337 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:06.382864 15344 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:06.384086 21752 consensus_queue.cc:260] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.385758 21752 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:06.387629 21737 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.390074 15196 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:06:06.270529 21653 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.391383 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.389989 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.392102 15196 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:06:06.392344 15341 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:06.392832 15190 raft_consensus.cc:606] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:06.392958 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:06.393184 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.393644 21741 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:06.393241 15190 raft_consensus.cc:614] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:06.397912 15188 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:06.397972 21747 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.411636 21653 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.413522 21735 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:06.415740 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.393970 15341 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
W20260709 13:06:06.416291 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.417305 15196 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:06:06.419275 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.420167 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.422698 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:06.424691 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.425515 15194 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:06.346993 21519 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:06.435331 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.424999 15237 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:06.439227 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.351948 21610 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:06.424185 15340 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:06.443675 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:06.458922 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:06.380025 21699 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:06.467829 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.469434 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:06.473707 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:06.475225 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:06.350483 21358 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:06:06.475412 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:06.346499 21646 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.496963 21646 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.473101 21610 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.499783 21610 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:06.488396 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.501844 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.503001 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:06.503645 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.505436 15341 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:06:06.441097 21675 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:06.476768 21671 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:06.510676 21671 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:06.464442 21443 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.511945 21443 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.513986 21443 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.473872 21696 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:06:06.516496 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.478176 21734 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:06.520072 21734 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:06.520928 21734 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:06.487512 21699 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:06.494876 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:06.509976 21675 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:06.525043 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:06.524647 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 58958.8us
I20260709 13:06:06.489902 21706 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.526351 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.527623 21672 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:06.528653 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.563520 15271 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:06.529255 21699 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:06.568017 15267 raft_consensus.cc:2393] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:06:06.568369 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 43832.1us
I20260709 13:06:06.532431 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:06.467660 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.533171 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:06.533520 15196 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:06:06.531445 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:06.579432 15196 pending_rounds.cc:85] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 8
I20260709 13:06:06.579864 15196 pending_rounds.cc:107] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 16.9
W20260709 13:06:06.579890 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48501.3us
I20260709 13:06:06.580365 15196 raft_consensus.cc:2889] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.576018 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.478415 21655 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:06.581501 15267 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:06.582613 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:06.586102 15271 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:06.587294 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.581133 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:06.584830 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.573657 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:06.591203 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.591655 20980 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:06.592921 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:06.595356 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.473295 21519 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:06.589787 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:06.612865 15339 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
W20260709 13:06:06.584602 21770 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
I20260709 13:06:06.612232 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:06.574299 21653 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:06.566953 21646 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:06:06.592836 21443 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:06.639593 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:06.601589 21737 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:06.608019 21698 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.646116 20980 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.646925 15197 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:06.631819 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:06.633528 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:06.641945 15196 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:06.646724 20980 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.570511 21623 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:06.616381 21358 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:06.621096 21653 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.620111 21696 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:06.629947 21562 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:06.571847 21706 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.602972 21655 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.668738 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:06.668783 20980 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.662016 15271 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:06.644660 21737 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.645498 21359 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:06.656679 21120 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:06.642895 15309 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:06.673816 20980 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:06.661072 21653 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:06.677275 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:06.682044 20980 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.642238 21443 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:06.656975 21358 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.680362 21777 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:06.645283 21566 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:06:06.663640 21562 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.667625 21307 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:06.678999 21737 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:06.690521 15872 raft_consensus.cc:1240] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:06.692086 20980 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.693130 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:06.686627 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43831.7us
I20260709 13:06:06.650547 21505 consensus_queue.cc:1059] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:06:06.664472 21699 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:06.681484 21120 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.724100 15270 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:06.656211 21698 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:06.688659 21443 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:06.684083 21358 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:06.690251 21710 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:06.757427 20980 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:06.757737 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:06.692435 21691 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:06.711992 21562 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:06.654060 21675 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:06.692870 21777 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:06:06.791610 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 120296us
I20260709 13:06:06.788991 15872 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:06.726150 21623 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:06.747829 21120 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:06.788925 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59508.9us
I20260709 13:06:06.801438 15237 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:06.803113 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 70786.4us
I20260709 13:06:06.807614 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:06.802636 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:06.711935 21702 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.727344 21307 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:06.810489 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:06.760244 21699 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:06.877414 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.988966 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.827625 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.041501 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.041929 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.889853 15270 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:06:07.042456 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.931677 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.043457 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.045130 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.028599 15872 raft_consensus.cc:2468] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
W20260709 13:06:07.042470 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.052433 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 241971us
I20260709 13:06:06.797737 21710 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:06.815691 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:06.893087 21779 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:06:06.893695 21773 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:06:06.892491 21781 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:06:07.055557 15311 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:06.897473 21743 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:06.931489 21672 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:06.913447 21519 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:06.872328 21707 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.093118 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 277522us
I20260709 13:06:07.082213 21735 raft_consensus.cc:2804] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:07.050850 21763 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.847379 21691 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:06.810905 21496 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:07.083082 21776 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 13:06:07.102916 21752 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:07.069110 21566 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.050704 21655 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:06.811384 21643 consensus_queue.cc:1059] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.284s
I20260709 13:06:07.114111 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:07.119478 21670 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.021s	sys 0.004s
W20260709 13:06:07.119988 21705 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.016s	sys 0.014s
I20260709 13:06:07.122115 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.098539 21623 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:07.091434 21672 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:07.111245 21648 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.168118 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:07.182052 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:07.090464 21787 raft_consensus.cc:2764] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:06:07.136637 21705 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.016s	sys 0.014s
I20260709 13:06:07.194640 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3232) took 1215 ms. Trace:
W20260709 13:06:07.136556 21670 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.021s	sys 0.004s
I20260709 13:06:07.195106 15338 rpcz_store.cc:276] 0709 13:06:05.978767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.006194 (+ 27427us) service_pool.cc:224] Handling call
0709 13:06:06.011951 (+  5757us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:06.188709 (+176758us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.188796 (+    87us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:06.189322 (+   526us) log.cc:844] Serialized 52 byte log entry
0709 13:06:06.427298 (+237976us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:06.427354 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.427446 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.518548 (+ 91102us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b1800378040. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:06:07.187346 (+668798us) raft_consensus.cc:1685] finished
0709 13:06:07.187381 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.194565 (+  7184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23891,"raft.queue_time_us":173058,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":11155840,"thread_start_us":233312,"threads_started":1,"wal-append.queue_time_us":455045}
I20260709 13:06:06.926746 21777 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.199992 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:07.179405 21519 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:07.181712 21672 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:07.139024 21643 consensus_queue.cc:1243] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:07.133675 21566 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.108649 21707 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.122447 21691 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.181943 21635 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.181062 21505 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:07.134192 21752 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.121109 21763 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:07.236778 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 137490us
I20260709 13:06:07.198026 21698 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:07.242131 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 109724us
I20260709 13:06:07.125653 21496 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:07.206735 21702 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.260708 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2990) took 1087 ms. Trace:
W20260709 13:06:07.263549 15237 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.523s (SENT)
I20260709 13:06:07.191313 21648 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:07.220120 21705 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.237867 21774 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 13:06:07.268013 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:07.272373 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:07.292718 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:07.293537 21213 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.293658 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:07.294305 21213 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:07.294687 21213 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.294806 21707 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.295094 21213 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:07.295841 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 2988) took 1123 ms. Trace:
I20260709 13:06:07.296178 15264 rpcz_store.cc:276] 0709 13:06:06.172578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.174158 (+  1580us) service_pool.cc:224] Handling call
0709 13:06:06.174459 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.174821 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.174846 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.198161 (+ 23315us) log.cc:844] Serialized 26 byte log entry
0709 13:06:06.617216 (+419055us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:06.617256 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.617315 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.295625 (+678310us) raft_consensus.cc:1685] finished
0709 13:06:07.295645 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.295784 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1928,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5376,"thread_start_us":415212,"threads_started":1,"wal-append.queue_time_us":532238}
I20260709 13:06:07.297415 21566 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.297960 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.298013 21566 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:07.298913 21795 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:07.299664 21795 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:07.300017 21795 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.300324 21795 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.303776 21213 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.305979 21648 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:07.306294 21213 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.309062 21795 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.259513 21505 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.318377 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2388) took 1114 ms. Trace:
W20260709 13:06:07.319299 21789 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:06:07.319978 21505 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.321138 15271 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:07.322194 21795 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:07.322974 21793 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:07.323673 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46386 (request call id 51) took 1298 ms. Trace:
I20260709 13:06:07.324131 15190 rpcz_store.cc:276] 0709 13:06:06.024805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.029799 (+  4994us) service_pool.cc:224] Handling call
0709 13:06:07.323314 (+1293515us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b54001f7cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e5707853 00007f36ea6d560a 00007f36e3c5b7d4 00007f36e3c5b762 00007f36e3c5b691 00007f36e3c5b60c 00007f36e3c5a8c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:07.323460 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465997184}
I20260709 13:06:07.325407 21691 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.325995 21691 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.236901 21643 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:07.327346 21643 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.327804 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2420) took 1151 ms. Trace:
I20260709 13:06:07.328444 15189 rpcz_store.cc:276] 0709 13:06:06.176272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.176382 (+   110us) service_pool.cc:224] Handling call
0709 13:06:07.327535 (+1151153us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400409554. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:07.327699 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969116544}
I20260709 13:06:07.329545 21643 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.195720 21710 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:07.335353 21766 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.229s	user 0.008s	sys 0.001s
W20260709 13:06:07.264202 21653 consensus_meta.cc:287] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
W20260709 13:06:07.344666 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 79241.1us
W20260709 13:06:07.346005 21120 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.535s	user 0.009s	sys 0.001s
I20260709 13:06:07.346397 21120 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.205957 21735 raft_consensus.cc:697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:07.283830 21752 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.288916 21496 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:07.358403 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:07.295017 15238 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:07.207698 21519 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:07.315407 21785 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
W20260709 13:06:07.316407 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2381) took 1362 ms (client timeout 1523 ms). Trace:
W20260709 13:06:07.316684 21786 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
W20260709 13:06:07.317613 21802 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:07.267710 15269 rpcz_store.cc:276] 0709 13:06:06.173250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.173357 (+   107us) service_pool.cc:224] Handling call
0709 13:06:06.189859 (+ 16502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:06.256490 (+ 66631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.256520 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:06.257079 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 13:06:06.612936 (+355857us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:06.612975 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.613039 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.260415 (+647376us) raft_consensus.cc:1685] finished
0709 13:06:07.260436 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.260629 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1158,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7682,"thread_start_us":355515,"threads_started":1,"wal-append.queue_time_us":422023}
I20260709 13:06:07.326429 21691 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:07.283776 21784 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:06:07.318909 15337 rpcz_store.cc:276] 0709 13:06:06.203952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.276210 (+ 72258us) service_pool.cc:224] Handling call
0709 13:06:07.318134 (+1041924us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000b7054. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:07.318301 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237117184}
I20260709 13:06:07.344022 15271 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:07.348637 21458 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:06:07.348891 21610 consensus_meta.cc:287] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.005s
I20260709 13:06:07.368489 21120 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:07.365850 15340 rpcz_store.cc:269] 0709 13:06:05.953701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.953846 (+   145us) service_pool.cc:224] Handling call
0709 13:06:07.316104 (+1362258us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54001752d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:07.316283 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885311232}
I20260709 13:06:07.361636 21643 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.372393 21735 consensus_queue.cc:237] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:07.354234 21648 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:07.295360 21705 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.375463 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:07.370071 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75118.7us
I20260709 13:06:07.399644 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:07.259400 21635 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.354960 21653 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.362118 21288 raft_consensus.cc:3055] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:07.339810 21698 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:06:07.366467 21519 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.380911 21496 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:07.275408 21787 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:06:07.405848 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2428) took 1224 ms. Trace:
W20260709 13:06:07.403625 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 185168us
I20260709 13:06:07.403852 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.406411 15194 rpcz_store.cc:276] 0709 13:06:06.181513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.194053 (+ 12540us) service_pool.cc:224] Handling call
0709 13:06:07.405631 (+1211578us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54001e7dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:07.405787 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297008896}
I20260709 13:06:07.409396 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:07.410029 15189 raft_consensus.cc:606] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:07.410236 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 117569us
I20260709 13:06:07.410408 15189 raft_consensus.cc:614] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:07.394781 21307 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.416338 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.417348 15196 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:07.417750 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:07.420957 21699 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:07.420298 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.421969 15195 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:07.403131 21288 raft_consensus.cc:740] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:07.391834 21610 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.425508 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.407456 21813 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:07.408730 21496 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.400807 21704 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:06:07.395263 21643 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.444769 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.445099 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:07.445676 15872 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:06:07.442305 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:07.442407 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.401458 21648 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.418010 21702 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:07.403165 21814 consensus_queue.cc:1059] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:06:07.452685 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.454421 15265 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 11. (term mismatch)
I20260709 13:06:07.454820 15265 pending_rounds.cc:85] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 10
I20260709 13:06:07.455061 15265 pending_rounds.cc:107] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 22.11
I20260709 13:06:07.455271 15265 raft_consensus.cc:2889] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:07.457350 21711 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:06:07.459568 21804 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:07.459884 21691 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:07.460373 21610 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.461265 15346 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:07.462138 21288 consensus_queue.cc:260] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:07.463683 21288 raft_consensus.cc:3060] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:07.422432 21752 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:06:07.430502 21795 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:07.464581 21795 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:07.465466 21795 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.466538 21643 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.471972 21705 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.441269 21813 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.475358 21813 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:07.475581 15265 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:07.476707 21648 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.442162 21496 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:07.450305 15343 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:06:07.450397 21443 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.658s	user 0.004s	sys 0.008s
I20260709 13:06:07.480722 21443 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:07.447022 21562 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.002s
I20260709 13:06:07.482978 21562 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.486199 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.487381 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.488112 21705 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.492328 21653 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.417410 21803 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:06:07.495232 21803 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:07.495642 21803 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:07.496538 21803 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.497887 21803 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.488096 15188 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:07.500731 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:07.489791 21705 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.501283 15188 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:07.443198 21815 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:07.501681 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:07.506287 15196 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.501101 21763 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.522219 15265 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:07.524618 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.509214 21672 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:07.509131 21737 consensus_meta.cc:287] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.762s	user 0.006s	sys 0.004s
W20260709 13:06:07.520725 21671 consensus_meta.cc:287] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.999s	user 0.010s	sys 0.001s
I20260709 13:06:07.501755 21817 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:07.506151 21743 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:07.566102 21813 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:07.569517 21767 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.447s	user 0.002s	sys 0.006s
I20260709 13:06:07.570268 21706 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:07.573721 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 146782us
W20260709 13:06:07.576499 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 156269us
W20260709 13:06:07.580982 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.508988 21358 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.712s	user 0.004s	sys 0.007s
I20260709 13:06:07.588806 15196 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:07.587877 15188 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:07.599323 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3478) took 1629 ms. Trace:
I20260709 13:06:07.570282 21519 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.614399 21743 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:07.616629 21810 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:06:07.618041 15269 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:07.596621 21671 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:07.617411 21705 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.631335 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.632265 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.633420 15345 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:07.639072 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:07.641278 15271 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:07.641819 15237 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:07.643217 15338 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:06:07.641978 15344 raft_consensus.cc:1240] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:06:07.648247 15265 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:07.648761 15266 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:07.653067 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:07.653594 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:07.653838 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.656337 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.656656 15264 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:07.657790 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:07.625142 15193 rpcz_store.cc:276] 0709 13:06:05.969846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.969983 (+   137us) service_pool.cc:224] Handling call
0709 13:06:05.970277 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.970472 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:07.491541 (+1521069us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b18003ec5c0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf
0709 13:06:07.491684 (+   143us) log.cc:844] Serialized 14 byte log entry
0709 13:06:07.598912 (+107228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:07.598964 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:07.599015 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.599106 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.599230 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16559,"prepare.queue_time_us":100240,"prepare.run_cpu_time_us":8826,"prepare.run_wall_time_us":92376,"raft.queue_time_us":74,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6355,"spinlock_wait_cycles":4006784,"thread_start_us":188180,"threads_started":2,"wal-append.queue_time_us":123360}
I20260709 13:06:07.654197 15266 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:07.660424 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:07.660655 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.659430 15268 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:07.661933 20980 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:07.662290 20980 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:07.662621 20980 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:07.662748 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.664348 15271 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:07.663383 15268 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:07.667603 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.667610 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:07.655735 21809 raft_consensus.cc:2764] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:07.672648 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.669910 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.611636 21737 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:07.678249 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:07.678323 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:07.628127 21358 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.657853 21787 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:07.681253 15268 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:07.664378 21705 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:07.682329 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.683669 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:07.686132 15272 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:07.693269 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3470) took 1839 ms. Trace:
W20260709 13:06:07.694653 21825 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:07.693666 15191 rpcz_store.cc:276] 0709 13:06:05.853952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.854120 (+   168us) service_pool.cc:224] Handling call
0709 13:06:05.863825 (+  9705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.893196 (+ 29371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.893232 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.901499 (+  8267us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.937116 (+ 35617us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:05.937153 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.937227 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.557312 (+1620085us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:07.685635 (+128323us) raft_consensus.cc:1685] finished
0709 13:06:07.685658 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.693191 (+  7533us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31655,"raft.queue_time_us":35765,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9760,"spinlock_wait_cycles":51968896,"thread_start_us":35258,"threads_started":1,"wal-append.queue_time_us":168937}
I20260709 13:06:07.672118 21817 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:06:07.695634 21824 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:06:07.697130 21823 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:06:07.702620 21672 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.692433 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:07.671983 21696 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:07.711001 21743 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:07.712250 21817 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.712435 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 1.14234e+06us
I20260709 13:06:07.712760 21817 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.713403 15162 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.715219 21702 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:07.715708 21821 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:06:07.715755 21702 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.717775 21566 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:07.718204 21566 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:07.718314 21702 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.720049 21562 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.722213 21698 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:07.724212 21519 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.682546 21671 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:07.725600 21610 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:07.726004 21610 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:07.727133 21737 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.728399 21824 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:07.728884 21824 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.731374 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:07.731428 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.731714 21813 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.732208 15196 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:07.732169 15188 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:07.733196 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.733264 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.714615 15162 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.734314 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.737795 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.739643 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.691771 21830 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.690554 21307 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:07.747869 20980 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.742072 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.743882 15196 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:06:07.748586 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.716069 21675 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:07.755652 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2390) took 1551 ms. Trace:
I20260709 13:06:07.751884 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.752883 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:07.714888 21817 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.759196 15162 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.711089 21443 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:07.795250 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.803325 20980 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:07.759855 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:07.805996 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 46875.1us
I20260709 13:06:07.806187 15196 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:06:07.802681 15343 rpcz_store.cc:276] 0709 13:06:06.204481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.419856 (+215375us) service_pool.cc:224] Handling call
0709 13:06:07.755448 (+1335592us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540016c454. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:07.755594 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2366912768}
I20260709 13:06:07.807505 15193 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:07.806994 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:07.842293 15237 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.558s (SENT)
I20260709 13:06:07.853900 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:07.854713 20980 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:07.855896 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:07.859403 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 99634.5us
I20260709 13:06:07.861378 15188 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:07.726858 21610 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.862715 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.866628 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.809187 15342 raft_consensus.cc:1275] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:07.743111 21655 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:07.868484 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:07.868955 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62056.1us
I20260709 13:06:07.757395 21824 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:07.867615 15338 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:06:07.871457 15841 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.046s (SENT)
I20260709 13:06:07.872152 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.751246 21711 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:07.807940 21623 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.874616 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.853786 21359 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.853543 21691 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:07.807237 21702 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:07.749049 21737 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 13:06:07.750936 21307 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:07.738487 21566 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.895964 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.921944 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.901583 21120 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:07.802042 21735 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.879719 21655 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.808573 21562 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:07.904670 15162 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.875080 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.907445 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.875818 21680 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:07.937781 15344 raft_consensus.cc:2393] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:07.895967 21823 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:07.896921 21648 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.876500 21675 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.874697 21810 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:07.908342 21824 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.939329 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.068919 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.069540 15341 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:07.926767 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.931366 21735 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.975636 21458 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:07.910764 21623 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:07.976778 21794 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.866s	user 0.004s	sys 0.000s
I20260709 13:06:07.977648 21743 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:08.032302 15237 leader_election.cc:336] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.654s (SENT)
I20260709 13:06:08.091370 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:08.092422 20980 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:08.092787 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 60544.5us
I20260709 13:06:07.994361 21680 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.103492 15263 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:06:08.008337 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.046885 15872 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:07.896524 21814 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
W20260709 13:06:08.045900 15841 leader_election.cc:336] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.220s (SENT)
W20260709 13:06:08.111935 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 66092.1us
I20260709 13:06:08.070575 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.113090 15341 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:08.114262 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.105286 15344 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:08.116654 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:07.927582 21307 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.902647 21711 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:08.079447 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.046586 21643 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:07.755520 21830 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.037719 15269 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:07.932827 21610 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:08.108206 15876 raft_consensus.cc:3055] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:08.145074 15876 raft_consensus.cc:740] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:07.912985 21359 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:07.931665 21655 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.136024 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.137094 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:07.924454 21691 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.137885 15338 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:07.930006 21702 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.050020 21823 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.171430 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.069736 21648 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.137446 21643 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:08.138646 21711 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:08.179548 15876 consensus_queue.cc:260] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:08.240566 15340 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:06:08.111164 21680 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:08.084543 21566 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:08.210427 21840 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:08.212402 21830 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.082137 21824 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.204849 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.215339 15238 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:08.210879 21834 log.cc:927] Time spent T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:06:08.237560 21562 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:08.248317 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:08.249097 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:08.249815 15266 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:08.252903 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:08.251252 15344 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:08.220316 15341 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:08.206167 21737 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:08.192873 21837 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:08.245015 21458 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:08.110637 21743 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:08.164652 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.224931 21120 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:08.355325 21120 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:08.238145 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.213466 21747 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.359155 21747 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.361110 21747 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.245957 21840 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:08.363727 21840 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.365051 21840 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:08.240289 15265 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:08.241104 15337 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 26: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:08.235163 21496 consensus_meta.cc:287] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.004s
I20260709 13:06:08.219106 21132 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.244370 15876 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:08.367735 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:08.368361 15265 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:08.245366 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 487) took 1826 ms. Trace:
I20260709 13:06:08.205621 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.369872 15263 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:08.369581 15197 rpcz_store.cc:276] 0709 13:06:06.419020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.649003 (+229983us) service_pool.cc:224] Handling call
0709 13:06:06.649384 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:06.659880 (+ 10496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.659911 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:06.666299 (+  6388us) log.cc:844] Serialized 52 byte log entry
0709 13:06:06.794163 (+127864us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:06.794230 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.794321 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.809738 (+1015417us) spinlock_profiling.cc:243] Waited 9.18 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:08.242217 (+432479us) raft_consensus.cc:1685] finished
0709 13:06:08.242238 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.245299 (+  3061us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10175,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":5903,"spinlock_wait_cycles":21121920,"thread_start_us":102566,"threads_started":1,"wal-append.queue_time_us":278615}
I20260709 13:06:08.371239 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:08.280143 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.372238 15341 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
W20260709 13:06:08.322348 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74110.3us
I20260709 13:06:08.178990 21358 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.366660 21841 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:08.375638 15266 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:08.378383 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.378993 15341 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:08.379489 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.322928 20980 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:08.379884 15265 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:08.322374 21803 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:08.388046 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.396718 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.398083 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:08.398231 21120 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:08.404017 15338 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:08.405833 15876 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:08.410918 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.411788 15338 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:08.375222 21458 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:08.322687 21562 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.352398 21737 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.367756 21132 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.416612 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:08.367651 21496 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.426676 15265 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:08.450110 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:06:08.459053 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 377210us
I20260709 13:06:08.452914 15160 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:08.462579 15160 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:08.470242 15869 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:08.475598 15341 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:08.483114 15263 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:08.482940 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:08.458094 21842 log.cc:927] Time spent T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 13:06:08.490795 15194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:08.491614 15194 raft_consensus.cc:606] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.492040 15194 raft_consensus.cc:614] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:08.495780 21831 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.805s	user 0.012s	sys 0.005s
I20260709 13:06:08.496768 21132 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:08.503230 21843 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:06:08.507063 21824 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.507948 21824 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:08.411087 21643 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.510845 21691 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.512312 21562 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.516742 21458 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:08.517910 21307 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.521174 21496 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.453339 21623 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.528555 21737 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.516120 21823 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.457427 21841 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:06:08.530510 21743 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.471117 21358 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:08.488119 21747 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:08.544358 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.538316 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.529403 15190 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:08.546751 15265 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
W20260709 13:06:08.549274 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 412264us
W20260709 13:06:08.553054 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 185580us
I20260709 13:06:08.554131 15309 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:08.555022 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 181882us
I20260709 13:06:08.490134 15341 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:06:08.557101 20980 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:08.559099 15338 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
W20260709 13:06:08.560129 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 272984us
W20260709 13:06:08.562234 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.565307 15237 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.624s (SENT) [suppressed 29 similar messages]
I20260709 13:06:08.566341 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:08.572290 15194 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:06:08.576236 15874 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:08.577360 15341 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:08.579635 15341 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:08.577505 20980 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.582129 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:08.550158 21358 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:08.561539 21743 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:08.554522 21747 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:08.564350 21734 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.591915 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:08.595129 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.596662 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:08.597992 21857 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:08.606268 21857 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:08.606626 21857 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.579483 21854 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:06:08.612313 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.610852 15343 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
W20260709 13:06:08.612938 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.591506 21648 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.588183 21847 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:08.599977 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.579663 21562 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
W20260709 13:06:08.620479 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55209.2us
I20260709 13:06:08.600697 21841 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:08.624904 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:08.630118 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:08.629093 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.599372 21846 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:08.627231 21120 consensus_queue.cc:1059] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:08.600925 21803 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:08.622839 21847 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.641572 21860 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:08.625005 21810 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:06:08.644407 21120 raft_consensus.cc:3055] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:08.653000 21120 raft_consensus.cc:740] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:08.653973 21120 consensus_queue.cc:260] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:08.655303 21120 raft_consensus.cc:3060] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:08.647518 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.610847 21680 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.657258 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:08.630865 21566 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:08.598894 21734 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:08.633960 21846 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:08.667502 15346 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2385) took 2459 ms (client timeout 2624 ms). Trace:
W20260709 13:06:08.667922 15346 rpcz_store.cc:269] 0709 13:06:06.202885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.207021 (+  4136us) service_pool.cc:224] Handling call
0709 13:06:08.661651 (+2454630us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400175cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:08.661776 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2572052864}
W20260709 13:06:08.674276 21852 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:06:08.675606 21857 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.652510 21847 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:08.677582 21846 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:08.665740 15190 raft_consensus.cc:2368] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:06:08.691074 15265 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:08.676659 15268 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:08.644568 21648 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:08.690974 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:08.694890 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.695727 15268 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:08.699790 21871 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:08.625005 21849 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:06:08.700171 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 449) took 1067 ms. Trace:
I20260709 13:06:08.702059 15342 rpcz_store.cc:276] 0709 13:06:07.632461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.632576 (+   115us) service_pool.cc:224] Handling call
0709 13:06:07.632843 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.867828 (+234985us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.699945 (+832117us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54000974d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:08.700116 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":404577152}
I20260709 13:06:08.653684 15160 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:08.707109 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.708184 15268 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:06:08.708616 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 51823.3us
W20260709 13:06:08.707993 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 54383.6us
I20260709 13:06:08.712591 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.713538 15265 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 13.
I20260709 13:06:08.715503 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:08.715855 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 91082.6us
I20260709 13:06:08.663553 21790 raft_consensus.cc:3055] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:08.716609 15237 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:08.716100 15268 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:08.719106 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.640668 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.722348 15339 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:06:08.722723 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:08.722047 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 81433.5us
I20260709 13:06:08.723863 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:08.725498 15190 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:08.634047 21358 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.716342 21132 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:08.733963 15268 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:08.643990 21747 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.732111 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:08.735785 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:08.740090 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:08.718766 21790 raft_consensus.cc:740] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:08.666777 21860 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:06:08.722645 21648 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:08.737191 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:08.757534 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47622.5us
I20260709 13:06:08.734432 21132 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.754926 21443 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:08.764927 21855 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:06:08.770170 21827 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.076s	user 0.011s	sys 0.004s
I20260709 13:06:08.771875 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 484) took 2596 ms. Trace:
I20260709 13:06:08.772781 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:08.775637 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 3015) took 1411 ms. Trace:
I20260709 13:06:08.810348 15269 rpcz_store.cc:276] 0709 13:06:07.364712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.375151 (+ 10439us) service_pool.cc:224] Handling call
0709 13:06:08.775471 (+1400320us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001d8dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:08.775577 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":503102336}
I20260709 13:06:08.811676 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:08.776780 21792 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 1.641s	user 0.008s	sys 0.002s
I20260709 13:06:08.738322 21307 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.839756 15238 leader_election.cc:400] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:06:08.840322 15238 leader_election.cc:403] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.741870 21653 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:08.842435 21653 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.842857 21653 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:08.742965 21803 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.745028 21840 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:08.745283 21566 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:08.855000 21851 consensus_queue.cc:1048] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:06:08.856962 21635 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.856917 21566 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:08.857839 21566 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:08.793746 21829 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.097s	user 0.004s	sys 0.018s
I20260709 13:06:08.855330 21840 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:08.861050 21840 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:08.741850 21456 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:06:08.796455 21860 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:08.800213 21830 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.865293 21830 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.800916 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.802276 15312 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.802760 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:08.804068 21870 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:08.804457 21790 consensus_queue.cc:260] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:08.807332 21734 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:08.817126 15344 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:08.739532 21562 consensus_queue.cc:1059] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:06:08.819926 15192 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 16: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:08.809176 15195 rpcz_store.cc:276] 0709 13:06:06.175440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.175557 (+   117us) service_pool.cc:224] Handling call
0709 13:06:06.175865 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.429074 (+1253209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.771593 (+1342519us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540023a5d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:08.771782 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865293184}
I20260709 13:06:08.786096 21132 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:08.785548 21443 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.855360 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.872377 15337 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:08.818166 21760 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.890290 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:08.891641 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 89443us
W20260709 13:06:08.893237 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72614.9us
I20260709 13:06:08.852916 21691 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.936563 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.953354 15344 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
W20260709 13:06:08.924932 21827 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:06:08.964499 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.920362 21648 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:08.965739 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 249212us
I20260709 13:06:08.965891 15344 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:08.966549 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:08.926959 21307 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17.
I20260709 13:06:08.949589 21443 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:08.963230 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 199606us
I20260709 13:06:08.976559 15342 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:08.969498 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.939930 21875 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.972010 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.957567 21841 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:08.983409 15341 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:06:08.984920 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:08.982645 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:08.985786 15195 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:08.986822 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.987399 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:08.988886 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:08.990985 15195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:08.991624 15195 raft_consensus.cc:606] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:08.993187 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:08.990347 15337 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:06:08.995056 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:08.995194 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.987481 15341 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:08.988320 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:08.971964 21517 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:08.995867 15271 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:08.973685 21680 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:08.959739 21760 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:09.009145 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3004) took 2471 ms. Trace:
I20260709 13:06:08.971535 21648 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:09.003440 15337 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:09.002010 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:09.016160 15266 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:09.002189 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:09.017932 15271 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 15.
I20260709 13:06:08.959753 21691 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:08.988605 21610 consensus_meta.cc:287] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.811s	user 0.012s	sys 0.000s
I20260709 13:06:09.009697 15267 rpcz_store.cc:276] 0709 13:06:06.531873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.587706 (+ 55833us) service_pool.cc:224] Handling call
0709 13:06:06.588185 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:06.611586 (+ 23401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.611617 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:06.653471 (+ 41854us) log.cc:844] Serialized 52 byte log entry
0709 13:06:06.856016 (+202545us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:06.856058 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.856153 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.776152 (+1919999us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:08.989563 (+213411us) raft_consensus.cc:1685] finished
0709 13:06:08.989594 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.002983 (+ 13389us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4759,"raft.queue_time_us":16539,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":13242,"spinlock_wait_cycles":4890880,"thread_start_us":174803,"threads_started":1,"wal-append.queue_time_us":400518}
I20260709 13:06:08.983902 21857 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:09.019477 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:08.994760 21307 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:09.006247 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48793.6us
I20260709 13:06:09.030500 15312 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:09.030860 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:09.033002 15267 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:06:09.037122 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:09.049896 15341 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:06:09.020924 21655 consensus_meta.cc:287] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.779s	user 0.010s	sys 0.001s
I20260709 13:06:09.035283 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:09.004819 21841 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:06:08.983803 21875 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.034152 21849 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:09.072111 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:06:09.078941 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 85878.6us
I20260709 13:06:09.080432 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:09.084367 15337 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:09.079244 21857 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:09.086179 21889 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:09.088153 21857 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:09.088553 21857 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:09.089466 21857 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.090754 21857 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:09.093674 21847 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.092023 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:09.096254 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:09.097015 15272 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:09.097380 21846 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:09.097743 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:09.098366 15272 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:09.090865 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:09.059589 21830 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:09.100896 15344 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:06:09.103618 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82386.5us
I20260709 13:06:09.029141 21680 consensus_queue.cc:1059] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:06:09.066280 21860 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:09.111681 21876 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:09.100979 21871 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:09.208601 15346 raft_consensus.cc:1240] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:09.132431 15266 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:09.081339 21849 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:09.207259 21868 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 13:06:09.220052 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 139683us
I20260709 13:06:09.221081 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:09.222282 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:09.223592 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:09.224640 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:09.225307 15337 raft_consensus.cc:2393] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:09.067996 21655 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.227792 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:09.230270 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:09.231971 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:09.235749 15346 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:09.230222 15272 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:09.253520 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:09.213701 21849 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:09.255604 15194 raft_consensus.cc:2368] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
W20260709 13:06:09.229812 21711 consensus_meta.cc:287] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.984s	user 0.010s	sys 0.003s
I20260709 13:06:09.131009 21877 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:06:09.260074 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49330us
I20260709 13:06:09.285096 21888 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.285889 21888 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.263389 21877 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:09.259501 21711 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.283726 21846 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:09.310854 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.279454 21795 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:09.305974 21876 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:09.296700 21847 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:09.324359 15191 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:09.313750 21760 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:09.326076 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 3501) took 1596 ms. Trace:
W20260709 13:06:09.328316 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 98173.3us
I20260709 13:06:09.340092 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:09.341042 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:09.338366 15188 rpcz_store.cc:276] 0709 13:06:07.729358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.734328 (+  4970us) service_pool.cc:224] Handling call
0709 13:06:09.325909 (+1591581us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54001a5754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:09.326021 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129816448}
I20260709 13:06:09.323339 21358 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:09.332470 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.308480 21877 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:09.323139 21901 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:09.363001 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:09.336740 21876 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:09.358765 21691 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:09.376617 21879 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:06:09.377689 21890 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:06:09.377950 21896 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:09.375388 21885 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:06:09.366437 21875 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:09.366515 21876 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:09.379892 21883 consensus_queue.cc:1059] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:06:09.362444 21358 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.391316 21908 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:06:09.401870 21653 consensus_meta.cc:287] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.559s	user 0.012s	sys 0.000s
I20260709 13:06:09.365535 21895 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:09.361956 21897 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:09.403108 21901 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.427683 21896 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:09.443725 21896 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:09.374943 21882 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:09.447983 21443 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.450271 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:09.435428 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3008) took 2765 ms. Trace:
I20260709 13:06:09.452853 21882 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:09.451624 15270 rpcz_store.cc:276] 0709 13:06:06.670497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.203497 (+533000us) service_pool.cc:224] Handling call
0709 13:06:07.237320 (+ 33823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.268307 (+ 30987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.268339 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.268802 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.755870 (+1487068us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b18003240a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1 00007f36e56c8a0f
0709 13:06:09.036746 (+280876us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:09.036785 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.036847 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.435083 (+398236us) raft_consensus.cc:1685] finished
0709 13:06:09.435111 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.435362 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7572,"raft.queue_time_us":7785,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13727,"spinlock_wait_cycles":10256128,"thread_start_us":280641,"threads_started":1,"wal-append.queue_time_us":1915202}
W20260709 13:06:09.404038 21566 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.546s	user 0.014s	sys 0.002s
I20260709 13:06:09.404359 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:09.405480 21888 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:09.356794 21886 raft_consensus.cc:2764] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:06:09.405783 21909 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:09.406432 21795 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:09.406381 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:09.407021 21894 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:09.372009 21846 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:09.375459 21881 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:09.407142 21711 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:09.408399 21655 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:09.411803 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:09.413954 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:09.409974 21840 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
W20260709 13:06:09.415614 15340 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2424) took 1487 ms (client timeout 1726 ms). Trace:
W20260709 13:06:09.419814 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.423517 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:09.360464 21904 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.454249 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:09.907446 15270 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:09.907728 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.907852 15340 rpcz_store.cc:269] 0709 13:06:07.927932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.933468 (+  5536us) service_pool.cc:224] Handling call
0709 13:06:09.415482 (+1482014us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54000b6b54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:09.415569 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392099712}
W20260709 13:06:09.532665 15264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 3012) took 2236 ms (client timeout 1906 ms). Trace:
W20260709 13:06:09.798054 15346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.000s
W20260709 13:06:09.910414 15346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.010s	sys 0.004s
I20260709 13:06:09.532732 15337 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:06:09.913524 15195 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:09.908488 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:09.917809 15342 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:09.921727 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:09.927446 15342 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
W20260709 13:06:09.928072 15264 rpcz_store.cc:269] 0709 13:06:07.296074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.297699 (+  1625us) service_pool.cc:224] Handling call
0709 13:06:09.532397 (+2234698us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54003101d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:09.532536 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":823007104}
I20260709 13:06:09.934969 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:09.960891 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:09.826278 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:09.969158 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:09.970060 15342 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:09.977980 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:10.011876 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.055819 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.058769 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:10.061563 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 649815us
W20260709 13:06:09.905277 21849 consensus_meta.cc:287] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:06:09.451934 21908 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:10.070324 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:09.905645 21803 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.089843 15264 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:10.092957 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.093863 15188 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:09.569134 21883 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.096787 21886 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:09.909502 21847 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:10.060307 21691 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.914673 21846 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:10.071576 21858 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:09.442423 21653 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.121718 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.141466 15340 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:10.090890 21711 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:10.085695 21888 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.451469 21877 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.112269 15270 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:10.153230 15270 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:10.154006 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3043) took 1052 ms. Trace:
I20260709 13:06:09.439621 21132 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.162598 15190 raft_consensus.cc:2368] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:06:10.139165 21846 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:10.057787 21795 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.143957 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:09.959893 21840 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.055330 21566 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:10.170303 21840 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.171252 15338 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:10.128103 21358 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.170332 21566 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:10.060735 21904 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.173812 21840 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.174304 15269 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:10.174474 21840 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.177222 21840 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.178789 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2460) took 1536 ms. Trace:
I20260709 13:06:10.179203 15194 rpcz_store.cc:276] 0709 13:06:08.642028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.642150 (+   122us) service_pool.cc:224] Handling call
0709 13:06:10.178585 (+1536435us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54000f9bd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:10.178731 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287898368}
I20260709 13:06:10.190393 21735 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.117903 21886 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.150525 21858 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:10.194451 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2454) took 1642 ms. Trace:
I20260709 13:06:10.194844 15191 rpcz_store.cc:276] 0709 13:06:08.551973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.552122 (+   149us) service_pool.cc:224] Handling call
0709 13:06:08.554835 (+  2713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.337982 (+783147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.194196 (+856214us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54002251d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:10.194392 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1769184640}
I20260709 13:06:10.058182 21894 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:10.196259 21702 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.085534 21881 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.139081 21691 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.200208 15344 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:10.201264 21691 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.201691 15344 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:10.098377 21803 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.102635 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3187) took 1070 ms. Trace:
I20260709 13:06:10.205597 15271 rpcz_store.cc:276] 0709 13:06:09.032511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.101591 (+1069080us) service_pool.cc:224] Handling call
0709 13:06:10.101954 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.102177 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.102213 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.102266 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:10.102309 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.102366 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.102578 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.154554 15270 rpcz_store.cc:276] 0709 13:06:09.101692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.152391 (+1050699us) service_pool.cc:224] Handling call
0709 13:06:10.152782 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.153695 (+   913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.153935 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:10.167273 15337 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:06:10.168006 15340 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:09.454195 21882 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:09.442759 21895 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.203305 15344 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:10.157107 21307 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.208782 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 309901us
I20260709 13:06:10.093400 21849 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:10.128679 21847 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:10.221912 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.222337 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 164988us
I20260709 13:06:10.224509 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.115495 21883 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.257092 15270 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:10.257705 15337 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:10.234635 15340 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:10.159189 21888 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.259486 21120 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:10.204267 21358 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:10.259344 15311 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:10.214658 21707 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:10.264261 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 859946us
W20260709 13:06:10.263200 15263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 3021) took 2083 ms (client timeout 1617 ms). Trace:
I20260709 13:06:10.264165 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.222126 21710 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:10.266305 21120 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:10.268946 15263 rpcz_store.cc:269] 0709 13:06:08.179327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.370945 (+191618us) service_pool.cc:224] Handling call
0709 13:06:10.262985 (+1892040us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b54003291d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:10.263133 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214461312}
I20260709 13:06:10.219529 21854 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.270052 15193 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:10.256636 21897 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:10.230964 21909 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.296854 15263 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 24. Current term is 25. Ops: [24.13-24.13]
I20260709 13:06:10.266217 15312 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:10.266677 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:10.292562 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.233001 21307 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.300384 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:10.334825 15337 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:10.298890 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:10.336004 15340 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:10.277086 21288 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:10.297575 21120 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:10.338858 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.220351 21908 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.298139 15263 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:10.194245 21858 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:10.302968 21876 consensus_meta.cc:287] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.865s	user 0.007s	sys 0.010s
I20260709 13:06:10.300854 21743 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:10.354169 15267 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:10.326864 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.300549 21911 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:10.278954 21707 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.330909 15270 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:06:10.302204 21710 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:10.355139 21876 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:10.331544 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65499.4us
W20260709 13:06:10.301338 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 237816us
I20260709 13:06:10.344663 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.279086 21358 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.381531 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:10.350570 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 97575.6us
I20260709 13:06:10.351766 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.298887 21897 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:10.338105 21566 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.340538 21735 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:10.385318 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.385871 15270 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:10.329228 21854 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.300578 21909 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.365705 21653 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.387288 15340 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:10.367596 21877 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.368108 21911 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.384048 21132 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.361282 21743 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.385424 21735 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.385914 21923 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.488047 15191 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:10.386185 15193 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:10.398465 21566 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.452339 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.453509 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:10.465663 21648 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:10.467749 21888 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.468984 21849 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.384271 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:10.470331 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.498081 15340 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:10.472182 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3038) took 1767 ms. Trace:
I20260709 13:06:10.471055 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2462) took 1828 ms. Trace:
I20260709 13:06:10.474726 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.479274 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:10.499392 15874 raft_consensus.cc:2410] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:06:10.387405 21856 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:06:10.498929 15190 rpcz_store.cc:276] 0709 13:06:08.642662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.735493 (+ 92831us) service_pool.cc:224] Handling call
0709 13:06:10.470845 (+1735352us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54000c1cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:10.470976 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3270371072}
I20260709 13:06:10.500888 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.501178 15194 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:06:10.470779 21883 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.448922 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.504690 15270 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:10.489526 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.485460 21803 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.453424 21876 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.495957 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:10.491216 21735 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:10.498761 15268 rpcz_store.cc:276] 0709 13:06:08.705068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.738621 (+ 33553us) service_pool.cc:224] Handling call
0709 13:06:08.742256 (+  3635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.742437 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:08.755327 (+ 12890us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.294929 (+1539602us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b180003df60. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:06:10.471811 (+176882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.471887 (+    76us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:10.471947 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.472014 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.472117 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91446,"prepare.queue_time_us":12724,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":93599,"spinlock_wait_cycles":29705216,"thread_start_us":85091,"threads_started":1}
I20260709 13:06:10.485184 21680 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.505800 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:10.506146 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 121953us
I20260709 13:06:10.489504 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:10.512805 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:10.513262 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:10.507616 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:10.516142 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 155147us
I20260709 13:06:10.484884 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3267) took 1216 ms. Trace:
I20260709 13:06:10.509626 15263 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:10.487695 21895 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.507968 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:10.517536 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:10.496690 21847 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.527149 21915 raft_consensus.cc:2764] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:06:10.528216 21909 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.528679 21926 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:10.528745 21911 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.529264 21926 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.515616 15346 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3264) took 1278 ms. Trace:
I20260709 13:06:10.502302 21496 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:10.520750 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:10.521934 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.506472 21288 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.523104 21803 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:10.524128 21897 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:10.524287 21710 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:10.525785 21854 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.529297 21743 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.529892 15346 rpcz_store.cc:276] 0709 13:06:09.237205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.253648 (+ 16443us) service_pool.cc:224] Handling call
0709 13:06:09.266973 (+ 13325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.910936 (+643963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.910991 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.911860 (+   869us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.342010 (+430150us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:10.342053 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.342125 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.515385 (+173260us) raft_consensus.cc:1685] finished
0709 13:06:10.515403 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.515557 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7868,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6090,"thread_start_us":871427,"threads_started":2,"wal-append.queue_time_us":309076}
I20260709 13:06:10.531198 15190 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 22: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:10.517537 15342 rpcz_store.cc:276] 0709 13:06:09.268465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.188551 (+920086us) service_pool.cc:224] Handling call
0709 13:06:10.188922 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.189151 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:10.189465 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.457089 (+267624us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.483346 (+ 26257us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.483748 (+   402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.483867 (+   119us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:10.484014 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.484405 (+   391us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.484748 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41048,"prepare.queue_time_us":16099,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":117,"raft.queue_time_us":127236,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":248,"thread_start_us":182335,"threads_started":1,"wal-append.queue_time_us":321373}
I20260709 13:06:10.519969 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:10.532444 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.494282 21923 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:10.522336 21893 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:10.515321 21928 consensus_queue.cc:1059] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:06:10.509838 21883 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:10.474997 21927 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:06:10.541702 15337 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:10.536089 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:10.519351 21680 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.533324 21496 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.579012 15162 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:10.542807 21803 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.672715 21904 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:10.717701 21891 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.308s	user 0.009s	sys 0.014s
I20260709 13:06:10.579102 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:10.623814 21933 log.cc:927] Time spent T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:10.714485 15874 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:10.757808 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:10.655961 21896 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 1.212s	user 0.006s	sys 0.012s
W20260709 13:06:10.750731 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 171819us
W20260709 13:06:10.634672 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.657591 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2469) took 1552 ms. Trace:
I20260709 13:06:10.529871 21888 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:10.644326 15195 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3512) took 1324 ms. Trace:
I20260709 13:06:10.758920 15268 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:10.754933 21823 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:10.533042 21926 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:10.642982 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2467) took 1657 ms. Trace:
W20260709 13:06:10.612460 21939 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:06:10.770218 15192 rpcz_store.cc:276] 0709 13:06:08.985436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.006749 (+ 21313us) service_pool.cc:224] Handling call
0709 13:06:09.007168 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.642434 (+1635266us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b18003fb800. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5705bfb 00007f36e571064b
0709 13:06:10.642581 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:10.642604 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.642649 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:10.642680 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.642767 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.642911 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94521,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":42044,"spinlock_wait_cycles":134421760,"thread_start_us":143607,"threads_started":1}
I20260709 13:06:10.665320 21358 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.539583 21876 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:10.725438 21846 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.777482 21876 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.755959 21803 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:10.668723 21566 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.653167 21849 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:10.755256 21942 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:10.651386 21648 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.109s
I20260709 13:06:10.760499 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:10.761215 15263 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:10.726577 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.753736 21496 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:10.764252 21643 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:10.761977 15196 rpcz_store.cc:276] 0709 13:06:09.104750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.075454 (+970704us) service_pool.cc:224] Handling call
0709 13:06:10.097511 (+ 22057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.163838 (+ 66327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.163885 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.163943 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:10.163987 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.657262 (+493275us) spinlock_profiling.cc:243] Waited 66.1 ms on lock 0x7b54000f8cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:10.657325 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.657508 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151934336}
I20260709 13:06:10.598064 21854 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.767395 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3042) took 1774 ms. Trace:
I20260709 13:06:10.801153 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:10.753185 21623 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.802776 15190 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:10.802009 15264 rpcz_store.cc:276] 0709 13:06:08.992709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.091512 (+1098803us) service_pool.cc:224] Handling call
0709 13:06:10.091963 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.274598 (+182635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.274626 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.294435 (+ 19809us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.486447 (+192012us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:10.486733 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.766657 (+279924us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54000d6454. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:10.766734 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.766784 (+    50us) raft_consensus.cc:1685] finished
0709 13:06:10.766799 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.767322 (+   523us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3058,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8342,"spinlock_wait_cycles":419173632,"thread_start_us":140402,"threads_started":1,"wal-append.queue_time_us":289985}
I20260709 13:06:10.804638 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.721735 21830 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:10.768281 15195 rpcz_store.cc:276] 0709 13:06:09.320393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.073244 (+752851us) service_pool.cc:224] Handling call
0709 13:06:10.073522 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.259630 (+186108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.259661 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.259702 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:10.259740 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.644098 (+384358us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b540024ca54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:10.644161 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.644273 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":427543936}
I20260709 13:06:10.807495 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.769158 15162 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:10.638381 21359 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.770134 15340 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:10.583609 21937 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:06:10.771282 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 251373us
I20260709 13:06:10.771898 21823 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.812162 21937 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.771929 21904 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:10.774746 21901 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.814462 21937 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.808779 21623 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.806842 21830 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:10.824111 21830 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.825623 21830 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:10.827278 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.827477 21902 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:10.827966 21902 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.828630 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.829324 15194 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:10.801621 21566 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.829985 21902 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.830032 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.830350 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.832264 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:10.769810 21896 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:06:10.833683 21932 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.318s	user 0.000s	sys 0.002s
I20260709 13:06:10.645416 21711 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:10.834301 21711 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.835326 15271 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:10.660280 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2456) took 2087 ms. Trace:
I20260709 13:06:10.775988 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.835995 15196 raft_consensus.cc:2393] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:10.836784 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.781347 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.782127 15337 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:06:10.838342 15337 pending_rounds.cc:85] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 8
I20260709 13:06:10.838420 15268 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:10.781131 21892 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:10.767978 21888 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:10.769335 21610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.678s	user 0.017s	sys 0.015s
I20260709 13:06:10.800972 15346 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:10.840435 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.840557 15340 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
I20260709 13:06:10.799685 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.548116 21288 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:10.809173 15195 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 22: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:10.810776 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:10.805655 21849 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:10.655896 21307 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.684681 21881 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.838647 15337 pending_rounds.cc:107] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:06:10.859882 15337 raft_consensus.cc:2889] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.849912 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.862676 15269 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 25: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:10.863734 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.864451 15269 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:10.866099 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.866763 15268 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
W20260709 13:06:10.867841 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 57142.7us
I20260709 13:06:10.781113 15345 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3249) took 1965 ms. Trace:
I20260709 13:06:10.837877 15189 rpcz_store.cc:276] 0709 13:06:08.572533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.572735 (+   202us) service_pool.cc:224] Handling call
0709 13:06:09.326050 (+753315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.326265 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.326292 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.326334 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:09.326376 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.326435 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.660105 (+1333670us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54001a5750. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:10.660223 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1693621632}
I20260709 13:06:10.839653 21904 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:10.842756 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2471) took 1511 ms. Trace:
I20260709 13:06:10.842986 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.802482 21942 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:10.848416 15339 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2418) took 2949 ms (client timeout 3251 ms). Trace:
I20260709 13:06:10.848850 21846 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.849891 21876 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.839742 21892 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:10.853569 21916 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.713s	user 0.000s	sys 0.001s
I20260709 13:06:10.854525 21680 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.855175 21847 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.844424 21888 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:10.856324 21699 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:10.870527 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 59053.5us
I20260709 13:06:10.869295 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:10.844334 21610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.753s	user 0.017s	sys 0.015s
W20260709 13:06:10.870328 15339 rpcz_store.cc:269] 0709 13:06:07.899503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.467157 (+567654us) service_pool.cc:224] Handling call
0709 13:06:10.848219 (+2381062us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400245254. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:10.848353 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":406794112}
I20260709 13:06:10.874521 15337 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:06:10.875327 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:10.869094 15188 rpcz_store.cc:276] 0709 13:06:09.331853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.094670 (+762817us) service_pool.cc:224] Handling call
0709 13:06:10.124268 (+ 29598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.124703 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.124742 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.125281 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.348072 (+222791us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:10.348113 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.348205 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.833156 (+484951us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:10.835538 (+  2382us) raft_consensus.cc:1685] finished
0709 13:06:10.835559 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.842666 (+  7107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1197,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"spinlock_wait_cycles":6534016,"thread_start_us":222461,"threads_started":1,"wal-append.queue_time_us":366818}
I20260709 13:06:10.870726 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.879468 21904 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.880748 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.868525 15345 rpcz_store.cc:276] 0709 13:06:08.815545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.815656 (+   111us) service_pool.cc:224] Handling call
0709 13:06:08.815921 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.816118 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:08.879142 (+ 63024us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.467688 (+1588546us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b1800364c60. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:06:10.779273 (+311585us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.779445 (+   172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.779491 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:10.779533 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.779597 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.781055 (+  1458us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285618,"prepare.queue_time_us":340226,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":18794,"raft.queue_time_us":6502,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":22739,"spinlock_wait_cycles":3202944,"thread_start_us":29160,"threads_started":1,"wal-append.queue_time_us":1731365}
I20260709 13:06:10.881441 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.915450 15346 raft_consensus.cc:2376] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18. Re-sending same reply.
I20260709 13:06:10.843796 21566 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.874899 21942 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:10.915444 21855 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:06:10.925575 21566 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.926844 21926 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.929060 21926 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.930449 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:10.882218 21735 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.888222 21847 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.932065 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.933848 15337 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:10.936177 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.939467 15337 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:10.942160 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.916435 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.916436 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:10.923211 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:10.932616 21735 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.806748 21854 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.948787 21496 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.950114 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:10.950418 21854 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.950711 15189 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:10.951450 15194 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:10.933030 21923 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:10.933794 21942 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:10.899223 21896 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
W20260709 13:06:10.940142 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.942559 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.956279 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.956588 21707 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.939487 15339 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:10.895094 21699 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:10.943962 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.945037 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3254) took 1973 ms. Trace:
I20260709 13:06:10.945807 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:10.919513 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.947487 15337 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:10.947515 15346 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:10.957160 15270 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:10.972224 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.973181 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:10.958406 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.960258 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:10.964919 15338 rpcz_store.cc:276] 0709 13:06:08.972140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.972738 (+   598us) service_pool.cc:224] Handling call
0709 13:06:08.975097 (+  2359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.171753 (+1196656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.944801 (+773048us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002738d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:10.944977 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2750398848}
I20260709 13:06:10.969602 15188 raft_consensus.cc:2410] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260709 13:06:10.970276 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:10.970913 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:10.979624 15189 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:10.979373 15194 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:10.888842 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.874361 21358 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:10.941443 21456 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:06:10.985780 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.980872 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:10.912410 15162 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:10.981616 15196 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 15.
I20260709 13:06:10.987941 15189 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:10.988932 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:10.981467 15345 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:10.989679 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:11.055415 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:11.024242 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 111891us
I20260709 13:06:11.024581 15346 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:06:11.088402 15346 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:11.088337 15162 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:10.989763 15338 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:11.091353 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:11.092485 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:11.086683 15188 raft_consensus.cc:2368] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:11.085319 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.094944 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.095336 15338 raft_consensus.cc:1240] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:11.092332 15337 pending_rounds.cc:85] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 8
I20260709 13:06:11.097728 15337 pending_rounds.cc:107] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:06:11.098199 15337 raft_consensus.cc:2889] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:11.091358 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.966732 21860 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:10.965834 21443 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.104766 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:11.104780 15162 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:11.103374 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.108119 15190 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:10.964072 21795 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.964098 21886 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.957151 21942 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:10.957983 21699 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:10.966398 21790 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:10.988795 21735 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:11.111827 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:11.052146 21707 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:11.117226 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:11.112432 15345 raft_consensus.cc:1240] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:06:10.970587 21496 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.091207 21923 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:11.119140 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.010922 21849 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:10.988566 21456 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:11.125027 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.126435 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:11.107123 21902 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:11.128283 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.107182 21860 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:11.129523 15270 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:11.130210 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:11.130439 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.127002 15162 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:11.111609 21855 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:11.146407 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:11.090801 21888 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.153576 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:11.153753 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.154373 15189 raft_consensus.cc:2368] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:06:11.154407 15270 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:11.157101 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:11.120645 21735 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.128052 21707 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:11.162271 15339 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:11.164155 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:11.166168 21859 raft_consensus.cc:3055] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:11.159602 21854 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:11.168134 21707 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.190158 21859 raft_consensus.cc:740] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:11.166867 21735 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.170400 15162 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:11.152861 21855 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:11.179046 20980 raft_consensus.cc:3055] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:11.198532 20980 raft_consensus.cc:740] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:11.132186 21860 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:11.161448 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:11.194736 15190 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:11.197038 21453 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:11.197276 21859 consensus_queue.cc:260] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.199987 15270 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:11.199283 20980 consensus_queue.cc:260] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.205705 20980 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:11.201620 21453 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:11.200838 15190 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:11.200628 15162 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:11.194327 21854 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:11.192914 21824 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.202375 21855 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:11.206244 21859 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:11.209610 21453 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:11.235706 21905 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.253408 21854 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:11.169199 21923 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:11.317536 15270 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 16.
W20260709 13:06:11.360931 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.361807 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:11.362802 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 3057) took 1002 ms. Trace:
I20260709 13:06:11.363307 15270 rpcz_store.cc:276] 0709 13:06:10.360510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.361477 (+1000967us) service_pool.cc:224] Handling call
0709 13:06:11.362728 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.364590 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:11.365291 15270 raft_consensus.cc:2376] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17. Re-sending same reply.
I20260709 13:06:11.236021 21937 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:06:11.205356 21902 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.103s
I20260709 13:06:11.235903 21737 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:06:11.333072 21648 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.370074 21648 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.373003 21648 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.375442 21888 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:11.378194 21803 consensus_meta.cc:287] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.576s	user 0.003s	sys 0.006s
I20260709 13:06:11.379323 21898 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:11.380000 21898 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:11.381203 21898 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.266119 21847 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.296892 21896 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:11.384510 21896 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:11.338382 21951 log.cc:927] Time spent T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:06:11.390897 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 190330us
I20260709 13:06:11.392097 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:11.392345 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2473) took 1169 ms. Trace:
I20260709 13:06:11.392874 15191 rpcz_store.cc:276] 0709 13:06:10.223196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.223939 (+   743us) service_pool.cc:224] Handling call
0709 13:06:10.261561 (+ 37622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.488460 (+226899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.392026 (+903566us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54002116d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:11.392268 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520016768}
I20260709 13:06:11.304044 21824 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.204986 21881 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.102s
I20260709 13:06:11.347211 21849 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:11.349925 21817 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:11.350246 21846 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:11.353154 21950 log.cc:927] Time spent T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:11.352777 21453 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.198863 21456 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.393136 15162 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:11.388577 21830 consensus_meta.cc:287] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.002s
I20260709 13:06:11.399664 21937 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:11.399526 21849 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:11.400552 21817 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:11.404305 15266 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 3181) took 2582 ms (client timeout 2153 ms). Trace:
W20260709 13:06:11.414134 15266 rpcz_store.cc:269] 0709 13:06:08.822389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.016837 (+194448us) service_pool.cc:224] Handling call
0709 13:06:11.404069 (+2387232us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b54002a94d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:11.404212 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217139456}
I20260709 13:06:11.378759 21803 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.389671 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:11.416765 21120 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:11.417604 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 3056) took 1057 ms. Trace:
I20260709 13:06:11.418094 15270 rpcz_store.cc:276] 0709 13:06:10.360198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.389294 (+1029096us) service_pool.cc:224] Handling call
0709 13:06:11.417530 (+ 28236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.349697 21699 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:11.418802 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.416639 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:11.419720 15266 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:11.387171 21905 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.423288 21453 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.414273 21902 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:11.424160 21803 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.437853 15269 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:11.408808 21937 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.440747 21699 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.442174 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3285) took 1147 ms. Trace:
I20260709 13:06:11.443373 15196 raft_consensus.cc:1240] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:11.443907 15264 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:11.444249 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3044) took 2056 ms. Trace:
I20260709 13:06:11.445156 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.445564 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3040) took 2466 ms. Trace:
I20260709 13:06:11.446954 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 3524) took 1143 ms. Trace:
I20260709 13:06:11.448410 21849 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.451004 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3041) took 2468 ms. Trace:
I20260709 13:06:11.406412 21846 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.529618 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:11.643610 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 114119us
I20260709 13:06:11.644577 15271 rpcz_store.cc:276] 0709 13:06:09.388004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.220318 (+832314us) service_pool.cc:224] Handling call
0709 13:06:10.220663 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.835723 (+615060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.443996 (+608273us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54001d83d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:11.444191 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413198592}
I20260709 13:06:11.648634 15270 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:11.640237 15344 rpcz_store.cc:276] 0709 13:06:10.295100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.781774 (+486674us) service_pool.cc:224] Handling call
0709 13:06:10.781999 (+   225us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:10.782304 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.782321 (+    17us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:10.789723 (+  7402us) log.cc:844] Serialized 52 byte log entry
0709 13:06:10.948061 (+158338us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:10.949032 (+   971us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.949229 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.949302 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.441925 (+492623us) raft_consensus.cc:1685] finished
0709 13:06:11.441947 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.442111 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":468,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":12358,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":3592,"thread_start_us":116910,"threads_started":1,"wal-append.queue_time_us":380108}
I20260709 13:06:11.656499 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:11.658677 15271 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:06:11.659693 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3054) took 1358 ms. Trace:
I20260709 13:06:11.660211 15271 rpcz_store.cc:276] 0709 13:06:10.300946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.657799 (+1356853us) service_pool.cc:224] Handling call
0709 13:06:11.658251 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.659354 (+  1103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.659621 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.662318 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 565) took 1126 ms. Trace:
W20260709 13:06:11.570827 21957 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 13:06:11.499837 21956 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:06:11.664269 15271 rpcz_store.cc:276] 0709 13:06:10.535914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.661290 (+1125376us) service_pool.cc:224] Handling call
0709 13:06:11.661670 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.661894 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.661931 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.661988 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:11.662033 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.662103 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.662253 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.651933 21734 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:11.649406 21937 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:11.468530 21896 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:11.470897 21623 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.645725 21711 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.465972 21824 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.451653 21443 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.248s
I20260709 13:06:11.676762 21905 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.663841 21830 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:11.664188 21648 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:11.569073 21860 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:11.657230 21902 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:11.548360 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.692127 21888 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:11.701781 21648 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.702103 21830 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.735821 21902 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.715533 21888 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.528604 21710 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:11.744066 21702 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:11.754364 21702 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:11.765877 21892 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.796557 21737 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:11.797235 21737 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:11.799786 21711 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:11.800292 21711 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:11.719919 21855 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.803020 21817 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:11.803656 21962 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.084s	user 0.001s	sys 0.001s
I20260709 13:06:11.805879 21888 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:11.818866 21964 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.096s	user 0.000s	sys 0.004s
I20260709 13:06:11.810983 21830 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.812261 21823 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.812814 21860 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:11.822332 21894 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:11.824968 21711 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.826457 21711 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:11.798319 21737 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:11.832106 21737 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:11.836119 21855 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.783500 21846 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:11.845769 21937 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.848740 21937 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:11.903149 15190 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.011s
W20260709 13:06:11.904316 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.904320 15190 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.003s	sys 0.012s
I20260709 13:06:11.911474 15190 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2488) took 1058 ms. Trace:
W20260709 13:06:11.912679 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.912808 15193 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:11.915252 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2451) took 3443 ms. Trace:
I20260709 13:06:11.915769 15197 rpcz_store.cc:276] 0709 13:06:08.472113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.472264 (+   151us) service_pool.cc:224] Handling call
0709 13:06:08.472685 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.472972 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.473014 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.320031 (+2847017us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b2c00000f48. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:06:11.320569 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.504566 (+183997us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:11.504622 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.504734 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.914484 (+409750us) raft_consensus.cc:1685] finished
0709 13:06:11.914544 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.915017 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28056448,"thread_start_us":181080,"threads_started":1,"wal-append.queue_time_us":380969}
I20260709 13:06:11.917949 15267 rpcz_store.cc:276] 0709 13:06:08.982370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.066264 (+1083894us) service_pool.cc:224] Handling call
0709 13:06:10.155322 (+ 89058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.357943 (+202621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.449858 (+1091915us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54000d7354. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:11.450761 (+   903us) spinlock_profiling.cc:243] Waited 88.7 ms on lock 0x7b54000d7350. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:11.450931 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":660895232}
W20260709 13:06:11.921466 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.922003 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3206) took 1267 ms. Trace:
I20260709 13:06:11.922863 15267 rpcz_store.cc:276] 0709 13:06:10.654191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.920031 (+1265840us) service_pool.cc:224] Handling call
0709 13:06:11.920900 (+   869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.921491 (+   591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.921526 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.921609 (+    83us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:11.921695 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.921783 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.921902 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.627941 15266 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:11.580835 15265 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:11.910791 15194 rpcz_store.cc:276] 0709 13:06:10.303435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.830974 (+527539us) service_pool.cc:224] Handling call
0709 13:06:11.446729 (+615755us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54000c0dd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:11.446872 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272666368}
I20260709 13:06:11.926177 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3053) took 1647 ms. Trace:
I20260709 13:06:11.926633 15265 rpcz_store.cc:276] 0709 13:06:10.278401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.578782 (+1300381us) service_pool.cc:224] Handling call
0709 13:06:11.579195 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.925463 (+346268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.925930 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.927165 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 566) took 1210 ms. Trace:
I20260709 13:06:11.927270 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 3546) took 1103 ms. Trace:
I20260709 13:06:11.928434 15265 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:11.922034 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.929169 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 567) took 1159 ms. Trace:
I20260709 13:06:11.929502 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3208) took 1259 ms. Trace:
I20260709 13:06:11.927996 15193 rpcz_store.cc:276] 0709 13:06:10.823975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.878380 (+ 54405us) service_pool.cc:224] Handling call
0709 13:06:11.926957 (+1048577us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54000c12d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:11.927190 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292182784}
I20260709 13:06:11.930076 15267 rpcz_store.cc:276] 0709 13:06:10.669710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.928072 (+1258362us) service_pool.cc:224] Handling call
0709 13:06:11.928649 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.929082 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.929109 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.929162 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:11.929275 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.929324 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.929438 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.980988 15267 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3070) took 1031 ms. Trace:
I20260709 13:06:11.938982 15270 raft_consensus.cc:1240] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: [20.11-21.12]
I20260709 13:06:11.939841 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:11.695205 15272 rpcz_store.cc:276] 0709 13:06:08.979506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.254536 (+275030us) service_pool.cc:224] Handling call
0709 13:06:09.254801 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.098753 (+843952us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:10.342726 (+243973us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.473818 (+131092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.473924 (+   106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:10.474001 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.958474 (+484473us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b18002f0d40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:06:11.445354 (+486880us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400088754. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:11.445399 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.445509 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25797,"prepare.queue_time_us":380928,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":26084,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6440,"spinlock_wait_cycles":1961416192,"thread_start_us":327322,"threads_started":2,"wal-append.queue_time_us":190939}
I20260709 13:06:11.912038 15190 rpcz_store.cc:276] 0709 13:06:10.853384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.214382 (+360998us) service_pool.cc:224] Handling call
0709 13:06:11.304978 (+ 90596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.305202 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:11.305225 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.310421 (+  5196us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.790911 (+480490us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:11.910350 (+119439us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:11.910514 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.910703 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.910809 (+   106us) raft_consensus.cc:1685] finished
0709 13:06:11.910841 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.911341 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3544960,"thread_start_us":513163,"threads_started":1,"wal-append.queue_time_us":391709}
I20260709 13:06:11.946038 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:12.028139 21859 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.028776 21737 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:12.028867 21859 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.029641 21288 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:12.029964 21737 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:12.028972 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.031309 21699 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.032013 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.032404 15188 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3527) took 1724 ms. Trace:
I20260709 13:06:12.032323 21699 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.949841 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:11.948210 15269 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 3207) took 1279 ms. Trace:
W20260709 13:06:11.946079 15264 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 3063) took 1277 ms (client timeout 1692 ms). Trace:
I20260709 13:06:11.957500 15337 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2436) took 1086 ms. Trace:
I20260709 13:06:12.033272 15188 rpcz_store.cc:276] 0709 13:06:10.307537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.196462 (+888925us) service_pool.cc:224] Handling call
0709 13:06:11.197731 (+  1269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.197929 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:11.452223 (+254294us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.031614 (+579391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.031715 (+   101us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:12.031816 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.031931 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.032208 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122499,"prepare.queue_time_us":501072,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"thread_start_us":710065,"threads_started":2,"wal-append.queue_time_us":292086}
W20260709 13:06:12.034619 15264 rpcz_store.cc:269] 0709 13:06:10.668055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.804410 (+136355us) service_pool.cc:224] Handling call
0709 13:06:11.945590 (+1141180us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54001d92d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:11.945830 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1469062016}
W20260709 13:06:11.959852 15263 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45870 (request call id 3064) took 1291 ms (client timeout 1617 ms). Trace:
I20260709 13:06:11.961310 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.035682 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.036288 15339 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.036983 15190 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
W20260709 13:06:11.962067 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.038892 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.962451 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.039935 15341 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
I20260709 13:06:12.044030 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3059) took 1497 ms. Trace:
I20260709 13:06:12.045239 21702 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:11.967856 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48112 (request call id 452) took 2986 ms. Trace:
I20260709 13:06:12.047196 20980 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:12.045881 15343 rpcz_store.cc:276] 0709 13:06:08.981325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.981436 (+   111us) service_pool.cc:224] Handling call
0709 13:06:08.981759 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.114859 (+133100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.114900 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.115519 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.255465 (+139946us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:11.448889 (+2193424us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18001d67a0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e91053c7 00007f36e57179a7 00007f36e57270bf
0709 13:06:11.449067 (+   178us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.743937 (+294870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.744706 (+   769us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.744756 (+    50us) raft_consensus.cc:1685] finished
0709 13:06:11.967244 (+222488us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.967620 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12021,"prepare.queue_time_us":57725,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":5562,"raft.queue_time_us":75279,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":15814,"spinlock_wait_cycles":47295744,"thread_start_us":622950,"threads_started":4,"wal-append.queue_time_us":550396,"wal-append.run_cpu_time_us":8535,"wal-append.run_wall_time_us":1113840}
I20260709 13:06:12.047967 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:12.048237 21859 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.968793 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.049484 15344 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:11.971463 15340 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:11.972920 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.047969 20980 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.051968 15338 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:11.974206 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.053818 20980 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.953775 15238 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:11.929577 15265 rpcz_store.cc:276] 0709 13:06:10.769920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.927635 (+1157715us) service_pool.cc:224] Handling call
0709 13:06:11.928100 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.928925 (+   825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.929119 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:11.864873 21854 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:11.927899 15266 rpcz_store.cc:276] 0709 13:06:10.716471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.925475 (+1209004us) service_pool.cc:224] Handling call
0709 13:06:11.926134 (+   659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.926664 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.926696 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.926753 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:11.926784 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.926837 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.926954 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:12.056866 15189 raft_consensus.cc:1240] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:11.995282 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:12.058344 21854 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:11.992774 15841 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:12.058799 21699 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.003757 21710 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.059540 21763 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:12.060894 21763 raft_consensus.cc:2804] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:06:12.060338 21942 consensus_queue.cc:1175] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" responder_term: 20 status { last_received { term: 19 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:12.061710 21763 raft_consensus.cc:697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:06:12.059581 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67329.7us
I20260709 13:06:12.063990 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:12.064909 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 64340.6us
W20260709 13:06:12.035730 15263 rpcz_store.cc:269] 0709 13:06:10.668342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.799100 (+130758us) service_pool.cc:224] Handling call
0709 13:06:11.959381 (+1160281us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003291d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:11.959654 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740194048}
I20260709 13:06:12.067211 15193 raft_consensus.cc:1240] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:12.067981 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:12.069001 15194 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:12.044512 15271 rpcz_store.cc:276] 0709 13:06:10.547062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.677253 (+1130191us) service_pool.cc:224] Handling call
0709 13:06:11.677740 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.678268 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:11.678310 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.678904 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.043416 (+364512us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:12.043480 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.043605 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.043654 (+    49us) raft_consensus.cc:1685] finished
0709 13:06:12.043671 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.043863 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":363971,"threads_started":1,"wal-append.queue_time_us":325753}
I20260709 13:06:12.078101 21648 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:12.023255 21696 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:12.024309 15268 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:12.025329 21803 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.025265 21790 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:12.026170 21860 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:12.055534 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 102088us
I20260709 13:06:11.999315 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:12.059739 21699 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:12.087194 21803 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.087733 21699 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.072335 21517 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:12.088322 21699 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.088697 15238 leader_election.cc:400] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:12.088979 21517 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:12.089497 21517 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:12.090005 21803 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:12.014038 15191 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.012s	sys 0.003s
I20260709 13:06:12.075354 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:12.091296 15268 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45862 (request call id 3202) took 1600 ms. Trace:
I20260709 13:06:12.091784 15194 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 21: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:12.034545 15269 rpcz_store.cc:276] 0709 13:06:10.669360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.867946 (+198586us) service_pool.cc:224] Handling call
0709 13:06:11.947715 (+1079769us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54000d7854. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:11.947946 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1212957440}
I20260709 13:06:12.076725 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.017350 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:12.056885 21737 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.080031 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.081151 15188 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:12.008636 15267 rpcz_store.cc:276] 0709 13:06:10.949384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.979470 (+1030086us) service_pool.cc:224] Handling call
0709 13:06:11.980005 (+   535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.980461 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.980502 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.980589 (+    87us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:11.980651 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.980727 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.980898 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:12.081730 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 132327us
I20260709 13:06:12.087105 21860 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.074175 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:12.095328 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.091332 15191 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.013s	sys 0.003s
I20260709 13:06:12.086943 21696 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.091228 21790 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.096674 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:12.078393 21763 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.098357 21696 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:12.091794 15268 rpcz_store.cc:276] 0709 13:06:10.482165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.939115 (+1456950us) service_pool.cc:224] Handling call
0709 13:06:12.082795 (+143680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:12.098927 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.035223 15337 rpcz_store.cc:276] 0709 13:06:10.871309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.989932 (+118623us) service_pool.cc:224] Handling call
0709 13:06:11.092131 (+102199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.103570 (+ 11439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.103626 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.104457 (+   831us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.297451 (+192994us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:11.297494 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.297565 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.708974 (+411409us) raft_consensus.cc:1685] finished
0709 13:06:11.956826 (+247852us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.957234 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":186727,"threads_started":1,"wal-append.queue_time_us":301161}
I20260709 13:06:12.090731 21517 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.100354 15196 raft_consensus.cc:1275] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:06:12.100749 15196 pending_rounds.cc:85] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 14
I20260709 13:06:12.100697 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3203) took 1618 ms. Trace:
I20260709 13:06:12.101219 15196 pending_rounds.cc:107] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:06:12.101325 21517 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.101727 15270 rpcz_store.cc:276] 0709 13:06:10.482497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.652872 (+1170375us) service_pool.cc:224] Handling call
0709 13:06:11.938253 (+285381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:12.020300 (+ 82047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.100476 (+ 80176us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400329bd0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:12.100632 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654828800}
I20260709 13:06:12.090742 15238 leader_election.cc:400] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:06:12.103451 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:12.104318 15192 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.105976 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:12.081920 15162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.002s	sys 0.010s
I20260709 13:06:12.099005 15193 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:12.108065 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.109091 21860 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.109261 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.110461 21860 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:12.091204 21702 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.097582 15194 raft_consensus.cc:2368] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:06:12.111598 21851 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:12.102555 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.112735 21696 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:12.113047 15197 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
I20260709 13:06:12.113579 21851 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:12.114003 21851 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:12.111548 21702 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.098400 21790 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.101660 15196 raft_consensus.cc:2889] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:12.115955 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 129580us
I20260709 13:06:12.117830 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.114391 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:12.118675 15194 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:12.118680 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.117424 21851 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.120671 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.120978 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.121431 15197 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:12.121992 21702 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:12.122607 21851 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.122831 15197 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:06:12.122948 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.124648 15090 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 9 to 13, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 13 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.118896 21710 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:12.127424 15162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.003s	sys 0.010s
I20260709 13:06:12.127601 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:12.128386 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 712196us
I20260709 13:06:12.129252 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.129595 21456 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:12.130398 21702 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:12.131261 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.130836 21702 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.134246 21702 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:12.139065 21911 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:12.142982 15342 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:06:12.115106 21860 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:12.146924 21120 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:12.147017 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:12.147490 21120 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:12.148524 21120 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.148763 21860 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.136083 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.153533 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2490) took 1222 ms. Trace:
I20260709 13:06:12.154135 15189 rpcz_store.cc:276] 0709 13:06:10.930758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.304928 (+374170us) service_pool.cc:224] Handling call
0709 13:06:11.305145 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.057457 (+752312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.153238 (+ 95781us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54000c03d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:12.153464 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727839104}
I20260709 13:06:12.156231 21648 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:12.156455 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:12.136835 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.128389 21288 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:12.159252 21288 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:12.160732 21288 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.167085 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.168022 15337 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:12.185181 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 498) took 1218 ms. Trace:
I20260709 13:06:12.187680 15339 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:12.187773 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.188519 15346 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:12.191766 21803 consensus_queue.cc:1059] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:12.192976 21790 raft_consensus.cc:3055] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:12.193372 21790 raft_consensus.cc:740] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:12.194638 21790 consensus_queue.cc:260] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.197880 21120 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:12.208978 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.209937 15339 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:12.213465 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.214140 15338 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:12.214799 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:12.215986 21734 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:12.216240 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.216681 21734 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.220264 21734 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:12.217262 15338 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:06:12.221118 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.222937 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.204777 15090 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 20 to 23, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 23 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.225342 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.226548 21648 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:12.227172 21648 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:12.228257 21648 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.187049 15191 rpcz_store.cc:276] 0709 13:06:10.967079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.394445 (+427366us) service_pool.cc:224] Handling call
0709 13:06:11.407838 (+ 13393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.408027 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:06:12.096879 (+688852us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.184131 (+ 87252us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.184657 (+   526us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.184738 (+    81us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:12.184823 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.184920 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.185101 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":297374,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":79,"raft.queue_time_us":1464,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":196,"thread_start_us":764649,"threads_started":2,"wal-append.queue_time_us":84925}
I20260709 13:06:12.233150 21702 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.235110 15339 raft_consensus.cc:2368] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23.
I20260709 13:06:12.226663 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.241873 15337 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
W20260709 13:06:12.254633 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48267us
I20260709 13:06:12.259662 15090 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 24 to 27, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 27 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.259639 21702 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:12.262315 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.261760 15090 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index -1 to 10, term changed from 14 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to <none>, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 15 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:12.264063 15090 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 17 to 19, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.266623 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.266307 15090 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 15 to 17, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 17 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.267817 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:06:12.267961 15160 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Timed out: RequestConsensusVote RPC to 127.13.181.2:41191 timed out after 1.906s (SENT)
I20260709 13:06:12.268574 15090 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.280958 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:12.282704 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56200.9us
I20260709 13:06:12.284200 15342 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:12.285168 15192 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:12.287060 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.287499 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:12.288650 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.290254 20980 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:12.290747 20980 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:12.308715 20980 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:12.309612 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.312760 21699 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.315315 21790 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:12.316440 15090 catalog_manager.cc:5697] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 12 to 19, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.319986 15090 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 10 to 19, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.326406 15090 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.328644 15090 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 23 to 26, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 26 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.331975 15090 catalog_manager.cc:5697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 9 to 21, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.333578 15090 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.335947 15090 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 16 to 17, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.338979 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:12.339395 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.340148 15341 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:12.340548 21896 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:12.342782 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.343763 15339 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 24: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:12.340318 15090 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 15 to 20, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 20 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.344688 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.345034 15090 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 16 to 22, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 22 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.346505 15090 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 15 to 16, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:06:12.325212 15094 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 172) took 20167 ms (client timeout 15000 ms). Trace:
W20260709 13:06:12.347308 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.327293 21846 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:12.323495 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:12.355299 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 66371us
I20260709 13:06:12.360742 15346 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:12.360075 21846 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.378397 21120 consensus_queue.cc:1059] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:12.379530 21120 raft_consensus.cc:3055] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:12.380126 21120 raft_consensus.cc:740] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:12.381095 21120 consensus_queue.cc:260] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.363901 21699 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.379505 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:12.376355 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 88999.5us
I20260709 13:06:12.395539 20980 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.399751 15346 raft_consensus.cc:1240] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
W20260709 13:06:12.356247 15094 rpcz_store.cc:269] 0709 13:05:52.157477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.159538 (+  2061us) service_pool.cc:224] Handling call
0709 13:06:12.324921 (+20165383us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:03.528761 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:03.529308 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:03.529369 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:06:03.529385 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:03.590223 (+ 60838us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:03.590310 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:03.590338 (+    28us) tablet.cc:685] Acquiring locks for 31 operations
0709 13:06:03.592520 (+  2182us) tablet.cc:701] Row locks acquired
0709 13:06:03.592563 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:06:03.592748 (+   185us) write_op.cc:270] Start()
0709 13:06:03.592904 (+   156us) write_op.cc:276] Timestamp: P: 1783602363592681 usec, L: 0
0709 13:06:03.592937 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:06:03.651261 (+ 58324us) log.cc:844] Serialized 12141 byte log entry
0709 13:06:04.500525 (+849264us) op_driver.cc:464] REPLICATION: finished
0709 13:06:04.767231 (+266706us) write_op.cc:301] APPLY: starting
0709 13:06:04.767353 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:06.106756 (+1339403us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:06.106883 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:07.522146 (+1415263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:07.567439 (+ 45293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=62,key_file_lookups=62,delta_file_lookups=62,mrs_lookups=0
0709 13:06:07.567509 (+    70us) write_op.cc:312] APPLY: finished
0709 13:06:07.568145 (+   636us) log.cc:844] Serialized 267 byte log entry
0709 13:06:07.651213 (+ 83068us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:07.707883 (+ 56670us) write_op.cc:454] Released schema lock
0709 13:06:07.756345 (+ 48462us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:07.902421 (+146076us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:07.905259 (+  2838us) write_op.cc:454] Released schema lock
0709 13:06:08.495072 (+589813us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
Metrics: {"mutex_wait_us":8046,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":238652,"apply.run_cpu_time_us":74950,"apply.run_wall_time_us":3088203,"cfile_cache_hit":126,"cfile_cache_hit_bytes":133893,"num_ops":31,"prepare.queue_time_us":306655,"prepare.run_cpu_time_us":18781,"prepare.run_wall_time_us":282563,"raft.queue_time_us":56212,"raft.run_cpu_time_us":18991,"raft.run_wall_time_us":176720,"replication_time_us":904570,"spinlock_wait_cycles":24936960,"thread_start_us":508866,"threads_started":5,"wal-append.queue_time_us":354060,"wal-append.run_cpu_time_us":39933,"wal-append.run_wall_time_us":3475652}]]}
I20260709 13:06:12.403815 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.404247 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.408614 15162 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.404247 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.406952 15341 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:12.411118 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:12.411542 21120 raft_consensus.cc:3060] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:12.404528 21648 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:12.416062 21648 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.416530 21648 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.382099 21846 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.412487 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:12.419976 21655 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:12.420459 21655 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:12.420830 21655 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:12.421176 21803 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:12.421687 21803 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.422091 21803 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:12.423221 21456 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:12.423642 21456 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.423969 21456 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:12.428499 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:12.405526 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.428562 15238 leader_election.cc:400] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:06:12.432227 15238 leader_election.cc:403] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:06:12.434336 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.433995 21288 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:12.437541 21288 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.437983 21288 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:12.436453 15090 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.448433 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.452361 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.456477 20980 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.448498 21699 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:06:12.461669 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.472558 21120 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.476761 21120 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:12.477849 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.478751 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.491551 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 79170.5us
I20260709 13:06:12.491845 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:12.496786 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.451843 21896 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:12.449751 21860 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:12.498618 15090 catalog_manager.cc:5697] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 9 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.498668 15341 raft_consensus.cc:2368] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:12.502344 21120 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.503903 21823 consensus_queue.cc:1048] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:06:12.511566 15090 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:12.513433 15090 catalog_manager.cc:5697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.496177 21517 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:12.496558 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.523306 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.531924 15237 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:12.532137 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.535610 15340 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:12.519999 21702 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:06:12.544245 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 82768us
I20260709 13:06:12.539788 15162 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.537245 21699 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:12.543587 15876 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:12.551167 20980 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:12.537837 15090 catalog_manager.cc:5697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 14 to 15, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 15 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.539461 21702 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.559257 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.545872 21456 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.564949 21823 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:12.565248 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.572985 21458 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:12.573381 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:12.574432 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 76054.9us
I20260709 13:06:12.577826 21846 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.537807 21655 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:12.589358 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 58834.8us
I20260709 13:06:12.570044 21702 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:12.593103 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.595706 15341 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:12.602264 20980 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:12.602731 20980 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:12.603516 20980 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:12.598435 21846 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:12.605471 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.603390 15238 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.584266 21823 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.608071 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.532140 21696 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:06:12.616873 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.620806 20980 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.600332 15090 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 10 to 20. New cstate: current_term: 20 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.629139 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:12.630100 15188 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.634811 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.635962 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:12.637068 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.616658 21823 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:12.645362 21696 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:06:12.648765 15339 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:12.649145 21610 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.650188 15090 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 14 to 22, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 22 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.641299 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:12.616398 21860 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:12.653350 15194 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:06:12.648450 15237 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:12.659734 20980 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.656651 15340 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:12.572139 21905 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 13:06:12.612689 21458 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:12.632925 21846 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:12.647467 21655 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.650242 21711 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:06:12.696235 20980 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:12.699183 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 61293.8us
I20260709 13:06:12.696660 15090 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.693495 21896 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
W20260709 13:06:12.724117 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 454784us
I20260709 13:06:12.664350 21610 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.748868 21610 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:12.750509 21610 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:12.702370 21860 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:12.755100 21860 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:12.755510 21860 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:12.759172 15162 leader_election.cc:400] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23.
I20260709 13:06:12.759613 15162 leader_election.cc:403] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:12.759519 21458 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:12.760217 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 52547.5us
I20260709 13:06:12.762029 15162 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:12.697990 21517 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:12.697618 21790 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:12.768371 20980 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.743810 15090 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 12 to 21. New cstate: current_term: 21 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:12.771701 21517 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.773032 21711 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:12.773768 21711 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:12.776064 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110020us
I20260709 13:06:12.780074 21456 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.781656 15090 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
W20260709 13:06:12.778829 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.792157 21990 log.cc:927] Time spent T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:06:12.806192 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.807796 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.774839 21711 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.819973 15345 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:12.820315 20980 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:12.768716 21790 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:12.703805 21288 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.825234 15090 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 16 to 17, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.833752 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.835199 15339 raft_consensus.cc:2410] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 10.
I20260709 13:06:12.836086 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.837486 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:12.850968 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.873070 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.841413 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.766551 21610 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:12.830793 15090 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:12.826591 21790 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.885077 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.889822 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:12.893440 15342 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 26: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:12.816321 21803 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.898254 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:12.898703 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.907783 15339 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
W20260709 13:06:12.903913 22001 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:06:12.905241 21997 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:06:12.900302 15344 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 27.
I20260709 13:06:12.910867 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:12.919642 15345 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:06:12.833189 21648 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:12.922935 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 314997us
I20260709 13:06:12.925688 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:12.927368 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:12.928145 15267 raft_consensus.cc:2368] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:12.940513 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:12.924608 15090 catalog_manager.cc:5697] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 20 to 21, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:12.944695 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 296344us
I20260709 13:06:12.946053 15267 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:12.946363 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:12.949584 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:12.950075 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:12.951362 15271 raft_consensus.cc:1240] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:12.960681 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:12.948225 21846 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:12.966485 21846 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:12.963822 15237 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:12.975210 21998 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:06:12.980129 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:12.981351 15267 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:12.983655 15194 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
W20260709 13:06:12.991703 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.983757 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.002436 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:12.958686 21699 consensus_queue.cc:1059] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:06:13.004360 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.005192 15270 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:13.019100 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.026490 15188 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
W20260709 13:06:13.033349 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 271412us
I20260709 13:06:12.957975 21905 consensus_queue.cc:1059] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:06:12.984730 21737 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23.
I20260709 13:06:13.043467 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:13.024837 21517 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.044955 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.045706 15267 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:12.995388 21823 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.048134 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.048403 21648 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:13.054284 20980 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:06:13.056644 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 98034us
I20260709 13:06:13.061691 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.066653 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.072211 15270 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:06:13.072175 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.059763 21288 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:13.057955 22000 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:13.089797 15269 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:13.089010 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:13.094796 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:13.095803 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 81411.3us
W20260709 13:06:13.096617 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 116793us
I20260709 13:06:13.117874 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.118022 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.121773 15269 raft_consensus.cc:2393] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:13.125064 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 153590us
I20260709 13:06:13.136389 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.138209 21823 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:13.141202 22007 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.141853 22007 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.142495 21876 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:13.164057 21876 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:13.144467 22007 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.149756 21803 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.150961 21610 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:13.161932 22006 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:13.168329 22006 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.171075 22006 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.177665 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:13.178390 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48022us
I20260709 13:06:13.180740 15266 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 22: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:13.111956 21702 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.185087 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:13.165158 21876 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:13.190034 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 123149us
I20260709 13:06:13.192106 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.193317 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.196097 15266 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:13.173882 21790 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.213922 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.195232 21711 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:13.221182 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:13.222805 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:13.227135 21702 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:13.227672 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:13.236761 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60465.1us
I20260709 13:06:13.239641 21120 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:13.243350 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.243289 15312 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:13.247920 15312 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:13.253700 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:13.254359 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.254678 15196 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:13.255582 15266 raft_consensus.cc:2410] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:06:13.246868 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:13.256718 15188 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:06:13.255237 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 191954us
I20260709 13:06:13.241667 21876 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:13.259096 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.258601 15191 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:13.260818 21458 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:13.259536 21790 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.264695 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:13.219471 22022 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:06:13.242072 21851 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:13.266727 15269 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:13.270179 15189 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:13.258941 22020 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:13.263017 22027 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:13.263437 21846 raft_consensus.cc:2804] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:13.309624 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.265235 21702 raft_consensus.cc:2804] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:13.244041 21517 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:06:13.278779 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55109us
I20260709 13:06:13.288450 22028 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:13.267534 21458 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:06:13.331604 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64725.7us
W20260709 13:06:13.296957 22017 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:06:13.277540 22027 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:13.299405 21860 consensus_meta.cc:287] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.008s
I20260709 13:06:13.269551 21851 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:13.303721 20980 raft_consensus.cc:3055] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:06:13.302024 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 115315us
I20260709 13:06:13.308192 15191 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:13.308823 15268 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:13.310117 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:13.319162 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.327196 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62899us
I20260709 13:06:13.319746 15269 raft_consensus.cc:2376] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23. Re-sending same reply.
I20260709 13:06:13.346990 15266 raft_consensus.cc:2368] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20.
I20260709 13:06:13.345508 20980 raft_consensus.cc:740] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:13.349463 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.350150 15265 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:13.350666 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:13.351393 15189 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:13.350135 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:13.331663 22028 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:13.342089 21458 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:13.355772 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:13.354152 15876 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEARNER]: Advancing to term 16
I20260709 13:06:13.343170 21702 raft_consensus.cc:697] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:13.342597 21790 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.371553 21790 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.374380 21790 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.344015 22027 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:13.375525 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.376163 15266 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:13.348769 21851 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:13.356590 22019 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:06:13.353591 20980 consensus_queue.cc:260] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.342106 21846 raft_consensus.cc:697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:13.363387 22026 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.345254 21711 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:13.384832 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:13.346251 21860 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.365883 22028 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.362517 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:13.387287 21702 consensus_queue.cc:237] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.381328 21905 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.389402 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.391798 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.392231 15271 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:13.392102 21905 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.390125 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.393175 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.393168 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.362058 22020 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:13.391413 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.393976 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.395439 15263 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:13.395668 15267 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:13.395294 22026 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.392539 15265 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:13.396975 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.397593 15266 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:13.397624 22026 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.399091 21846 consensus_queue.cc:237] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.391355 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.401206 15264 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 27.
W20260709 13:06:13.402347 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 50684.6us
I20260709 13:06:13.392287 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.403230 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.404500 20980 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:13.393960 15272 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:13.404506 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.411851 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:13.427666 22023 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:13.429179 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.431288 15272 raft_consensus.cc:3060] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:13.429914 21711 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:13.432322 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69996.4us
I20260709 13:06:13.432490 22022 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:13.433246 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.434440 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:13.435614 22019 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:13.435897 21610 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:13.394857 22020 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:13.436342 21610 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:13.436775 21610 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:13.437255 22015 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.436964 22020 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.437778 22015 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:13.394454 21905 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.431598 21860 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.442582 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.443475 22028 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:13.452641 15272 raft_consensus.cc:2468] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:13.451536 21456 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:13.432330 15270 raft_consensus.cc:2393] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 14: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:13.429109 22033 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:13.471558 15876 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:13.475663 15191 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:13.467309 15196 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:13.478794 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:13.488709 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.429733 22014 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:06:13.491581 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.501789 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 146365us
I20260709 13:06:13.507016 21790 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:06:13.507858 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65353.2us
I20260709 13:06:13.508530 21790 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:13.508652 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.509078 21790 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.509931 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:13.511224 21456 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:13.511940 21456 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:13.512166 21790 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.512418 21456 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:13.512837 21456 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:13.472869 22033 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:06:13.527467 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.582360 15162 leader_election.cc:400] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:13.583398 15162 leader_election.cc:403] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:06:13.562141 15189 raft_consensus.cc:2468] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:13.585222 20980 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.585803 20980 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.490797 22025 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:13.501444 21702 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:06:13.595355 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47224.4us
I20260709 13:06:13.499967 22014 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:13.536932 22015 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.585018 22033 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:13.530490 21876 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:13.604285 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.605080 15312 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:13.607897 21702 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:06:13.613027 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 102005us
I20260709 13:06:13.523795 21610 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.522761 21458 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:13.608155 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 173757us
I20260709 13:06:13.606290 20980 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.604489 22014 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:13.518955 22027 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.618158 21823 raft_consensus.cc:2804] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:13.624984 22034 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:13.625005 21823 raft_consensus.cc:697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:13.612215 22021 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:13.616104 22015 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.611111 21702 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:13.600057 22025 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.607993 22000 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:06:13.613241 21851 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:13.638693 15188 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:13.615020 21876 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.642366 21120 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:13.650688 20980 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:13.651312 20980 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:13.635748 22015 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.659512 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.663537 20980 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:13.636653 21711 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:06:13.667377 21846 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:13.670434 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:13.671149 15869 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:13.644598 22029 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:06:13.673744 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:13.648569 21823 consensus_queue.cc:237] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.680936 20980 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:13.682255 20980 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:13.682610 20980 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:13.681187 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49535us
I20260709 13:06:13.695577 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:13.714124 20980 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:13.716974 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.718710 22015 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.737377 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:13.735816 20980 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:13.735816 15160 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:13.744690 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 96826us
I20260709 13:06:13.715564 21458 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:13.736213 22015 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:13.741906 21610 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:13.736378 22030 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 13:06:13.757051 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.759106 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:13.761914 21876 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:13.778868 22042 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 13:06:13.782397 22043 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:06:13.819610 22025 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:13.820282 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.820942 21851 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:13.823320 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 87605us
I20260709 13:06:13.760159 22027 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:13.760489 21711 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:06:13.831106 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 79124.3us
I20260709 13:06:13.834491 15869 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:13.835520 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:13.906626 15270 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:13.837320 22036 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.250s	user 0.001s	sys 0.003s
I20260709 13:06:13.837689 22000 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:13.839565 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:13.840153 22027 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:13.840747 21711 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:13.842250 21846 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:06:13.833061 15238 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.724s (SENT) [suppressed 27 similar messages]
W20260709 13:06:13.913676 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80642.3us
I20260709 13:06:13.851251 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:13.850085 21655 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.863826 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:13.915499 15337 raft_consensus.cc:2393] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 18: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:13.866959 15345 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:13.868357 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:13.888837 21456 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:13.908685 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.858428 22033 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:13.923373 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:13.924607 15344 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:06:13.828019 22014 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:13.928961 15343 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:13.910678 22000 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:13.945732 15189 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:13.958892 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:13.960350 15345 raft_consensus.cc:1240] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:13.961953 15339 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:13.927862 22028 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:13.964382 15344 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
W20260709 13:06:13.974000 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 103943us
I20260709 13:06:13.976521 21790 raft_consensus.cc:1064] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:06:13.977133 21790 raft_consensus.cc:1068] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:13.977336 15237 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:13.981756 21860 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:13.982484 21860 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:13.983839 21860 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:13.955071 22000 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:13.998318 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:14.012027 15270 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:06:13.927181 21655 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:14.020622 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:14.033267 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 193790us
W20260709 13:06:14.037266 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 281794us
W20260709 13:06:14.045863 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 186800us
W20260709 13:06:14.028836 22001 log.cc:927] Time spent T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:14.055881 22014 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:14.056749 22014 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:14.057160 22014 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:14.058112 22014 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.060055 21763 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:14.060644 21763 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:14.061508 21763 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:14.064316 22033 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:14.068431 21655 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:14.021582 21711 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.074560 21456 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:14.078974 22025 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.080005 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.079744 22025 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:14.081449 15160 leader_election.cc:400] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:14.083957 22025 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:14.084546 21458 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:14.097862 22000 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.099066 22014 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:14.082321 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:14.100450 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.102885 15869 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:14.132218 21456 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:14.135459 21456 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:14.137658 21456 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:14.142586 22033 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.143217 22033 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.145385 22033 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:14.145891 22033 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:14.147392 22028 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:14.149768 15162 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:14.153139 22023 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:14.153597 22023 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.153935 22023 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:14.160763 22048 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:14.163408 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 81168.5us
I20260709 13:06:14.164142 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.166189 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:14.162839 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:14.174578 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 72824.5us
I20260709 13:06:14.185561 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:14.175926 21846 raft_consensus.cc:2764] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:06:14.178814 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:14.189090 15339 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:14.190519 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:14.186640 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 127419us
I20260709 13:06:14.193588 15162 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:14.197060 15342 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:14.198068 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:14.183884 22048 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:14.202358 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.202433 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:14.203184 15869 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:14.185385 21456 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:14.205826 21456 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.206331 21456 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:14.212766 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.200245 21655 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:14.216281 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:14.199165 22028 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:14.223884 22068 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:06:14.228596 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:14.228847 21655 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:14.229215 15339 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:14.229768 21655 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:14.235101 22048 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:14.237345 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.244237 15160 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:14.245244 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:14.245442 21120 consensus_queue.cc:1059] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:14.225983 22033 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:06:14.259370 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.267673 15189 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:14.227090 22028 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:14.306510 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62327.9us
I20260709 13:06:14.311179 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:14.315711 15194 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:06:14.316926 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:14.319631 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 53625.5us
I20260709 13:06:14.320638 21120 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:06:14.321192 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83919.7us
I20260709 13:06:14.321910 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.331818 15194 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:14.334892 15188 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:14.305725 22028 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:14.308132 21711 raft_consensus.cc:3055] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:14.340590 15196 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:14.313405 22054 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:14.342329 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.245096 22048 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:06:14.347250 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.366077 15190 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:06:14.366887 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.346308 15192 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:06:14.367259 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:14.365975 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:14.369613 15190 pending_rounds.cc:85] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 9
I20260709 13:06:14.373124 15190 pending_rounds.cc:107] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:06:14.373382 15190 raft_consensus.cc:2889] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.373411 21823 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:14.374137 21823 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:14.374492 22020 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:14.376029 22020 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:14.379976 21120 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:14.365145 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:14.381064 21120 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.329933 22000 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:14.380820 22048 consensus_queue.cc:1243] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:06:14.340140 21711 raft_consensus.cc:740] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:14.342654 22054 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:06:14.400717 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.403967 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:14.408200 15272 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:14.409403 15272 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:14.409686 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:14.410393 15264 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 25: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:14.411397 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:14.411549 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 89687.5us
I20260709 13:06:14.412539 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.404320 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:14.334288 22029 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 13:06:14.420902 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:14.421586 15266 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:14.422267 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:14.423286 15268 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:14.394183 22015 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:14.424777 15267 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:14.425550 15263 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:14.343989 22034 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:06:14.429539 15272 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:14.419127 22058 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:14.441213 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:14.441500 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:14.443537 15266 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:14.443974 15268 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:14.427282 22015 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.448827 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:14.449760 15337 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:14.450555 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:14.451790 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.452550 15188 raft_consensus.cc:2393] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 26: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:14.454188 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.456621 22029 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.457123 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.457285 22029 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.457365 15267 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:14.438884 22034 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:14.462054 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:14.462821 15265 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:14.464830 15268 raft_consensus.cc:1240] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:14.468302 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.468904 21120 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:14.469278 21120 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:14.470687 15192 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:14.472263 22029 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:14.475579 21120 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.451220 22015 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:14.488126 21711 consensus_queue.cc:260] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.469514 21790 raft_consensus.cc:1064] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:14.519325 21120 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:14.496083 15188 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:14.496337 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.515570 15869 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:14.489717 21456 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:14.514533 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:14.493852 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:14.524519 15269 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:14.545892 15270 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:14.548614 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:14.466850 22034 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:14.509810 22058 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:14.568107 15190 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
W20260709 13:06:14.570108 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.558565 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:14.548359 22075 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:06:14.573063 21655 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:14.554958 22068 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
W20260709 13:06:14.577533 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 123429us
W20260709 13:06:14.552359 21790 raft_consensus.cc:1068] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:06:14.581614 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 98324us
I20260709 13:06:14.543272 21860 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.595412 15197 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:14.597026 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.598979 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:14.599710 15346 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:14.608886 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:14.610023 15268 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:14.552747 22069 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:14.627458 15269 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:14.628433 15269 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:14.629700 15270 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:14.629833 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.466620 22054 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.647423 15197 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:14.581228 21655 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:14.651132 15268 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:14.633245 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:14.610999 21711 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:14.612748 21790 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.650724 15869 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEARNER]: Advancing to term 17
I20260709 13:06:14.668823 15194 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:14.645488 15269 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.633857 22025 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:14.685817 15269 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:14.707887 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:14.625135 21860 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.671460 22058 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:14.715214 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:14.717473 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.720700 15869 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:06:14.721077 15869 pending_rounds.cc:85] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting all ops after (but not including) 10
I20260709 13:06:14.721306 15869 pending_rounds.cc:107] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:06:14.721571 15869 raft_consensus.cc:2889] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.707213 22014 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:06:14.724395 15269 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
W20260709 13:06:14.712492 22074 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:06:14.730544 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.726755 15269 pending_rounds.cc:85] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 8
I20260709 13:06:14.731395 15269 pending_rounds.cc:107] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:06:14.732873 15269 raft_consensus.cc:2889] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.668535 21790 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:14.740338 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 146800us
I20260709 13:06:14.719306 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:14.753997 15265 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:14.649006 22034 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.744707 21876 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.805542 15266 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
W20260709 13:06:14.824721 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 83477.1us
I20260709 13:06:14.728168 22065 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:06:14.713272 22025 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:14.832820 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.840543 21790 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:14.841260 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.843318 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.843828 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:14.859112 15189 raft_consensus.cc:2393] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:14.920634 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:14.924746 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 183035us
I20260709 13:06:14.831648 21456 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:14.855692 22022 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:14.929571 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 45285.1us
I20260709 13:06:14.868649 22065 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:14.936142 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.938877 15196 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:14.943933 15193 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:14.882766 22034 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:14.787262 15346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:14.950384 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:14.953903 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:14.934675 22081 log.cc:927] Time spent T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260709 13:06:14.926859 21860 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:14.961223 21860 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.961793 21860 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:14.959620 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 133873us
I20260709 13:06:14.964346 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.965698 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:14.832355 21876 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:14.966320 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:14.967283 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.967541 22000 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:14.968297 22000 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:14.970018 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:14.800259 21655 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:14.934508 22022 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.975342 22022 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:14.952031 22023 consensus_meta.cc:287] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.002s
I20260709 13:06:14.979548 22023 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:14.982206 22023 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.000653 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.004642 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.002103 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.020473 15196 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:15.034485 22113 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.035552 22084 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.322s	user 0.001s	sys 0.001s
I20260709 13:06:15.036454 15196 raft_consensus.cc:1240] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:15.038276 22091 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:06:15.035156 22113 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.044832 22025 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:15.045434 22025 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.045632 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.045981 22113 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.047806 15338 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3337) took 1141 ms. Trace:
I20260709 13:06:15.048177 15338 rpcz_store.cc:276] 0709 13:06:13.906068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.906187 (+   119us) service_pool.cc:224] Handling call
0709 13:06:13.913691 (+  7504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.052849 (+139158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.052881 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.321148 (+268267us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b2c00136ac8. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e4006a11 00007f36e4016372 00007f36e5748a01 00007f36e570d43a 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2
0709 13:06:14.336694 (+ 15546us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.515335 (+178641us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:14.515372 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.515431 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.047482 (+532051us) raft_consensus.cc:1685] finished
0709 13:06:15.047504 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.047717 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136499,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"spinlock_wait_cycles":42193664,"thread_start_us":197956,"threads_started":2,"wal-append.queue_time_us":261303}
I20260709 13:06:15.049247 22054 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:15.046936 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.045912 22025 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:15.063750 15345 consensus_meta.cc:287] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.611s	user 0.005s	sys 0.008s
I20260709 13:06:15.064471 15345 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:15.065797 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.068856 15193 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:15.073659 22028 consensus_meta.cc:287] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.724s	user 0.011s	sys 0.000s
I20260709 13:06:15.074226 22028 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:15.085151 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 119534us
I20260709 13:06:15.063673 21655 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:15.096232 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.100642 15192 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:15.021224 21790 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
W20260709 13:06:15.109529 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.117731 22025 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:15.126572 22015 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.004s
I20260709 13:06:15.127357 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.140654 15193 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
W20260709 13:06:15.136458 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.143258 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.110106 22023 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.152331 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:15.162707 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:15.164183 15269 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:15.164562 15269 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:15.166172 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:15.166816 15265 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:15.170710 15267 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:06:15.170579 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 244822us
I20260709 13:06:15.147863 22025 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.197497 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:15.187067 15269 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.199626 15270 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:15.199075 15268 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:15.205554 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.152204 22048 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:15.146421 22015 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.210073 15269 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:15.240859 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.178211 22068 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:15.243440 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.248102 21846 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:15.284464 21458 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:15.289768 15194 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:06:15.207767 22115 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:06:15.208168 22105 consensus_queue.cc:1059] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:06:15.173192 22023 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.263043 15190 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:15.271312 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 164836us
I20260709 13:06:15.254317 15270 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:15.306041 15309 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.217602 15265 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:15.212289 22025 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.249030 15266 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:15.248530 22048 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:15.304720 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 66869.4us
I20260709 13:06:15.312772 15269 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:06:15.313370 15269 pending_rounds.cc:85] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 10
I20260709 13:06:15.313652 15269 pending_rounds.cc:107] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:06:15.313949 15269 raft_consensus.cc:2889] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:15.280181 21860 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.262432 21456 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
W20260709 13:06:15.320604 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 79829.1us
I20260709 13:06:15.324985 15193 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:06:15.329771 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:15.321399 22112 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:06:15.335585 15874 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:15.300541 21846 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.352120 21702 raft_consensus.cc:2749] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:15.356071 22128 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:15.365983 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44017.1us
I20260709 13:06:15.370558 15876 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEARNER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:15.372550 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.373771 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.377660 22109 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:06:15.380908 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.368281 21860 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.376814 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.400347 15870 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:15.407009 15346 raft_consensus.cc:606] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:15.407115 15237 leader_election.cc:336] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 3.251s (SENT)
I20260709 13:06:15.373131 22028 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.407694 15346 raft_consensus.cc:614] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:15.397244 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 70767.7us
W20260709 13:06:15.411345 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 87487.4us
I20260709 13:06:15.412823 15309 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.414213 21846 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:15.415102 21846 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:15.415483 22023 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.416146 22015 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:15.422855 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.395668 22093 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:15.429982 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 43665us
I20260709 13:06:15.401353 22022 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.432768 22125 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:06:15.433696 22085 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.886s	user 0.002s	sys 0.002s
I20260709 13:06:15.408398 21860 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.435240 22025 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.440896 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.441138 15309 leader_election.cc:400] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20.
W20260709 13:06:15.442395 21711 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.775s	user 0.005s	sys 0.007s
I20260709 13:06:15.454857 15309 leader_election.cc:403] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
W20260709 13:06:15.455821 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.462548 21860 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:15.450212 22069 consensus_meta.cc:287] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.806s	user 0.012s	sys 0.000s
I20260709 13:06:15.470621 22069 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:15.471784 22025 consensus_queue.cc:1059] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:15.472718 22025 raft_consensus.cc:3055] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:15.473037 22025 raft_consensus.cc:740] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:15.473799 21876 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:15.478122 15189 raft_consensus.cc:2410] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:06:15.498054 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 44384.4us
W20260709 13:06:15.498749 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 57773.6us
I20260709 13:06:15.502497 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.506003 22132 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:15.507849 22126 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:06:15.516597 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:15.476823 21120 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:15.520920 21120 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:15.517174 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:15.525079 21120 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.476001 22023 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:15.527369 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:15.528904 21120 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:15.476437 22048 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:15.524545 22015 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:15.540452 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.475806 22121 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:06:15.473997 22025 consensus_queue.cc:260] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.544687 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:15.542138 22108 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:15.529969 22023 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:15.543514 22068 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:15.556314 21846 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:15.556236 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:15.557432 22023 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.547328 21790 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:15.532395 22093 consensus_queue.cc:1059] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:06:15.554708 22108 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:06:15.563861 22079 log.cc:927] Time spent T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.045s	user 0.003s	sys 0.000s
W20260709 13:06:15.553438 22054 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.005s
I20260709 13:06:15.569725 22130 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:06:15.570822 22025 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:15.571820 21790 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:15.566628 21846 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:15.576735 15266 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:15.587425 15160 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:15.590215 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.583730 22108 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.573841 21860 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:15.572904 22023 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:15.565331 22068 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:15.593360 15309 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.586941 21790 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:15.604143 22115 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:15.607539 22104 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.608081 22104 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:15.597076 21860 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.610041 21458 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:15.610206 21860 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:15.614177 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3353) took 1400 ms. Trace:
I20260709 13:06:15.614621 15339 rpcz_store.cc:276] 0709 13:06:14.213954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.229841 (+ 15887us) service_pool.cc:224] Handling call
0709 13:06:14.230166 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.247150 (+ 16984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.247184 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.247742 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.316798 (+ 69056us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:14.316839 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.433451 (+116612us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b54000b6b54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:14.433518 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.563336 (+1129818us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:15.613963 (+ 50627us) raft_consensus.cc:1685] finished
0709 13:06:15.613985 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.614112 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42140,"raft.queue_time_us":71603,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":26046592,"thread_start_us":68666,"threads_started":1,"wal-append.queue_time_us":187909}
W20260709 13:06:15.616425 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.621642 22103 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.403s	user 0.000s	sys 0.002s
I20260709 13:06:15.595587 21846 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:15.629081 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:15.626654 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:15.600205 22068 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:15.644747 21120 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:15.644996 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 57669.3us
W20260709 13:06:15.652679 22137 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:06:15.661824 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.676640 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.671597 15342 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
W20260709 13:06:15.682158 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.642562 22014 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:15.683713 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:15.684880 15338 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:15.685315 22054 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:15.650209 22022 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.687446 15339 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:06:15.687774 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:15.691753 15341 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:15.686867 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 60998.6us
I20260709 13:06:15.723956 21120 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:15.726213 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:15.727211 21120 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:15.727757 21120 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:15.729207 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:15.739363 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 110332us
I20260709 13:06:15.740121 15309 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:15.742446 21120 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.733538 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3090) took 1280 ms. Trace:
I20260709 13:06:15.744024 15271 rpcz_store.cc:276] 0709 13:06:14.405903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.406038 (+   135us) service_pool.cc:224] Handling call
0709 13:06:14.412735 (+  6697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.413055 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:14.493147 (+ 80092us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.614450 (+1121303us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800466e40. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:06:15.685978 (+ 71528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.686024 (+    46us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:15.686387 (+   363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.686454 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.686554 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40,"prepare.queue_time_us":138910,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3759,"raft.queue_time_us":75,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":48413,"spinlock_wait_cycles":5404928,"thread_start_us":151029,"threads_started":2}
I20260709 13:06:15.752789 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:15.755759 15342 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:15.756337 15337 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:15.760488 22122 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:06:15.762755 22134 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:15.763473 22134 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.767992 22000 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:15.776095 22139 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:15.685714 22054 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:15.780047 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:15.783864 15338 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:15.741520 22033 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:15.684319 22093 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:06:15.786281 22054 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:15.798475 22132 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20.
I20260709 13:06:15.754424 22022 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:06:15.800865 22033 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:15.801846 22033 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.740760 21655 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:15.790009 22069 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:15.804817 22069 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:15.805210 22069 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:15.780855 22048 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:06:15.781876 22130 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.815363 22130 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.815783 15162 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:15.816190 22122 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:15.817214 21711 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:15.817607 22130 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:15.817799 21711 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:15.819708 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:15.785605 15160 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:15.787683 15342 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:15.826081 15341 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:15.818750 21711 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:15.758355 21860 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.828433 22125 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:06:15.830576 15345 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34532 (request call id 3344) took 1623 ms (client timeout 1595 ms). Trace:
I20260709 13:06:15.830868 15337 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:06:15.832530 22098 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.804s	user 0.000s	sys 0.003s
I20260709 13:06:15.833240 22145 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.834265 22068 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:15.836546 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 56569.6us
I20260709 13:06:15.905984 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:15.837395 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:15.831063 15162 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:15.907130 15342 raft_consensus.cc:2376] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23. Re-sending same reply.
W20260709 13:06:15.907289 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 76335.5us
I20260709 13:06:15.844861 21846 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.837783 22105 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.856655 22134 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:15.863637 22096 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.923s	user 0.005s	sys 0.000s
I20260709 13:06:15.865101 22054 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:15.871558 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 86026.5us
I20260709 13:06:15.866820 21790 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.903258 15876 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58398 (request call id 391) took 1019 ms. Trace:
W20260709 13:06:15.875492 15345 rpcz_store.cc:269] 0709 13:06:14.168245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.185300 (+ 17055us) service_pool.cc:224] Handling call
0709 13:06:15.790857 (+1605557us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400246154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:15.790958 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603114752}
I20260709 13:06:15.905228 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:15.922039 15337 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:15.887611 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.924336 15343 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:15.874552 22122 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:15.913642 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:15.928074 15341 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:15.916100 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:15.929548 15342 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:15.919440 15876 rpcz_store.cc:276] 0709 13:06:14.873245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.873434 (+   189us) service_pool.cc:224] Handling call
0709 13:06:15.370375 (+496941us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.370989 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.892030 (+521041us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54008ad9d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:15.892187 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141984512}
I20260709 13:06:15.875413 22125 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:15.939785 15267 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:15.940356 15346 raft_consensus.cc:1240] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 26. Current term is 27. Ops: []
I20260709 13:06:15.940872 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:15.941232 15271 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:15.941530 15267 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:15.941766 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:15.942502 15263 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 20: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:15.931377 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:15.943491 15265 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:15.878932 15093 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:15.946591 22122 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:15.947220 15337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:15.947840 15337 raft_consensus.cc:606] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:15.948249 15337 raft_consensus.cc:614] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:15.947903 22122 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.950337 15337 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:15.939409 22128 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:15.951514 22128 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:15.951905 22128 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:15.952170 22125 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:15.953999 22125 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:15.955355 15192 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:15.955374 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:15.957365 15266 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:15.939380 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.963732 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:15.966943 15337 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:15.969573 22136 raft_consensus.cc:1064] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:15.969633 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:06:15.970139 22136 raft_consensus.cc:1068] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:15.968573 22133 raft_consensus.cc:1064] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:15.970331 15876 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 13.
W20260709 13:06:15.970824 22133 raft_consensus.cc:1068] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:15.971999 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:15.974610 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:15.974160 15337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:15.977026 15337 raft_consensus.cc:606] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:15.978909 15337 raft_consensus.cc:614] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:15.985761 15196 raft_consensus.cc:1240] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:15.987134 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:15.988593 21846 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:15.967289 22048 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:15.990731 22048 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.991206 22048 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:15.992400 15237 leader_election.cc:336] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.724s (SENT)
I20260709 13:06:15.992857 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:15.993431 15272 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3101) took 1544 ms. Trace:
I20260709 13:06:15.993896 15272 rpcz_store.cc:276] 0709 13:06:14.448864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.448969 (+   105us) service_pool.cc:224] Handling call
0709 13:06:14.449296 (+   327us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:14.449762 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.449789 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:14.539279 (+ 89490us) log.cc:844] Serialized 78 byte log entry
0709 13:06:14.737411 (+198132us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:14.821307 (+ 83896us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.821619 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.821728 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.829779 (+1008051us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:15.993155 (+163376us) raft_consensus.cc:1685] finished
0709 13:06:15.993242 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.993377 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":85061,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":138474,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":25721,"spinlock_wait_cycles":89135872,"thread_start_us":110357,"threads_started":1,"wal-append.queue_time_us":233932}
I20260709 13:06:16.005121 21790 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:16.007580 15842 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.553s (SENT)
I20260709 13:06:16.007975 15189 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2530) took 1171 ms. Trace:
I20260709 13:06:16.008076 15842 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:16.008536 22104 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:15.913532 22014 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.008669 15189 rpcz_store.cc:276] 0709 13:06:14.836919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.958713 (+121794us) service_pool.cc:224] Handling call
0709 13:06:16.007740 (+1049027us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000ffd54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:16.007902 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082363264}
I20260709 13:06:16.009370 22110 raft_consensus.cc:3055] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:16.009866 22110 raft_consensus.cc:740] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:16.009613 22014 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.010779 22110 consensus_queue.cc:260] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:16.011273 15344 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:16.011173 22115 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:16.011879 22110 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:15.916625 22105 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:15.967092 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:16.015144 22027 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:16.015210 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48292.9us
I20260709 13:06:16.015691 22027 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:16.016153 22027 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:16.016249 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:16.020640 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.917400 21655 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:06:16.022678 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:16.024012 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:16.024355 22068 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:16.025163 22111 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.025682 22111 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.025843 22130 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:16.028877 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:16.014765 22105 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:16.031862 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.910216 22022 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:15.910321 22145 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.032410 21876 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:16.032614 22015 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:16.033583 15093 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 11 to 13, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 13 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:16.041975 15266 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:16.034420 15162 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:16.044550 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:15.998395 22131 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:16.091702 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.092392 15340 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:16.049229 15193 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:06:16.095463 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.055164 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.061830 21458 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:16.062390 22033 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:16.063427 22023 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:16.064127 22029 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:16.065573 22100 consensus_queue.cc:1059] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:06:16.075857 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.102684 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.105448 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.105443 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.106910 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:15.991019 21860 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:16.110121 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 169334us
I20260709 13:06:16.114362 15190 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:16.080152 22015 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.115597 15193 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:16.115870 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:16.119371 15197 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:16.122499 15191 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3598) took 1599 ms. Trace:
I20260709 13:06:16.122961 15191 rpcz_store.cc:276] 0709 13:06:14.518079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.518259 (+   180us) service_pool.cc:224] Handling call
0709 13:06:14.555163 (+ 36904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.582004 (+ 26841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.582036 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.596571 (+ 14535us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.721080 (+124509us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:14.721122 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.721216 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.571101 (+849885us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b480021c258. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36ea636aa1 00007f36ea62db37 00007f36ea62d9ca 00007f36ea72526f 00007f36ea724f37 00007f36ea73955c 00007f36ea739508 00007f36ea739488 00007f36ea739443 00007f36ea7386ec 00007f36e9662a96
0709 13:06:15.831851 (+260750us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:16.117034 (+285183us) raft_consensus.cc:1685] finished
0709 13:06:16.117076 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.117260 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55604,"raft.queue_time_us":14528,"raft.run_cpu_time_us":3875,"raft.run_wall_time_us":995019,"spinlock_wait_cycles":61360768,"thread_start_us":52680,"threads_started":1,"wal-append.queue_time_us":316462}
I20260709 13:06:16.126996 21120 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:16.127503 21120 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.127658 22111 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:16.128355 21120 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.111250 22054 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:16.118945 22015 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:16.129667 21120 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:16.133522 22000 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:16.081278 21790 consensus_queue.cc:1059] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:06:16.135687 21790 raft_consensus.cc:3055] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:16.136093 21790 raft_consensus.cc:740] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:16.136790 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.136931 21790 consensus_queue.cc:260] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.137480 15194 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:16.138306 21790 raft_consensus.cc:3060] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:16.034971 22069 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.139415 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.139667 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.139421 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.140573 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:16.140722 15190 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:16.103420 22022 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.141803 15190 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:06:16.142057 22022 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.145771 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:16.146404 15338 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:16.146385 15190 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:16.153748 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.080824 22104 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:06:16.159971 22104 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:16.160467 22104 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:06:16.163105 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47335.4us
I20260709 13:06:16.164126 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:16.113411 22033 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.175768 22014 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:16.175942 22033 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:16.176941 22147 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:16.168987 22093 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:06:16.122066 22068 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:16.106781 21458 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.155388 22095 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:06:16.184101 22058 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:16.162107 22145 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:16.185869 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.187287 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:16.188988 15237 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.855s (SENT)
I20260709 13:06:16.189432 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:16.190446 15237 leader_election.cc:336] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.870s (SENT)
I20260709 13:06:16.193080 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:16.193871 15191 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:16.198333 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.207520 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.161449 22104 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:16.211826 15197 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2519) took 1636 ms. Trace:
I20260709 13:06:16.217103 15197 rpcz_store.cc:276] 0709 13:06:14.575885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.659153 (+ 83268us) service_pool.cc:224] Handling call
0709 13:06:16.117368 (+1458215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.121862 (+  4494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.211583 (+ 89721us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54000c08d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:16.211757 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3319526656}
I20260709 13:06:16.195812 22000 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:16.195253 22121 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:16.194434 22145 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
W20260709 13:06:16.220489 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 159288us
W20260709 13:06:16.226500 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60481.1us
I20260709 13:06:16.227972 21120 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:16.229058 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:16.230710 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.204883 21860 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:16.237226 15237 leader_election.cc:336] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.937s (SENT)
I20260709 13:06:16.237818 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:16.241799 15191 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:16.244268 21120 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:16.244621 21120 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.243397 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.246786 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.248152 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:16.248260 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.249035 15268 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:16.260416 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.261336 15269 raft_consensus.cc:3060] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:16.263432 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:16.268337 15237 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.103s (SENT)
I20260709 13:06:16.268971 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:16.295459 21120 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:16.315655 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47372.7us
I20260709 13:06:16.234774 22111 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:16.323975 21120 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:16.247222 21876 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:16.295225 22121 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:16.341336 15269 raft_consensus.cc:2410] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:06:16.343183 15841 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.553s (SENT)
I20260709 13:06:16.318269 22104 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:16.235245 22145 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:16.363130 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.368978 22027 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:16.369964 15190 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:06:16.242749 21763 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:06:16.281246 21655 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:06:16.371107 22136 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:16.371716 22136 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.373844 22136 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:16.375946 22027 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:16.247605 21860 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.379133 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.380307 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.380826 15267 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:16.381132 21860 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:16.335981 22069 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:16.383697 15190 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:16.385519 22110 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:16.386656 22110 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:16.387055 22110 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
W20260709 13:06:16.402578 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.311182 22128 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.460376 15268 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:16.474018 15267 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:16.477044 15338 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 27. Current term is 28. Ops: []
I20260709 13:06:16.478899 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.450232 21763 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:16.491681 15267 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:16.527748 21120 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:16.528352 21120 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.528563 15267 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
W20260709 13:06:16.513036 22116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.015s
I20260709 13:06:16.535969 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.536082 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.536583 15346 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:16.537034 15267 raft_consensus.cc:2368] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:06:16.515630 21763 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:16.543272 21763 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:16.513110 22110 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:16.549952 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.551426 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.552356 15272 raft_consensus.cc:2410] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 19 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:06:16.553346 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.553828 15340 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:16.554289 15093 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 12 to 13, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 13 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:16.556489 22154 log.cc:927] Time spent T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:06:16.528551 22048 consensus_meta.cc:287] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.007s
I20260709 13:06:16.563321 15272 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:06:16.535478 22116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.013s	sys 0.016s
I20260709 13:06:16.565614 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:06:16.567342 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.567423 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.565694 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:16.568789 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.569002 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.572942 15270 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:16.574434 15267 raft_consensus.cc:2368] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:06:16.577558 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.578586 15267 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:16.579989 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.584890 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:16.584713 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:16.590826 15237 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.956s (SENT)
I20260709 13:06:16.591496 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:16.593729 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.594892 15271 raft_consensus.cc:2410] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:06:16.594324 15346 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:16.597771 15270 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:16.599480 15270 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
W20260709 13:06:16.601270 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.602811 15270 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:16.604976 15270 raft_consensus.cc:1275] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:06:16.626874 15270 pending_rounds.cc:85] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 12
W20260709 13:06:16.608019 22157 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:16.627738 15272 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23. Ops: []
W20260709 13:06:16.609548 22152 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 13:06:16.612530 21120 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:16.613868 22128 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 28 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:16.615267 22150 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:06:16.595820 22029 raft_consensus.cc:3055] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:06:16.614871 22068 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:16.633653 22015 consensus_meta.cc:287] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:06:16.634114 22015 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.582378 21846 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.635334 21846 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.612553 22125 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:16.636368 22000 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:16.637625 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.637934 21846 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:16.626942 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.639719 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.637341 22125 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.618675 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.606141 21876 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:16.608726 22155 log.cc:927] Time spent T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:06:16.628201 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.631742 22029 raft_consensus.cc:740] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.648909 15195 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:16.649456 22145 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:16.649382 22029 consensus_queue.cc:260] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.567744 22048 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.646059 15266 raft_consensus.cc:1275] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:16.651803 15194 raft_consensus.cc:2368] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:16.652369 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:16.652726 15266 raft_consensus.cc:1275] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:06:16.653244 15266 pending_rounds.cc:85] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 9
I20260709 13:06:16.653532 15266 pending_rounds.cc:107] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:06:16.653839 15266 raft_consensus.cc:2889] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.654582 15272 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:16.660144 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:16.627895 15270 pending_rounds.cc:107] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:06:16.667272 15270 raft_consensus.cc:2889] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.672623 15267 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
W20260709 13:06:16.681519 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.682952 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 148576us
I20260709 13:06:16.650985 22029 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:16.685032 15337 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:16.651366 22015 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:16.689260 15337 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:16.696753 15344 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:16.694866 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.697570 15339 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:16.700069 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:16.702814 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.703500 15346 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:06:16.707224 15238 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:16.712304 15340 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:16.718797 22121 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:16.713917 21876 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:16.720014 21876 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.720461 21876 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:16.715276 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:16.725384 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:16.728459 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:16.752745 15237 leader_election.cc:336] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.528s (SENT)
I20260709 13:06:16.753376 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:16.724752 22121 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:16.739616 22108 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:16.755450 22108 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.755686 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:16.755815 22108 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:16.739887 21790 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:16.756630 21790 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.757007 21790 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:16.759263 21860 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:16.759943 21860 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:16.755857 22121 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.764679 21790 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:16.767135 21790 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:16.768044 15237 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.681s (SENT)
I20260709 13:06:16.769968 15269 raft_consensus.cc:2410] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:06:16.770994 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.771407 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.772079 15345 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 24: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:16.772540 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:16.773475 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45090.8us
I20260709 13:06:16.774390 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.775426 15345 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:16.777617 15345 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:16.770375 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.780503 15344 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:06:16.781931 15344 raft_consensus.cc:1240] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:16.789592 15339 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
W20260709 13:06:16.794770 15237 leader_election.cc:336] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.711s (SENT)
I20260709 13:06:16.795418 15237 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:16.797483 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.791599 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:16.801879 15345 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:06:16.802232 15345 pending_rounds.cc:85] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 11
I20260709 13:06:16.802435 15345 pending_rounds.cc:107] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:06:16.802647 15345 raft_consensus.cc:2889] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.799746 21790 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:16.803951 15343 raft_consensus.cc:1240] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:06:16.806857 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.813397 22100 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:16.814563 22027 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:16.820701 15342 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:06:16.841153 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.841975 15342 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:16.843850 21120 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:16.799932 22022 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:16.858318 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.837963 22100 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.859411 15342 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 27: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:16.859764 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.862279 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.862493 15341 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:16.862905 15192 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
W20260709 13:06:16.865271 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 109666us
I20260709 13:06:16.866163 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:16.866444 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.867256 15342 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:16.858130 22022 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:16.861480 22048 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:16.854166 22131 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 13:06:16.896173 22158 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.299s	user 0.003s	sys 0.000s
I20260709 13:06:16.900588 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.900843 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.901455 15346 raft_consensus.cc:2393] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:16.884546 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:16.889938 22100 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:16.903849 15341 raft_consensus.cc:1240] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:16.870886 22121 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:16.916738 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.924494 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.925168 15346 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:16.929102 15338 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:16.929279 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:16.928207 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.946980 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:16.947746 15192 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:16.910642 21790 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:16.953678 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.954756 15338 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:16.957823 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:16.959280 15312 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:16.961474 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.963969 15193 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:16.925465 22121 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:16.971479 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 114670us
I20260709 13:06:16.980283 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.981968 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:16.987818 15343 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:16.988116 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.989181 15338 raft_consensus.cc:2393] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:16.992355 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.993444 15341 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 28: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:16.994125 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:16.995297 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 47754.4us
I20260709 13:06:16.963229 21790 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:16.967478 22121 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:16.969285 22134 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:16.991650 22188 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:16.999068 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.004405 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.005098 15343 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:17.006206 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.006460 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:17.022640 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.000007 22134 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:17.027894 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.007223 15338 raft_consensus.cc:2468] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:16.997869 21790 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:17.032274 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.035567 15341 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:17.039621 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:16.992673 22190 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:06:16.971807 22022 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.063758 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.064927 15341 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 25: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:17.034119 22134 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:17.057073 22191 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.128s	user 0.005s	sys 0.006s
W20260709 13:06:17.067166 15237 leader_election.cc:336] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.548s (SENT)
I20260709 13:06:17.076479 15237 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:17.041536 22145 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.078516 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.079659 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.077073 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:17.032289 22108 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.090438 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:17.092692 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.095151 21120 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:17.095806 21120 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:17.097262 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.098062 15341 raft_consensus.cc:2376] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24. Re-sending same reply.
I20260709 13:06:17.096798 21120 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.105154 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.105260 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.106817 15341 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 24: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:17.064518 21876 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.101338 22015 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:17.096163 22190 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:17.099068 22145 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.099954 22197 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.123376 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.123575 15341 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:17.126163 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.123749 22132 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:17.125291 15342 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:17.078989 22068 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:06:17.128118 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:17.132663 22199 log.cc:927] Time spent T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:17.099781 22093 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:06:17.104804 22131 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 27.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:06:17.122927 22015 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:17.144450 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.146977 15345 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:17.148581 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.156167 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.161520 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.168015 15345 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
W20260709 13:06:17.168967 15237 leader_election.cc:336] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.650s (SENT)
I20260709 13:06:17.151443 22015 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:17.170765 15265 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:06:17.173431 15265 pending_rounds.cc:85] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 10
I20260709 13:06:17.173735 15265 pending_rounds.cc:107] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:06:17.173974 15265 raft_consensus.cc:2889] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:17.176016 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3133) took 1238 ms. Trace:
I20260709 13:06:17.178588 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.130633 22197 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.176407 15263 rpcz_store.cc:276] 0709 13:06:15.937949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.943967 (+  6018us) service_pool.cc:224] Handling call
0709 13:06:15.944257 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.112494 (+168237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.112539 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.113018 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.487736 (+374718us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:16.700855 (+213119us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.701115 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.170285 (+469170us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54001b4c54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:17.170332 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.170384 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:17.175821 (+  5437us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.175964 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35255,"prepare.queue_time_us":146531,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":5511,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":11258,"spinlock_wait_cycles":386099072,"thread_start_us":489068,"threads_started":2,"wal-append.queue_time_us":528724}
W20260709 13:06:17.200639 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 132053us
I20260709 13:06:17.201586 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:17.201812 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 292148us
I20260709 13:06:17.204061 15346 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:17.206105 15238 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:17.207964 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:17.207710 22125 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.208714 22125 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:17.209254 15238 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:17.194391 22195 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:06:17.213773 22201 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:17.224778 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.229388 15338 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:17.231824 15344 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:17.232271 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.233373 15346 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:17.213933 21458 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.216310 22190 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:17.247505 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:17.248189 15901 heartbeater.cc:646] Failed to heartbeat to 127.13.181.62:42621 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.181.62:42621 timed out after 15.000s (SENT)
I20260709 13:06:17.231866 21876 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.237829 22108 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.252085 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.256202 15346 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
W20260709 13:06:17.265547 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.267953 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:17.267967 15269 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:17.270989 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46358 (request call id 2560) took 1132 ms. Trace:
I20260709 13:06:17.271400 15194 rpcz_store.cc:276] 0709 13:06:16.138154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.138997 (+   843us) service_pool.cc:224] Handling call
0709 13:06:17.268214 (+1129217us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54000ffd54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:17.270926 (+  2712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176318208}
I20260709 13:06:17.272683 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:17.273788 15268 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 25: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:17.270915 22145 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.278118 15267 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:06:17.280462 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.281077 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.281716 15267 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:17.286043 15270 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:17.305493 22201 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:06:17.284957 15237 leader_election.cc:336] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.764s (SENT)
I20260709 13:06:17.315322 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.319747 22197 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.257678 21876 raft_consensus.cc:2764] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:06:17.258744 22100 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.331967 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.332553 15271 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:17.334626 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:17.336660 15237 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:17.362376 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.374280 15264 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:17.359704 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:17.340879 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 131677us
I20260709 13:06:17.378059 22215 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.381462 15193 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:06:17.383746 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.385839 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:17.386538 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:17.388499 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.385722 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:17.383740 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:17.388510 15188 raft_consensus.cc:3060] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:17.389269 15189 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:17.390877 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 105947us
I20260709 13:06:17.376035 22190 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:17.342998 22216 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.394338 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:17.394833 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.341292 22205 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:17.399255 15346 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 27: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:17.400050 22216 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.402635 22216 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.333432 22131 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:06:17.359925 22023 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:06:17.390815 22022 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.376533 22130 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:06:17.357671 22121 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.393965 22215 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:17.428812 22207 log.cc:927] Time spent T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:06:17.431926 22201 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:17.429366 22218 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:17.428637 22121 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.441350 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.431458 22029 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:06:17.442760 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.443078 22029 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:17.444108 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.444016 22029 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.445502 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.446249 15344 raft_consensus.cc:2368] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:17.446409 22095 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:17.422256 22221 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:17.445524 22029 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:17.447584 22133 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:17.386520 22197 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:06:17.453136 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.359720 22134 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.377808 22100 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.480974 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.457155 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.460439 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:17.482550 15192 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:06:17.464214 15188 raft_consensus.cc:2468] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:06:17.476598 15189 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:06:17.477644 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 96941.3us
W20260709 13:06:17.485653 15842 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.487262 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.488250 15338 raft_consensus.cc:2393] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:17.489169 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.490291 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.503068 15842 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:17.504237 15338 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:17.431645 22215 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:17.509483 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.518579 15339 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:17.475524 22133 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:17.412158 22205 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.530259 15265 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3268) took 1190 ms. Trace:
I20260709 13:06:17.533753 15238 leader_election.cc:400] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:17.533902 15265 rpcz_store.cc:276] 0709 13:06:16.340131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.654055 (+313924us) service_pool.cc:224] Handling call
0709 13:06:17.170303 (+516248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.178753 (+  8450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.530012 (+351259us) spinlock_profiling.cc:243] Waited 515 ms on lock 0x7b5400010750. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:17.530182 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185534720}
I20260709 13:06:17.518357 22105 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:17.457154 22022 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.536492 15346 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:17.534300 15238 leader_election.cc:403] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:17.533208 15237 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.811s (SENT)
I20260709 13:06:17.544025 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:17.548280 15237 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.496s (SENT)
I20260709 13:06:17.551769 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:17.551986 22145 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:17.552384 22108 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:17.552420 15192 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:17.558990 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:17.541411 22105 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.560721 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:17.560230 15263 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:51924
I20260709 13:06:17.564599 15192 raft_consensus.cc:2468] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:17.566617 15196 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:17.561977 15238 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:17.572000 22132 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:06:17.557802 21790 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.004s
I20260709 13:06:17.564054 22133 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.524580 22190 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.554039 22015 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.570235 22105 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:17.598345 22222 log.cc:927] Time spent T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:17.598250 22226 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.599412 22234 raft_consensus.cc:2804] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:06:17.601840 22219 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:06:17.602913 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.611541 22022 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:17.643812 15237 leader_election.cc:336] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.912s (SENT)
I20260709 13:06:17.612495 22110 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:17.617545 22015 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.618214 15190 raft_consensus.cc:1240] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:17.622072 22225 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:17.583853 22134 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:17.584784 22100 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.626454 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.660485 15346 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:17.627285 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.661381 15342 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:17.589905 21790 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:17.637774 15264 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:17.664913 22220 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:17.586095 22133 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:17.645862 15237 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:17.668553 15237 leader_election.cc:336] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 1.989s (SENT)
W20260709 13:06:17.669724 15237 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.063s (SENT)
I20260709 13:06:17.670195 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:17.675343 22216 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:17.676292 22216 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:17.577814 22132 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:17.645644 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.649626 22234 raft_consensus.cc:697] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:17.707262 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.710410 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.712000 15338 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 25: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:17.715801 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.642170 22226 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.703742 22015 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:17.722232 15263 raft_consensus.cc:606] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:17.722873 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.724359 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.725026 15343 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:17.715749 22023 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.726475 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.729967 15342 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:17.732127 15266 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 596) took 1124 ms. Trace:
I20260709 13:06:17.732481 15266 rpcz_store.cc:276] 0709 13:06:16.607381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.661974 (+ 54593us) service_pool.cc:224] Handling call
0709 13:06:17.127521 (+465547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.127681 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.127703 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:17.127739 (+    36us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:17.127768 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.127817 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.731948 (+604131us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b5400290250. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:17.732063 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070084480}
I20260709 13:06:17.733858 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.744133 21790 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:17.745975 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:06:17.746834 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 500083us
I20260709 13:06:17.749895 22226 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.749729 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:17.733472 22023 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.754086 22023 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:17.755645 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.756260 21846 raft_consensus.cc:1064] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:17.759336 22000 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:17.759413 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:17.760599 22000 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:17.765748 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.768196 15266 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:17.769697 15162 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:17.770496 22029 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:17.771263 22234 consensus_queue.cc:237] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.727241 22015 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.775236 22015 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.780267 22230 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:06:17.780897 22125 consensus_meta.cc:287] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.001s
I20260709 13:06:17.781359 22230 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:17.781534 22125 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:17.781767 22230 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:17.781551 15162 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:17.798434 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.801775 15342 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:17.802903 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.804675 15342 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:17.806756 15197 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:06:17.803938 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.805735 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.807931 15341 raft_consensus.cc:2376] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18. Re-sending same reply.
I20260709 13:06:17.808100 15342 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 14.
I20260709 13:06:17.810511 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.809547 15342 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:06:17.811853 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.812604 15346 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:17.813596 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:17.819242 21846 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:17.823019 21851 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.823649 22226 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.824163 22226 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:17.824550 22100 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:06:17.842814 15237 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Timed out: RequestConsensusVote RPC to 127.13.181.3:46145 timed out after 2.176s (SENT)
I20260709 13:06:17.843571 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:17.846546 15342 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:06:17.848308 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:17.850250 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:17.850370 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:17.851150 15162 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:17.845911 21790 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:17.826414 22226 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:17.806177 22015 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:17.875610 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.864771 22029 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:17.869594 22023 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:17.865150 21655 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:17.823650 21851 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:17.782793 22230 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:17.897625 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.881669 22185 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:17.883574 22015 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:17.886827 22110 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:17.877681 22100 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
I20260709 13:06:17.885533 22029 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.906224 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:17.910244 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:17.896812 22023 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.897174 22111 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:17.897800 21655 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.921181 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:17.924602 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.924826 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:17.927403 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:17.916227 22029 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:17.920449 22111 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:17.922256 21655 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:17.921940 22023 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:17.923931 22095 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:17.903959 22185 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.935844 15869 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:17.936913 22226 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.939656 22210 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:17.927824 22133 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:17.919330 22110 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:17.946399 22095 raft_consensus.cc:493] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:17.945859 22015 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.950654 22226 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.958513 22095 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:17.977283 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:17.966557 22132 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.980521 15238 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:17.991892 15238 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:17.961328 22105 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:17.997853 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:17.957573 22111 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:17.984833 21790 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:18.004595 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:18.016441 15309 leader_election.cc:400] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:06:18.016749 15309 leader_election.cc:403] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:06:18.011513 22190 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:18.017603 22190 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.017961 22190 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:18.022847 21851 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.024330 22105 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:18.024639 22210 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:18.025220 22210 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:18.008014 22133 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:18.007643 22234 raft_consensus.cc:2804] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:18.037460 22054 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:06:18.038877 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.040133 22132 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:18.016139 21790 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:18.030579 22111 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:18.035075 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:18.062526 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.066295 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.043308 22054 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:18.064781 22216 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
W20260709 13:06:18.068372 22245 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:06:18.073294 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.068816 22000 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:18.068949 22229 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:18.060765 22233 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:18.057545 22234 raft_consensus.cc:697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:18.060933 22226 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.076202 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.063292 22023 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:18.092008 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 53200.4us
I20260709 13:06:18.093340 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.094372 15309 leader_election.cc:400] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:06:18.094648 15309 leader_election.cc:403] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:06:18.103994 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:18.087090 22185 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.108722 15196 raft_consensus.cc:2393] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 22: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:18.104291 21456 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.098559 22054 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 22. Current term is 23.
I20260709 13:06:18.095676 22000 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:18.110983 21456 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.117972 22023 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.124015 15197 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:18.084211 22229 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:18.128146 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 152802us
I20260709 13:06:18.131004 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.108390 22110 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.136178 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:18.136749 15188 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:18.132542 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.134855 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:18.079341 22210 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.140259 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:18.096874 21790 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.145377 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.145697 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.155900 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.156378 22206 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:18.156967 22206 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:18.157387 22206 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:18.158195 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.160291 22213 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:18.160951 22213 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:18.162156 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:18.164546 22213 raft_consensus.cc:2764] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:06:18.166571 22213 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:18.167841 22000 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:18.168249 22000 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:18.168645 22213 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:18.169100 22000 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.170827 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.139225 22054 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:18.172631 22213 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:18.175382 22213 consensus_queue.cc:1048] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:18.177315 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2517) took 1055 ms. Trace:
I20260709 13:06:18.177708 22213 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:18.179558 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.181243 22213 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:18.183204 22213 consensus_queue.cc:1048] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:06:18.184231 15869 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58400 (request call id 455) took 1643 ms (client timeout 1621 ms). Trace:
W20260709 13:06:18.184648 15869 rpcz_store.cc:269] 0709 13:06:16.540598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.565370 (+ 24772us) service_pool.cc:224] Handling call
0709 13:06:18.184034 (+1618664us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540059d154. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:18.184133 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3075707776}
I20260709 13:06:18.185864 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:18.187197 22213 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:18.188634 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:18.190099 22193 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:18.190510 22193 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:18.189417 22213 consensus_queue.cc:1048] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:18.190907 22193 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:18.192091 15840 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.192480 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:18.194155 22213 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:18.194506 22213 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:18.194850 22213 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:18.195521 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:18.196283 15188 raft_consensus.cc:2468] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:06:18.211578 21655 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:18.216362 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.216923 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.217342 15236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.217877 22104 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:18.218374 22104 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:18.220435 22104 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:18.100255 22234 consensus_queue.cc:237] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.222285 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.225574 15263 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:18.222910 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.177801 15339 rpcz_store.cc:276] 0709 13:06:17.122151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.123123 (+   972us) service_pool.cc:224] Handling call
0709 13:06:18.177113 (+1053990us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54001752d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:18.177236 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901422464}
I20260709 13:06:18.229773 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.230400 15337 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:18.230742 15340 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:18.234663 15342 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:06:18.239473 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.241369 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.243371 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.245280 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.246825 15264 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:18.248090 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.249040 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:18.268888 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.275523 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:18.277282 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.274284 15311 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:18.284057 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.288596 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.289330 15346 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 22.
I20260709 13:06:18.140187 22216 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 13:06:18.293231 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:18.298995 15340 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:18.298177 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.300511 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.214892 22229 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.307650 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.309850 15338 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:06:18.309932 22230 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:18.312112 22116 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.312700 22116 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.316797 15340 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:06:18.317047 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.279102 22233 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:18.322449 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 406630us
I20260709 13:06:18.314869 22116 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.321094 22214 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:18.380090 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 192148us
I20260709 13:06:18.366657 22023 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.331672 22233 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.333113 22190 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:18.411280 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 168916us
I20260709 13:06:18.410753 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:18.429345 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:18.438103 22242 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.507s	user 0.001s	sys 0.002s
I20260709 13:06:18.439479 21458 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:18.439064 22227 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:18.440367 22227 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:18.440784 22227 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:18.442212 22068 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.404793 22250 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:06:18.439394 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.449023 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.450556 22214 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:18.451292 22214 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:18.451853 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.452343 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.452699 15344 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2538) took 1012 ms. Trace:
I20260709 13:06:18.453133 15344 rpcz_store.cc:276] 0709 13:06:17.440095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.451525 (+1011430us) service_pool.cc:224] Handling call
0709 13:06:18.452639 (+  1114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:18.456352 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.427953 22022 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:18.467792 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 193581us
I20260709 13:06:18.442762 22068 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.410677 22023 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.418650 22201 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:06:18.458691 21851 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:18.458899 22247 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:18.467195 22214 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:06:18.516291 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:18.528846 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 119429us
I20260709 13:06:18.531121 15237 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.502100 21851 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.546828 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.553527 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.478264 22022 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.563552 22233 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.570327 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:18.571600 22253 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:06:18.554234 22226 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:18.575258 15237 leader_election.cc:400] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:18.602461 15237 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.577366 15270 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:18.577418 15263 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:18.577556 15269 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:18.555114 21851 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:18.603947 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.607998 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.514631 22227 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.609113 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.610121 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.614773 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.616888 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:18.618597 15269 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
W20260709 13:06:18.602932 22262 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:06:18.620671 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.621028 15269 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:18.626691 15237 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:18.629280 22251 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:06:18.630541 22274 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:18.630031 15237 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:18.631948 22220 raft_consensus.cc:2764] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:06:18.632426 22022 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.633096 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.634130 22023 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.634788 22257 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:18.635710 22190 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.636240 22250 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:18.637450 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.638664 15237 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.640391 22274 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:18.641137 22274 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:18.644290 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.635174 22068 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:18.626900 22226 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:18.676681 22241 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:18.689487 22227 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.691287 15267 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:06:18.691699 15267 pending_rounds.cc:85] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 11
I20260709 13:06:18.691916 15267 pending_rounds.cc:107] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:06:18.684194 22104 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:18.692140 15267 raft_consensus.cc:2889] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:18.695677 22193 consensus_meta.cc:287] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:06:18.696107 22193 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.680724 22213 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:18.700078 15337 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:18.701187 22213 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:18.701362 22205 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:18.707752 22269 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:06:18.709877 22022 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.711275 22193 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:18.712482 22095 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.002s
W20260709 13:06:18.714443 22206 consensus_meta.cc:287] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.000s
I20260709 13:06:18.714983 22206 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.716210 15344 raft_consensus.cc:1240] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:18.718487 21456 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.723565 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:18.710498 22022 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.678720 22068 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:18.746910 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 102699us
I20260709 13:06:18.712893 22095 raft_consensus.cc:515] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:18.752753 15160 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.748916 15237 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.757426 15160 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:18.718439 22206 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:18.762868 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:18.748580 22226 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:18.769254 15842 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.781131 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.763440 15188 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:18.763404 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.784961 15190 raft_consensus.cc:2368] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:06:18.767438 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.793174 15193 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:18.795058 22213 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:18.795694 22213 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:18.795830 22226 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:18.796658 22213 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.797982 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.798540 15270 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:18.799494 22226 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:18.801251 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.801827 15272 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:18.801954 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.802244 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.802593 15266 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:18.802649 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.803089 22226 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:18.803489 22276 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:06:18.803705 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.803929 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.804260 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.804852 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.805931 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.804963 22226 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:18.747632 22193 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:06:18.761835 21456 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:18.804963 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.775581 22100 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:18.815244 15272 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:18.748826 22068 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.778165 22104 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:18.776757 22134 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:18.817247 22100 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:18.826588 21851 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:18.827047 22134 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.827548 22100 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.828804 21851 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.829092 22134 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:18.831105 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:18.831825 15869 raft_consensus.cc:2368] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23.
I20260709 13:06:18.834573 15270 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:18.820470 22095 leader_election.cc:290] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.835181 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:18.823135 22029 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.887s	user 0.005s	sys 0.017s
I20260709 13:06:18.835892 15339 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 27.
I20260709 13:06:18.814769 22209 raft_consensus.cc:2804] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:18.823379 15272 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:06:18.778072 22093 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:06:18.851692 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.851938 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:18.824329 22022 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.825618 22068 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:18.852921 15870 raft_consensus.cc:1240] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23. Ops: []
W20260709 13:06:18.826385 22277 log.cc:927] Time spent T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:06:18.835095 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 352647us
I20260709 13:06:18.839121 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.861384 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.862700 15263 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:06:18.776248 22014 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:18.843369 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:18.864091 15339 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:18.844188 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:18.818203 15876 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:06:18.866459 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.867745 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.867893 15162 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:18.849553 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:18.855460 22291 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:06:18.870757 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.851344 22029 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.856108 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:18.875003 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.874929 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.857041 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.877250 15272 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:18.858666 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:18.845607 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:18.878310 15338 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:18.868685 15342 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:18.869665 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.869877 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:18.879314 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:18.811477 22220 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:18.880568 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.856518 22226 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:18.879345 15340 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:18.878729 15869 raft_consensus.cc:1240] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:18.886989 15197 raft_consensus.cc:2393] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 15: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:18.888044 15339 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:06:18.888957 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:18.889494 15339 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:18.889777 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.891949 15192 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:18.893754 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:18.882007 22068 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:18.896000 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.911626 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:18.903113 15339 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:18.897100 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:18.916092 15191 raft_consensus.cc:3060] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:18.916082 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.902626 15197 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:06:18.897533 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:18.871112 22193 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:18.920866 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.861042 22209 raft_consensus.cc:697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:18.870309 22104 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:18.922698 15341 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:06:18.923183 15193 raft_consensus.cc:2368] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:06:18.917418 15339 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:18.869596 22022 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:18.929958 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:18.895383 22234 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:18.937423 15341 pending_rounds.cc:85] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 12
I20260709 13:06:18.941586 15341 pending_rounds.cc:107] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:06:18.941965 15341 raft_consensus.cc:2889] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.942365 15341 pending_rounds.cc:107] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:06:18.942633 15341 raft_consensus.cc:2889] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.910563 22250 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:18.948665 15191 raft_consensus.cc:2468] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:18.950580 15237 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.951298 15339 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:06:18.951561 15841 leader_election.cc:304] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:18.882591 22116 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:06:18.882931 22014 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.957896 15267 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:18.938045 22095 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:18.965812 15237 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:18.970294 15340 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:18.918612 22068 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.932778 22233 consensus_queue.cc:1059] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:06:18.976675 22233 raft_consensus.cc:3055] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:18.976817 15346 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:06:18.977167 22233 raft_consensus.cc:740] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:18.977746 22216 raft_consensus.cc:2804] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:18.978394 22216 raft_consensus.cc:697] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:18.956461 21851 raft_consensus.cc:2804] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:18.978196 22233 consensus_queue.cc:260] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:18.979478 21851 raft_consensus.cc:697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:18.947978 22022 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:18.979358 22216 consensus_queue.cc:237] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.980563 21851 consensus_queue.cc:237] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:18.982304 22022 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.954663 22250 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.953060 15339 raft_consensus.cc:1240] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:18.985342 22250 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:18.986068 22209 consensus_queue.cc:237] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:18.984851 15237 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.989554 22250 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:18.993842 22250 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:18.918359 22054 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:06:18.881677 22226 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:18.968493 15338 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:19.010082 15341 raft_consensus.cc:1240] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
W20260709 13:06:19.002643 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65537.8us
I20260709 13:06:19.005198 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:19.017001 15338 raft_consensus.cc:3060] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:18.954219 22229 consensus_queue.cc:1059] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:19.017908 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:18.999912 22122 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:19.040848 22014 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:19.042039 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:19.044024 22015 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:19.044739 22015 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:19.058319 22267 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.369s	user 0.001s	sys 0.001s
I20260709 13:06:19.062274 22095 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:19.063486 22095 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:19.063840 22095 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:19.064713 22095 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:19.065953 22095 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:19.074086 15197 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:19.075644 22215 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.075948 22128 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:19.076388 22215 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:19.077206 22227 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:19.046861 22015 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:19.080868 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:19.081218 22215 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:19.085721 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.087229 22128 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:19.087606 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:19.088640 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:19.090271 22033 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:19.090658 22033 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.091045 22033 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:19.091074 22100 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:19.091614 22100 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.091975 22100 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:19.101454 22033 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:19.102329 15090 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 176) took 14132 ms (client timeout 15000 ms). Trace:
I20260709 13:06:19.105152 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:19.105496 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.107646 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:19.109308 15093 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 69) took 16941 ms (client timeout 15000 ms). Trace:
I20260709 13:06:19.087483 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.111635 22000 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:19.111894 15309 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.112709 22286 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:19.113376 22286 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:19.116129 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:19.116874 21846 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:19.117259 21846 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.117674 21846 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:19.102727 15090 rpcz_store.cc:269] 0709 13:06:04.969849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.970008 (+   159us) service_pool.cc:224] Handling call
0709 13:06:19.102246 (+14132238us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:13.357313 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:13.358024 (+   711us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:13.358075 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:06:13.358097 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:13.451980 (+ 93883us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:13.467879 (+ 15899us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:13.472265 (+  4386us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:06:13.533686 (+ 61421us) tablet.cc:701] Row locks acquired
0709 13:06:13.533756 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:06:13.534001 (+   245us) write_op.cc:270] Start()
0709 13:06:13.534206 (+   205us) write_op.cc:276] Timestamp: P: 1783602373533920 usec, L: 0
0709 13:06:13.534254 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:06:13.584835 (+ 50581us) log.cc:844] Serialized 11712 byte log entry
0709 13:06:14.092567 (+507732us) op_driver.cc:464] REPLICATION: finished
0709 13:06:14.248120 (+155553us) write_op.cc:301] APPLY: starting
0709 13:06:14.248216 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:15.037356 (+789140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:15.037470 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:15.441460 (+403990us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:15.441934 (+   474us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 13:06:15.442009 (+    75us) write_op.cc:312] APPLY: finished
0709 13:06:15.442701 (+   692us) log.cc:844] Serialized 259 byte log entry
0709 13:06:15.599592 (+156891us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.608110 (+  8518us) write_op.cc:454] Released schema lock
0709 13:06:15.608214 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:15.614599 (+  6385us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.614633 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91129,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":155247,"apply.run_cpu_time_us":58426,"apply.run_wall_time_us":1366380,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129707,"num_ops":30,"prepare.queue_time_us":171444,"prepare.run_cpu_time_us":17684,"prepare.run_wall_time_us":261392,"raft.queue_time_us":250003,"raft.run_cpu_time_us":11096,"raft.run_wall_time_us":111709,"replication_time_us":558123,"thread_start_us":561060,"threads_started":5,"wal-append.queue_time_us":244570,"wal-append.run_cpu_time_us":25806,"wal-append.run_wall_time_us":2543762}]]}
I20260709 13:06:19.127431 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:19.127686 21456 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:19.128223 21456 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:19.129176 21456 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:19.109709 15093 rpcz_store.cc:269] 0709 13:06:02.168215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.168384 (+   169us) service_pool.cc:224] Handling call
0709 13:06:19.109217 (+16940833us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:16.801115 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:16.915549 (+114434us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:16.923657 (+  8108us) write_op.cc:435] Acquired schema lock
0709 13:06:16.930081 (+  6424us) tablet.cc:662] Decoding operations
0709 13:06:17.026943 (+ 96862us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:17.030948 (+  4005us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:17.031963 (+  1015us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:17.034609 (+  2646us) tablet.cc:701] Row locks acquired
0709 13:06:17.034632 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:06:17.034778 (+   146us) write_op.cc:270] Start()
0709 13:06:17.034907 (+   129us) write_op.cc:276] Timestamp: P: 1783602377034734 usec, L: 0
0709 13:06:17.034930 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:17.035584 (+   654us) log.cc:844] Serialized 1354 byte log entry
0709 13:06:17.214097 (+178513us) op_driver.cc:464] REPLICATION: finished
0709 13:06:17.418422 (+204325us) write_op.cc:301] APPLY: starting
0709 13:06:17.422892 (+  4470us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:17.449909 (+ 27017us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:17.450014 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:17.570139 (+120125us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:17.595974 (+ 25835us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:06:17.599171 (+  3197us) write_op.cc:312] APPLY: finished
0709 13:06:17.599415 (+   244us) log.cc:844] Serialized 40 byte log entry
0709 13:06:17.599588 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:17.599701 (+   113us) write_op.cc:454] Released schema lock
0709 13:06:17.599750 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:17.600198 (+   448us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:17.600229 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2048752,"reported_tablets":6,"spinlock_wait_cycles":219264,"child_traces":[["op",{"apply.queue_time_us":178438,"apply.run_cpu_time_us":6824,"apply.run_wall_time_us":202552,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16685,"num_ops":3,"prepare.queue_time_us":211835,"prepare.run_cpu_time_us":19057,"prepare.run_wall_time_us":347920,"raft.queue_time_us":63518,"raft.run_cpu_time_us":5621,"raft.run_wall_time_us":164863,"replication_time_us":159306,"thread_start_us":338285,"threads_started":4,"wal-append.queue_time_us":72742,"wal-append.run_cpu_time_us":6413,"wal-append.run_wall_time_us":1497283}]]}
I20260709 13:06:19.132057 22093 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:19.135823 22023 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:19.144151 15343 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:19.145505 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:19.146059 15342 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:19.146293 22023 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:19.146744 22023 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.147183 22023 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:19.149403 21846 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:19.153021 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:19.154374 15309 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.155369 22132 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:19.159539 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.161077 15309 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.009464 22250 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:06:19.166131 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 148293us
I20260709 13:06:19.168277 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:19.170277 15266 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 17.
I20260709 13:06:19.172024 15238 leader_election.cc:400] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:06:19.172382 15238 leader_election.cc:403] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.173307 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:19.173918 15266 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:06:19.177340 15338 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:06:19.178375 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 251817us
I20260709 13:06:19.029765 22220 consensus_queue.cc:1059] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
I20260709 13:06:19.162351 22128 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:19.169674 22015 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.127454 22100 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:19.177064 21790 raft_consensus.cc:2764] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260709 13:06:19.208521 22297 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:06:19.208797 22104 raft_consensus.cc:3060] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:06:19.209146 22111 consensus_queue.cc:1059] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:19.211952 22233 raft_consensus.cc:3060] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:19.213157 22301 raft_consensus.cc:3055] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:19.213543 22220 raft_consensus.cc:3055] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:19.213963 22220 raft_consensus.cc:740] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:19.214738 22220 consensus_queue.cc:260] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:19.213578 22301 raft_consensus.cc:740] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:19.216787 22301 consensus_queue.cc:260] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:19.218021 22301 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:19.195751 22133 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:06:19.220046 22033 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:19.163582 22249 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.173s
I20260709 13:06:19.159468 22122 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:19.222378 15193 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:06:19.199147 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:19.196535 22029 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:19.226177 22295 log.cc:927] Time spent T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:06:19.206952 21846 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:19.234344 15197 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:06:19.239221 15192 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:19.246408 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:19.257156 15196 raft_consensus.cc:2368] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21.
I20260709 13:06:19.259399 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:19.271481 15270 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:19.228868 15266 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:19.290450 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:19.291399 15266 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:06:19.232810 22022 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:19.296168 15312 leader_election.cc:400] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21.
I20260709 13:06:19.303722 15312 leader_election.cc:403] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:19.305753 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 269822us
W20260709 13:06:19.308480 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.207816 22015 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:19.325805 15309 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.328434 22000 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:19.329101 22000 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:19.299229 22022 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:19.338604 22260 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:19.351085 15266 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 28.
I20260709 13:06:19.365409 22200 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:19.335764 22214 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 20. Current term is 21.
I20260709 13:06:19.337689 22068 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:19.369297 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 166536us
I20260709 13:06:19.361877 22022 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:19.341902 22226 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:19.336958 22133 consensus_queue.cc:1059] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:19.364473 21458 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.362258 22260 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:19.379810 15238 leader_election.cc:400] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:06:19.380318 15238 leader_election.cc:403] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.368019 22229 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:19.402014 15271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45862 (request call id 3288) took 1146 ms. Trace:
I20260709 13:06:19.402422 15271 rpcz_store.cc:276] 0709 13:06:18.255484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.296176 (+ 40692us) service_pool.cc:224] Handling call
0709 13:06:18.296460 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.847791 (+551331us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b180039b140. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5705bfb 00007f36e571064b
0709 13:06:18.847921 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.847948 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.857552 (+  9604us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.162796 (+305244us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:19.183199 (+ 20403us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.387446 (+204247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.387665 (+   219us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.387717 (+    52us) raft_consensus.cc:1685] finished
0709 13:06:19.401836 (+ 14119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.401961 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48654,"prepare.queue_time_us":20244,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":61205,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":37168,"spinlock_wait_cycles":22121728,"thread_start_us":505480,"threads_started":3,"wal-append.queue_time_us":365486}
W20260709 13:06:19.410018 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.389039 22104 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19.
I20260709 13:06:19.389768 22234 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:19.448340 21655 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:19.451007 15841 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.382473 22201 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:06:19.382922 21458 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:19.386384 22226 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:06:19.461330 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:19.459070 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:19.406688 22100 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:19.401141 22250 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:06:19.401626 22023 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:19.474385 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 179419us
I20260709 13:06:19.459046 22122 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:19.462142 22249 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 22. Current term is 23.
I20260709 13:06:19.398636 22229 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:19.506356 15162 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.529421 15162 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.536931 15162 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:19.538082 15162 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:19.526049 22292 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:19.561219 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:19.562063 15270 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:06:19.466356 22311 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:06:19.535708 21456 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:06:19.572245 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.583798 22308 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:06:19.591863 22307 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260709 13:06:19.592160 22220 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:19.593485 22304 log.cc:927] Time spent T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:06:19.595430 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:19.596204 15340 raft_consensus.cc:2393] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 28: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:19.597446 15338 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:19.598317 22132 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:19.563817 22015 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:19.556689 22029 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:19.600423 22023 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:19.600835 21456 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:19.620223 15342 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:06:19.621045 15338 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:06:19.611578 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:19.614531 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:19.616755 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:19.623618 15344 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:19.619138 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:19.624575 15876 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:19.625730 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:19.626595 15340 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:19.627804 15270 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:19.632012 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:19.635984 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:19.637116 15338 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:19.643465 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:19.629150 21456 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:19.651839 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:19.673492 22300 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:19.630201 21655 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:19.683413 21655 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:19.683876 21655 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:19.707490 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:19.692265 21456 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:19.569762 22125 consensus_queue.cc:1059] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 13:06:19.745015 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
W20260709 13:06:19.747138 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 130324us
I20260709 13:06:19.747912 15162 leader_election.cc:400] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23.
W20260709 13:06:19.696383 22320 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:06:19.714898 15338 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:19.752921 15340 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 28.
I20260709 13:06:19.752555 15344 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:19.689677 22015 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.698663 22257 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:19.699196 22000 raft_consensus.cc:3055] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:19.695066 22029 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:19.750617 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 160968us
I20260709 13:06:19.761324 15337 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:19.707561 21458 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:19.744417 21851 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:20.016992 21851 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.017458 21851 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:19.765960 22306 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.403s	user 0.000s	sys 0.004s
I20260709 13:06:19.751121 22209 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:06:19.764298 22300 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:20.024618 22300 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.027385 22289 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.027981 22289 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.028177 21851 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.030066 22289 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:20.030699 21851 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:20.034468 22289 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.035250 22289 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.038082 22289 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:20.039433 22122 consensus_queue.cc:1059] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:20.040557 22122 raft_consensus.cc:3055] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:20.040922 22122 raft_consensus.cc:740] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:20.041761 22122 consensus_queue.cc:260] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:20.044478 22326 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 13:06:20.046411 22029 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.003389 22258 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.052042 22258 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.054414 22258 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:19.979112 22000 raft_consensus.cc:740] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:20.059942 22000 consensus_queue.cc:260] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.061049 22000 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:20.070643 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:19.979637 22015 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.089618 22015 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:19.924116 22257 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:20.091425 22257 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.092716 22257 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:20.095671 22233 consensus_meta.cc:287] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.883s	user 0.012s	sys 0.000s
I20260709 13:06:19.752751 22022 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:20.003331 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 231578us
I20260709 13:06:19.769104 22023 raft_consensus.cc:3055] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:20.108256 15264 raft_consensus.cc:2468] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:06:20.103528 15162 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:19.980312 22125 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.128988 15194 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:06:20.043018 22122 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:20.136407 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:20.105618 22289 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.106350 22023 raft_consensus.cc:740] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:20.155260 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.159062 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:20.161885 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 416988us
I20260709 13:06:20.157306 15266 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:20.151643 22321 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:20.200853 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:20.197278 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.199183 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.199585 15268 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:20.207718 15271 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:20.126576 22125 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.209729 22260 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.211934 22125 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.201135 22321 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:20.214112 22321 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:20.188546 22316 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.218500 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:20.219257 15267 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:20.225881 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.226763 15263 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 27.
I20260709 13:06:20.152575 22289 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.194794 22226 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.188601 21655 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:20.238713 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 647190us
I20260709 13:06:20.244539 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:20.245296 15269 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:20.268851 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.271986 15192 raft_consensus.cc:1275] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:20.272835 15267 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:20.273597 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:20.274381 15197 raft_consensus.cc:1275] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:06:20.275830 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.275992 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.276684 15196 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 28.
I20260709 13:06:20.278484 15196 raft_consensus.cc:1275] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:06:20.281539 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 126276us
I20260709 13:06:20.285868 15189 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:20.287606 15189 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:20.298030 15191 raft_consensus.cc:1240] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 24. Current term is 25. Ops: []
W20260709 13:06:20.299985 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.314287 15196 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:20.216913 22023 consensus_queue.cc:260] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.315833 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.316447 15342 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 28.
I20260709 13:06:20.317591 15095 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 10 to 11, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 11 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:20.319936 15337 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:06:20.320613 15095 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 6 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:20.323123 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.323144 22234 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.323729 15188 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:06:20.323905 15346 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:20.324050 22234 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:20.324558 22337 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:20.326373 22234 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.326586 21456 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.329440 22209 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.227861 22316 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.313014 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:20.235677 22226 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.340332 15269 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
I20260709 13:06:20.348857 15160 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:20.348269 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:20.358492 21456 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:20.360502 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:20.361851 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:20.366683 22100 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:20.368606 22100 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:20.369057 22100 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.369408 22100 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:20.372207 22185 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:20.372855 22185 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:20.373860 22185 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.375716 21456 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:20.376336 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47147.9us
I20260709 13:06:20.376734 21456 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:20.416841 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 99618.7us
W20260709 13:06:20.429699 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 66726.3us
I20260709 13:06:20.329993 22209 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.317603 22310 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:06:20.348620 22022 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.379633 22193 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:20.381201 22348 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.440591 21851 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.444856 22104 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.476728 15264 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44984 (request call id 611) took 1017 ms. Trace:
I20260709 13:06:20.477085 15270 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:20.477236 15264 rpcz_store.cc:276] 0709 13:06:19.459361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.459568 (+   207us) service_pool.cc:224] Handling call
0709 13:06:20.476489 (+1016921us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54001d97d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:20.476665 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1450389760}
I20260709 13:06:20.453006 22095 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:20.492313 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 130512us
I20260709 13:06:20.494751 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:20.497179 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.499321 22357 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.500500 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.500147 22357 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.466899 22205 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.504096 22205 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.506126 22205 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:20.514045 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:20.514364 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 166172us
I20260709 13:06:20.540596 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:20.531431 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:20.544700 15343 raft_consensus.cc:1275] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:20.548980 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.551717 15340 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:20.469924 22193 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:20.478969 22201 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.564550 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.566845 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.567822 15337 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:06:20.485365 21851 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:20.573700 22000 consensus_meta.cc:287] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 13:06:20.574189 21851 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:20.575599 22343 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:06:20.576061 22193 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:20.577179 22346 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:06:20.577917 21655 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:20.579097 22349 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:06:20.516913 22355 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.579990 22355 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.592795 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:20.545701 22133 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:20.522250 22357 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:20.557981 22250 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:20.591470 15237 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:20.474042 22356 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.125s
I20260709 13:06:20.510380 22104 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:20.460016 22348 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.544337 22095 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.617054 22322 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.587069 21790 consensus_queue.cc:1048] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
W20260709 13:06:20.651921 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 103066us
I20260709 13:06:20.620064 22250 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.656664 22341 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:20.593492 22201 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:20.658016 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 66642.4us
I20260709 13:06:20.659780 22111 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:20.663707 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.663549 22111 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.620703 22133 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.622977 22274 consensus_queue.cc:1048] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:20.674427 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:20.658281 22029 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.677629 22111 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:20.670469 22300 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.693653 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 128709us
I20260709 13:06:20.661281 22250 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:20.671310 22316 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.687800 22353 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:20.716174 22369 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:20.718024 22201 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.657204 22364 consensus_queue.cc:1048] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:06:20.720171 22095 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:20.722322 22104 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:20.658983 22322 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.686115 15162 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:20.729755 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 57020us
I20260709 13:06:20.688263 22133 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:20.710297 22029 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.692140 21851 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.733419 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47436.1us
I20260709 13:06:20.691761 22226 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.743145 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.769438 15342 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:20.736064 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.743575 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.748322 22347 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:06:20.752851 22209 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.753034 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.754209 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.755162 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.762813 22348 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.738185 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.765224 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:20.766185 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.770777 15162 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:20.773872 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.784835 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.774591 15237 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:20.732134 22227 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:20.777061 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.778147 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.787495 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.788491 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:20.775743 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.788321 15337 raft_consensus.cc:1275] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:06:20.797179 15191 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 25: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:20.797489 15345 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
I20260709 13:06:20.682031 22366 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.095s
W20260709 13:06:20.787956 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 170149us
I20260709 13:06:20.799592 15188 raft_consensus.cc:1240] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:06:20.802923 15841 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:20.804579 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:20.733487 22364 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:06:20.794617 22022 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:20.809794 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:20.729317 22300 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.810878 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:20.801097 22257 consensus_meta.cc:287] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.001s
I20260709 13:06:20.798786 22348 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:20.844326 15870 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:20.845747 22029 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.816644 22095 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:20.847412 22095 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.847779 22095 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:20.844360 22348 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.852288 22100 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.773402 21851 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.816390 22190 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:06:20.819622 22350 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:20.856920 22350 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.858539 22100 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 29 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.864230 22104 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:20.864831 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45973.4us
I20260709 13:06:20.865069 22104 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.866122 22301 consensus_queue.cc:1059] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:20.867691 22301 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:20.867462 22201 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:20.868233 22301 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:20.868782 22201 consensus_queue.cc:1243] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:06:20.869217 22301 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.870483 22301 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:20.824473 22370 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:06:20.825125 22313 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:20.816355 22359 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:20.825964 22311 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:20.816206 22226 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:20.831245 22321 consensus_meta.cc:287] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
I20260709 13:06:20.834107 22274 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:20.907234 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:20.796576 22341 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:20.841261 22229 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:20.875706 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 66029.5us
I20260709 13:06:20.874073 22313 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:20.912124 22341 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.836544 22300 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:20.837550 22322 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:20.883966 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.912601 22313 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:20.914362 22313 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:20.883205 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 99277.1us
I20260709 13:06:20.934413 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:20.941988 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:20.943564 15312 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:20.944495 21846 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:20.945513 21846 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:20.935141 22321 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.949496 15192 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:20.933537 22226 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.953739 22226 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.852377 22348 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:20.959977 15192 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
W20260709 13:06:20.909732 22122 consensus_meta.cc:287] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.761s	user 0.008s	sys 0.004s
I20260709 13:06:20.881947 22205 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.950763 22321 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:20.976890 22229 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:20.977551 22314 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.977838 22229 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.978457 22229 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.978229 22314 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.979254 22274 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.979773 22274 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.980913 22229 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.981150 22314 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.981452 22229 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.981575 22226 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:20.934903 22316 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:20.985416 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:20.957270 21790 consensus_queue.cc:1175] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" responder_term: 18 status { last_received { term: 18 index: 13 } last_committed_idx: 12 last_received_current_leader { term: 18 index: 13 } }
I20260709 13:06:20.988933 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:20.957899 22350 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.973089 22364 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:20.993681 22373 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:20.993187 22364 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.994292 22373 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.959143 22257 consensus_queue.cc:1048] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:06:20.996786 15269 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 17.
I20260709 13:06:20.997711 21851 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.999344 22373 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:20.982192 22274 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.002851 22364 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:20.910910 22111 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.011319 22111 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:21.014328 22323 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 1.318s	user 0.009s	sys 0.008s
I20260709 13:06:20.993150 22335 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:20.986439 22093 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
W20260709 13:06:21.043941 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 54967.8us
I20260709 13:06:21.048658 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.049602 15263 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 13.
I20260709 13:06:21.051530 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:21.081890 15341 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34546 (request call id 2580) took 1771 ms. Trace:
I20260709 13:06:21.052390 15876 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:21.082393 15341 rpcz_store.cc:276] 0709 13:06:19.310980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.324018 (+ 13038us) service_pool.cc:224] Handling call
0709 13:06:19.324429 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.326757 (+  2328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.326786 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:19.327389 (+   603us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.474009 (+146620us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:19.474066 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.474191 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.013701 (+1539510us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:21.015666 (+  1965us) raft_consensus.cc:1685] finished
0709 13:06:21.015693 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.081808 (+ 66115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1874,"raft.queue_time_us":1997,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":70647168,"thread_start_us":146141,"threads_started":1,"wal-append.queue_time_us":368229}
I20260709 13:06:20.998490 22095 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:20.981997 22229 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.048049 15162 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:20.982082 22226 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:20.966377 21655 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:06:21.111425 22104 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:20.974367 22205 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.114132 22205 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:21.090806 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 69592.4us
W20260709 13:06:21.095937 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 48023.6us
I20260709 13:06:21.119264 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.096529 21456 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:21.098688 22250 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.099538 22367 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.132488 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.119923 15196 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:21.139487 15312 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:21.139758 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.121856 21456 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.146862 21456 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:21.141403 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.147605 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46346 (request call id 3678) took 1882 ms. Trace:
I20260709 13:06:21.147797 15346 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:21.147995 15194 rpcz_store.cc:276] 0709 13:06:19.264945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.265143 (+   198us) service_pool.cc:224] Handling call
0709 13:06:19.265821 (+   678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.130905 (+865084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.147275 (+1016370us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54000c08d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570de01 00007f36e570c83e 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6
0709 13:06:21.147550 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980615936}
I20260709 13:06:21.148594 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.149129 15342 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:21.148988 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.149727 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:21.141700 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.150276 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.141435 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
W20260709 13:06:21.158347 22375 log.cc:927] Time spent T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.445s	user 0.001s	sys 0.000s
I20260709 13:06:21.160936 22200 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.161098 22095 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.161562 22200 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.169807 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:20.990475 22316 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:21.170118 21456 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.168998 15343 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:06:21.176330 15195 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:21.177645 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:21.129360 22214 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.141695 22335 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:21.141296 22132 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.187691 15265 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:06:21.186972 21456 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.169551 22210 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.190735 22014 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.199811 22014 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.181725 22029 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:21.182186 22226 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.202625 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.195814 15342 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 29.
I20260709 13:06:21.163354 22206 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:06:21.181831 21846 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.189687 22335 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.207172 15162 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:21.147467 22367 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.191519 22214 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.194478 22132 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.204196 22029 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.224284 22029 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:21.201346 22210 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:21.239473 22395 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:21.234985 22200 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.242624 22210 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.232146 22260 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.221324 21846 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.245654 21846 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.220150 22335 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.194674 22185 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:06:21.246272 22350 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:06:21.255657 22286 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.286631 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:21.286938 15839 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:21.256130 21846 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:21.288846 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.259668 22214 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.242393 22132 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.236006 22316 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:21.263728 15270 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44984 (request call id 614) took 1556 ms. Trace:
I20260709 13:06:21.263886 22250 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.230158 22367 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.295979 22365 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.268244 22029 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.278162 22348 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.278924 22388 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.280454 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:21.290746 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:21.294212 15270 rpcz_store.cc:276] 0709 13:06:19.707660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.711444 (+  3784us) service_pool.cc:224] Handling call
0709 13:06:20.476681 (+765237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.477524 (+   843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.263540 (+786016us) spinlock_profiling.cc:243] Waited 749 ms on lock 0x7b54001d97d0. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570c8ad 00007f36ea6d1419 00007f36e3c48bd4 00007f36e3c48b62 00007f36e3c48a91 00007f36e3c48a0c 00007f36e3c47cc2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:21.263670 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1723770624}
I20260709 13:06:21.290182 22286 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.291769 22095 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:21.290529 22350 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:21.301469 15237 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:21.354056 15870 raft_consensus.cc:2368] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:06:21.291647 21846 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
W20260709 13:06:21.359913 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 58571.7us
W20260709 13:06:21.363488 22398 log.cc:927] Time spent T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:06:21.366145 22029 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.366544 22364 consensus_queue.cc:1048] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:06:21.369004 15237 leader_election.cc:400] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:06:21.370252 15237 leader_election.cc:403] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:21.374418 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.375286 15343 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:21.356405 22095 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:21.385097 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.388273 22332 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.202s	user 0.000s	sys 0.006s
W20260709 13:06:21.389911 22330 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 1.640s	user 0.000s	sys 0.005s
W20260709 13:06:21.391253 22394 log.cc:927] Time spent T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:21.396543 22373 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:21.300187 22365 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.404477 15343 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:21.409041 22365 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.372035 22190 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:21.410044 22190 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.410580 22190 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:21.416219 22348 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.383996 22095 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:21.424408 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.425966 15269 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:21.428200 22371 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:21.399600 22350 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.403918 21846 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:21.357583 22388 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.439836 22388 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.404944 22226 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.440739 22226 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.406515 22286 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.447480 22226 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.453346 22373 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:06:21.454449 15162 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:21.383216 22335 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.460417 15344 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 13:06:21.474496 22095 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:21.491201 15346 raft_consensus.cc:2368] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
I20260709 13:06:21.491983 22362 consensus_queue.cc:1059] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:06:21.495613 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.495236 22335 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.487092 22116 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:21.496668 22116 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:21.482795 22190 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:21.497565 22116 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.510286 22014 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.511067 22289 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.511293 22095 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.514621 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:21.515409 15270 raft_consensus.cc:2393] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 18: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:21.516111 15339 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3474) took 1903 ms. Trace:
I20260709 13:06:21.516491 15339 rpcz_store.cc:276] 0709 13:06:19.612873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.615096 (+  2223us) service_pool.cc:224] Handling call
0709 13:06:19.615331 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.615509 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:06:20.109471 (+493962us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.515720 (+1406249us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b1800473440. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287
0709 13:06:21.515805 (+    85us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.515844 (+    39us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:06:21.515885 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.515943 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.516042 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31222,"prepare.queue_time_us":570743,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2618,"raft.queue_time_us":107838,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":6943,"spinlock_wait_cycles":6892928,"thread_start_us":757559,"threads_started":3,"wal-append.queue_time_us":197804,"wal-append.run_cpu_time_us":1391,"wal-append.run_wall_time_us":1044515}
I20260709 13:06:21.530083 15339 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:06:21.532075 22190 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:21.533183 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:21.536581 22362 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:06:21.550154 22373 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.550791 22373 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.551192 22201 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:21.551795 22201 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.553678 22234 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.554268 22234 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.555843 22190 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.556401 22190 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.556393 22388 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.556553 22301 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.559432 22301 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.561442 22388 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.563232 22233 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.563778 22233 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.565521 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.566134 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.573640 15344 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:21.574658 15162 leader_election.cc:400] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
I20260709 13:06:21.574988 15162 leader_election.cc:403] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:21.574872 15272 raft_consensus.cc:1240] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:06:21.593837 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.594719 15271 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
W20260709 13:06:21.601504 22368 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.007s	sys 0.019s
W20260709 13:06:21.601925 22368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.007s	sys 0.019s
I20260709 13:06:21.610105 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.611291 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.611717 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.613279 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.613546 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:21.610513 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.600435 22015 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.616359 22358 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:21.618012 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.618896 22229 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.629444 22234 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.623364 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.613090 22014 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.642679 22014 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.644912 22014 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:21.645042 15192 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40392 (request call id 528) took 1372 ms (client timeout 1610 ms). Trace:
W20260709 13:06:21.645475 15192 rpcz_store.cc:269] 0709 13:06:20.273108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.273313 (+   205us) service_pool.cc:224] Handling call
0709 13:06:21.644877 (+1371564us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54003e62d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:21.644990 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553104128}
I20260709 13:06:21.634438 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.634337 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.649287 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.632865 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.622125 22201 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.650076 15264 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:21.637082 22373 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.605813 22321 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:06:21.637945 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.650681 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.639652 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.640601 15870 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
W20260709 13:06:21.645849 15842 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.610s (SENT) [suppressed 50 similar messages]
I20260709 13:06:21.652631 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.649819 15271 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:21.651127 15263 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:21.617937 22335 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.637243 22301 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.656374 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.656405 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.662344 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.662531 15266 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:21.657155 22335 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.653234 22128 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.667505 22128 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:21.663051 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.671384 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.672140 15271 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:21.673826 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.675499 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.654011 22054 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:21.677170 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.679594 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:21.677356 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.679708 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.665060 22264 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:21.681114 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.683931 15263 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:21.680773 15271 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:21.684933 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.685760 15264 raft_consensus.cc:2410] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:06:21.692123 15268 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:21.693404 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.694202 15268 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 15.
I20260709 13:06:21.695690 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.696449 15268 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:21.697479 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 29 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:21.698506 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.698544 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:21.675400 22133 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:21.705127 15267 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:06:21.704946 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:21.707800 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:21.670346 22289 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260709 13:06:21.708807 15195 raft_consensus.cc:1240] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:06:21.711537 15266 raft_consensus.cc:3060] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.717135 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.711531 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.719264 15193 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 24 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260709 13:06:21.712481 15268 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:21.681012 22321 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:21.731020 22321 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:21.689093 21846 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:21.732079 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:21.732417 21846 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:21.732844 21846 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:21.733273 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.733877 15191 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:21.735195 22128 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:21.744136 22289 consensus_queue.cc:1243] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer 5e6eed5c7a6b4571b5f898002fc990d2 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:06:21.744644 22367 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:21.744923 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:21.745779 15870 raft_consensus.cc:2393] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 23: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:21.745628 22365 consensus_queue.cc:1059] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:21.745004 22367 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:21.747656 22367 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.748240 15189 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:21.749033 22367 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:21.755743 22313 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:21.734890 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.728730 22335 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.786895 22125 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:21.794871 22233 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.742866 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:21.806788 15266 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
W20260709 13:06:21.813076 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 96022.6us
W20260709 13:06:21.813488 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 167653us
I20260709 13:06:21.814416 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:21.817736 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.820195 15268 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 29.
I20260709 13:06:21.820571 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:21.814539 22300 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:21.827745 15312 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.837353 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:21.838874 15272 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:21.845283 15266 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:06:21.846274 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 103482us
I20260709 13:06:21.846983 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:21.848052 15309 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:21.848155 22132 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:21.848605 22132 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.848901 22397 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:21.849134 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.849514 22397 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.850111 22397 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.828495 22122 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:06:21.852100 22396 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:21.852559 22396 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.852918 22396 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:21.818924 22334 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:21.848973 22132 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:21.857437 22334 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:21.860076 22334 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:21.857452 22122 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:21.864053 22015 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20.
I20260709 13:06:21.834209 22289 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.862793 22122 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:21.866778 22289 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.867704 22122 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:21.868857 22122 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:21.868996 22289 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:21.869694 22300 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.870435 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:21.732141 22321 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:21.871695 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.872509 22321 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:21.874287 22264 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:21.876623 22367 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:21.877920 15312 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:21.880688 22015 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.888870 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59300.7us
I20260709 13:06:21.892112 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:21.905534 15270 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:21.915078 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.917251 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45630us
I20260709 13:06:21.917996 15271 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:21.918030 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:21.828719 22347 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:21.919402 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.920406 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.927353 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:21.924072 15272 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:21.928903 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.929736 15344 raft_consensus.cc:2410] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for term 24 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260709 13:06:21.929379 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.931246 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.931838 15344 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:21.933012 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.931216 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.934940 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.936391 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.937407 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.937407 15270 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:21.939610 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.918977 22258 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:21.941358 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:21.953083 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.941700 15337 raft_consensus.cc:2368] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 28. Current term is 29.
I20260709 13:06:21.948756 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.951171 15190 raft_consensus.cc:2468] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:21.905089 22335 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:21.957867 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.958470 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:21.952108 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:21.925850 22054 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:21.947976 22116 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:21.936097 22216 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.952713 22264 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:21.953411 22350 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:21.919116 22015 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:21.957850 22335 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:21.969210 22054 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.964187 22347 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:06:21.987787 22300 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:21.973280 22264 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:22.001645 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.003445 15344 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21.
I20260709 13:06:21.983804 22335 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:21.992350 22054 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:22.030778 22128 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:22.033197 22258 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:22.034050 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.038199 15340 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:22.034714 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:21.977417 22132 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.006364 22264 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:21.975088 22216 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.042425 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.045069 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.049328 15339 raft_consensus.cc:2368] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:06:22.050485 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.052525 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.054054 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.055749 15340 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:22.059813 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.062742 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.067365 15841 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.072464 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:22.072355 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.061795 15272 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:22.075517 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.106431 15309 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.041040 22201 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.072008 22367 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:22.122754 22367 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.123306 22289 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:22.123891 22289 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.124382 22289 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:22.125478 22367 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.120389 22373 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.126482 22373 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.127283 22133 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:22.129128 22410 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:22.129313 22373 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.079427 15237 leader_election.cc:400] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 28. Current term is 29.
I20260709 13:06:22.133193 15237 leader_election.cc:403] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Cancelling election due to peer responding with higher term
I20260709 13:06:22.121548 15309 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:22.112761 15265 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:22.134811 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:22.060890 15270 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:22.141887 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.181016 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 238489us
I20260709 13:06:21.869493 22397 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.183279 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:22.113977 22361 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:22.040550 22128 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:22.076334 22014 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:22.207525 15189 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
W20260709 13:06:22.221886 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 155648us
I20260709 13:06:22.131510 22249 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.040737 22258 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.134941 22111 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.200490 22133 raft_consensus.cc:2804] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:06:22.323395 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 140212us
I20260709 13:06:22.273587 22250 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader election lost for term 28. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 28. Current term is 29.
I20260709 13:06:22.333629 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.229321 22355 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.305194 22014 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.136734 22201 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.312328 22132 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.313058 22015 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:22.133425 21846 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.315513 22128 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:22.315766 22415 log.cc:927] Time spent T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:06:22.201844 22373 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.181600 22348 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.316565 22000 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:06:22.365115 22313 consensus_meta.cc:287] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.001s
I20260709 13:06:22.332021 22111 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.365626 22201 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.369019 21846 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.371132 22014 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.371862 22373 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.324893 22249 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.343173 22133 raft_consensus.cc:697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:06:22.373525 22416 log.cc:927] Time spent T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:06:22.381564 22190 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:22.396991 22396 consensus_meta.cc:287] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:06:22.379374 22348 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.399524 22361 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:22.405622 22388 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.402756 22396 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.409444 22373 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.410924 22396 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.412055 22397 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.350665 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:22.303721 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:22.448716 15268 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:06:22.450088 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 146317us
I20260709 13:06:22.338899 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.353613 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:22.471771 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 116054us
I20260709 13:06:22.472342 15341 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:22.479841 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:22.375015 22000 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.485242 22000 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:22.490933 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:22.492216 15876 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:22.494194 22133 consensus_queue.cc:237] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.494621 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:22.499689 22201 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:22.499778 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.502967 15270 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:22.522395 22258 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.528966 22289 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.503785 22111 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.530966 22264 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:22.553169 22335 consensus_meta.cc:287] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.014s
I20260709 13:06:22.554013 22335 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:22.557621 22335 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:22.558573 22264 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.531759 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:22.531771 22361 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:22.542042 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 353138us
I20260709 13:06:22.542454 22249 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.567952 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.568915 22249 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:22.569602 22249 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.570142 22249 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:22.571659 22421 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:22.573922 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:22.574532 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.575636 22193 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:22.504880 22216 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:22.544186 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.545568 22015 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:22.546607 22358 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:06:22.550206 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93810.3us
I20260709 13:06:22.538682 22348 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.588430 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:22.597149 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:22.604542 22023 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:22.613324 22289 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.615453 22133 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.616758 15272 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:22.580415 22358 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:22.617764 15268 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:22.622053 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:22.638998 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47484.3us
I20260709 13:06:22.640182 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.640246 22436 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:22.642464 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 45671.9us
I20260709 13:06:22.647732 22022 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:22.648397 22022 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.648798 22022 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:22.653546 22015 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.659021 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.660974 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.661198 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:22.661689 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:22.664104 22347 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:22.667670 22029 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:22.668524 22194 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:22.671361 22133 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.675336 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:22.643771 22436 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.670722 22194 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:06:22.654469 22015 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.685807 22015 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:22.687686 22414 log.cc:927] Time spent T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.555s	user 0.005s	sys 0.000s
I20260709 13:06:22.691385 22133 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.693029 22234 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.706818 22234 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.708922 22033 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:22.709631 22234 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:22.713157 22409 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.011s	sys 0.018s
W20260709 13:06:22.713903 22409 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.012s	sys 0.018s
I20260709 13:06:22.695441 22436 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:22.704172 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.705967 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:22.717140 15188 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 25: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:22.718071 22418 log.cc:927] Time spent T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
W20260709 13:06:22.715997 22413 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.675s	user 0.002s	sys 0.000s
I20260709 13:06:22.738021 22226 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:22.738912 22226 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.739355 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:22.740382 15188 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:22.741984 22226 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.768101 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:22.773234 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:22.777271 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.776592 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:22.799433 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:22.803668 15192 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40392 (request call id 530) took 1107 ms. Trace:
I20260709 13:06:22.806567 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:22.809983 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:22.812078 15194 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:22.815465 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.804211 15192 rpcz_store.cc:276] 0709 13:06:21.663540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.664434 (+   894us) service_pool.cc:224] Handling call
0709 13:06:21.664807 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.673261 (+  8454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.673290 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.676457 (+  3167us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.986451 (+309994us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:21.987468 (+  1017us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.541271 (+553803us) spinlock_profiling.cc:243] Waited 6.04 ms on lock 0x7b1800329980. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e259ac0a 00007f36ebcda219 00007f36e2622a40 00007f36e261d4e4 00007f36e261d455 00007f36e5705060 00007f36e5717716 00007f36e5728287 00007f36e5728208
0709 13:06:22.541761 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.541918 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.686460 (+144542us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:22.755792 (+ 69332us) raft_consensus.cc:1685] finished
0709 13:06:22.755830 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.770396 (+ 14566us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4229,"prepare.queue_time_us":3998,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":566454,"raft.run_cpu_time_us":419,"raft.run_wall_time_us":3070,"spinlock_wait_cycles":118818304,"thread_start_us":259071,"threads_started":1,"wal-append.queue_time_us":349251}
I20260709 13:06:22.822582 15196 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:22.817741 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:22.825344 15270 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:22.828229 15341 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:06:22.830078 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.839550 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 233306us
I20260709 13:06:22.842090 15344 raft_consensus.cc:1240] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:22.843092 15342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34532 (request call id 3535) took 1179 ms. Trace:
I20260709 13:06:22.843506 15342 rpcz_store.cc:276] 0709 13:06:21.661142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.661281 (+   139us) service_pool.cc:224] Handling call
0709 13:06:21.667963 (+  6682us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:21.668327 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.668355 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:21.668896 (+   541us) log.cc:844] Serialized 52 byte log entry
0709 13:06:21.815720 (+146824us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:21.815815 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.816677 (+   862us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.714840 (+898163us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:22.837243 (+122403us) raft_consensus.cc:1685] finished
0709 13:06:22.837268 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.840211 (+  2943us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":3478912,"thread_start_us":146426,"threads_started":1,"wal-append.queue_time_us":323939}
I20260709 13:06:22.848116 22300 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.850284 22300 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.852209 22365 consensus_queue.cc:1059] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:06:22.853933 22435 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:22.860081 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:22.871488 22200 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:22.872223 22200 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:22.873529 22200 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.879467 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.880354 15341 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:22.871171 15312 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:22.888124 22133 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:22.890635 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.893699 22264 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:22.893901 15312 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.894238 22264 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:22.894740 22264 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:22.895507 15196 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 3706) took 1285 ms. Trace:
I20260709 13:06:22.895967 15196 rpcz_store.cc:276] 0709 13:06:21.609628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.609787 (+   159us) service_pool.cc:224] Handling call
0709 13:06:22.890995 (+1281208us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003e53d4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:22.895412 (+  4417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785824000}
I20260709 13:06:22.858580 22435 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:22.856292 22249 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.903869 22367 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:22.904346 15309 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:22.896420 22358 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:22.899915 22435 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:22.906561 22054 consensus_meta.cc:287] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.010s
W20260709 13:06:22.923792 22321 consensus_meta.cc:287] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 1.005s	user 0.007s	sys 0.015s
I20260709 13:06:22.930771 15193 raft_consensus.cc:2410] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:06:22.931658 22022 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:22.933116 15193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46346 (request call id 3724) took 1020 ms. Trace:
I20260709 13:06:22.933529 15193 rpcz_store.cc:276] 0709 13:06:21.912363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.912591 (+   228us) service_pool.cc:224] Handling call
0709 13:06:22.932795 (+1020204us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54001f7cd4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:22.933056 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247004032}
I20260709 13:06:22.934628 22249 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.927682 22358 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:22.935194 22054 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.941352 15343 raft_consensus.cc:2368] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:22.943488 22054 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:22.926612 22133 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:22.947568 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48064.5us
I20260709 13:06:22.948872 15343 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34546 (request call id 2607) took 1013 ms. Trace:
I20260709 13:06:22.953024 15270 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
I20260709 13:06:22.955621 15343 rpcz_store.cc:276] 0709 13:06:21.935050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.935744 (+   694us) service_pool.cc:224] Handling call
0709 13:06:22.948627 (+1012883us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400244d54. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e57112fa 00007f36ea6d2b17 00007f36e3c4d6d4 00007f36e3c4d662 00007f36e3c4d591 00007f36e3c4d50c 00007f36e3c4c7c2 00007f36e3a4848c 00007f36e3a478c6 00007f36e3a4726f
0709 13:06:22.948811 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269288832}
I20260709 13:06:22.959290 22300 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:22.960795 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.962287 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.964286 22022 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:22.965138 15265 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:22.966672 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.968537 22435 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.969955 15267 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
W20260709 13:06:22.971589 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67369.9us
I20260709 13:06:22.973165 15237 leader_election.cc:400] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:06:22.973492 15237 leader_election.cc:403] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:22.975183 22234 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21.
I20260709 13:06:22.975427 22054 raft_consensus.cc:2804] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:22.976094 22054 raft_consensus.cc:697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:22.977212 22054 consensus_queue.cc:237] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:22.983371 15264 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
W20260709 13:06:22.983747 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 92937.3us
I20260709 13:06:22.984133 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:22.984926 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:22.986519 22364 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:23.016405 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:22.895552 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:22.970921 22435 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:23.011307 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:23.022716 15267 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
W20260709 13:06:23.032840 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 66241.5us
I20260709 13:06:23.038774 22128 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:23.042166 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:23.043365 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.046023 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.049399 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.050235 15344 raft_consensus.cc:2393] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 26: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:23.051219 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:23.052217 15344 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:23.051266 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.053273 15342 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:23.024184 22200 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:23.066275 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.066607 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.067766 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:23.067917 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.068318 15341 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:23.071244 22200 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:23.073927 22200 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:23.074936 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.075402 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.075773 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:23.076015 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:23.076366 15340 raft_consensus.cc:2393] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:23.076416 15271 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:06:23.081662 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 96978.3us
I20260709 13:06:23.083315 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.079397 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.079003 15340 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:23.082949 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.095928 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:23.100687 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.099502 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.105913 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.109467 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.110918 15342 raft_consensus.cc:2368] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:23.108546 15339 raft_consensus.cc:1240] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:23.118038 15189 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:06:23.118943 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:23.118011 15087 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 23 to 24, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 24 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:23.128940 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.130023 15338 raft_consensus.cc:2410] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:06:23.129701 15087 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 16 to 17, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 17 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:23.131063 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:23.132683 22301 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:23.133270 22301 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.133695 22301 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:23.139642 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.140434 15197 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
W20260709 13:06:23.140762 22000 consensus_meta.cc:287] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.655s	user 0.015s	sys 0.003s
I20260709 13:06:23.140954 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.141307 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.141182 22000 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.142151 15197 raft_consensus.cc:2393] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:23.142220 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.143362 22233 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.143730 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.144011 22233 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:23.144999 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.145787 15195 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:23.146201 22233 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:23.147382 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.143404 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.144348 15190 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:23.148996 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.156437 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.158154 15271 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:23.166496 15339 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
W20260709 13:06:23.170576 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 136260us
I20260709 13:06:23.171586 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:23.169576 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:23.166921 15339 pending_rounds.cc:85] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting all ops after (but not including) 13
I20260709 13:06:23.162962 15263 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45870 (request call id 3226) took 1322 ms. Trace:
I20260709 13:06:23.176079 15339 pending_rounds.cc:107] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:06:23.170231 15087 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 15 to 17, leader changed from <none> to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:23.176461 15339 raft_consensus.cc:2889] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:23.177362 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.178220 15192 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:23.178959 22365 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:23.159963 22054 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:23.187232 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:23.191550 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.192333 15346 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
W20260709 13:06:23.220323 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 50835.2us
W20260709 13:06:23.221256 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 64582.8us
I20260709 13:06:23.236550 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:23.241030 15341 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
W20260709 13:06:23.241298 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 69774.1us
I20260709 13:06:23.245466 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:23.224903 22133 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:23.215451 22000 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:23.220111 22365 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:23.231896 22358 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:23.260990 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:23.262868 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.270541 15340 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:23.274703 15309 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:23.252223 22367 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.284950 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:23.275805 22335 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:23.259152 22133 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:23.299206 15270 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:23.217494 15263 rpcz_store.cc:276] 0709 13:06:21.687007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.695547 (+  8540us) service_pool.cc:224] Handling call
0709 13:06:21.698776 (+  3229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.699046 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:21.699525 (+   479us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.853455 (+1153930us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b180025a620. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad23a 00007f36e5717a2a
0709 13:06:22.912375 (+ 58920us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:22.947245 (+ 34870us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:22.955614 (+  8369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.009098 (+ 53484us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.009253 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39829,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":11978,"raft.queue_time_us":2049,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":2972,"spinlock_wait_cycles":6952704,"thread_start_us":48509,"threads_started":1,"wal-append.queue_time_us":1324572}
I20260709 13:06:23.269522 22358 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.311465 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.313966 22367 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.317269 22367 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:23.318441 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.318737 15341 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:06:23.319278 22015 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:23.320879 22321 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:23.303812 22448 log.cc:927] Time spent T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:23.284556 22022 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:06:23.337450 15237 leader_election.cc:400] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:23.352716 15237 leader_election.cc:403] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:23.340019 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 108347us
I20260709 13:06:23.304191 22133 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:23.307540 22200 raft_consensus.cc:2804] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:06:23.374410 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 260423us
I20260709 13:06:23.343392 22358 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:23.308465 22000 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:06:23.381245 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 80363.9us
I20260709 13:06:23.386818 15265 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:23.395160 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.380441 22200 raft_consensus.cc:697] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:23.395888 15189 raft_consensus.cc:2468] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:23.407292 22229 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 19. Current term is 20.
I20260709 13:06:23.435623 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.394726 22033 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.434082 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 159440us
I20260709 13:06:23.439940 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:23.386142 22300 consensus_queue.cc:1059] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:06:23.448040 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:23.387450 22321 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.394490 22361 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260709 13:06:23.361855 22365 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.460857 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:23.465691 15341 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:23.459981 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:23.467592 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.469213 15272 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:06:23.471225 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:23.472173 15270 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 29.
I20260709 13:06:23.480127 22023 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:23.480643 22023 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:23.481530 22023 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.483547 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.484818 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.486014 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.481959 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.488833 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.483739 15197 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:23.491479 22454 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:06:23.482951 22023 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:23.497685 15192 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:23.499341 22364 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:23.501832 22361 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:23.503784 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.504532 22321 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:23.486099 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:23.494834 22264 consensus_meta.cc:287] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:06:23.461259 22000 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:06:23.512368 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 59971.3us
W20260709 13:06:23.513346 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 228497us
I20260709 13:06:23.514650 15344 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:23.515372 15345 raft_consensus.cc:1240] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:23.520746 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.523746 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.441468 22033 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.527467 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.529244 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.530201 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.534726 15237 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:23.547410 15095 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 174) took 62442 ms (client timeout 15000 ms). Trace:
I20260709 13:06:23.502943 15087 catalog_manager.cc:5697] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 13 to 14, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 14 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.518168 22111 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:23.548565 22015 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:23.519650 22200 consensus_queue.cc:237] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.551898 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:23.517148 22264 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.577126 15189 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:23.582166 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.525908 22000 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:23.519611 22023 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:23.585566 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:23.611234 22335 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:23.577692 22249 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:23.612711 15339 raft_consensus.cc:1240] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:23.616156 15340 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:23.609272 22023 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.577479 22111 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.618921 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.616469 15087 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 13 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 16 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.626642 22435 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:23.613305 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.578246 22015 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:23.645223 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 59754.4us
I20260709 13:06:23.633406 22111 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:23.652343 15087 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 16 to 19, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 19 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.656275 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.640801 22249 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:23.661659 15270 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:06:23.671469 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 119647us
W20260709 13:06:23.672161 15238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.675485 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:23.677528 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 92760.7us
W20260709 13:06:23.678673 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 199281us
I20260709 13:06:23.649955 22335 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:06:23.683866 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.636085 22015 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.689288 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:23.696280 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 258988us
I20260709 13:06:23.700842 22249 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.706754 22229 consensus_queue.cc:1059] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:23.708937 22033 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:23.709903 22133 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.711022 15345 raft_consensus.cc:1240] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:23.713001 22264 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:23.713917 22015 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:23.715118 15337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.009s	sys 0.025s
W20260709 13:06:23.715590 15337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.009s	sys 0.025s
I20260709 13:06:23.717787 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.719848 22023 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:23.720414 22023 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:23.720506 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.721086 15193 raft_consensus.cc:3060] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:23.720955 22023 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.698621 22193 consensus_queue.cc:1059] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:06:23.724246 22193 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.724754 22193 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.725210 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.726379 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.726747 22193 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:23.727257 22321 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:23.683544 22335 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.730479 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.731321 15197 raft_consensus.cc:2393] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:23.731657 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.752238 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.757411 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.757653 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.758183 15192 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:23.764863 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.730417 22321 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:23.736066 22335 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:23.768478 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.769097 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.758112 15191 raft_consensus.cc:2376] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18. Re-sending same reply.
I20260709 13:06:23.698915 22365 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:06:23.680891 22000 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.770193 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:23.777287 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 94459.3us
I20260709 13:06:23.769606 15162 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:23.773140 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.729763 22358 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.783722 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.748777 22300 consensus_queue.cc:1059] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
W20260709 13:06:23.554184 15095 rpcz_store.cc:269] 0709 13:05:21.114400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.133057 (+ 18657us) service_pool.cc:224] Handling call
0709 13:06:23.547150 (+62414093us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:20.679756 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:20.723731 (+ 43975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:20.723769 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:20.723792 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:20.724193 (+   401us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:20.724249 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:20.724282 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:20.724591 (+   309us) tablet.cc:701] Row locks acquired
0709 13:06:20.724608 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:20.724763 (+   155us) write_op.cc:270] Start()
0709 13:06:20.724875 (+   112us) write_op.cc:276] Timestamp: P: 1783602380724710 usec, L: 0
0709 13:06:20.724900 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:06:20.726964 (+  2064us) log.cc:844] Serialized 922 byte log entry
0709 13:06:21.557606 (+830642us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e26030ac 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b
0709 13:06:21.787990 (+230384us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b180022b520. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2620557 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:06:21.884262 (+ 96272us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b180022b520. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e2602e07 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261d455 00007f36e568a190 00007f36e5683ae7 00007f36e5682dd9 00007f36e568d930
0709 13:06:22.539682 (+655420us) op_driver.cc:464] REPLICATION: finished
0709 13:06:22.811067 (+271385us) write_op.cc:301] APPLY: starting
0709 13:06:22.811239 (+   172us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:22.829310 (+ 18071us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:22.829354 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:22.834760 (+  5406us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:22.860053 (+ 25293us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:06:22.860137 (+    84us) write_op.cc:312] APPLY: finished
0709 13:06:22.860666 (+   529us) log.cc:844] Serialized 32 byte log entry
0709 13:06:22.861045 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:22.861224 (+   179us) write_op.cc:454] Released schema lock
0709 13:06:22.861299 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:22.862190 (+   891us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:22.862225 (+    35us) write_op.cc:454] Released schema lock
0709 13:06:22.956445 (+ 94220us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b540035cad4. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e5676571 00007f36e570a32a 00007f36e568ff14 00007f36e568fec3 00007f36e568fe38 00007f36e568fdf3 00007f36e568f0dc 00007f36e56b8e16 00007f36e56a0cbb 00007f36e568b39d 00007f36e568ed75
Metrics: {"mutex_wait_us":12758,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":270889,"apply.run_cpu_time_us":7234,"apply.run_wall_time_us":51106,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":179570,"prepare.run_cpu_time_us":30517,"prepare.run_wall_time_us":932567,"raft.queue_time_us":506829,"raft.run_cpu_time_us":130488,"raft.run_wall_time_us":756901,"replication_time_us":1814372,"spinlock_wait_cycles":772802304,"thread_start_us":1955470,"threads_started":4,"wal-append.queue_time_us":874673}]]}
I20260709 13:06:23.736635 22361 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 13:06:23.785027 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.779268 15194 raft_consensus.cc:2376] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20. Re-sending same reply.
I20260709 13:06:23.788136 15188 raft_consensus.cc:2393] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 20: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:23.796095 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.796175 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.761475 22193 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:06:23.798492 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:23.784200 22301 consensus_meta.cc:287] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Time spent flushing consensus metadata: real 0.650s	user 0.013s	sys 0.000s
I20260709 13:06:23.801127 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.777061 22233 raft_consensus.cc:3055] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:23.801832 15191 raft_consensus.cc:2376] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18. Re-sending same reply.
I20260709 13:06:23.805681 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.805994 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
W20260709 13:06:23.799774 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 111976us
I20260709 13:06:23.779138 22023 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:23.813779 22249 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.814457 22249 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.815135 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.815294 15337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49393a249e3f433db3840189ee7dc630"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:23.816087 15337 raft_consensus.cc:606] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:23.816399 15337 raft_consensus.cc:614] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:23.818969 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.783905 22200 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.810724 15338 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:23.807987 15194 raft_consensus.cc:2468] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:23.822319 15195 raft_consensus.cc:3060] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:23.823954 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:23.825130 15189 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 18: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:23.828783 15193 raft_consensus.cc:2468] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:23.812330 22420 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:23.806646 22233 raft_consensus.cc:740] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:23.816671 22249 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:23.854547 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:23.728395 15087 catalog_manager.cc:5697] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 20 to 22, leader changed from 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 22 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:23.855659 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 89051.2us
I20260709 13:06:23.875805 15266 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:23.880044 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:23.810850 22301 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:23.875936 15842 leader_election.cc:336] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Timed out: RequestConsensusVote RPC to 127.13.181.1:39515 timed out after 1.610s (SENT)
I20260709 13:06:23.893204 15264 raft_consensus.cc:2393] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:23.895319 15194 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:06:23.872215 22420 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:23.904109 15271 raft_consensus.cc:1240] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:06:23.837447 22200 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.896831 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:23.907231 15870 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:23.915254 22300 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:23.916467 22300 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:23.916833 22300 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:23.924863 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 103914us
I20260709 13:06:23.917652 22300 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.931488 22469 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:23.932693 22033 raft_consensus.cc:3055] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:23.933302 22022 consensus_queue.cc:1059] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:23.934522 22023 consensus_queue.cc:1059] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:06:23.939661 22470 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:06:23.940002 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.940251 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 64359.2us
I20260709 13:06:23.940847 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.946036 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
W20260709 13:06:23.947697 22476 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:23.938915 15266 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 29 index: 15. (index mismatch)
I20260709 13:06:23.950440 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:23.956717 15195 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:23.962042 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.904094 22133 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:23.967643 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.974819 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.918272 22111 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:23.863250 22321 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:23.973376 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.977731 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:23.982892 15192 raft_consensus.cc:1275] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:06:23.987865 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 43934.9us
I20260709 13:06:23.983590 15346 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:23.986780 15269 raft_consensus.cc:1240] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:24.008019 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:24.008610 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.959908 22033 raft_consensus.cc:740] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:23.907881 22475 consensus_queue.cc:1059] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:06:24.019292 22033 consensus_queue.cc:260] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:24.023955 22321 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:24.027316 22420 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:24.028458 22200 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:24.028836 22465 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
I20260709 13:06:24.029232 22300 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:24.032704 15272 raft_consensus.cc:1240] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:06:24.046675 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:24.052809 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.038134 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:24.039518 15870 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:23.954368 22233 consensus_queue.cc:260] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.042582 22033 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:24.026775 22335 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.045291 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.063325 22233 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:24.063954 22358 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:24.065855 22478 log.cc:927] Time spent T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.219s	user 0.003s	sys 0.000s
I20260709 13:06:24.067998 22461 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:24.068786 22023 consensus_queue.cc:1243] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer 9d785ccef0634edd9f0fbb52fa1c8d27 log is divergent from this leader: its last log entry 24.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:06:24.070021 22335 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 30 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:24.059427 15842 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.071151 22301 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.071810 22301 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:24.072072 22456 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:24.074334 15312 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.075358 22200 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:24.078394 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.081066 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.082966 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.081681 22301 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:24.084291 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:24.060527 15160 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:24.108623 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 49275.8us
I20260709 13:06:24.113353 15268 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:06:24.119414 15842 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.126595 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.039112 22479 consensus_queue.cc:1059] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:06:24.099324 22358 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:24.100180 22475 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:24.099588 22193 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:24.140640 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:24.106773 22483 raft_consensus.cc:3055] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:24.143410 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:24.150259 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67378.4us
I20260709 13:06:24.135365 22264 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:24.155246 15269 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:24.133885 22335 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:06:24.163782 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:24.151721 22301 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:24.171625 22485 log.cc:927] Time spent T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:06:24.173601 22481 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:06:24.148856 22483 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:24.167623 22185 consensus_queue.cc:1059] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
W20260709 13:06:24.168155 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.167143 22468 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:24.138166 22461 consensus_queue.cc:1048] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:06:24.185201 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:24.199673 15339 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 24: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:24.190711 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:24.190047 22480 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:24.206845 22111 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:24.211802 22483 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.213393 22483 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:24.189988 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 79006us
I20260709 13:06:24.191402 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:24.223253 15270 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 19.
I20260709 13:06:24.191951 15238 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.192227 22347 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:24.153091 22193 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:24.193439 22460 log.cc:927] Time spent T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.577s	user 0.002s	sys 0.002s
I20260709 13:06:24.235342 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:24.233174 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:24.231889 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:24.235749 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:24.238135 15270 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:24.238735 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:24.242122 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:24.242559 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:24.243239 15269 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:24.218236 22484 raft_consensus.cc:3055] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:24.247839 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.250308 15340 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 29. Current term is 30. Ops: [29.15-29.15]
I20260709 13:06:24.251507 15263 raft_consensus.cc:1275] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:24.228313 22300 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.257436 15270 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:24.259709 15339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:24.246027 22301 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:24.260309 15339 raft_consensus.cc:606] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.260720 15339 raft_consensus.cc:614] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.268815 22022 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:24.269313 22022 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.269678 22022 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:24.228744 22347 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:24.271881 22347 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.274940 15271 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260709 13:06:24.282856 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 91007.5us
I20260709 13:06:24.283691 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.284128 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.284816 15269 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 30.
W20260709 13:06:24.286091 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 225596us
I20260709 13:06:24.287096 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.251708 22484 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:24.350502 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 87368.3us
I20260709 13:06:24.244469 22435 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
W20260709 13:06:24.352038 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67972.7us
I20260709 13:06:24.278013 22335 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:24.360307 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 68839.2us
I20260709 13:06:24.353669 15309 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.289343 22229 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:24.355767 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 68804us
I20260709 13:06:24.254994 22300 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:24.354738 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 71125.2us
I20260709 13:06:24.353647 22133 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:24.379390 22347 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:24.360682 22482 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:24.393577 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.394834 22499 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:06:24.394999 22494 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.407356 22494 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.409682 22494 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.413995 22022 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.416219 22022 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.416477 15196 raft_consensus.cc:1275] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:24.418817 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 30 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:24.418990 22475 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:24.421034 22193 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:24.422513 22300 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.364898 22471 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:24.388226 22462 consensus_queue.cc:1048] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:06:24.431752 22229 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:24.438386 22484 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.446326 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.429345 22475 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
W20260709 13:06:24.448715 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 82986.4us
W20260709 13:06:24.449887 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62522.4us
I20260709 13:06:24.446450 22022 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:06:24.439700 22484 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:24.453984 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:24.455436 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.462652 22015 raft_consensus.cc:3055] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:24.463124 22015 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:24.463996 22015 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.465395 22015 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:24.458544 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 70809.1us
I20260709 13:06:24.450676 22300 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:24.473906 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.469357 22471 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:06:24.474027 22022 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:24.490567 22022 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:24.477146 22229 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:24.456566 22133 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 13:06:24.500578 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45204us
I20260709 13:06:24.502410 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.493549 22475 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.506168 22475 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:24.495829 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.511402 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.516310 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.521279 15340 raft_consensus.cc:1240] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:24.521603 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:24.519493 22503 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:24.521903 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:24.522416 22503 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.523115 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:24.523855 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:24.524380 15341 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:24.456875 22128 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:06:24.523888 15345 raft_consensus.cc:2410] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:06:24.477229 22301 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:24.536419 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:24.539095 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:24.586185 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 83873.2us
I20260709 13:06:24.495239 22471 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:24.588469 15238 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:24.616451 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 72279.2us
I20260709 13:06:24.538193 22133 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.620304 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 78871.2us
W20260709 13:06:24.651870 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 63669.5us
I20260709 13:06:24.653069 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.611495 22233 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:24.616047 22033 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:24.680677 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.688735 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 52239.9us
W20260709 13:06:24.688973 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.687717 22301 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.692708 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.694561 15238 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.695839 15238 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.696300 22483 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:24.697069 22483 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:24.697224 15238 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.698817 15195 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:06:24.699251 22496 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:24.657264 22133 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:24.703112 22420 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:24.706193 22133 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:24.707469 22505 log.cc:927] Time spent T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:06:24.707396 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:24.708451 15876 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:24.713490 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.714416 15341 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:24.719564 22496 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:24.721968 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.723138 22496 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:24.723663 22496 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:24.724110 22496 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:24.735920 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45619.4us
I20260709 13:06:24.739742 15337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c39b63dad5d94468b5872c05e2d72e0d"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:24.687835 22479 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:24.670205 22335 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:24.752681 15337 raft_consensus.cc:606] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.812282 15337 raft_consensus.cc:614] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.806450 22500 consensus_queue.cc:1059] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 27.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
W20260709 13:06:24.813658 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 62984.5us
I20260709 13:06:24.815424 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:24.816922 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:24.817530 15190 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:24.714829 22498 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:24.655624 22022 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.822613 15189 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:24.740711 22503 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:24.784848 22486 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:24.829991 22486 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:24.830449 22486 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:24.831385 22500 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 LEADER]: Stepping down as leader of term 29
I20260709 13:06:24.831773 22500 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:24.832588 22500 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 29.15, Last appended by leader: 15, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.833801 22500 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:24.692898 22301 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.836505 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.836839 22301 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.749858 22456 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
W20260709 13:06:24.804774 22481 log.cc:927] Time spent T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 13:06:24.828850 22321 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:24.838879 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:24.843515 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 121637us
I20260709 13:06:24.849522 22321 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.820936 22335 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.851653 22321 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.853689 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.819111 22264 consensus_queue.cc:1048] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:06:24.855005 22022 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:24.869026 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:24.840247 22498 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:24.823477 22471 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.14, Last appended by leader: 14, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.846123 22456 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:24.879833 22456 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.828917 22514 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:24.880317 15312 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:24.880677 22514 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.881938 22436 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:24.881189 22503 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:24.854946 22133 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:06:24.895217 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:24.882988 22514 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.903338 22347 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:24.904134 22347 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.905442 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 130416us
I20260709 13:06:24.904593 22347 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.911537 22347 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.888772 22498 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:24.913667 22033 consensus_queue.cc:1059] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:24.914747 22033 raft_consensus.cc:3055] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:24.918463 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:24.920430 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:24.922649 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 86193.7us
I20260709 13:06:24.919369 15272 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:24.915089 22033 raft_consensus.cc:740] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:24.942250 15272 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:24.889022 22503 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.944978 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:24.905480 22301 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:24.956846 15272 raft_consensus.cc:2393] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 24: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:24.960294 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:24.960410 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 115956us
I20260709 13:06:24.952203 22503 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:24.965548 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51849.1us
I20260709 13:06:24.966729 15160 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:24.971246 15238 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.972206 22475 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:24.974377 22033 consensus_queue.cc:260] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.976145 22033 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:24.974524 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:24.951788 22496 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:24.992650 22496 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:24.993932 22022 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:24.995174 22335 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:24.995744 15162 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:25.001372 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:25.007426 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.008208 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.010093 15338 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:06:25.009891 15337 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:25.014571 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.016502 22301 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:25.016844 22486 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.017127 22301 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.019905 22249 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:25.020510 22249 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.022770 22229 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:25.027256 22500 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:25.003887 22054 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:25.034660 22301 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:25.038946 15162 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:25.024662 22335 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.042232 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67923.6us
I20260709 13:06:25.049018 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.049160 22435 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:25.051191 22054 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:25.052460 15342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:25.053035 15342 raft_consensus.cc:606] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:25.054248 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:25.055881 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.057305 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.065614 15338 raft_consensus.cc:2393] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:25.067636 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.069259 15238 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:25.070817 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:25.076505 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 109862us
I20260709 13:06:25.052389 22456 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.041944 22249 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:25.053112 22500 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:25.083664 15872 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:06:25.088445 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.090459 22483 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:25.091728 22486 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.093017 15238 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.103364 22301 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:25.081312 22493 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:25.104133 22493 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:25.076025 22475 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:25.106040 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.107570 22469 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:25.080360 22513 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:25.108940 22300 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:25.110368 15339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:25.110965 15339 raft_consensus.cc:606] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:25.111521 15339 raft_consensus.cc:614] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:25.061694 22335 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:25.113508 22335 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:25.114130 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:25.116039 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:25.079244 22420 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:25.119640 22420 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.120026 22420 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:25.105077 22493 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.087832 22456 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.126559 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:25.127348 15338 raft_consensus.cc:2368] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
I20260709 13:06:25.129773 15237 leader_election.cc:400] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
I20260709 13:06:25.130131 15237 leader_election.cc:403] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.131119 22229 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:25.136904 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.138957 22500 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.139519 22457 consensus_queue.cc:1059] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:25.140627 22457 raft_consensus.cc:3055] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:25.140962 22457 raft_consensus.cc:740] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:25.141794 22457 consensus_queue.cc:260] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:25.143646 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 55277us
I20260709 13:06:25.144172 22499 raft_consensus.cc:2749] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:25.145264 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.146077 22499 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:25.147240 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.147990 22499 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:25.148368 22499 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:25.148748 22499 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:25.152051 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.152186 22054 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:25.152688 15188 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
I20260709 13:06:25.153345 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.154654 15312 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.155449 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.155737 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.155948 22335 raft_consensus.cc:993] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:25.156255 22457 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:25.157346 22473 raft_consensus.cc:1081] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Signalling peer 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:25.127256 22456 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:25.157222 22335 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:25.159520 22335 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.160230 15192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:46346
I20260709 13:06:25.160956 15192 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.161309 15192 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:25.166033 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.166682 22335 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:25.172536 22498 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:25.173069 22498 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.167519 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.160055 22503 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.175405 22498 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.176544 15345 raft_consensus.cc:2368] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 18. Current term is 19.
I20260709 13:06:25.176734 22420 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.179155 22471 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:25.179432 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.179740 22471 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.181787 22471 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:25.181696 22475 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:25.182451 15192 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.182623 22475 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.184593 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.192745 15338 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:25.184835 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:25.194046 15876 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:06:25.185777 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:25.185911 15346 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:25.182890 22301 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:25.188239 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.195886 15269 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:06:25.196790 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:25.191754 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:25.197619 15191 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:25.197646 15190 raft_consensus.cc:2410] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
I20260709 13:06:25.191824 22503 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:25.191915 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.189591 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.205714 15189 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
W20260709 13:06:25.212976 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 292282us
I20260709 13:06:25.212546 15162 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:25.216187 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:25.224735 15190 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:06:25.225186 15190 pending_rounds.cc:85] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 12
I20260709 13:06:25.225426 15190 pending_rounds.cc:107] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:06:25.225703 15190 raft_consensus.cc:2889] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:25.226780 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.231294 15192 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.232123 15269 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:25.234656 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:25.235273 15346 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:06:25.235594 15346 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:25.236382 15346 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.239914 15188 raft_consensus.cc:2368] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 26. Current term is 27.
I20260709 13:06:25.245942 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:25.248479 15841 leader_election.cc:400] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 18. Current term is 19.
I20260709 13:06:25.248960 15841 leader_election.cc:403] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.250119 22229 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
W20260709 13:06:25.250765 22526 log.cc:927] Time spent T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: Append to log took a long time: real 0.167s	user 0.002s	sys 0.001s
I20260709 13:06:25.257148 15876 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:25.228681 22033 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:25.240087 22503 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:25.264076 22361 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:25.270490 22530 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 18. Current term is 19.
I20260709 13:06:25.273895 15346 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:25.274911 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.210912 22301 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.284861 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.304399 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.260676 22033 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:25.309839 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:25.308709 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.282603 22503 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:25.310781 22486 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:25.307948 22229 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.407258 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.408869 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:25.408038 15189 raft_consensus.cc:2468] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:25.299938 22361 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.393144 22503 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:25.398582 22033 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:25.351418 22483 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:06:25.398662 22015 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:25.425055 22358 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.449329 22527 log.cc:927] Time spent T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260709 13:06:25.417132 22335 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:25.435874 22347 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.490577 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 183866us
W20260709 13:06:25.497805 15162 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.439863 22015 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.503437 15195 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 30 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 29 index: 15. Preceding OpId from leader: term: 30 index: 15. (term mismatch)
I20260709 13:06:25.509892 15195 pending_rounds.cc:85] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting all ops after (but not including) 14
I20260709 13:06:25.510274 15195 pending_rounds.cc:107] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting uncommitted NO_OP operation due to leader change: 29.15
I20260709 13:06:25.510586 15195 raft_consensus.cc:2889] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:25.497869 22496 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.516028 22367 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:06:25.518985 22536 log.cc:927] Time spent T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:06:25.524605 22015 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:25.484692 22358 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.492415 22347 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:25.541033 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.553049 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.554239 15265 raft_consensus.cc:2410] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:06:25.555886 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
W20260709 13:06:25.540426 22535 log.cc:927] Time spent T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:06:25.620162 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.622048 15192 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 18.
I20260709 13:06:25.622977 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.623663 15311 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:25.617566 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.623785 15194 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:25.625660 15265 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:25.617600 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.536449 22496 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:25.632520 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 207917us
I20260709 13:06:25.639418 15238 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.633574 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.633167 15271 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 27 index: 14. Preceding OpId from leader: term: 30 index: 15. (index mismatch)
I20260709 13:06:25.628285 15264 raft_consensus.cc:2393] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:25.644475 15265 raft_consensus.cc:1240] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 29. Current term is 30. Ops: [29.15-29.15]
I20260709 13:06:25.626807 22472 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.661578 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.649688 22301 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:25.663571 22529 log.cc:927] Time spent T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.258s	user 0.000s	sys 0.002s
I20260709 13:06:25.666477 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.667547 22468 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:25.688416 22468 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.688858 22468 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:25.671458 22499 consensus_meta.cc:287] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.002s
I20260709 13:06:25.691354 22499 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.693765 22499 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.672245 22358 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:25.675313 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.636646 22023 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:25.696038 22023 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.698287 22023 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.701812 15191 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:25.652324 22128 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:06:25.719373 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 80071.8us
I20260709 13:06:25.720479 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:25.728614 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 82682.9us
I20260709 13:06:25.659595 22522 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.734027 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.735395 15346 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 27.
I20260709 13:06:25.709085 22493 raft_consensus.cc:2749] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:25.735008 15264 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:25.738083 15238 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.718674 22483 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.749794 22128 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:25.750212 22496 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.750967 22128 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:25.755975 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 122539us
I20260709 13:06:25.757959 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.764278 22133 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:25.765066 22133 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.733605 22022 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.734004 22301 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:25.683322 22472 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.735817 22335 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:25.782325 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:25.755112 22528 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.362s	user 0.001s	sys 0.001s
I20260709 13:06:25.743182 22200 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:25.759083 22361 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:25.797250 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 59263.8us
I20260709 13:06:25.801623 15238 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.803591 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:25.804356 15264 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:25.807716 15238 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:25.816572 15188 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:25.756021 22483 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.736969 22522 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:25.835469 22538 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.213s	user 0.000s	sys 0.000s
W20260709 13:06:25.837137 22543 log.cc:927] Time spent T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 13:06:25.838542 22547 log.cc:927] Time spent T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:06:25.842072 22468 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:25.798416 22133 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:25.817806 22229 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:25.792729 22200 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.844507 22468 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:25.816840 22548 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.845623 15267 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:25.845791 22200 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:25.845916 22548 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.866740 15238 leader_election.cc:400] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 26. Current term is 27.
I20260709 13:06:25.867235 15238 leader_election.cc:403] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.782552 22503 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.783622 22022 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.873432 15264 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 27.
I20260709 13:06:25.867624 22496 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:06:25.874744 22229 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:06:25.848277 22548 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:25.884967 22229 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 26. Current term is 27.
I20260709 13:06:25.885790 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:25.889323 15160 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.891106 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:25.892550 22022 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.893716 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.894140 22420 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.894258 22365 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:25.894912 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.895524 15263 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 16.
I20260709 13:06:25.897253 15272 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 27.
I20260709 13:06:25.898044 22483 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.901854 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:25.910056 22033 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.912220 22033 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.920782 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:25.921448 15272 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:06:25.923269 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.923892 15339 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
W20260709 13:06:25.926373 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75015.2us
I20260709 13:06:25.927203 15238 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:25.928978 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 139857us
I20260709 13:06:25.928720 15272 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:25.931311 15872 raft_consensus.cc:1240] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:25.933264 15160 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:25.936079 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 280793us
I20260709 13:06:25.936877 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.930367 15309 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:25.940358 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:25.940979 15194 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:25.937503 15340 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:25.942325 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:25.945026 22022 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:25.945744 22022 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:25.946245 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.953816 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:25.954445 15194 raft_consensus.cc:3060] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:25.949012 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:25.956319 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:25.959939 22483 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.960474 22483 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.962493 22483 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:25.953125 22249 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:25.963313 22559 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.953459 15162 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:25.978243 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.978922 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:25.979506 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:25.985998 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:25.977715 22229 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:25.989413 22562 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:25.989718 22229 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:25.990124 22229 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:25.991165 22022 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:25.992915 22033 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:25.988605 22498 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:25.993723 22503 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:25.993794 22498 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:25.994839 22498 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:25.976783 22249 consensus_queue.cc:1059] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 13:06:26.000352 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.001112 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.001464 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.001731 15195 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:06:26.002213 15341 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 16: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:26.003337 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.003650 15195 raft_consensus.cc:1240] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:26.005908 15343 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:25.974373 22552 raft_consensus.cc:2804] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:26.007300 22552 raft_consensus.cc:697] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:26.008198 22552 consensus_queue.cc:237] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:26.011111 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:25.964025 22559 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.012465 22568 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:26.012955 22568 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.013283 22568 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:26.014204 22559 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.015405 22249 raft_consensus.cc:3055] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:26.016009 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.025812 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.015815 22249 raft_consensus.cc:740] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:26.023841 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.027505 15194 raft_consensus.cc:2468] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:25.992833 22472 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.022821 22200 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:06:26.078543 22565 log.cc:927] Time spent T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:26.083976 15340 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:06:26.030341 22335 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:26.090457 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.095558 15337 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 23.
I20260709 13:06:26.103626 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:26.132218 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 101189us
I20260709 13:06:26.130242 15337 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:26.098030 22335 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.134727 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.135388 15340 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:26.076184 22472 consensus_queue.cc:1059] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:06:26.138635 22500 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.144676 22500 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.129308 22249 consensus_queue.cc:260] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:26.158401 22249 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:26.158591 22475 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:26.094187 22200 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.163208 22200 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.139816 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:26.172168 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.176025 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:26.182600 15087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 70) took 7125 ms. Trace:
I20260709 13:06:26.187350 22461 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:26.136111 22335 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:26.192058 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.193504 15340 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 27.
I20260709 13:06:26.194024 15189 raft_consensus.cc:2393] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:26.196676 22347 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.183133 15087 rpcz_store.cc:276] 0709 13:06:19.057678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.057961 (+   283us) service_pool.cc:224] Handling call
0709 13:06:19.705192 (+647231us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400002490. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e90b2 00007f36eb562a89 00007f36eb4fada6 00007f36eb4cc088 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc
0709 13:06:26.182501 (+6477309us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:24.825264 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:24.825977 (+   713us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:24.826032 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:06:24.826057 (+    25us) tablet.cc:662] Decoding operations
0709 13:06:24.827018 (+   961us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:24.855340 (+ 28322us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:24.890889 (+ 35549us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:06:24.891617 (+   728us) tablet.cc:701] Row locks acquired
0709 13:06:24.891666 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:06:24.891834 (+   168us) write_op.cc:270] Start()
0709 13:06:24.891981 (+   147us) write_op.cc:276] Timestamp: P: 1783602384891764 usec, L: 0
0709 13:06:24.892004 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.961030 (+ 69026us) log.cc:844] Serialized 2938 byte log entry
0709 13:06:25.247239 (+286209us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b4400022b4c. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e2546c85 00007f36e25476a2 00007f36e52b91db 00007f36e52b4aaf 00007f36e52a886e 00007f36e52a7bb6 00007f36e52a77d8 00007f36e52b1221 00007f36e52b11d9 00007f36e52b1169
0709 13:06:25.522072 (+274833us) op_driver.cc:464] REPLICATION: finished
0709 13:06:25.687424 (+165352us) write_op.cc:301] APPLY: starting
0709 13:06:25.687526 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:25.692853 (+  5327us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:25.692911 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:25.706981 (+ 14070us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:25.711467 (+  4486us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:06:25.711712 (+   245us) write_op.cc:312] APPLY: finished
0709 13:06:25.713675 (+  1963us) log.cc:844] Serialized 73 byte log entry
0709 13:06:25.714615 (+   940us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.715207 (+   592us) write_op.cc:454] Released schema lock
0709 13:06:25.715300 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:25.738962 (+ 23662us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.742688 (+  3726us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":304576,"reported_tablets":11,"spinlock_wait_cycles":311708928,"child_traces":[["op",{"apply.queue_time_us":165026,"apply.run_cpu_time_us":15861,"apply.run_wall_time_us":44295,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33429,"num_ops":7,"prepare.queue_time_us":329604,"prepare.run_cpu_time_us":15891,"prepare.run_wall_time_us":255657,"raft.queue_time_us":242564,"raft.run_cpu_time_us":21318,"raft.run_wall_time_us":139028,"replication_time_us":617138,"spinlock_wait_cycles":12609920,"thread_start_us":461750,"threads_started":4,"wal-append.queue_time_us":120437}]]}
I20260709 13:06:26.201689 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.192925 22503 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:26.202996 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.209461 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.210085 22300 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:26.210517 22300 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:26.194322 22461 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.205271 22499 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:26.208308 22503 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.217365 22301 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:26.217839 22542 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:26.218240 22503 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.220599 22483 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:26.220906 22493 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.221236 22483 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.221447 22493 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.223819 22493 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.225406 22562 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:26.225782 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.225972 22562 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:26.226402 15339 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:26.226847 22562 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.229084 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.137547 22229 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:26.230883 15272 raft_consensus.cc:1240] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Rejecting Update request from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:26.232043 22229 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:26.233994 22461 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.188228 22475 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:26.234889 22475 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.237092 22475 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.238303 22483 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.238180 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.210865 22300 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:26.239395 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.240034 15344 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 25.
I20260709 13:06:26.241582 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:26.247255 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.249187 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.249876 15162 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.251161 22499 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:26.256510 15311 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:26.260541 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.260866 22522 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.261581 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.262223 15337 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 20.
I20260709 13:06:26.262522 15195 raft_consensus.cc:1240] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:26.265034 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.265686 15192 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:26.268179 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.268862 15265 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:26.269218 22365 raft_consensus.cc:3055] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:26.269595 22365 raft_consensus.cc:740] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:26.269672 22300 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.270375 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.271175 15189 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:26.272197 22500 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.272903 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.273388 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.274019 15269 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:26.276836 22568 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.277998 15341 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:26.278755 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.273504 15270 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:26.270490 22365 consensus_queue.cc:260] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.280431 22365 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:26.281605 22572 log.cc:927] Time spent T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:06:26.284372 15237 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.286242 22542 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:26.286635 22542 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.290089 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.290897 22229 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:26.291394 22229 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.291785 22229 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:26.290124 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.293182 15193 raft_consensus.cc:2393] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 25: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
I20260709 13:06:26.295318 15237 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.296195 22493 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:26.296551 22493 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.296907 22493 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:26.286989 22542 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:26.303159 22567 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.062s	user 0.000s	sys 0.008s
I20260709 13:06:26.306450 22435 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:26.307533 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 51103.9us
I20260709 13:06:26.307794 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.319089 15197 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:26.292292 22475 consensus_queue.cc:1059] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 24.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:26.309407 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.311794 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.321877 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.322662 22436 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:26.322728 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.323143 22436 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.323709 22436 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.325471 22471 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:26.325892 22471 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:26.326267 22471 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:26.329396 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.329699 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.330904 22475 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:26.331393 22475 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:26.331887 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.332437 22475 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.333202 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 31 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.333680 22475 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:26.334472 22556 consensus_queue.cc:1059] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:26.336776 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.337450 22530 raft_consensus.cc:3055] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:26.337795 22496 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:26.338451 22496 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:26.339926 22496 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:26.317030 15192 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:26.341964 15191 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:26.316200 22515 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:26.336344 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.343317 15196 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:26.337816 22530 raft_consensus.cc:740] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:26.343901 22335 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.344786 22530 consensus_queue.cc:260] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:26.346112 22530 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:26.348788 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.350298 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.351142 15263 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:26.352085 22493 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.353726 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.384816 15192 raft_consensus.cc:3060] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:26.353770 22471 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.318408 22568 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.356073 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.355258 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.389003 15191 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:26.389509 15162 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.391952 22482 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:26.392375 22482 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.392602 22469 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:26.394773 22469 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.395313 22469 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:26.355669 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.396831 15263 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:26.386703 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:26.385987 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 47206.4us
I20260709 13:06:26.397588 15162 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.397933 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.398578 15195 raft_consensus.cc:3060] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:26.368369 22335 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.398598 15309 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:26.405504 15235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.416769 22300 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.419270 22556 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.419790 22556 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:26.421816 22556 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.424618 22471 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.424705 22229 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.388717 22054 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:06:26.428524 15191 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:26.429772 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.406836 22321 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:26.430450 15270 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 22.
I20260709 13:06:26.432426 22436 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.430454 22321 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.433879 22321 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.392706 22482 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:26.435439 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.438431 15192 raft_consensus.cc:2468] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 17.
I20260709 13:06:26.449502 22551 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:26.450026 22551 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.450383 22551 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.451152 22436 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:26.414286 22496 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.460374 15272 raft_consensus.cc:2368] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20.
I20260709 13:06:26.463176 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.464018 15341 raft_consensus.cc:2368] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
W20260709 13:06:26.463918 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 65435.9us
I20260709 13:06:26.465653 15271 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 26: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:26.471339 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.471649 22568 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:26.482573 22493 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.465245 22229 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:26.479651 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 48069.5us
I20260709 13:06:26.484057 15312 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.484531 22482 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.484941 15312 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:26.485705 22552 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:26.486233 22552 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:26.486625 22482 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.487375 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.487269 22469 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.487977 15196 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.487739 22552 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:26.489166 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.489392 22469 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.486150 22568 raft_consensus.cc:2804] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:26.489995 22568 raft_consensus.cc:697] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:26.490895 22568 consensus_queue.cc:237] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.491461 15089 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 17 to 18, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 18 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:26.482184 15263 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:26.470968 15195 raft_consensus.cc:2468] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
I20260709 13:06:26.507823 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.508657 15341 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:26.512687 15338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.513470 15338 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:26.515823 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 51207.8us
I20260709 13:06:26.524443 15162 leader_election.cc:400] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:26.524971 15162 leader_election.cc:403] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:06:26.526821 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.527544 15238 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:26.527765 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.528515 15271 raft_consensus.cc:2393] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:26.529343 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.529516 15272 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:26.530928 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.531860 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.532599 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.542798 15270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.549238 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.540007 15271 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:26.554445 15270 raft_consensus.cc:2368] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:26.554354 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.553443 15238 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:26.556267 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.551853 15842 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.555557 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.556670 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.562364 15309 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.566862 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.568104 15193 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:26.566002 15271 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:26.572508 15341 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:26.523494 22229 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:26.570601 15268 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 21.
I20260709 13:06:26.571862 15238 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:26.573787 15160 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.495512 22542 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.556336 22023 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:26.564962 22530 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:26.587811 15264 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:06:26.566066 22493 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:26.593623 22493 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:26.587231 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:26.599079 15266 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:26.601104 15238 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:26.569564 22475 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:26.580582 22347 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:26.604624 15311 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.608291 15195 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 17: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:26.608846 15193 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:26.590934 22456 raft_consensus.cc:2804] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:26.612052 22551 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:26.594530 22493 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.591089 22033 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:26.619949 22249 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:06:26.580634 22435 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:26.588048 22483 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:26.602833 22486 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:26.630142 22496 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.589304 22229 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.632777 15192 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:26.657815 15271 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
W20260709 13:06:26.659343 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 74709.8us
I20260709 13:06:26.660195 15263 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:26.643146 22456 raft_consensus.cc:697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:26.670074 15309 leader_election.cc:400] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20.
I20260709 13:06:26.670411 15309 leader_election.cc:403] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:26.668855 22347 consensus_queue.cc:1059] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:06:26.678259 22542 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.689325 22229 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.692040 22456 consensus_queue.cc:237] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:26.698544 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.702064 22560 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:06:26.705538 22436 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:26.708825 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.708999 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.709733 15266 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:26.709733 15271 raft_consensus.cc:2393] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 17: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:26.710028 15196 raft_consensus.cc:2468] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:26.712579 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.712946 22321 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.713600 15160 leader_election.cc:400] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 16 election: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 16. Current term is 17.
I20260709 13:06:26.714079 15191 raft_consensus.cc:2368] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22.
I20260709 13:06:26.711021 15338 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:26.725538 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:26.727831 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.728565 15346 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21.
I20260709 13:06:26.733001 15870 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:26.732123 15089 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:26.734409 22551 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.734543 22015 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.734997 22503 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:26.735777 15160 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.738706 22522 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:26.739250 22522 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:26.740213 22522 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.743332 22420 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:26.743884 22420 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:26.744937 15264 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:26.744679 22420 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.745270 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.730415 22586 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:26.746843 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.747184 22015 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.747619 15346 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.749276 22015 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.747640 15238 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.751248 22475 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:26.751297 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.751849 22475 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:26.752720 22475 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.753224 15196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:26.753814 15196 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:06:26.762944 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:26.763834 15190 raft_consensus.cc:2368] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
I20260709 13:06:26.764784 22321 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:26.767467 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.769814 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:26.770457 15266 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:26.772619 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.773439 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:26.774085 15266 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.773571 15271 raft_consensus.cc:3060] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.781409 15238 leader_election.cc:400] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
I20260709 13:06:26.781844 15238 leader_election.cc:403] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:26.785866 15346 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 23.
I20260709 13:06:26.788636 15196 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:26.783790 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.800586 15266 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:26.805593 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.805599 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.824076 15271 raft_consensus.cc:2468] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 23.
I20260709 13:06:26.825243 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.826006 15346 raft_consensus.cc:3060] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:26.824532 15238 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.828938 15839 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:26.831821 15192 raft_consensus.cc:1275] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:26.834856 15312 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:26.837060 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 251522us
I20260709 13:06:26.844044 15346 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:26.838550 15162 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:26.852699 15312 leader_election.cc:400] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22.
I20260709 13:06:26.852708 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.854285 15346 raft_consensus.cc:2368] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
I20260709 13:06:26.853233 15312 leader_election.cc:403] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:06:26.859815 15338 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:06:26.830698 22249 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:06:26.864549 15338 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:06:26.834120 22015 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:26.834403 22480 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:26.839665 22496 raft_consensus.cc:2804] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:26.867049 22000 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.883327 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:26.846719 22551 raft_consensus.cc:2804] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:26.881012 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:26.875329 22033 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:26.854553 22568 raft_consensus.cc:2804] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:26.900321 15271 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:26.892899 15237 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:26.884023 15343 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 24.
I20260709 13:06:26.866849 22347 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:26.871758 22015 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.906610 15237 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:26.914727 15237 leader_election.cc:400] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
W20260709 13:06:26.924108 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 52822.3us
W20260709 13:06:26.924522 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 50668.9us
I20260709 13:06:26.871438 22514 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:06:26.887625 22480 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:26.912314 22551 raft_consensus.cc:697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:26.923460 22015 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:26.905673 22496 raft_consensus.cc:697] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:26.922901 22229 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:26.925904 22570 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:06:26.954387 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 48541.1us
I20260709 13:06:26.931315 22435 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:06:26.981737 22480 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:26.984900 22249 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 for earlier term 23. Current term is 24.
I20260709 13:06:26.986093 22551 consensus_queue.cc:237] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:26.987206 22000 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515) with higher term. Message: Invalid argument: T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22.
I20260709 13:06:26.989283 22560 raft_consensus.cc:2749] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191) with higher term. Message: Invalid argument: T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 19. Current term is 20.
I20260709 13:06:26.997196 15339 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:27.008330 22568 raft_consensus.cc:697] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:27.008658 15270 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:27.009588 15263 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 26 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:06:27.010082 22568 consensus_queue.cc:237] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.022430 15341 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
W20260709 13:06:27.023188 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 67848.9us
W20260709 13:06:27.026701 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 101677us
W20260709 13:06:27.084599 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56981.1us
W20260709 13:06:27.086743 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 72524.2us
I20260709 13:06:27.012744 22496 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:27.098022 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 89447.4us
I20260709 13:06:27.102085 22560 consensus_queue.cc:1048] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 13:06:27.100191 22436 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:27.141325 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 96379.6us
I20260709 13:06:27.023093 22347 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
W20260709 13:06:27.134894 22591 log.cc:927] Time spent T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.204s	user 0.000s	sys 0.003s
I20260709 13:06:27.156718 22603 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.084s
W20260709 13:06:27.263733 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 106657us
I20260709 13:06:27.265290 15265 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:06:27.270404 22347 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.253708 22015 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:27.321699 22607 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:27.325135 22588 raft_consensus.cc:3055] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:27.325650 22588 raft_consensus.cc:740] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:27.326483 22588 consensus_queue.cc:260] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.336036 22588 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:27.348701 15264 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:06:27.350826 15264 pending_rounds.cc:85] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 14
I20260709 13:06:27.351161 15264 pending_rounds.cc:107] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:06:27.351454 15264 raft_consensus.cc:2889] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:27.353628 15265 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:06:27.350337 22249 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.359371 22249 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:27.376855 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:27.377810 15265 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:27.386289 22249 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:27.388621 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:27.405900 22613 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:27.474475 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:27.487248 15343 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:27.507586 15341 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:06:27.520944 22616 log.cc:927] Time spent T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:06:27.522744 15271 raft_consensus.cc:1275] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:06:27.524961 22614 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:27.528249 15265 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
W20260709 13:06:27.537055 22611 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:06:27.531685 22054 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:27.555766 22015 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:27.553332 22054 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.559255 22054 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:27.586326 15341 raft_consensus.cc:1240] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 25. Current term is 26. Ops: []
W20260709 13:06:27.592025 15160 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.593806 15341 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:27.595297 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:27.595947 15341 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:27.605782 15196 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:06:27.606760 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.610975 15194 raft_consensus.cc:1240] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:27.613288 15194 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:27.619582 15192 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:06:27.623437 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:27.637530 15340 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:27.640009 22570 consensus_queue.cc:1059] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:27.640791 15264 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:27.641681 22475 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:27.634770 22568 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:06:27.645464 22570 raft_consensus.cc:3055] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:27.645862 22570 raft_consensus.cc:740] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:27.646656 22570 consensus_queue.cc:260] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.647871 22570 raft_consensus.cc:3060] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:27.650030 22558 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:27.652503 15238 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:27.655045 22301 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:27.585354 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:27.672711 15341 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:27.633023 22133 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:06:27.708597 15264 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:06:27.713788 22054 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:06:27.737167 15160 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:27.714664 22469 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:06:27.744006 22558 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:27.745129 22522 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:27.747215 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:27.785079 22522 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:27.798568 22522 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.812529 22494 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:27.786103 22558 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:06:27.815160 22473 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.815718 22473 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.817808 22473 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:27.823395 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:27.824272 15191 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:27.825919 15312 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:27.831290 22473 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:27.836990 22229 raft_consensus.cc:493] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:27.860046 22229 raft_consensus.cc:515] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.862313 22229 leader_election.cc:290] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:27.846256 22473 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.869947 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:27.871434 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be59fc6c54f44b09ae8f08b1dcb46a62" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:27.851742 22614 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:27.871490 22473 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:27.888222 15195 raft_consensus.cc:1275] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:06:27.883821 22614 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:27.940598 22614 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:27.908936 22613 consensus_queue.cc:1048] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:06:27.943094 22613 consensus_queue.cc:1048] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:27.946233 15343 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:06:27.947752 22475 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:27.949271 22475 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:27.958988 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:27.965312 15342 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:06:27.966836 15237 leader_election.cc:304] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:27.966971 15263 raft_consensus.cc:1275] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:27.968721 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:27.969396 15267 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:06:27.974139 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:27.976517 22473 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:27.989521 15309 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:28.003604 22598 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:28.003849 22601 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:06:27.992981 22475 raft_consensus.cc:2749] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:28.047187 15346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:28.047818 15346 raft_consensus.cc:606] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:28.070645 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:28.006042 22321 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
W20260709 13:06:28.087205 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 73102.6us
I20260709 13:06:28.088541 15841 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:28.045784 22515 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:28.028228 22365 consensus_queue.cc:1048] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:06:28.102365 22473 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:28.099710 22515 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:28.096653 22614 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:28.467095 22552 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.467806 22552 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.470479 22552 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:28.474776 22530 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.475513 22530 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:28.479449 22530 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:28.507818 15341 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.009s	sys 0.011s
W20260709 13:06:28.509661 15341 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.009s	sys 0.011s
W20260709 13:06:28.495106 22646 log.cc:927] Time spent T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.396s	user 0.000s	sys 0.013s
I20260709 13:06:28.527570 22515 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:28.614639 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 592530us
W20260709 13:06:28.634702 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 543821us
I20260709 13:06:28.645258 22493 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:28.641683 22249 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:28.667600 15266 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:06:28.669225 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:28.670240 15266 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 in current term 21: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:28.672972 15263 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:06:28.674520 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:28.675191 15263 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:28.661104 22493 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.676867 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:28.655797 22301 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:28.677309 22249 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.679689 22493 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:28.687078 15272 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
I20260709 13:06:28.706812 22249 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:28.709966 15870 consensus_queue.cc:237] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:28.711577 15194 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46358 (request call id 2727) took 1054 ms. Trace:
I20260709 13:06:28.716074 15194 rpcz_store.cc:276] 0709 13:06:27.656574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.657524 (+   950us) service_pool.cc:224] Handling call
0709 13:06:27.657839 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:27.658187 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.658218 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.658731 (+   513us) log.cc:844] Serialized 52 byte log entry
0709 13:06:27.963335 (+304604us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b18002eb400. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e52b54bc 00007f36e260348b 00007f36eb45dab9 00007f36e261f69b 00007f36e261d93f 00007f36e261fc02 00007f36e52a720b 00007f36e52acd23 00007f36e52ad0d1
0709 13:06:27.963474 (+   139us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:27.985779 (+ 22305us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.989127 (+  3348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.989206 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.709161 (+719955us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b18002eb400. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36eb4e8de1 00007f36eb4f55b1 00007f36e26203f3 00007f36e26227c1 00007f36e2622779 00007f36e2622709 00007f36e26226d1 00007f36e26219cd 000000000038f354 000000000038f199 00007f36e260383a
0709 13:06:28.711219 (+  2058us) raft_consensus.cc:1685] finished
0709 13:06:28.711243 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.711385 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10817,"prepare.queue_time_us":22466,"prepare.run_wall_time_us":40,"raft.queue_time_us":8973,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":24801,"spinlock_wait_cycles":37586816,"thread_start_us":30401,"threads_started":1,"wal-append.queue_time_us":30697}
I20260709 13:06:28.704324 22301 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:28.720710 22301 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:28.720811 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.721537 15195 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
I20260709 13:06:28.696542 15263 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:28.724912 15842 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 
I20260709 13:06:28.726366 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:28.727244 15192 raft_consensus.cc:3060] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:28.731158 15193 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:28.733110 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.734081 15263 raft_consensus.cc:1275] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260709 13:06:28.734567 15263 pending_rounds.cc:85] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Aborting all ops after (but not including) 12
I20260709 13:06:28.734836 15263 pending_rounds.cc:107] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:06:28.739789 15263 raft_consensus.cc:2889] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.742837 15337 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:28.756505 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:28.736505 22435 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.736261 22493 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:28.735445 22652 raft_consensus.cc:493] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.768601 15193 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:28.736068 22614 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:28.769250 15192 raft_consensus.cc:2468] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
W20260709 13:06:28.769830 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 133169us
I20260709 13:06:28.786088 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:28.792523 15309 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:28.808450 22000 raft_consensus.cc:2804] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:28.809146 22000 raft_consensus.cc:697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:28.810060 22000 consensus_queue.cc:237] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.810957 22436 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:06:28.812067 22663 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:28.777307 22435 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.818509 22435 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:28.787559 22672 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:28.820953 22672 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.794142 22420 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:06:28.811190 22655 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:28.827960 22655 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.828517 22655 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:28.777948 22614 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.835978 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:28.836771 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:28.837384 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:28.838748 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:28.847584 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 53614.1us
I20260709 13:06:28.853971 22499 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:28.856225 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:28.856935 22365 consensus_queue.cc:1048] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:28.784101 22652 raft_consensus.cc:515] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.797013 22674 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.865000 22674 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:28.784272 22493 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.869252 22493 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:28.845585 22614 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:28.884965 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:28.881938 15268 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21.
I20260709 13:06:28.899816 15339 raft_consensus.cc:1275] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:28.901379 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:28.902037 15263 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:28.904565 22652 leader_election.cc:290] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:28.906381 15237 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:28.909281 22676 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:28.915321 22457 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:28.919126 22672 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:28.921120 22601 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:28.925551 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:28.927196 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.930220 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.930775 15266 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:28.841267 22469 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.932385 15192 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:28.933257 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.937958 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.952373 15341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49393a249e3f433db3840189ee7dc630"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:28.953198 15341 raft_consensus.cc:606] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:28.953400 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.953754 15341 raft_consensus.cc:614] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:28.935129 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:28.937472 22662 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.935947 15238 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:28.969997 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 82188.9us
I20260709 13:06:28.976912 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:28.942418 22469 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.979501 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:28.980185 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:28.969574 22672 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:28.985136 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "061ef1ddcd60472fbf7e0c7c536414d4" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:28.966004 22680 log.cc:927] Time spent T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:06:28.990816 15238 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:28.991218 15160 leader_election.cc:304] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:28.979429 22457 consensus_queue.cc:1048] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:06:28.987228 22435 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:29.007685 22435 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:29.008325 22435 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:28.965847 22662 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:28.968760 22614 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:28.990226 22483 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:28.997349 22674 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:29.004762 22301 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:29.049477 22655 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.052464 15343 raft_consensus.cc:1240] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:28.993413 22482 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:06:29.065392 15872 raft_consensus.cc:2368] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22.
I20260709 13:06:29.066365 22614 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:29.001333 22475 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 13:06:29.055327 22644 log.cc:927] Time spent T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:29.083051 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:29.082008 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:29.068070 22469 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:29.159475 15264 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:29.105657 22655 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:29.110285 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55953.9us
I20260709 13:06:29.083694 15162 leader_election.cc:400] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22.
I20260709 13:06:29.161863 15162 leader_election.cc:403] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:29.084251 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:29.163385 15193 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 22
W20260709 13:06:29.167436 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 83957.9us
I20260709 13:06:29.114610 22335 raft_consensus.cc:993] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:29.175743 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:29.070854 22662 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:29.070796 22435 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:29.186465 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 199172us
I20260709 13:06:29.112342 22667 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:29.202740 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:29.203608 15872 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:29.203764 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:29.182847 22552 raft_consensus.cc:1081] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
W20260709 13:06:29.211485 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 220786us
I20260709 13:06:29.196046 22571 raft_consensus.cc:2749] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:29.201709 22667 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.211578 22621 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 3 to 11, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:29.238778 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:29.241887 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:29.214630 15193 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 22.
I20260709 13:06:29.248383 15238 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:29.255517 15338 raft_consensus.cc:1240] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:29.240842 15087 catalog_manager.cc:5697] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.231339 22624 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.268859 22624 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.272678 15345 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:29.270977 22624 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:29.304693 22435 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:29.258960 22668 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:29.306981 22668 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.309101 22668 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:29.249853 22587 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) with higher term. Message: Invalid argument: T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 21. Current term is 22.
I20260709 13:06:29.320506 15338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:29.321177 15338 raft_consensus.cc:606] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:29.321498 15338 raft_consensus.cc:614] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.321713 22666 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:29.322315 22666 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.324505 22666 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:29.329434 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45862
I20260709 13:06:29.330040 15267 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:29.330408 15267 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.332310 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:29.332971 15268 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:29.337086 15338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:29.337668 15338 raft_consensus.cc:606] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:29.338034 15338 raft_consensus.cc:614] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:29.339548 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 92274.5us
I20260709 13:06:29.339665 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:29.340888 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:29.341374 15267 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:29.342592 15338 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 3 to 11, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:29.346308 15087 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 18 to 24, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 24 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:29.347992 15087 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.352298 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:29.353220 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:29.353504 15346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:29.354019 15346 raft_consensus.cc:606] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:29.354331 15346 raft_consensus.cc:614] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:29.354997 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:29.339334 22676 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:29.365135 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:29.367908 15271 raft_consensus.cc:3060] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:29.366914 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 155319us
I20260709 13:06:29.367177 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:29.370900 15267 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:29.371917 22603 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:29.373591 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:29.378197 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:29.380136 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:29.381047 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:29.374119 15876 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.383427 15191 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:29.385169 22033 consensus_queue.cc:1059] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:06:29.389381 22666 raft_consensus.cc:3055] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:29.389747 22666 raft_consensus.cc:740] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:29.390761 22666 consensus_queue.cc:260] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.391891 22666 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:29.389683 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:29.397876 22622 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:29.398332 22622 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.398674 22622 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:29.398864 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:29.399552 15344 raft_consensus.cc:3055] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:29.399837 15344 raft_consensus.cc:740] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:29.400614 15344 consensus_queue.cc:260] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:29.408664 15271 raft_consensus.cc:2468] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 22.
I20260709 13:06:29.411621 15839 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:29.414119 15876 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:29.432529 22664 raft_consensus.cc:2804] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:29.439122 22664 raft_consensus.cc:697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:29.440133 22664 consensus_queue.cc:237] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:29.445182 22667 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:29.479144 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:29.477855 15087 catalog_manager.cc:5697] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 15 to 18, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 18 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.478394 22668 consensus_queue.cc:1059] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:29.486817 15087 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 10 to 12, term changed from 17 to 19, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to <none>, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:29.488198 22668 raft_consensus.cc:3055] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:29.488761 22668 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:29.489825 22668 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:29.567513 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93662.3us
I20260709 13:06:29.569612 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:29.572566 15081 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:06:29.564695 22668 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:29.582499 15312 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:29.586154 15876 raft_consensus.cc:1240] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:29.582662 22598 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:29.608321 15194 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:29.588936 22661 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:29.666090 15312 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.628269 22661 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:06:29.666618 22694 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:29.681011 22694 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.696166 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:29.702100 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:29.716682 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:29.745206 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:29.740209 22694 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:29.783044 15161 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.791376 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:29.796180 15269 raft_consensus.cc:1275] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:06:29.805219 15309 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.759235 22587 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:29.824457 22622 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.826956 22622 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:29.828943 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:29.835124 15344 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.800629 22588 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:29.857807 15344 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
I20260709 13:06:29.861841 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:29.862512 15269 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:29.838650 22587 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.865126 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:29.863803 22335 consensus_queue.cc:1048] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:06:29.875803 22023 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:29.876557 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:29.878968 22499 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:29.867189 22587 raft_consensus.cc:3060] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:29.887363 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:29.888237 15190 raft_consensus.cc:2393] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 22: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:29.893224 15195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:29.893822 15195 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:29.895057 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:29.868414 15237 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:29.904644 22587 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:29.907052 22587 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:29.910934 15189 raft_consensus.cc:2393] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 27: Already voted for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in this term.
W20260709 13:06:29.916247 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 47907.8us
I20260709 13:06:29.897192 15188 raft_consensus.cc:2955] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 3 to 11, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:29.917970 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:29.956450 15269 raft_consensus.cc:2468] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 27.
I20260709 13:06:29.951700 22600 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:29.934562 22666 consensus_meta.cc:287] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.001s
W20260709 13:06:29.982239 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49059.7us
W20260709 13:06:29.994881 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 75239.6us
I20260709 13:06:30.067333 15309 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:30.075474 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:30.060096 15195 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 14.
W20260709 13:06:30.068066 15089 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 175) took 43476 ms (client timeout 15000 ms). Trace:
I20260709 13:06:30.074062 22600 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:30.080034 22667 raft_consensus.cc:2804] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:06:30.148988 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 177965us
I20260709 13:06:30.144924 22667 raft_consensus.cc:697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:06:30.194983 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 67780.9us
W20260709 13:06:30.197117 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46343.3us
I20260709 13:06:30.197929 15238 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:30.202906 15195 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:06:30.216468 22668 consensus_meta.cc:287] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Time spent flushing consensus metadata: real 0.633s	user 0.011s	sys 0.001s
I20260709 13:06:30.198606 22667 consensus_queue.cc:237] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.230528 22614 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:30.182264 22600 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:30.105454 15089 rpcz_store.cc:269] 0709 13:05:46.584676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.585241 (+   565us) service_pool.cc:224] Handling call
0709 13:06:30.060525 (+43475284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:26.920330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:26.920892 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:26.920925 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:06:26.920943 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:26.921324 (+   381us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:26.921402 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:26.921430 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:26.921743 (+   313us) tablet.cc:701] Row locks acquired
0709 13:06:26.921760 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:26.921903 (+   143us) write_op.cc:270] Start()
0709 13:06:26.922014 (+   111us) write_op.cc:276] Timestamp: P: 1783602386921859 usec, L: 0
0709 13:06:26.922040 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:06:26.934864 (+ 12824us) log.cc:844] Serialized 923 byte log entry
0709 13:06:27.361854 (+426990us) op_driver.cc:464] REPLICATION: finished
0709 13:06:27.535695 (+173841us) write_op.cc:301] APPLY: starting
0709 13:06:27.535813 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:27.537771 (+  1958us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:27.537876 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:27.552369 (+ 14493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:27.571349 (+ 18980us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:06:27.571983 (+   634us) write_op.cc:312] APPLY: finished
0709 13:06:27.575473 (+  3490us) log.cc:844] Serialized 33 byte log entry
0709 13:06:27.575658 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:27.575742 (+    84us) write_op.cc:454] Released schema lock
0709 13:06:27.575783 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:27.576196 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:27.576245 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":688783,"reported_tablets":57,"child_traces":[["op",{"apply.queue_time_us":167606,"apply.run_cpu_time_us":5241,"apply.run_wall_time_us":45590,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":167162,"prepare.run_cpu_time_us":5465,"prepare.run_wall_time_us":18060,"raft.queue_time_us":238404,"raft.run_cpu_time_us":14833,"raft.run_wall_time_us":152107,"replication_time_us":438486,"thread_start_us":489948,"threads_started":4,"wal-append.queue_time_us":44777,"wal-append.run_cpu_time_us":46014,"wal-append.run_wall_time_us":1571480}]]}
W20260709 13:06:30.258823 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 60990.3us
I20260709 13:06:30.261493 22673 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:30.260604 15238 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:06:30.326977 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 66457.6us
I20260709 13:06:30.330895 15162 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:30.363632 15271 raft_consensus.cc:1275] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:30.370005 22614 consensus_queue.cc:1048] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:30.345721 22519 raft_consensus.cc:2749] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:30.332145 22676 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:30.463783 22676 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:30.467456 22676 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:30.475615 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:30.485034 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:30.483781 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:30.489843 22717 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:30.490408 22717 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.492450 22716 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:30.493539 22717 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:30.493204 22716 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.495499 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:30.496255 15342 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:30.499840 15238 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:30.500200 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:30.500852 15197 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:30.508623 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:30.512802 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:30.512758 22717 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:30.515851 22717 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:30.516229 22717 raft_consensus.cc:3060] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:30.512998 22600 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:30.521934 22716 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:30.522878 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:30.523698 15340 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 25: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:30.526582 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:30.527256 15197 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 25.
I20260709 13:06:30.528988 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:30.530573 22600 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:30.531020 22600 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:30.531466 22600 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:30.470963 22676 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:30.553676 22717 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.565546 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:30.566825 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:30.567629 15342 raft_consensus.cc:2393] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:30.569748 22600 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.572778 15197 raft_consensus.cc:2468] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:30.573037 22600 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:30.574196 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:30.574985 15342 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 25: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:30.578611 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:30.574424 22717 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:30.578730 15238 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:30.592614 22717 raft_consensus.cc:2804] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:30.593681 22717 raft_consensus.cc:697] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:30.594779 22717 consensus_queue.cc:237] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.593737 15197 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 25.
W20260709 13:06:30.608579 15081 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 81d86ef88f7f41238f3a595588effaca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 11
I20260709 13:06:30.609709 15238 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:30.611514 22676 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:30.612032 22676 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:30.612802 22676 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.607012 15087 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43458 (request call id 71) took 4300 ms. Trace:
I20260709 13:06:30.615559 15087 rpcz_store.cc:276] 0709 13:06:26.306466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.317871 (+ 11405us) service_pool.cc:224] Handling call
0709 13:06:26.329183 (+ 11312us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b5400002490. stack: 00007f36e25ee343 00007f36e25ee240 00007f36e1f7d1d4 00007f36ebcbb304 00007f36ebcbb299 00007f36e24a8db1 00007f36e25e8b71 00007f36e25e90b2 00007f36eb562a89 00007f36eb4fada6 00007f36eb4cc088 00007f36eb5ca37e 00007f36e9a8b2a4 00007f36e9a8b232 00007f36e9a8b161 00007f36e9a8b0dc
0709 13:06:30.606953 (+4277770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:29.668285 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:29.706354 (+ 38069us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:29.708199 (+  1845us) write_op.cc:435] Acquired schema lock
0709 13:06:29.715298 (+  7099us) tablet.cc:662] Decoding operations
0709 13:06:29.864186 (+148888us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:29.892508 (+ 28322us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:29.900153 (+  7645us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:29.907192 (+  7039us) tablet.cc:701] Row locks acquired
0709 13:06:29.907211 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:29.907372 (+   161us) write_op.cc:270] Start()
0709 13:06:29.907610 (+   238us) write_op.cc:276] Timestamp: P: 1783602389907321 usec, L: 0
0709 13:06:29.907654 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:06:29.908355 (+   701us) log.cc:844] Serialized 2082 byte log entry
0709 13:06:30.435310 (+526955us) op_driver.cc:464] REPLICATION: finished
0709 13:06:30.520094 (+ 84784us) write_op.cc:301] APPLY: starting
0709 13:06:30.520174 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:30.526882 (+  6708us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:30.526976 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:30.562384 (+ 35408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:30.562622 (+   238us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:06:30.562679 (+    57us) write_op.cc:312] APPLY: finished
0709 13:06:30.562934 (+   255us) log.cc:844] Serialized 57 byte log entry
0709 13:06:30.591200 (+ 28266us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.591312 (+   112us) write_op.cc:454] Released schema lock
0709 13:06:30.591355 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":627063,"reported_tablets":7,"spinlock_wait_cycles":20123904,"child_traces":[["op",{"apply.queue_time_us":78430,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25057,"num_ops":5,"prepare.queue_time_us":134865,"prepare.run_cpu_time_us":27989,"prepare.run_wall_time_us":496901,"raft.queue_time_us":209888,"raft.run_cpu_time_us":16141,"raft.run_wall_time_us":73550,"replication_time_us":522106,"thread_start_us":509472,"threads_started":4,"wal-append.queue_time_us":287128}]]}
I20260709 13:06:30.647714 15091 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 12 to -1, term changed from 19 to 13, leader changed from <none> to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1), VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) evicted. New cstate: current_term: 13 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:30.685696 15197 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:06:30.690181 22624 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:30.700512 15872 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:30.702286 22676 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:30.709764 15193 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:30.711434 22600 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:30.726333 15268 raft_consensus.cc:1275] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:06:30.732259 22548 consensus_queue.cc:1048] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:30.755008 15342 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:30.762658 22717 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:06:30.787627 15087 catalog_manager.cc:5697] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.833931 15087 catalog_manager.cc:5697] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 3 to 11, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New cstate: current_term: 16 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.836043 15087 catalog_manager.cc:5697] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 17 to 19, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 19 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.838896 15087 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index -1 to 12, term changed from 13 to 19, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3), VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:30.857007 15087 catalog_manager.cc:5697] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:30.924301 22548 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.924921 22548 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:30.930632 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:30.931522 15197 raft_consensus.cc:2410] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 for term 26 because replica has last-logged OpId of term: 24 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:06:30.938575 15866 tablet_service.cc:1558] Processing DeleteTablet for tablet 6056d49d08dc4130887dbf154edc6675 with delete_type TABLET_DATA_TOMBSTONED (TS 2a3d3cf7ed3b453ebeccda54becdb6e1 not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:51610
I20260709 13:06:30.940685 15333 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e75f905ad042d89b465e6461b29a5d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:34528
I20260709 13:06:30.945225 15255 tablet_service.cc:1558] Processing DeleteTablet for tablet 81d86ef88f7f41238f3a595588effaca with delete_type TABLET_DATA_TOMBSTONED (TS f4ca86ee1d194023b1414bbe226f4798 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:58520
I20260709 13:06:30.940665 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:30.947551 15309 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:30.948338 22667 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:30.927307 22548 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:30.960884 15091 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 162) took 53384 ms (client timeout 15000 ms). Trace:
I20260709 13:06:30.970607 22733 tablet_replica.cc:333] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:06:30.971869 22733 raft_consensus.cc:2243] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:30.972692 22733 raft_consensus.cc:2272] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:30.982419 15081 catalog_manager.cc:5028] TS 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): tablet 35e75f905ad042d89b465e6461b29a5d (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
W20260709 13:06:30.961472 15091 rpcz_store.cc:269] 0709 13:05:37.576899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.577091 (+   192us) service_pool.cc:224] Handling call
0709 13:06:30.960774 (+53383683us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:30.749540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:30.756468 (+  6928us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:30.756520 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:30.756548 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:30.756938 (+   390us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.757028 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.757056 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:30.757251 (+   195us) tablet.cc:701] Row locks acquired
0709 13:06:30.757269 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:30.759947 (+  2678us) write_op.cc:270] Start()
0709 13:06:30.760091 (+   144us) write_op.cc:276] Timestamp: P: 1783602390757370 usec, L: 0
0709 13:06:30.760114 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.763443 (+  3329us) log.cc:844] Serialized 538 byte log entry
0709 13:06:30.766393 (+  2950us) op_driver.cc:464] REPLICATION: finished
0709 13:06:30.766798 (+   405us) write_op.cc:301] APPLY: starting
0709 13:06:30.766884 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:30.767816 (+   932us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:30.767917 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:30.768636 (+   719us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:30.768826 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:06:30.768882 (+    56us) write_op.cc:312] APPLY: finished
0709 13:06:30.769072 (+   190us) log.cc:844] Serialized 25 byte log entry
0709 13:06:30.769243 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.769326 (+    83us) write_op.cc:454] Released schema lock
0709 13:06:30.769367 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:30.769755 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.769806 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16282,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":138,"apply.run_cpu_time_us":2909,"apply.run_wall_time_us":2910,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":16983,"prepare.run_cpu_time_us":2899,"prepare.run_wall_time_us":14198,"replication_time_us":6132,"thread_start_us":28318,"threads_started":1}]]}
I20260709 13:06:31.010936 15345 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:31.012677 22715 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:31.048861 15342 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:06:31.050726 22715 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:31.066339 22733 ts_tablet_manager.cc:1916] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:31.103610 22735 tablet_replica.cc:333] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:06:31.104799 22735 raft_consensus.cc:2243] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:31.105476 22735 raft_consensus.cc:2272] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:31.110352 15197 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:06:31.205752 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 80490.7us
I20260709 13:06:31.220428 22735 ts_tablet_manager.cc:1916] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:06:31.228034 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 116017us
I20260709 13:06:31.236589 22676 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 13:06:31.304307 22735 ts_tablet_manager.cc:1929] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.10
I20260709 13:06:31.314112 22735 log.cc:1199] T 81d86ef88f7f41238f3a595588effaca P f4ca86ee1d194023b1414bbe226f4798: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/wals/81d86ef88f7f41238f3a595588effaca
W20260709 13:06:31.315321 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 82956.2us
W20260709 13:06:31.406203 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 50679.5us
I20260709 13:06:31.414497 15193 raft_consensus.cc:1275] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260709 13:06:31.448361 22736 log.cc:927] Time spent T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:06:31.456300 15079 catalog_manager.cc:5028] TS f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): tablet 81d86ef88f7f41238f3a595588effaca (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:31.473272 22733 ts_tablet_manager.cc:1929] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:06:31.473785 22733 log.cc:1199] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-3-root/wals/6056d49d08dc4130887dbf154edc6675
W20260709 13:06:31.483837 15311 consensus_peers.cc:597] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:31.451911 15087 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 13 to 14, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 14 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:31.513396 15081 catalog_manager.cc:5028] TS 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): tablet 6056d49d08dc4130887dbf154edc6675 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
W20260709 13:06:31.534304 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 81516.2us
W20260709 13:06:31.543118 15092 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 161) took 79421 ms (client timeout 15000 ms). Trace:
W20260709 13:06:31.555843 15092 rpcz_store.cc:269] 0709 13:05:12.120832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.121020 (+   188us) service_pool.cc:224] Handling call
0709 13:06:31.541724 (+79420704us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4302355,"reported_tablets":56}
I20260709 13:06:31.652776 15333 tablet_service.cc:1558] Processing DeleteTablet for tablet 35e75f905ad042d89b465e6461b29a5d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:34528
W20260709 13:06:31.655179 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 57145.1us
I20260709 13:06:31.686931 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:31.768108 15081 catalog_manager.cc:5028] TS 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): tablet 35e75f905ad042d89b465e6461b29a5d (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:31.771772 22715 consensus_queue.cc:1048] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:31.872210 22756 ts_tablet_manager.cc:933] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:31.879496 22756 tablet_copy_client.cc:323] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.3:46145
I20260709 13:06:31.907310 15356 tablet_copy_service.cc:140] P 9d785ccef0634edd9f0fbb52fa1c8d27: Received BeginTabletCopySession request for tablet 6056d49d08dc4130887dbf154edc6675 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:48112)
I20260709 13:06:31.907914 15356 tablet_copy_service.cc:161] P 9d785ccef0634edd9f0fbb52fa1c8d27: Beginning new tablet copy session on tablet 6056d49d08dc4130887dbf154edc6675 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:48112: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-6056d49d08dc4130887dbf154edc6675
I20260709 13:06:31.908349 15345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49393a249e3f433db3840189ee7dc630"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:31.909019 15345 raft_consensus.cc:606] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:31.909366 15345 raft_consensus.cc:614] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:31.923739 15345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:31.924959 15345 raft_consensus.cc:606] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:31.957777 15345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:31.959491 15345 raft_consensus.cc:606] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:31.961483 15345 raft_consensus.cc:614] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:31.973712 15345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:31.974310 15345 raft_consensus.cc:606] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:31.974702 15345 raft_consensus.cc:614] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:31.984869 15342 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:31.985623 15342 raft_consensus.cc:606] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:31.985966 15342 raft_consensus.cc:614] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:31.986753 15356 tablet_copy_source_session.cc:215] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:31.987339 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:31.989077 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:31.993211 22756 ts_tablet_manager.cc:1916] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 13:06:32.032289 15094 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 17 to 19, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.038375 15094 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.041615 15094 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.059653 15094 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 21, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 21 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.061439 15094 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 19 to 20, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 20 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.062979 15094 catalog_manager.cc:5697] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 6 to 15, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 15 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.064613 15094 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.066921 15094 catalog_manager.cc:5697] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 16 to 18, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 18 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.069214 15094 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 13 to 17, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 17 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.070655 15094 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 16 to 17, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 17 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.072402 15094 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 19 to 21, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 21 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.075354 15094 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 17, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 17 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.077071 15094 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 18, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 18 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.078662 15094 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 19, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.080319 15094 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:32.082885 22548 raft_consensus.cc:993] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:32.083403 22548 raft_consensus.cc:1081] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Signalling peer 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:32.085655 15197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:46346
I20260709 13:06:32.086174 15197 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:32.086506 15197 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:32.096194 15197 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:32.138235 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:32.138952 15343 raft_consensus.cc:3055] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:32.139324 15343 raft_consensus.cc:740] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:32.140174 15343 consensus_queue.cc:260] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:32.141575 15343 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:32.148999 15255 tablet_service.cc:1558] Processing DeleteTablet for tablet 81d86ef88f7f41238f3a595588effaca with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:58520
W20260709 13:06:32.150238 15094 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 173) took 18442 ms (client timeout 15000 ms). Trace:
W20260709 13:06:32.150622 15094 rpcz_store.cc:269] 0709 13:06:13.716323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.716499 (+   176us) service_pool.cc:224] Handling call
0709 13:06:32.150152 (+18433653us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:32.089873 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:32.090396 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:32.090430 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:06:32.090446 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:32.091638 (+  1192us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:32.091695 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:32.091725 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:06:32.092836 (+  1111us) tablet.cc:701] Row locks acquired
0709 13:06:32.092852 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:06:32.093024 (+   172us) write_op.cc:270] Start()
0709 13:06:32.093137 (+   113us) write_op.cc:276] Timestamp: P: 1783602392092979 usec, L: 0
0709 13:06:32.093156 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:32.093804 (+   648us) log.cc:844] Serialized 5929 byte log entry
0709 13:06:32.096261 (+  2457us) op_driver.cc:464] REPLICATION: finished
0709 13:06:32.096625 (+   364us) write_op.cc:301] APPLY: starting
0709 13:06:32.096722 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:32.105698 (+  8976us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:32.105783 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:32.114452 (+  8669us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:32.114696 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:06:32.114737 (+    41us) write_op.cc:312] APPLY: finished
0709 13:06:32.115088 (+   351us) log.cc:844] Serialized 139 byte log entry
0709 13:06:32.115810 (+   722us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.115974 (+   164us) write_op.cc:454] Released schema lock
0709 13:06:32.116025 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:32.123996 (+  7971us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.124025 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":56,"spinlock_wait_cycles":9600,"child_traces":[["op",{"apply.queue_time_us":123,"apply.run_cpu_time_us":17663,"apply.run_wall_time_us":27319,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62790,"num_ops":15,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":4229,"prepare.run_wall_time_us":4235,"replication_time_us":2995,"spinlock_wait_cycles":68864}]]}
I20260709 13:06:32.155205 15197 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:32.170356 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:32.170938 15267 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:32.174177 22756 ts_tablet_manager.cc:1929] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 19.13
I20260709 13:06:32.175144 22756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6056d49d08dc4130887dbf154edc6675. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:32.178753 15267 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:32.186095 15160 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:32.186497 15343 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 25.
I20260709 13:06:32.188033 22015 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:32.188511 22015 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:32.189209 22015 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:32.193003 15079 catalog_manager.cc:5028] TS f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): tablet 81d86ef88f7f41238f3a595588effaca (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:32.215699 22756 tablet_copy_client.cc:806] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:32.219684 22756 tablet_copy_client.cc:670] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:32.226675 22756 tablet_copy_client.cc:538] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:32.236590 22756 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:06:32.242017 15088 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 18 to 21, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.250773 15088 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 16 to 24. New cstate: current_term: 24 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.254755 15088 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 13 to 14, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 14 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.351934 15095 catalog_manager.cc:5697] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 17 to 20, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 20 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.353864 15095 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.368716 15095 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.376075 15095 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 27 to 30, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 30 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:32.386587 15088 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 163) took 26469 ms (client timeout 15000 ms). Trace:
W20260709 13:06:32.387081 15088 rpcz_store.cc:269] 0709 13:06:05.917117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.918072 (+   955us) service_pool.cc:224] Handling call
0709 13:06:32.386509 (+26468437us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:32.261108 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:32.261608 (+   500us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:32.261641 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:06:32.261666 (+    25us) tablet.cc:662] Decoding operations
0709 13:06:32.262169 (+   503us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:32.262220 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:32.262250 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:32.262579 (+   329us) tablet.cc:701] Row locks acquired
0709 13:06:32.262597 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:32.262742 (+   145us) write_op.cc:270] Start()
0709 13:06:32.262849 (+   107us) write_op.cc:276] Timestamp: P: 1783602392262696 usec, L: 0
0709 13:06:32.262872 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:32.264980 (+  2108us) log.cc:844] Serialized 1308 byte log entry
0709 13:06:32.268082 (+  3102us) op_driver.cc:464] REPLICATION: finished
0709 13:06:32.269386 (+  1304us) write_op.cc:301] APPLY: starting
0709 13:06:32.269464 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:32.273201 (+  3737us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:32.273324 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:32.275639 (+  2315us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:32.275841 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:06:32.275901 (+    60us) write_op.cc:312] APPLY: finished
0709 13:06:32.276147 (+   246us) log.cc:844] Serialized 41 byte log entry
0709 13:06:32.277038 (+   891us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.277378 (+   340us) write_op.cc:454] Released schema lock
0709 13:06:32.277432 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:32.277822 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.277859 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23632,"reported_tablets":56,"spinlock_wait_cycles":6912,"child_traces":[["op",{"apply.queue_time_us":874,"apply.run_cpu_time_us":5853,"apply.run_wall_time_us":8398,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":2901,"prepare.run_wall_time_us":4201,"replication_time_us":5059,"spinlock_wait_cycles":2304}]]}
I20260709 13:06:32.391167 15095 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 23 to 25, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 25 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.394111 15095 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 13 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 15 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.396276 15095 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.397758 15095 catalog_manager.cc:5697] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.399655 15095 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 12 to 15, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 15 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.401556 15095 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 21 to 24, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 24 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.403915 15095 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 19 to 22, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 22 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.414175 15095 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.418437 15095 catalog_manager.cc:5697] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 21 to 23, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 23 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.423570 15095 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 19 to 20, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 20 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.424957 15095 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 21 to 23, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 23 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.425884 15095 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.427511 15095 catalog_manager.cc:5697] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 18 to 19, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.429986 15095 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 25, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.431612 22756 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:32.431335 15095 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 16 to 17, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.432582 22756 tablet_bootstrap.cc:492] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:32.433383 22756 ts_tablet_manager.cc:1403] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.197s	user 0.050s	sys 0.005s
I20260709 13:06:32.433317 15095 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.434856 15095 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 24, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 24 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.436169 15095 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.436686 22756 raft_consensus.cc:359] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:32.437502 22756 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: FOLLOWER
I20260709 13:06:32.437692 15095 catalog_manager.cc:5697] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.438423 22756 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:32.439206 15095 catalog_manager.cc:5697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 15 to 19, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 19 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.440673 15095 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.441926 22756 ts_tablet_manager.cc:1434] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:06:32.447405 15356 tablet_copy_service.cc:342] P 9d785ccef0634edd9f0fbb52fa1c8d27: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-6056d49d08dc4130887dbf154edc6675 received from {username='slave'} at 127.0.0.1:48112
I20260709 13:06:32.447958 15356 tablet_copy_service.cc:434] P 9d785ccef0634edd9f0fbb52fa1c8d27: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-6056d49d08dc4130887dbf154edc6675 on tablet 6056d49d08dc4130887dbf154edc6675 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:32.442065 15095 catalog_manager.cc:5697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.449342 15095 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 14 to 16, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 16 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.451623 15095 catalog_manager.cc:5697] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 18 to 20, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 20 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.460446 15095 catalog_manager.cc:5697] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.461745 15095 catalog_manager.cc:5697] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 19 to 22, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 22 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.463093 15095 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 14 to 18, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 18 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.469077 15095 catalog_manager.cc:5697] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.470500 15095 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.599303 15268 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:06:32.603446 22015 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:32.775475 15093 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.805284 15344 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:06:32.828184 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 117742us
I20260709 13:06:32.851671 15095 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60926 (request call id 164) took 7756 ms. Trace:
I20260709 13:06:32.852191 15095 rpcz_store.cc:276] 0709 13:06:25.095662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.095895 (+   233us) service_pool.cc:224] Handling call
0709 13:06:32.851449 (+7755554us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:32.519418 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:32.519995 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:32.520031 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:06:32.520049 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:32.523005 (+  2956us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:32.523098 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:32.523132 (+    34us) tablet.cc:685] Acquiring locks for 33 operations
0709 13:06:32.525644 (+  2512us) tablet.cc:701] Row locks acquired
0709 13:06:32.525668 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:06:32.525834 (+   166us) write_op.cc:270] Start()
0709 13:06:32.525962 (+   128us) write_op.cc:276] Timestamp: P: 1783602392525776 usec, L: 0
0709 13:06:32.525987 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:06:32.526726 (+   739us) log.cc:844] Serialized 12855 byte log entry
0709 13:06:32.529922 (+  3196us) op_driver.cc:464] REPLICATION: finished
0709 13:06:32.530392 (+   470us) write_op.cc:301] APPLY: starting
0709 13:06:32.530478 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:32.552557 (+ 22079us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:32.552786 (+   229us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:32.577074 (+ 24288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:32.577436 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=66,key_file_lookups=66,delta_file_lookups=66,mrs_lookups=0
0709 13:06:32.577482 (+    46us) write_op.cc:312] APPLY: finished
0709 13:06:32.578002 (+   520us) log.cc:844] Serialized 284 byte log entry
0709 13:06:32.578973 (+   971us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.579268 (+   295us) write_op.cc:454] Released schema lock
0709 13:06:32.579338 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:32.611375 (+ 32037us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.611406 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25119,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":264,"apply.run_cpu_time_us":38251,"apply.run_wall_time_us":80936,"cfile_cache_hit":132,"cfile_cache_hit_bytes":138138,"num_ops":33,"prepare.queue_time_us":2487,"prepare.run_cpu_time_us":7364,"prepare.run_wall_time_us":7663,"replication_time_us":3805,"spinlock_wait_cycles":51584}]]}
I20260709 13:06:32.876261 15093 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 21 to 24, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 24 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.903985 22740 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 13:06:32.878631 15093 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 20 to 24, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 24 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.914074 15093 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.916144 15093 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 19 to 27, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 27 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.919986 15093 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.928484 15093 catalog_manager.cc:5697] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 17, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 17 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.958338 15093 catalog_manager.cc:5697] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:32.962864 15093 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:32.990386 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:32.986683 15093 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 26 to 27, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 27 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:33.056375 15093 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 24 to 25, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:33.058148 15093 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:33.076603 15093 catalog_manager.cc:5697] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 25, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 25 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } }
I20260709 13:06:33.085872 15093 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.089025 15093 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 21, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:33.396420 15095 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 24 to 25, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:33.399901 15095 catalog_manager.cc:5697] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 23, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 23 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:33.402769 15095 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 24 to 25, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 25 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } }
I20260709 13:06:33.406138 15095 catalog_manager.cc:5697] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.425608 15255 tablet_service.cc:1558] Processing DeleteTablet for tablet 81d86ef88f7f41238f3a595588effaca with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:58520
I20260709 13:06:33.437515 15095 catalog_manager.cc:5697] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 25 to 27, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 27 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:33.447292 15093 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 174) took 3739 ms. Trace:
I20260709 13:06:33.448709 15079 catalog_manager.cc:5028] TS f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): tablet 81d86ef88f7f41238f3a595588effaca (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:33.447741 15093 rpcz_store.cc:276] 0709 13:06:29.707428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.721286 (+ 13858us) service_pool.cc:224] Handling call
0709 13:06:33.447182 (+3725896us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:33.156012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:33.157061 (+  1049us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:33.157126 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:06:33.157154 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:33.158851 (+  1697us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:33.158977 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:33.159006 (+    29us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:06:33.172232 (+ 13226us) tablet.cc:701] Row locks acquired
0709 13:06:33.172286 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:06:33.172500 (+   214us) write_op.cc:270] Start()
0709 13:06:33.172667 (+   167us) write_op.cc:276] Timestamp: P: 1783602393172427 usec, L: 0
0709 13:06:33.172707 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:06:33.173580 (+   873us) log.cc:844] Serialized 5921 byte log entry
0709 13:06:33.197708 (+ 24128us) op_driver.cc:464] REPLICATION: finished
0709 13:06:33.214435 (+ 16727us) write_op.cc:301] APPLY: starting
0709 13:06:33.214538 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:33.254843 (+ 40305us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:33.254983 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:33.309021 (+ 54038us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:33.309376 (+   355us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:06:33.309436 (+    60us) write_op.cc:312] APPLY: finished
0709 13:06:33.309831 (+   395us) log.cc:844] Serialized 139 byte log entry
0709 13:06:33.310668 (+   837us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.310842 (+   174us) write_op.cc:454] Released schema lock
0709 13:06:33.310917 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:33.315324 (+  4407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.315352 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67743,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":16353,"apply.run_cpu_time_us":21943,"apply.run_wall_time_us":100856,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66917,"num_ops":15,"prepare.queue_time_us":4571,"prepare.run_cpu_time_us":8179,"prepare.run_wall_time_us":24102,"replication_time_us":24756,"spinlock_wait_cycles":21248,"thread_start_us":32025,"threads_started":2}]]}
W20260709 13:06:33.783648 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 84764.4us
W20260709 13:06:33.817075 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 77478.7us
I20260709 13:06:33.857892 15344 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:33.973702 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45659.8us
I20260709 13:06:33.990634 15876 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:33.996534 15268 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:34.001509 15090 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60908 (request call id 177) took 7855 ms. Trace:
I20260709 13:06:34.004196 22797 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:06:34.013520 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45488.2us
I20260709 13:06:34.017553 22803 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:34.010396 15090 rpcz_store.cc:276] 0709 13:06:26.140464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.140790 (+   326us) service_pool.cc:224] Handling call
0709 13:06:33.995212 (+7854422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25267,"reported_tablets":52}
I20260709 13:06:34.068943 22797 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 12 to 14, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:34.078208 15872 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 12 to 14, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:34.106992 15090 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 12 to 14, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 19 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:34.138677 15081 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6056d49d08dc4130887dbf154edc6675 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:34.155652 15268 raft_consensus.cc:2955] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 12 to 14, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:34.172892 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:34.286430 15179 tablet_service.cc:1558] Processing DeleteTablet for tablet 6056d49d08dc4130887dbf154edc6675 with delete_type TABLET_DATA_TOMBSTONED (TS 5e6eed5c7a6b4571b5f898002fc990d2 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:46344
I20260709 13:06:34.361940 22809 tablet_replica.cc:333] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:34.363337 22809 raft_consensus.cc:2243] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:34.364897 22809 raft_consensus.cc:2272] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:34.369122 22809 ts_tablet_manager.cc:1916] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:34.412817 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49393a249e3f433db3840189ee7dc630"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:34.413739 15188 raft_consensus.cc:606] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:34.419090 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:34.419721 15188 raft_consensus.cc:606] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:34.432483 15341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:34.433166 15341 raft_consensus.cc:606] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:34.436494 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:34.437178 15188 raft_consensus.cc:606] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:34.441576 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:34.442149 15188 raft_consensus.cc:606] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:34.445732 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:34.446326 15188 raft_consensus.cc:606] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:34.446555 22809 ts_tablet_manager.cc:1929] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:06:34.447407 22809 log.cc:1199] T 6056d49d08dc4130887dbf154edc6675 P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/wals/6056d49d08dc4130887dbf154edc6675
I20260709 13:06:34.449687 15082 catalog_manager.cc:5028] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): tablet 6056d49d08dc4130887dbf154edc6675 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:34.454047 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:34.456091 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:34.479424 22785 raft_consensus.cc:993] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.480036 22785 raft_consensus.cc:1081] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.481801 15268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:34.482425 15268 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.482774 15268 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:34.493888 15268 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.498606 15268 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:34.501065 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:34.501767 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:34.502405 15341 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:34.501801 15193 raft_consensus.cc:3055] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:06:34.506877 15193 raft_consensus.cc:740] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:34.510360 15193 consensus_queue.cc:260] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.515552 15193 raft_consensus.cc:3060] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:34.519554 15341 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 28.
I20260709 13:06:34.521063 15237 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:34.522145 22796 raft_consensus.cc:2804] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:34.522761 22796 raft_consensus.cc:697] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:34.524111 22796 consensus_queue.cc:237] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.542914 22782 raft_consensus.cc:993] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.543522 22782 raft_consensus.cc:1081] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.545313 15268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:34.545833 15268 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.546221 15268 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:34.546540 15193 raft_consensus.cc:2468] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 28.
I20260709 13:06:34.554754 15268 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.558522 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:34.559621 15193 raft_consensus.cc:3055] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:34.559957 15193 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:34.560863 15268 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:34.561813 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:34.562409 15341 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:34.562844 15193 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.564378 15193 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:34.571409 15193 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:06:34.572615 15238 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:34.572536 15095 catalog_manager.cc:5697] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 27 to 28, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 28 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.573669 22796 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:34.574190 22796 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:34.575016 22796 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.646972 15341 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:06:34.663017 15095 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 21 to 22, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 22 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.670023 22795 raft_consensus.cc:993] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.671386 22797 raft_consensus.cc:1081] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.671896 22782 raft_consensus.cc:993] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.672423 22782 raft_consensus.cc:1081] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.674239 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45862
I20260709 13:06:34.674817 15267 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.675195 15267 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:06:34.675460 15268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:34.675977 15268 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.676306 15268 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:34.683946 15267 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 31 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.686029 15268 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.697301 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:34.697930 15188 raft_consensus.cc:3055] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:34.698202 15188 raft_consensus.cc:740] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:34.698982 15188 consensus_queue.cc:260] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.700279 15188 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:34.703157 15268 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:34.703501 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:34.712417 15341 raft_consensus.cc:3060] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:34.713344 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 31 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:34.713918 15344 raft_consensus.cc:3055] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 13:06:34.714205 15344 raft_consensus.cc:740] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:34.711706 15267 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 31 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:34.714939 15344 consensus_queue.cc:260] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.15, Last appended by leader: 15, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.716055 15344 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:06:34.716321 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 31 candidate_status { last_received { term: 30 index: 15 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:34.716890 15193 raft_consensus.cc:3060] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:06:34.752478 15341 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:34.753916 15237 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:34.754918 22796 raft_consensus.cc:2804] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:34.755472 22796 raft_consensus.cc:697] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:34.756390 22796 consensus_queue.cc:237] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.768260 15344 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 31.
I20260709 13:06:34.769528 15237 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:34.771620 22787 raft_consensus.cc:2804] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:06:34.772159 22787 raft_consensus.cc:697] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 31 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:34.773083 22787 consensus_queue.cc:237] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 30.15, Last appended by leader: 15, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.782368 15188 raft_consensus.cc:2468] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 21.
I20260709 13:06:34.783530 15193 raft_consensus.cc:2468] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 31.
I20260709 13:06:34.806103 15095 catalog_manager.cc:5697] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 20 to 21, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.876840 22801 raft_consensus.cc:993] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.886461 22815 raft_consensus.cc:1081] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.887804 15095 catalog_manager.cc:5697] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 30 to 31, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 31 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.902663 15268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49393a249e3f433db3840189ee7dc630"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:34.903285 15268 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.903681 15268 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:34.918676 15268 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.921099 15268 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:34.921815 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:34.922176 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:34.922444 15188 raft_consensus.cc:3055] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:34.922784 15188 raft_consensus.cc:740] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:34.922966 15341 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:34.923624 15188 consensus_queue.cc:260] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.924763 15188 raft_consensus.cc:3060] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:34.954463 15341 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:34.955991 15237 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:34.957104 22787 raft_consensus.cc:2804] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:34.957707 22787 raft_consensus.cc:697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:34.958808 22787 consensus_queue.cc:237] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.966434 15188 raft_consensus.cc:2468] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:34.970049 15344 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:06:34.968427 22782 raft_consensus.cc:993] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.971690 22782 raft_consensus.cc:1081] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:34.972752 22796 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:34.974309 15268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:34.974892 15268 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:34.975317 15268 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:34.991220 15345 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:34.991603 15268 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.993079 22796 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:34.994302 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:34.994908 15188 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:06:34.995213 15188 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:34.995986 15188 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:34.997270 15188 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:35.004596 15188 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 28.
I20260709 13:06:35.005692 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:35.006943 22796 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:35.007455 22796 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:35.008124 15268 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:35.008405 22796 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:35.022948 15188 raft_consensus.cc:1275] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 13:06:35.023622 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:35.024999 15341 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:35.024425 22787 consensus_queue.cc:1048] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:35.036875 15095 catalog_manager.cc:5697] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 17 to 18, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 18 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.095214 15341 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 28.
W20260709 13:06:35.151924 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 74104.2us
W20260709 13:06:35.210196 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 92845us
I20260709 13:06:35.211750 15094 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 27 to 28, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 28 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:35.236781 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 125410us
W20260709 13:06:35.284478 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 119041us
I20260709 13:06:35.306921 15193 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:35.318608 15197 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:06:35.322183 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 43918.1us
I20260709 13:06:35.343559 22836 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:35.338331 22824 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:06:35.471587 15344 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 30 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:06:35.476606 15344 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:06:35.486649 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49445.6us
I20260709 13:06:35.487973 22796 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:35.489017 15345 raft_consensus.cc:1275] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:35.521111 22839 consensus_queue.cc:1048] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:06:35.511708 22787 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:06:35.536036 15188 raft_consensus.cc:1275] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 31 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 30 index: 15. Preceding OpId from leader: term: 31 index: 16. (index mismatch)
I20260709 13:06:35.497888 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:35.543617 15194 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:06:35.556201 15194 raft_consensus.cc:1275] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:35.589697 22787 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:35.590056 22827 consensus_queue.cc:1048] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:35.584381 22836 consensus_queue.cc:1048] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
W20260709 13:06:35.599545 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 223569us
I20260709 13:06:35.614427 15345 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
I20260709 13:06:35.633008 22787 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:35.821751 15189 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:35.860987 15162 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d932cad3925e47b28537cca64ba27320. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:35.873669 15266 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:35.877322 22816 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:35.879527 15341 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:35.882223 22785 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:35.928002 22785 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:35.932281 15267 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:35.967010 15340 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:35.999002 15093 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 11, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 16 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.013835 15189 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:36.051575 15162 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0b08eaff26447e0b420aa798c881192. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.052981 15340 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:06:36.058650 22846 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:36.065402 15267 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:06:36.070590 22816 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:06:36.110203 22846 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.122756 15267 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.143959 15340 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index -1 to 16, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.170564 15266 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:36.223299 15095 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index -1 to 16, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
W20260709 13:06:36.313545 15237 consensus_peers.cc:597] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ce7d889544e4fcd9cbbf09d13da02b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.314360 15346 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:36.315914 22836 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:36.318259 15194 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:36.319852 22836 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:36.326936 22837 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.335666 15194 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.338131 15340 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.364073 22872 ts_tablet_manager.cc:933] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:36.384599 15269 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:36.385671 15095 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 22 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.418097 22872 tablet_copy_client.cc:323] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.1:39515
I20260709 13:06:36.420720 15207 tablet_copy_service.cc:140] P 5e6eed5c7a6b4571b5f898002fc990d2: Received BeginTabletCopySession request for tablet d932cad3925e47b28537cca64ba27320 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:40392)
I20260709 13:06:36.421367 15207 tablet_copy_service.cc:161] P 5e6eed5c7a6b4571b5f898002fc990d2: Beginning new tablet copy session on tablet d932cad3925e47b28537cca64ba27320 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:40392: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-d932cad3925e47b28537cca64ba27320
W20260709 13:06:36.426812 15237 consensus_peers.cc:597] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7df15ef5ed244e05887f9af5ba36331a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.429355 15340 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:36.431951 22836 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:36.439950 15189 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:36.450271 22796 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:36.490376 22796 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.482355 15207 tablet_copy_source_session.cc:215] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:36.500353 22872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d932cad3925e47b28537cca64ba27320. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:36.494354 15340 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.511950 15194 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.516295 22876 ts_tablet_manager.cc:933] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:36.539758 15094 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:36.572134 22876 tablet_copy_client.cc:323] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.1:39515
I20260709 13:06:36.574927 15207 tablet_copy_service.cc:140] P 5e6eed5c7a6b4571b5f898002fc990d2: Received BeginTabletCopySession request for tablet e0b08eaff26447e0b420aa798c881192 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:40392)
I20260709 13:06:36.575547 15207 tablet_copy_service.cc:161] P 5e6eed5c7a6b4571b5f898002fc990d2: Beginning new tablet copy session on tablet e0b08eaff26447e0b420aa798c881192 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:40392: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-e0b08eaff26447e0b420aa798c881192
I20260709 13:06:36.583927 22872 tablet_copy_client.cc:806] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:36.585702 22872 tablet_copy_client.cc:670] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:36.594245 15207 tablet_copy_source_session.cc:215] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:36.594631 22872 tablet_copy_client.cc:538] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:36.598613 22876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0b08eaff26447e0b420aa798c881192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:36.650252 22872 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:06:36.684233 22876 tablet_copy_client.cc:806] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:36.684927 22876 tablet_copy_client.cc:670] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:36.695181 22876 tablet_copy_client.cc:538] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:36.704878 22876 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
W20260709 13:06:36.784406 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67042.5us
I20260709 13:06:36.788160 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:36.878428 22881 ts_tablet_manager.cc:933] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:36.896135 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:36.896883 15189 raft_consensus.cc:606] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:36.920068 15194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:36.920723 15194 raft_consensus.cc:606] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:36.925150 22884 ts_tablet_manager.cc:933] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:36.929737 22881 tablet_copy_client.cc:323] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:06:36.931964 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 7df15ef5ed244e05887f9af5ba36331a from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:06:36.932607 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 7df15ef5ed244e05887f9af5ba36331a from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-7df15ef5ed244e05887f9af5ba36331a
I20260709 13:06:36.945312 15282 tablet_copy_source_session.cc:215] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:36.946733 22872 log.cc:927] Time spent T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:36.947917 15269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:51924
I20260709 13:06:36.948640 15269 raft_consensus.cc:606] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:36.952174 22881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df15ef5ed244e05887f9af5ba36331a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:36.966238 15341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:36.967157 15341 raft_consensus.cc:606] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:36.974296 15194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d932cad3925e47b28537cca64ba27320"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:36.974946 15194 raft_consensus.cc:606] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:36.988860 22814 raft_consensus.cc:993] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:36.990229 22814 raft_consensus.cc:1081] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:36.998230 22884 tablet_copy_client.cc:323] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:06:37.008497 15341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:37.013957 15341 raft_consensus.cc:606] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:37.015826 15269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:37.016414 15269 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.016790 15269 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:37.019311 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:37.021169 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:37.021987 22872 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:37.059499 15269 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.075522 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:37.077046 15197 raft_consensus.cc:3055] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:37.073907 15269 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:37.077360 15197 raft_consensus.cc:740] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:37.078272 15197 consensus_queue.cc:260] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.080281 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 8ce7d889544e4fcd9cbbf09d13da02b0 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:06:37.080909 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 8ce7d889544e4fcd9cbbf09d13da02b0 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-8ce7d889544e4fcd9cbbf09d13da02b0
I20260709 13:06:37.081105 15197 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:37.085435 22872 tablet_bootstrap.cc:492] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:37.131728 15197 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:37.133751 15238 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:37.131191 22872 ts_tablet_manager.cc:1403] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.481s	user 0.036s	sys 0.015s
I20260709 13:06:37.173045 22886 raft_consensus.cc:993] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:37.173702 22886 raft_consensus.cc:1081] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:37.158998 22888 raft_consensus.cc:2804] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:37.175659 22888 raft_consensus.cc:697] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:37.176736 22888 consensus_queue.cc:237] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:37.218529 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 49328.2us
I20260709 13:06:37.221988 15266 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d932cad3925e47b28537cca64ba27320"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:37.222712 15266 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.223129 15266 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.252570 15282 tablet_copy_source_session.cc:215] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:37.245919 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:37.273875 15346 raft_consensus.cc:3060] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:37.255663 22872 raft_consensus.cc:359] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:37.275885 22872 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:06:37.276733 22872 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:37.292060 22872 ts_tablet_manager.cc:1434] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.139s	user 0.004s	sys 0.005s
W20260709 13:06:37.297829 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 142156us
I20260709 13:06:37.308393 15872 raft_consensus.cc:1217] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:06:37.309262 22884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce7d889544e4fcd9cbbf09d13da02b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:37.316567 15266 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:37.300813 22881 tablet_copy_client.cc:806] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.320559 15266 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:37.323747 22890 raft_consensus.cc:993] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:37.331130 22890 raft_consensus.cc:1081] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Signalling peer 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:37.333102 22834 raft_consensus.cc:993] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:37.333745 22834 raft_consensus.cc:1081] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Signalling peer 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:37.336104 15207 tablet_copy_service.cc:342] P 5e6eed5c7a6b4571b5f898002fc990d2: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-d932cad3925e47b28537cca64ba27320 received from {username='slave'} at 127.0.0.1:40392
I20260709 13:06:37.336719 15207 tablet_copy_service.cc:434] P 5e6eed5c7a6b4571b5f898002fc990d2: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-d932cad3925e47b28537cca64ba27320 on tablet d932cad3925e47b28537cca64ba27320 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:37.337191 15197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:46346
I20260709 13:06:37.337743 15197 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.338065 15197 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:37.345798 15194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:46346
I20260709 13:06:37.348673 15194 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.349234 15194 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:37.349951 15346 raft_consensus.cc:2468] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 16.
I20260709 13:06:37.368975 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:37.370308 15189 raft_consensus.cc:3055] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:37.370741 15189 raft_consensus.cc:740] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:37.346946 22881 tablet_copy_client.cc:670] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.381867 15189 consensus_queue.cc:260] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:37.399295 15189 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.403762 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d932cad3925e47b28537cca64ba27320" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:37.404533 15341 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:37.405211 15197 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.446951 15194 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.455926 22876 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=1 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:37.457166 22876 tablet_bootstrap.cc:492] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:37.458236 22876 ts_tablet_manager.cc:1403] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.754s	user 0.058s	sys 0.011s
I20260709 13:06:37.467073 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:37.468091 15269 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:37.467860 15341 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:37.454165 15095 catalog_manager.cc:5697] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 15 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 16 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.474174 22881 tablet_copy_client.cc:538] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:37.479182 22902 log.cc:927] Time spent T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:37.484416 15237 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:37.488565 15194 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:37.495658 15197 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:37.512298 15269 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:37.516186 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:37.516822 15269 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:37.521399 15160 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:37.525362 22887 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:37.527204 22887 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:37.526970 15269 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:37.528394 22887 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.540215 22896 raft_consensus.cc:2804] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:37.540959 22896 raft_consensus.cc:697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:37.543076 22884 tablet_copy_client.cc:806] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:37.545917 22884 tablet_copy_client.cc:670] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:37.568816 15189 raft_consensus.cc:2468] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 17.
I20260709 13:06:37.560418 22876 raft_consensus.cc:359] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:37.577098 22876 raft_consensus.cc:740] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:06:37.577916 22876 consensus_queue.cc:260] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:37.581013 22876 ts_tablet_manager.cc:1434] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.122s	user 0.011s	sys 0.000s
I20260709 13:06:37.581532 22884 tablet_copy_client.cc:538] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:37.542104 22896 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:37.596961 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:37.597620 15345 raft_consensus.cc:3055] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:37.597993 15345 raft_consensus.cc:740] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:37.598809 15345 consensus_queue.cc:260] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.600214 15345 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:37.601367 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:37.603394 15346 raft_consensus.cc:3055] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:37.603148 15160 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:37.603783 15346 raft_consensus.cc:740] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:37.626873 15346 consensus_queue.cc:260] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.661958 15346 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:37.664753 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 132324us
I20260709 13:06:37.686851 15094 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 21 to 22, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 22 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.734915 15346 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
W20260709 13:06:37.735829 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 111932us
I20260709 13:06:37.738910 22893 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:37.739672 22893 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:37.740556 22893 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:37.729278 15207 tablet_copy_service.cc:342] P 5e6eed5c7a6b4571b5f898002fc990d2: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-e0b08eaff26447e0b420aa798c881192 received from {username='slave'} at 127.0.0.1:40392
I20260709 13:06:37.752236 15207 tablet_copy_service.cc:434] P 5e6eed5c7a6b4571b5f898002fc990d2: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-e0b08eaff26447e0b420aa798c881192 on tablet e0b08eaff26447e0b420aa798c881192 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:37.755434 15264 raft_consensus.cc:1240] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 21. Current term is 22. Ops: []
W20260709 13:06:37.762064 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 56121.9us
I20260709 13:06:37.771462 15194 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:37.808800 22905 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:06:37.840306 22881 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:06:37.845851 15345 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 22.
I20260709 13:06:37.880968 15268 raft_consensus.cc:1240] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Rejecting Update request from peer 9d785ccef0634edd9f0fbb52fa1c8d27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:37.892186 22884 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
W20260709 13:06:37.908308 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 181083us
W20260709 13:06:37.919960 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 72670.5us
I20260709 13:06:37.927305 15341 raft_consensus.cc:1275] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:06:37.980799 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 53399.8us
W20260709 13:06:37.989758 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 62548.3us
W20260709 13:06:38.012820 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 95411.2us
W20260709 13:06:38.037211 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 55397.1us
I20260709 13:06:38.094393 22905 raft_consensus.cc:993] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:38.094934 22905 raft_consensus.cc:1081] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:38.098388 15872 raft_consensus.cc:1217] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.15->[25.16-25.16]   Dedup: 25.16->[]
I20260709 13:06:38.099813 22897 raft_consensus.cc:993] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:38.100433 22887 raft_consensus.cc:1081] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:38.025234 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:38.113404 15872 raft_consensus.cc:3060] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEARNER]: Advancing to term 17
I20260709 13:06:38.115845 15095 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 16 to 17, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 17 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:38.137964 22906 consensus_queue.cc:1048] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:38.138826 15340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34546
I20260709 13:06:38.139514 15340 raft_consensus.cc:493] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.139951 15340 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:38.142970 15872 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:06:38.160938 15094 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 17 to 18, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 18 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:38.186322 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 193122us
I20260709 13:06:38.210963 22930 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:38.216709 15345 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:06:38.217267 15345 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:38.217607 15345 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:38.221138 15340 raft_consensus.cc:515] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:38.223870 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:38.224509 15189 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:38.224357 15345 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:38.226575 15345 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:38.228338 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:38.229029 15193 raft_consensus.cc:3055] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:38.229346 15193 raft_consensus.cc:740] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:38.230157 15193 consensus_queue.cc:260] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:38.232517 15193 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:38.246675 15189 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:38.248332 15312 leader_election.cc:304] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:38.249406 22891 raft_consensus.cc:2804] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:38.250012 22891 raft_consensus.cc:697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:38.250979 22891 consensus_queue.cc:237] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:38.257925 15341 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:06:38.260337 15341 raft_consensus.cc:1240] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Rejecting Update request from peer 5e6eed5c7a6b4571b5f898002fc990d2 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:38.261480 15193 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:38.262782 15312 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:38.264236 22901 raft_consensus.cc:2804] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:38.264849 22901 raft_consensus.cc:697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:38.265774 22901 consensus_queue.cc:237] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:38.274906 22906 raft_consensus.cc:1064] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:06:38.275422 22906 raft_consensus.cc:1068] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:38.277647 22933 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:38.303691 15340 leader_election.cc:290] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:38.314035 15341 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:38.314360 15340 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:06:38.319489 22932 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:38.346027 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:38.348744 15268 raft_consensus.cc:3060] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:38.349431 15094 catalog_manager.cc:5697] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 20 to 21, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.351858 15094 catalog_manager.cc:5697] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 24 to 25, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 25 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:38.350775 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3251a863683a43fd9e2d5c154e67b4f5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:38.354981 15264 raft_consensus.cc:3055] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:38.355334 15264 raft_consensus.cc:740] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:38.361876 22909 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:38.363752 15343 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:38.364898 22881 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=2 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.366040 22881 tablet_bootstrap.cc:492] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:38.367400 22881 ts_tablet_manager.cc:1403] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.527s	user 0.050s	sys 0.010s
I20260709 13:06:38.358156 15264 consensus_queue.cc:260] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:38.371932 15264 raft_consensus.cc:3060] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:38.389943 22881 raft_consensus.cc:359] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:38.390729 15268 raft_consensus.cc:2468] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:38.406581 22881 raft_consensus.cc:740] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:06:38.411892 22881 consensus_queue.cc:260] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:38.412739 15264 raft_consensus.cc:2468] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:38.425261 22881 ts_tablet_manager.cc:1434] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:06:38.427690 15189 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:06:38.434043 15194 raft_consensus.cc:1240] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:38.458458 15271 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:06:38.461457 15282 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-7df15ef5ed244e05887f9af5ba36331a received from {username='slave'} at 127.0.0.1:44984
I20260709 13:06:38.471321 15282 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-7df15ef5ed244e05887f9af5ba36331a on tablet 7df15ef5ed244e05887f9af5ba36331a with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:38.481748 22888 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:38.537834 22931 raft_consensus.cc:1064] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:06:38.547760 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 60858.1us
I20260709 13:06:38.600627 22933 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:38.608108 15267 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:38.619719 22884 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:38.620236 22927 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:38.693778 15197 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:38.696367 22904 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:38.674587 22884 tablet_bootstrap.cc:492] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:38.703780 22884 ts_tablet_manager.cc:1403] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.843s	user 0.048s	sys 0.010s
I20260709 13:06:38.744551 15872 raft_consensus.cc:1217] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
W20260709 13:06:38.743629 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 107349us
I20260709 13:06:38.813503 22884 raft_consensus.cc:359] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:38.817806 22884 raft_consensus.cc:740] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:06:38.818089 22931 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:38.818882 22884 consensus_queue.cc:260] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:38.823153 22884 ts_tablet_manager.cc:1434] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.002s
I20260709 13:06:38.832031 15341 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:06:38.832266 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 85770.2us
I20260709 13:06:38.835372 15282 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-8ce7d889544e4fcd9cbbf09d13da02b0 received from {username='slave'} at 127.0.0.1:44984
I20260709 13:06:38.835894 15282 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-8ce7d889544e4fcd9cbbf09d13da02b0 on tablet 8ce7d889544e4fcd9cbbf09d13da02b0 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:38.838974 15271 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:38.839557 15269 raft_consensus.cc:1275] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:38.841740 22956 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:38.842310 22929 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:38.843438 22922 consensus_queue.cc:1048] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:38.871199 15872 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:38.897800 15195 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:06:38.908622 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 46374.6us
I20260709 13:06:38.920650 22928 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 13:06:38.941133 15237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.944464 22816 raft_consensus.cc:1064] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:38.959725 15194 raft_consensus.cc:1275] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:38.969903 22816 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 14, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:38.971262 22955 consensus_queue.cc:1048] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
W20260709 13:06:38.972867 22963 log.cc:927] Time spent T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.094s	user 0.003s	sys 0.000s
I20260709 13:06:39.006687 15872 raft_consensus.cc:1217] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 13:06:39.026346 15872 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:39.054728 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 110049us
I20260709 13:06:39.019521 22909 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:06:39.112218 22931 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.126143 15194 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.121089 15095 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 11 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.161550 22928 raft_consensus.cc:1064] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:39.165119 22928 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:39.246031 15340 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:39.239231 15345 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:39.248461 15872 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:39.249291 15876 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:39.252048 22933 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:39.253932 22933 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:39.257465 15197 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:39.269640 22928 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:39.270933 15267 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:39.274405 22929 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:39.299352 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:39.305200 15340 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.308147 22897 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:06:39.298050 22929 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:06:39.430763 22927 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index 16 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.439787 15346 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.446133 15264 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.461078 22917 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.469570 15197 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.516399 15872 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.569904 15340 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.584374 15266 consensus_queue.cc:237] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:39.584592 15872 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index 16 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.586279 15090 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.596415 15197 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:39.598142 22931 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:39.604344 15870 raft_consensus.cc:1275] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:39.608826 15346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:39.609479 15346 raft_consensus.cc:606] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:39.612535 22837 consensus_queue.cc:1048] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:39.616324 15095 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: config changed from index 16 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.630765 22909 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.641072 15340 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "708015fd563e4389af835f3aca58eb01"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:39.641829 15340 raft_consensus.cc:606] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:39.641484 15194 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.649945 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:39.650512 15189 raft_consensus.cc:606] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:39.659719 22929 raft_consensus.cc:1064] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:39.664767 15189 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:39.665347 15189 raft_consensus.cc:606] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Received request to transfer leadership to TS f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:39.674305 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d932cad3925e47b28537cca64ba27320 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:39.679322 15269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:51924
I20260709 13:06:39.680128 15269 raft_consensus.cc:606] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:39.689630 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:39.691393 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:39.662472 22929 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:39.705650 15269 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:39.694334 15876 raft_consensus.cc:2955] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.714957 22920 raft_consensus.cc:993] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:39.716297 15090 catalog_manager.cc:5697] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index 13 to 14, VOTER 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) evicted. New cstate: current_term: 17 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:39.731886 22920 raft_consensus.cc:1081] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Signalling peer 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:39.762537 15876 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:39.765069 22837 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:39.769991 15194 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "708015fd563e4389af835f3aca58eb01"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:46346
I20260709 13:06:39.770587 15194 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.770911 15194 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:39.791823 15194 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:39.823797 22933 raft_consensus.cc:993] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:39.824376 22933 raft_consensus.cc:1081] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:39.824535 15333 tablet_service.cc:1558] Processing DeleteTablet for tablet d932cad3925e47b28537cca64ba27320 with delete_type TABLET_DATA_TOMBSTONED (TS 9d785ccef0634edd9f0fbb52fa1c8d27 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:34528
I20260709 13:06:39.824643 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:39.825380 15266 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:39.822760 15194 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:39.826318 15269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45870
I20260709 13:06:39.826884 15269 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.827554 15269 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:39.830354 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:39.830948 15340 raft_consensus.cc:3055] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:39.831537 15340 raft_consensus.cc:740] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:39.832281 15340 consensus_queue.cc:260] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:39.833546 15340 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:39.840344 22955 raft_consensus.cc:993] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:39.840888 22955 raft_consensus.cc:1081] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Signalling peer f4ca86ee1d194023b1414bbe226f4798 to start an election
I20260709 13:06:39.842713 15264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
 from {username='slave'} at 127.0.0.1:45862
I20260709 13:06:39.843261 15264 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:39.843571 15264 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:39.852861 15264 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:39.859437 15266 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:39.860662 15160 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:39.828918 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 49637us
I20260709 13:06:39.862974 15340 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 18.
I20260709 13:06:39.865294 15269 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:39.867548 15194 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:39.869011 15264 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:39.872813 15341 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:39.875711 15269 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:39.870438 22968 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:39.877925 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:39.878496 15189 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:39.878769 15189 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:39.879243 22968 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:39.879492 15189 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:39.881733 15341 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:39.882992 15876 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:39.885607 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:39.886164 15341 raft_consensus.cc:3055] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:39.886454 15341 raft_consensus.cc:740] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:39.886696 15346 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:39.887701 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:39.888314 15340 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:39.889557 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:39.890080 15876 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:39.891557 15189 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:39.887212 15341 consensus_queue.cc:260] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:39.898950 15341 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:39.903230 22968 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:39.904541 22837 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.910051 22909 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:39.912385 22953 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:39.889155 22933 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:06:39.914975 22892 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:39.917482 15872 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:39.919126 15870 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.927525 22909 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:39.947675 22965 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 17 to 18, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.948907 15869 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.972092 15093 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 21 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:39.975356 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7df15ef5ed244e05887f9af5ba36331a with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:39.976436 15346 raft_consensus.cc:2955] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.001782 15189 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 26.
I20260709 13:06:40.004428 15238 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:40.006462 15876 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:40.013341 15344 raft_consensus.cc:2955] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.037035 15194 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:40.044631 15341 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:40.050849 15340 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 26.
I20260709 13:06:40.047246 15237 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:40.034394 22837 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:40.080511 22929 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:06:40.133147 22979 log.cc:927] Time spent T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:06:40.121320 22837 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:40.128788 15179 tablet_service.cc:1558] Processing DeleteTablet for tablet 7df15ef5ed244e05887f9af5ba36331a with delete_type TABLET_DATA_TOMBSTONED (TS 5e6eed5c7a6b4571b5f898002fc990d2 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:46344
I20260709 13:06:40.184500 15094 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 17 to 18, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 18 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.132143 22931 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
W20260709 13:06:40.218006 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 177749us
W20260709 13:06:40.223730 22985 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:40.250260 22837 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:40.228171 22983 tablet_replica.cc:333] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:06:40.293982 22996 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.306336 15869 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.330451 22929 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:40.413915 22929 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:40.416988 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 55209.9us
W20260709 13:06:40.435075 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 68184.4us
W20260709 13:06:40.415959 22985 log.cc:927] Time spent T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:06:40.433917 22970 log.cc:927] Time spent T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:06:40.452104 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 121327us
W20260709 13:06:40.464208 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46272.9us
I20260709 13:06:40.501700 22983 raft_consensus.cc:2243] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:40.534267 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 170819us
I20260709 13:06:40.502856 22983 raft_consensus.cc:2272] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.546247 15271 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:06:40.589774 22983 ts_tablet_manager.cc:1916] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:40.600729 23003 raft_consensus.cc:993] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:40.601416 23003 raft_consensus.cc:1081] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:40.612790 15090 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 25 to 26, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 26 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:40.603207 22968 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:40.641170 23018 tablet_replica.cc:333] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:40.677078 15093 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 17 to 18, VOTER f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) evicted. New cstate: current_term: 25 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.719089 15194 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
W20260709 13:06:40.742509 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 287493us
I20260709 13:06:40.745388 15082 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e0b08eaff26447e0b420aa798c881192 with cas_config_opid_index 17: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:40.752825 22991 raft_consensus.cc:993] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
W20260709 13:06:40.753315 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 165371us
I20260709 13:06:40.753386 22991 raft_consensus.cc:1081] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:40.779021 15194 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.722589 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:40.792443 15346 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.738533 22953 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:06:40.804184 15344 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34546
I20260709 13:06:40.805086 15344 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.805483 15344 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:40.804507 15255 tablet_service.cc:1558] Processing DeleteTablet for tablet e0b08eaff26447e0b420aa798c881192 with delete_type TABLET_DATA_TOMBSTONED (TS f4ca86ee1d194023b1414bbe226f4798 not found in new config with opid_index 18) from {username='slave'} at 127.0.0.1:58520
I20260709 13:06:40.848526 15093 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 14 to 15, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:40.891672 15344 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:40.892122 15346 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:06:40.901563 22983 ts_tablet_manager.cc:1929] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:06:40.902064 22983 log.cc:1199] T d932cad3925e47b28537cca64ba27320 P 9d785ccef0634edd9f0fbb52fa1c8d27: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/wals/d932cad3925e47b28537cca64ba27320
I20260709 13:06:40.916817 22983 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34528 (request call id 84) took 1093 ms. Trace:
I20260709 13:06:40.917255 22983 rpcz_store.cc:276] 0709 13:06:39.823405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.824278 (+   873us) service_pool.cc:224] Handling call
0709 13:06:40.184279 (+360001us) ts_tablet_manager.cc:1151] Deleting tablet d932cad3925e47b28537cca64ba27320
0709 13:06:40.203395 (+ 19116us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:06:40.613379 (+409984us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:40.901420 (+288041us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:40.916712 (+ 15292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35066,"tablet-delete.queue_time_us":346213,"thread_start_us":213933,"threads_started":1}
I20260709 13:06:40.919251 15346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:06:40.919881 15346 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.920279 15346 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:40.923385 23018 raft_consensus.cc:2243] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:40.924293 23018 raft_consensus.cc:2272] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:40.930204 15344 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:40.937973 15081 catalog_manager.cc:5028] TS 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): tablet d932cad3925e47b28537cca64ba27320 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:40.938552 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:40.939162 15193 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:40.952116 15193 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 29.
I20260709 13:06:40.942857 15346 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:40.962392 15346 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:40.960397 15312 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:40.969135 22989 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:06:40.981194 23018 ts_tablet_manager.cc:1916] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:40.968747 22929 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:40.983947 22929 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:40.992570 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:40.993273 15193 raft_consensus.cc:3055] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:40.993579 15193 raft_consensus.cc:740] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:40.994340 15193 consensus_queue.cc:260] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:40.995671 15193 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:40.997696 22955 raft_consensus.cc:2804] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:06:40.998263 22955 raft_consensus.cc:697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:41.001821 15189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" is_pre_election: true
I20260709 13:06:40.986793 22929 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:41.008756 15193 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:41.009312 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:41.018234 15190 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 28. Current term is 29. Ops: []
I20260709 13:06:41.027730 15237 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:41.029008 22955 consensus_queue.cc:237] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:41.031843 22917 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:41.037034 23018 ts_tablet_manager.cc:1929] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.15
I20260709 13:06:41.037508 23018 log.cc:1199] T 7df15ef5ed244e05887f9af5ba36331a P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/wals/7df15ef5ed244e05887f9af5ba36331a
W20260709 13:06:41.039474 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 146428us
I20260709 13:06:41.044885 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:41.045460 15266 raft_consensus.cc:3060] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:41.047487 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 29 candidate_status { last_received { term: 28 index: 16 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:41.048064 15269 raft_consensus.cc:3055] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:06:41.048355 15269 raft_consensus.cc:740] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:41.049080 15345 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:06:41.053191 23025 tablet_replica.cc:333] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:06:41.058308 15266 raft_consensus.cc:2468] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:41.059326 15269 consensus_queue.cc:260] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 16, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:41.062501 22837 consensus_queue.cc:1059] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: INVALID_TERM, Last received: 28.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:41.063912 15269 raft_consensus.cc:3060] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:41.084188 15269 raft_consensus.cc:2468] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 29.
I20260709 13:06:41.089608 23025 raft_consensus.cc:2243] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:41.091145 23025 raft_consensus.cc:2272] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:41.095741 23018 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:46344 (request call id 84) took 1059 ms. Trace:
I20260709 13:06:41.095666 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:41.094028 15312 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:41.105252 23025 ts_tablet_manager.cc:1916] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:41.131888 22834 raft_consensus.cc:2804] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:41.115232 15090 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 19 to 20, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 20 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:41.138571 15344 raft_consensus.cc:1240] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 LEADER]: Rejecting Update request from peer f4ca86ee1d194023b1414bbe226f4798 for earlier term 28. Current term is 29. Ops: []
I20260709 13:06:41.139719 22834 raft_consensus.cc:697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:41.158357 22834 consensus_queue.cc:237] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:41.096340 23018 rpcz_store.cc:276] 0709 13:06:40.039269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.045868 (+  6599us) service_pool.cc:224] Handling call
0709 13:06:40.640665 (+594797us) ts_tablet_manager.cc:1151] Deleting tablet 7df15ef5ed244e05887f9af5ba36331a
0709 13:06:40.640752 (+    87us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:06:41.021790 (+381038us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:41.036886 (+ 15096us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:41.095652 (+ 58766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157496,"tablet-delete.queue_time_us":455984,"thread_start_us":420507,"threads_started":1}
I20260709 13:06:41.155620 22981 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:06:41.229208 15267 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:41.249665 15869 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:41.258247 22961 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:41.276484 15082 catalog_manager.cc:5028] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): tablet 7df15ef5ed244e05887f9af5ba36331a (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:41.305670 15872 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:41.309583 22999 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:41.309957 15346 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:41.336390 22961 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:41.339748 22928 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:41.352584 15872 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:41.357025 15346 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:41.358357 15344 raft_consensus.cc:2955] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:41.369227 22999 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:41.381536 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ce7d889544e4fcd9cbbf09d13da02b0 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:41.425657 15094 catalog_manager.cc:5697] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 28 to 29, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 29 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.439302 15094 catalog_manager.cc:5697] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 19 to 20, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 20 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.447229 15093 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index 15 to 16, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 22 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:41.484992 23025 ts_tablet_manager.cc:1929] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 25.17
I20260709 13:06:41.485956 23025 log.cc:1199] T e0b08eaff26447e0b420aa798c881192 P f4ca86ee1d194023b1414bbe226f4798: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/wals/e0b08eaff26447e0b420aa798c881192
I20260709 13:06:41.488432 15079 catalog_manager.cc:5028] TS f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): tablet e0b08eaff26447e0b420aa798c881192 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:41.489125 15197 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:06:41.491206 22955 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:41.550007 15268 raft_consensus.cc:1275] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260709 13:06:41.551524 22955 consensus_queue.cc:1048] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:41.558184 15179 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ce7d889544e4fcd9cbbf09d13da02b0 with delete_type TABLET_DATA_TOMBSTONED (TS 5e6eed5c7a6b4571b5f898002fc990d2 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:46344
I20260709 13:06:41.559192 23018 tablet_replica.cc:333] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:41.560333 23018 raft_consensus.cc:2243] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:41.561163 23018 raft_consensus.cc:2272] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:41.575573 23018 ts_tablet_manager.cc:1916] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:41.635138 23018 ts_tablet_manager.cc:1929] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.15
I20260709 13:06:41.635617 23018 log.cc:1199] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 5e6eed5c7a6b4571b5f898002fc990d2: Deleting WAL directory at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/wals/8ce7d889544e4fcd9cbbf09d13da02b0
I20260709 13:06:41.637246 15082 catalog_manager.cc:5028] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): tablet 8ce7d889544e4fcd9cbbf09d13da02b0 (table test-workload [id=01a285412a1641ef98de75fdd13d5f7f]) successfully deleted
I20260709 13:06:41.663709 15266 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:41.666133 22955 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:41.685513 15188 raft_consensus.cc:1275] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:41.690577 23026 consensus_queue.cc:1048] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:42.198035 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:42.354298 15346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
mode: GRACEFUL
new_leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:47982
I20260709 13:06:42.354943 15346 raft_consensus.cc:606] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Received request to transfer leadership to TS 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:42.358680 15188 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1d89f71244148538087b141a709ec50"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:46386
I20260709 13:06:42.361009 15188 raft_consensus.cc:606] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:42.364928 15268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
new_leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:51924
I20260709 13:06:42.365635 15268 raft_consensus.cc:606] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 LEADER]: Received request to transfer leadership to TS 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:42.367149 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:42.369681 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:42.414469 23019 raft_consensus.cc:993] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: : Instructing follower 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:42.415063 23019 raft_consensus.cc:1081] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Signalling peer 5e6eed5c7a6b4571b5f898002fc990d2 to start an election
I20260709 13:06:42.419087 15188 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267"
dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
 from {username='slave'} at 127.0.0.1:46346
I20260709 13:06:42.419675 15188 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.420020 15188 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:42.440618 15188 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:42.444121 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:42.444716 15346 raft_consensus.cc:3055] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:42.445012 15346 raft_consensus.cc:740] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:42.445680 15346 consensus_queue.cc:260] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:42.446820 15346 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:42.442570 15188 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:42.453876 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:42.454595 15268 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:42.462000 15268 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:42.465432 15346 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e6eed5c7a6b4571b5f898002fc990d2 in term 26.
I20260709 13:06:42.466255 15160 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:42.467676 22897 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:42.468220 22897 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 LEADER]: Becoming Leader. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:42.469086 22897 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:42.507519 15095 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: term changed from 25 to 26, leader changed from 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3) to 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1). New cstate: current_term: 26 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.578073 22892 raft_consensus.cc:993] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:42.578588 22892 raft_consensus.cc:1081] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:42.584213 15346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1d89f71244148538087b141a709ec50"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34532
I20260709 13:06:42.584930 15346 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.585594 15346 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:42.632226 15346 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:42.644083 15188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:42.661520 15188 raft_consensus.cc:3055] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:42.661959 15188 raft_consensus.cc:740] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5e6eed5c7a6b4571b5f898002fc990d2, State: Running, Role: LEADER
I20260709 13:06:42.698817 15188 consensus_queue.cc:260] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:42.700752 15188 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:42.758280 15188 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:42.759898 15312 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:42.772697 15346 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:42.773855 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:42.775194 15266 raft_consensus.cc:3060] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:42.776511 23019 raft_consensus.cc:2804] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:42.813941 23019 raft_consensus.cc:697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:42.916607 23019 consensus_queue.cc:237] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:42.956373 15268 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:42.976814 22909 raft_consensus.cc:993] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:42.977605 22909 raft_consensus.cc:1081] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:42.989619 15346 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34546
I20260709 13:06:42.990600 15346 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:42.991199 15346 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:42.993292 15266 raft_consensus.cc:2468] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:43.004516 15345 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:06:43.011548 23054 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:06:43.083091 15346 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:43.123685 15095 catalog_manager.cc:5697] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 21 to 22, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 22 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.133069 15193 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:43.139595 15345 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:06:43.145524 15237 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 68dae74f1ecc4da09974ea1562dcd4ea. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.148082 22928 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:43.160215 22928 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:43.172905 15346 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:43.174203 15269 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:06:43.175150 15197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "5e6eed5c7a6b4571b5f898002fc990d2"
I20260709 13:06:43.175937 15197 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:43.211796 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 15 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:43.212522 15268 raft_consensus.cc:3055] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:06:43.212886 15268 raft_consensus.cc:740] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:43.213832 15268 consensus_queue.cc:260] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:43.215344 15268 raft_consensus.cc:3060] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:43.253607 22892 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:06:43.280826 15197 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 27.
I20260709 13:06:43.286749 15312 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:43.287973 22891 raft_consensus.cc:2804] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:43.288691 22891 raft_consensus.cc:697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:43.290529 22891 consensus_queue.cc:237] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:43.297469 23056 raft_consensus.cc:2955] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.307667 15268 raft_consensus.cc:2468] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 27.
I20260709 13:06:43.315641 15344 raft_consensus.cc:2955] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.315662 15193 raft_consensus.cc:2955] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.338408 15197 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:43.354254 15090 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 reported cstate change: config changed from index -1 to 12, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.370294 15267 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:43.373001 23053 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:43.410236 15267 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:43.412124 23050 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:06:43.414129 15162 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2331edb5531f4ed8a202724323d28569. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.415751 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:43.430724 15344 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Refusing update from remote peer 5e6eed5c7a6b4571b5f898002fc990d2: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:43.444445 23068 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:43.488664 23050 raft_consensus.cc:2955] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.490016 15267 raft_consensus.cc:2955] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.492803 15194 raft_consensus.cc:1275] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:43.496043 22891 consensus_queue.cc:1048] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:43.537484 15339 raft_consensus.cc:2955] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.574558 15268 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:43.582981 15090 catalog_manager.cc:5697] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 26 to 27, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 27 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:43.607720 15094 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 14, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 22 leader_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:43.691247 15194 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:06:43.694732 23019 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:43.695940 15267 raft_consensus.cc:1275] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 26 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:06:43.698592 23053 consensus_queue.cc:1048] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:43.729883 15344 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:43.737663 22999 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.003s
W20260709 13:06:43.832244 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 84320us
I20260709 13:06:43.844410 15194 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:06:43.864318 23082 log.cc:927] Time spent T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:06:43.890946 15237 consensus_peers.cc:597] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 99208c2982d748dd8e728ff51c224658. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:43.981117 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 66654.6us
I20260709 13:06:43.919456 23084 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.057s
W20260709 13:06:44.015661 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 91176.7us
W20260709 13:06:44.022589 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 116054us
W20260709 13:06:44.027462 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 60771.8us
I20260709 13:06:44.052481 23100 ts_tablet_manager.cc:933] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:44.104377 23084 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 LEADER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:44.085065 23100 tablet_copy_client.cc:323] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 3
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:06:44.166939 23112 ts_tablet_manager.cc:933] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
I20260709 13:06:44.172303 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
I20260709 13:06:44.173378 15346 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Committing config change with OpId 25.17: config changed from index -1 to 17, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } }
I20260709 13:06:44.177811 23112 tablet_copy_client.cc:323] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.1:39515
I20260709 13:06:44.183269 15094 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index -1 to 17, NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) added. New cstate: current_term: 25 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:44.212592 15238 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 27 similar messages]
W20260709 13:06:44.241647 15143 auto_rebalancer.cc:629] Failed to schedule move for tablet be765c8e55da41e98042904983ca70dd: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:44.271489 23113 ts_tablet_manager.cc:933] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:44.273679 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62389.8us
I20260709 13:06:44.276218 15282 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 68dae74f1ecc4da09974ea1562dcd4ea from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:06:44.276844 15282 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 68dae74f1ecc4da09974ea1562dcd4ea from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-68dae74f1ecc4da09974ea1562dcd4ea
W20260709 13:06:44.286410 15238 consensus_peers.cc:597] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.305037 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 65824.8us
W20260709 13:06:44.362489 15238 consensus_peers.cc:597] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.371390 23113 tablet_copy_client.cc:323] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
W20260709 13:06:44.376034 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45721.1us
W20260709 13:06:44.383482 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.391566 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.394683 15282 tablet_copy_source_session.cc:215] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:44.401196 15238 consensus_peers.cc:597] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.404687 15281 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 99208c2982d748dd8e728ff51c224658 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:06:44.405331 15281 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 99208c2982d748dd8e728ff51c224658 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-99208c2982d748dd8e728ff51c224658
W20260709 13:06:44.407164 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.404172 15238 consensus_peers.cc:597] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.416577 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.419549 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.415344 15238 consensus_peers.cc:597] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.410746 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.436614 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.437073 23100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68dae74f1ecc4da09974ea1562dcd4ea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:44.437578 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.447541 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.448791 15281 tablet_copy_source_session.cc:215] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:06:44.448998 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.450079 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.450675 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.444409 15238 consensus_peers.cc:597] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.453409 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.455569 15238 consensus_peers.cc:597] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.460062 15238 consensus_peers.cc:597] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.458509 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.461573 15238 consensus_peers.cc:597] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.463079 23113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99208c2982d748dd8e728ff51c224658. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:44.477861 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.494633 15238 consensus_peers.cc:597] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.505712 23100 tablet_copy_client.cc:806] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
W20260709 13:06:44.517037 15238 consensus_peers.cc:597] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.522827 15238 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.514624 23100 tablet_copy_client.cc:670] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:44.535843 15238 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.544694 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.549211 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.559379 23100 tablet_copy_client.cc:538] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:44.637030 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.730677 23100 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
W20260709 13:06:44.814638 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 131351us
W20260709 13:06:44.856959 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 121408us
W20260709 13:06:44.891803 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.962874 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 172007us
W20260709 13:06:44.969424 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:44.983675 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:06:44.984625 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:44.992807 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:45.042260 14036 tablet_replica.cc:333] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.046450 14036 raft_consensus.cc:2243] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.050598 14036 raft_consensus.cc:2272] T b1d89f71244148538087b141a709ec50 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.042291 23113 tablet_copy_client.cc:806] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:45.056058 23113 tablet_copy_client.cc:670] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:45.060408 14036 tablet_replica.cc:333] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.061532 14036 raft_consensus.cc:2243] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.067441 14036 raft_consensus.cc:2272] T fddd7d735c9e4195aee24df42bc25619 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.072337 14036 tablet_replica.cc:333] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.073238 14036 raft_consensus.cc:2243] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.122781 14036 raft_consensus.cc:2272] T 05375e9e02424e74a5e9fad3c54cb5fa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:45.138854 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 96217.4us
I20260709 13:06:45.165907 23089 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.166663 23089 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.169042 23089 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.174126 14036 tablet_replica.cc:333] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.183393 23050 raft_consensus.cc:493] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.184123 23050 raft_consensus.cc:515] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.186540 23050 leader_election.cc:290] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.193277 14036 raft_consensus.cc:2243] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.198252 14036 raft_consensus.cc:2272] T 1082dceab99748b0a8dac27ba897e888 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.215642 23151 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.216298 23151 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:45.208101 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 87671.8us
W20260709 13:06:45.209308 15237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 60382.6us
W20260709 13:06:45.231169 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 104726us
I20260709 13:06:45.232867 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.234714 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.239153 23113 tablet_copy_client.cc:538] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:45.247463 23125 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.248111 23125 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.250502 23125 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.247186 23106 raft_consensus.cc:493] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.253263 23106 raft_consensus.cc:515] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.247116 23050 raft_consensus.cc:493] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:45.255865 23050 raft_consensus.cc:515] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:45.259120 23106 leader_election.cc:290] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.259910 23151 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.264348 23050 leader_election.cc:290] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:45.265300 14036 tablet_replica.cc:333] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.266288 14036 raft_consensus.cc:2243] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.279634 15269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.285766 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea59d818ff084b4eb5b080bf57d2e238" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.288569 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.288743 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d812963f3df640419e3d4986ba60b35d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.277945 23125 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.289980 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56be0280937f422d83d9e7889c5f55aa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.290110 23125 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.281831 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.292398 23125 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.286566 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.311043 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685539345e364189892668dfd1ff7309" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.316210 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.319125 14036 raft_consensus.cc:2272] T fc42a0ccf8934477a1ae58b60a2b2b07 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.322455 14036 tablet_replica.cc:333] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.325313 23113 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:06:45.352147 14036 raft_consensus.cc:2243] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.354820 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81d86ef88f7f41238f3a595588effaca" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:45.358180 23050 raft_consensus.cc:493] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.359118 23050 raft_consensus.cc:515] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.361352 23050 leader_election.cc:290] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.368287 14036 raft_consensus.cc:2272] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.375353 23106 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.375468 15160 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.375918 23106 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.377978 23106 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.376312 23050 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:45.384385 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:45.386673 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:45.386965 14036 tablet_replica.cc:333] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.388094 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.390137 23054 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.390515 23050 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.390759 23054 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.390969 15162 leader_election.cc:304] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:45.391076 23050 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:45.392576 23125 raft_consensus.cc:2749] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:45.392804 23054 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.393779 23050 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:45.393826 14036 raft_consensus.cc:2243] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.394752 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.399307 23132 raft_consensus.cc:493] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.399796 23132 raft_consensus.cc:515] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.401791 23132 leader_election.cc:290] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.405578 15160 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.409919 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.411809 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87f2fb4185c84ac7a09a309c58e0c6b5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.448388 23157 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:45.449484 23157 raft_consensus.cc:493] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.450054 23157 raft_consensus.cc:515] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.453562 23157 leader_election.cc:290] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:45.455771 15160 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 76372.6us
I20260709 13:06:45.456591 15160 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.463976 23132 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:45.464083 23151 raft_consensus.cc:493] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.464617 23151 raft_consensus.cc:515] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.465267 15160 leader_election.cc:304] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.465991 23132 raft_consensus.cc:2749] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:45.466611 23151 leader_election.cc:290] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.479822 14036 raft_consensus.cc:2272] T 929e7bd9064e489d8c24157abdd7499c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.483661 15160 leader_election.cc:304] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.484988 23151 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.485549 23151 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.448700 23100 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:45.487555 23151 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.488766 23100 tablet_bootstrap.cc:492] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:45.489543 23100 ts_tablet_manager.cc:1403] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.759s	user 0.043s	sys 0.018s
I20260709 13:06:45.492772 23100 raft_consensus.cc:359] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:45.496095 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 96990.6us
W20260709 13:06:45.484403 15160 raft_consensus.cc:2686] T 685539345e364189892668dfd1ff7309 P 5e6eed5c7a6b4571b5f898002fc990d2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:45.500090 15160 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.508873 14036 tablet_replica.cc:333] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.510003 14036 raft_consensus.cc:2243] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.511332 23106 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:45.511250 23151 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.512614 23151 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:45.512535 15160 leader_election.cc:304] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.515774 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.515877 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.515247 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:45.515151 23151 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.517367 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.520515 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.522212 23106 raft_consensus.cc:2749] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:45.527678 14036 raft_consensus.cc:2272] T 9eb9452f725f479a9fcc08d785cfecbc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.529587 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ecbb94961244797af5928bce195f79f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.530066 23151 raft_consensus.cc:493] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.530714 23151 raft_consensus.cc:515] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } }
I20260709 13:06:45.532979 23151 leader_election.cc:290] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.534484 14036 tablet_replica.cc:333] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.535557 14036 raft_consensus.cc:2243] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.535758 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.536429 14036 raft_consensus.cc:2272] T be765c8e55da41e98042904983ca70dd P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.537078 23151 raft_consensus.cc:493] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.537622 23151 raft_consensus.cc:515] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.540042 23151 leader_election.cc:290] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.540591 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.545354 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "716a73e82c564a6aa345a1f893caf7df" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.546336 14036 tablet_replica.cc:333] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.546545 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.547504 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "482b1159f7a94289b838ac9ce3753faa" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.549324 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbda06dce1ef4632a18d727a37228d76" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.550375 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.552198 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "380c5f9d7ddb4221b333ac415575e7fc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.555083 14036 raft_consensus.cc:2243] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.555904 14036 raft_consensus.cc:2272] T be59fc6c54f44b09ae8f08b1dcb46a62 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.559370 14036 tablet_replica.cc:333] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.560302 14036 raft_consensus.cc:2243] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.561028 14036 raft_consensus.cc:2272] T d932cad3925e47b28537cca64ba27320 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.563252 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.564320 14036 tablet_replica.cc:333] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.564760 23151 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.565346 23151 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.567751 23151 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.568696 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd30733283c2467f90c340ef580e1d8a" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.571120 23151 raft_consensus.cc:493] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:45.571877 23151 raft_consensus.cc:515] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:45.574143 23151 leader_election.cc:290] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:45.555734 23100 raft_consensus.cc:740] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:06:45.581456 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.582146 14036 raft_consensus.cc:2243] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.586539 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.595105 23106 raft_consensus.cc:493] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:45.595420 14036 raft_consensus.cc:2272] T 061ef1ddcd60472fbf7e0c7c536414d4 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.595849 23106 raft_consensus.cc:515] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:45.598335 23106 leader_election.cc:290] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:45.598719 14036 tablet_replica.cc:333] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.599686 14036 raft_consensus.cc:2243] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.600248 14036 pending_rounds.cc:70] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Trying to abort 1 pending ops.
I20260709 13:06:45.584317 23100 consensus_queue.cc:260] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:45.600528 14036 pending_rounds.cc:77] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7305635445009096704 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "99208c2982d748dd8e728ff51c224658" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } } new_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } } } }
I20260709 13:06:45.604027 14036 raft_consensus.cc:2917] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Aborting config change with OpId 25.17: Aborted: Op aborted
I20260709 13:06:45.604637 14036 raft_consensus.cc:2889] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:06:45.604998 14036 raft_consensus.cc:2272] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.607918 14036 tablet_replica.cc:333] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.608718 14036 raft_consensus.cc:2243] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.609467 14036 raft_consensus.cc:2272] T 81d86ef88f7f41238f3a595588effaca P 5e6eed5c7a6b4571b5f898002fc990d2 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.612208 14036 tablet_replica.cc:333] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.612947 14036 raft_consensus.cc:2243] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.613627 14036 raft_consensus.cc:2272] T 68dae74f1ecc4da09974ea1562dcd4ea P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.615703 23151 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.616233 23151 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:45.618175 23151 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:45.618589 23151 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.619073 23151 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.621192 23151 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.633703 14036 tablet_replica.cc:333] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.634706 14036 raft_consensus.cc:2243] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.635398 14036 raft_consensus.cc:2272] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.638165 14036 tablet_replica.cc:333] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.642802 14036 raft_consensus.cc:2243] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.643391 14036 raft_consensus.cc:2272] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.646586 14036 tablet_replica.cc:333] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.653313 14036 raft_consensus.cc:2243] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.654253 14036 raft_consensus.cc:2272] T 708015fd563e4389af835f3aca58eb01 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.603319 15162 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:45.666729 23106 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:45.667837 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 64594.3us
I20260709 13:06:45.668442 14036 tablet_replica.cc:333] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.685055 14036 raft_consensus.cc:2243] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.702025 14036 raft_consensus.cc:2272] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.673310 23100 ts_tablet_manager.cc:1434] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.183s	user 0.008s	sys 0.001s
I20260709 13:06:45.725265 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bb3da04f8ef4391ab70433e50f9700b" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.726732 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.727576 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.730573 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.732038 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.734400 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f6ff8071574893b4031710ebd49b6d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.736692 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.737653 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.738370 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca0c163c2e66421488cfcf267f5215be" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:45.739790 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddce72028fce49eb8627f523baef9ad0" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:45.742053 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.743853 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e8a0429d4024b20b2a1dbe68f14d55e" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:45.745637 14036 tablet_replica.cc:333] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.746599 14036 raft_consensus.cc:2243] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.780742 23151 raft_consensus.cc:493] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.781684 14036 raft_consensus.cc:2272] T 3251a863683a43fd9e2d5c154e67b4f5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.781419 23151 raft_consensus.cc:515] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.783638 23152 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:45.784206 23152 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.787007 14036 tablet_replica.cc:333] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.787472 23152 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.795123 14036 raft_consensus.cc:2243] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.795754 15281 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-68dae74f1ecc4da09974ea1562dcd4ea received from {username='slave'} at 127.0.0.1:44984
I20260709 13:06:45.796260 15281 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-68dae74f1ecc4da09974ea1562dcd4ea on tablet 68dae74f1ecc4da09974ea1562dcd4ea with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:45.805183 23151 leader_election.cc:290] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.785274 23157 raft_consensus.cc:493] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:45.813903 15160 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.812937 15162 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:45.815090 15160 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.806293 23157 raft_consensus.cc:515] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:45.818051 23125 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.818643 23125 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.819698 23157 leader_election.cc:290] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:45.819753 23123 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:45.820616 23125 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.809528 23152 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.825171 15160 leader_election.cc:304] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.827497 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.830701 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:45.832015 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.823558 23125 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:45.834874 15160 raft_consensus.cc:2686] T 716a73e82c564a6aa345a1f893caf7df P 5e6eed5c7a6b4571b5f898002fc990d2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:45.839489 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.829607 23123 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:45.842088 15160 leader_election.cc:304] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.854969 15160 leader_election.cc:304] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.865526 23151 raft_consensus.cc:2749] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:45.860884 23157 raft_consensus.cc:2749] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:45.868255 14036 raft_consensus.cc:2272] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.871083 14036 tablet_replica.cc:333] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.871933 14036 raft_consensus.cc:2243] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.872618 14036 raft_consensus.cc:2272] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.839349 23152 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.877231 23152 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.886723 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.899194 15160 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.900337 14036 tablet_replica.cc:333] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
W20260709 13:06:45.901654 15160 raft_consensus.cc:2686] T 380c5f9d7ddb4221b333ac415575e7fc P 5e6eed5c7a6b4571b5f898002fc990d2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:45.910650 23113 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=19 overwritten=2 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:45.912110 23113 tablet_bootstrap.cc:492] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:45.912992 23113 ts_tablet_manager.cc:1403] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.588s	user 0.051s	sys 0.014s
I20260709 13:06:45.912104 15160 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:45.915141 15160 raft_consensus.cc:2686] T 99208c2982d748dd8e728ff51c224658 P 5e6eed5c7a6b4571b5f898002fc990d2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:45.924144 15160 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:45.924821 15160 raft_consensus.cc:2686] T 29ea792889204a2e97dc9a7d427af0dc P 5e6eed5c7a6b4571b5f898002fc990d2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:45.931783 14036 raft_consensus.cc:2243] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.925628 15160 leader_election.cc:304] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.935298 23113 raft_consensus.cc:359] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:45.936368 15160 leader_election.cc:304] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.953287 23113 raft_consensus.cc:740] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:06:45.954245 15160 leader_election.cc:304] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.955588 15160 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:45.956175 15160 raft_consensus.cc:2686] T 49393a249e3f433db3840189ee7dc630 P 5e6eed5c7a6b4571b5f898002fc990d2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:45.954177 23113 consensus_queue.cc:260] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:45.956745 23157 raft_consensus.cc:2749] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:45.957962 23157 raft_consensus.cc:2749] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:45.936026 14036 raft_consensus.cc:2272] T 56be0280937f422d83d9e7889c5f55aa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.963589 14036 tablet_replica.cc:333] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.964448 14036 raft_consensus.cc:2243] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.936537 23151 raft_consensus.cc:2749] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:45.965525 14036 raft_consensus.cc:2272] T 2331edb5531f4ed8a202724323d28569 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.966248 15160 leader_election.cc:304] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:45.968230 23054 raft_consensus.cc:2749] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:45.971493 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.972440 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fce2f0ee66247f686730bc62ef5cdfb" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.972658 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659b62cebe2e47e793145022f6eed4ba" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 32 candidate_status { last_received { term: 31 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.972807 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.975617 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35e75f905ad042d89b465e6461b29a5d" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:45.976861 23054 raft_consensus.cc:493] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:45.978940 14036 tablet_replica.cc:333] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:45.978607 23054 raft_consensus.cc:515] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:45.979923 14036 raft_consensus.cc:2243] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:45.981048 23054 leader_election.cc:290] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:45.982288 23113 ts_tablet_manager.cc:1434] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.001s
I20260709 13:06:45.982102 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:45.988726 15281 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-99208c2982d748dd8e728ff51c224658 received from {username='slave'} at 127.0.0.1:44984
I20260709 13:06:45.989253 15281 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-99208c2982d748dd8e728ff51c224658 on tablet 99208c2982d748dd8e728ff51c224658 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
I20260709 13:06:46.003171 14036 raft_consensus.cc:2272] T aee71b2a252a4ac8bc26aaed3987219f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.007098 15160 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:46.008400 23054 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:46.009795 15160 leader_election.cc:304] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:46.010502 15160 raft_consensus.cc:2686] T 5fce2f0ee66247f686730bc62ef5cdfb P 5e6eed5c7a6b4571b5f898002fc990d2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:46.011515 15160 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:46.015246 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.015935 23054 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:06:46.017316 15160 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:46.020372 23054 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:46.023813 15160 leader_election.cc:304] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:46.032966 23054 raft_consensus.cc:2749] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:46.016098 14036 tablet_replica.cc:333] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.035125 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10c43c77e8974262bb6e378d078a6ab5" candidate_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:46.035534 14036 raft_consensus.cc:2243] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.037149 14036 raft_consensus.cc:2272] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.040427 14036 tablet_replica.cc:333] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.042438 14036 raft_consensus.cc:2243] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.045722 15869 raft_consensus.cc:1217] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:06:46.043725 15160 leader_election.cc:304] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e6eed5c7a6b4571b5f898002fc990d2; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:46.054672 14036 raft_consensus.cc:2272] T ddce72028fce49eb8627f523baef9ad0 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.055234 23151 raft_consensus.cc:2749] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:46.064917 14036 tablet_replica.cc:333] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.065793 14036 raft_consensus.cc:2243] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.066754 14036 raft_consensus.cc:2272] T 4a852937ac964a959721a465a5f36ad9 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.069329 14036 tablet_replica.cc:333] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.070065 14036 raft_consensus.cc:2243] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.087174 14036 raft_consensus.cc:2272] T f50ce7cd90ad42439199d54f3a3d3950 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.089910 14036 tablet_replica.cc:333] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.090793 14036 raft_consensus.cc:2243] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.091413 14036 raft_consensus.cc:2272] T ca0c163c2e66421488cfcf267f5215be P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.094645 14036 tablet_replica.cc:333] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.095561 14036 raft_consensus.cc:2243] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.096148 14036 raft_consensus.cc:2272] T 0e8a0429d4024b20b2a1dbe68f14d55e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.098992 14036 tablet_replica.cc:333] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.099731 14036 raft_consensus.cc:2243] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.115372 14036 raft_consensus.cc:2272] T bbda06dce1ef4632a18d727a37228d76 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.121519 14036 tablet_replica.cc:333] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.122321 14036 raft_consensus.cc:2243] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.123119 14036 raft_consensus.cc:2272] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.126073 14036 tablet_replica.cc:333] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.133013 14036 raft_consensus.cc:2243] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.134167 14036 raft_consensus.cc:2272] T 9c0b675005cd4e229d4415a2bcdf807c P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.137701 14036 tablet_replica.cc:333] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.138510 14036 raft_consensus.cc:2243] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.150851 14036 raft_consensus.cc:2272] T ea59d818ff084b4eb5b080bf57d2e238 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.154378 14036 tablet_replica.cc:333] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.160719 14036 raft_consensus.cc:2243] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.163378 14036 raft_consensus.cc:2272] T 659b62cebe2e47e793145022f6eed4ba P 5e6eed5c7a6b4571b5f898002fc990d2 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.166836 14036 tablet_replica.cc:333] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.167716 14036 raft_consensus.cc:2243] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.180121 14036 raft_consensus.cc:2272] T 5df18975ee214645b49e472675883b73 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.190177 14036 tablet_replica.cc:333] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.203753 14036 raft_consensus.cc:2243] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.204710 14036 raft_consensus.cc:2272] T 1a8ef022b8854b68ac36c434a5c64a1f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.207466 14036 tablet_replica.cc:333] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.213480 14036 raft_consensus.cc:2243] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.239269 14036 raft_consensus.cc:2272] T 10c43c77e8974262bb6e378d078a6ab5 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.242584 14036 tablet_replica.cc:333] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.247829 14036 raft_consensus.cc:2243] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.248704 14036 raft_consensus.cc:2272] T 9ecbb94961244797af5928bce195f79f P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.251756 14036 tablet_replica.cc:333] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.252472 14036 raft_consensus.cc:2243] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.253142 14036 raft_consensus.cc:2272] T 40f6ff8071574893b4031710ebd49b6d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.255863 14036 tablet_replica.cc:333] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.256801 14036 raft_consensus.cc:2243] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.257773 14036 raft_consensus.cc:2272] T 155d48b4318a4f7da7c4bc8ef9b73267 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.261287 14036 tablet_replica.cc:333] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.271675 14036 raft_consensus.cc:2243] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.272639 14036 raft_consensus.cc:2272] T 35e75f905ad042d89b465e6461b29a5d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.279525 14036 tablet_replica.cc:333] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.283541 14036 raft_consensus.cc:2243] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.291518 14036 raft_consensus.cc:2272] T cd30733283c2467f90c340ef580e1d8a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.294544 14036 tablet_replica.cc:333] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.307739 14036 raft_consensus.cc:2243] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.308581 14036 raft_consensus.cc:2272] T 482b1159f7a94289b838ac9ce3753faa P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.311887 14036 tablet_replica.cc:333] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.312644 14036 raft_consensus.cc:2243] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.313268 14036 raft_consensus.cc:2272] T d812963f3df640419e3d4986ba60b35d P 5e6eed5c7a6b4571b5f898002fc990d2 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.316002 14036 tablet_replica.cc:333] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.316706 14036 raft_consensus.cc:2243] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.317672 14036 raft_consensus.cc:2272] T 45855d6a21ab45bf98e978ef6a3fd439 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.337137 14036 tablet_replica.cc:333] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.339573 14036 raft_consensus.cc:2243] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.348045 14036 raft_consensus.cc:2272] T e0b08eaff26447e0b420aa798c881192 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.357837 14036 tablet_replica.cc:333] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.363734 14036 raft_consensus.cc:2243] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.365080 14036 raft_consensus.cc:2272] T 11ca54a37ddc4e00b8e839d0559b4c60 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.368291 14036 tablet_replica.cc:333] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.369082 14036 raft_consensus.cc:2243] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.370302 14036 raft_consensus.cc:2272] T d2e635b488cd4db6bce175bf8230091e P 5e6eed5c7a6b4571b5f898002fc990d2 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.385366 14036 tablet_replica.cc:333] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.385365 15869 raft_consensus.cc:1217] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.16->[25.17-25.17]   Dedup: 25.17->[]
I20260709 13:06:46.386471 14036 raft_consensus.cc:2243] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.387202 14036 raft_consensus.cc:2272] T c93533d7be6c4a0e8829e3256295bd39 P 5e6eed5c7a6b4571b5f898002fc990d2 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.421422 14036 tablet_replica.cc:333] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.422125 14036 raft_consensus.cc:2243] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.422688 14036 raft_consensus.cc:2272] T 4e05bb3e986e4b3a8f417f713423b82a P 5e6eed5c7a6b4571b5f898002fc990d2 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.425493 14036 tablet_replica.cc:333] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2: stopping tablet replica
I20260709 13:06:46.426077 14036 raft_consensus.cc:2243] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.430199 14036 raft_consensus.cc:2272] T 1bb3da04f8ef4391ab70433e50f9700b P 5e6eed5c7a6b4571b5f898002fc990d2 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.468186 23153 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.468801 23156 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.470130 23156 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:46.472187 23156 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:46.473997 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:46.469388 23153 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:46.487329 15238 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.498183 23153 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:46.502419 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:46.494766 15238 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:46.518548 23163 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.519150 23163 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:46.523964 15163 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:46.525561 15312 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.529527 23163 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:46.530781 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:46.531255 23154 raft_consensus.cc:2749] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:46.532444 15268 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
W20260709 13:06:46.535082 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 47784.5us
I20260709 13:06:46.535392 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:46.536273 23163 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:46.536725 23163 raft_consensus.cc:493] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.537235 23163 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:46.545958 23163 raft_consensus.cc:515] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:46.554097 15312 leader_election.cc:336] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.560364 23163 leader_election.cc:290] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:46.560642 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1082dceab99748b0a8dac27ba897e888" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:46.561467 15268 raft_consensus.cc:3060] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:46.569527 15268 raft_consensus.cc:2468] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:46.573772 15309 leader_election.cc:304] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:46.575778 23128 raft_consensus.cc:2804] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:46.576342 23128 raft_consensus.cc:697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:46.577252 23128 consensus_queue.cc:237] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:46.580541 15238 leader_election.cc:336] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.581081 15238 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:46.587246 23154 raft_consensus.cc:2749] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:46.596375 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:46.608068 23154 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.608690 23154 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:46.612787 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:46.617887 23162 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.618017 15095 catalog_manager.cc:5697] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 25 to 26, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 26 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.618599 23162 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:46.626168 23162 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:46.629199 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:46.610867 23154 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:46.629289 15238 leader_election.cc:336] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.634285 15238 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:46.636519 23153 raft_consensus.cc:1064] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:46.649019 23162 raft_consensus.cc:2749] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:46.686364 23153 consensus_queue.cc:237] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:46.688915 15238 leader_election.cc:336] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.689360 15238 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:46.690627 23154 raft_consensus.cc:2749] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:46.754673 23163 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.755239 23163 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:46.757138 23163 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:46.757601 23163 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.758028 23163 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:46.760373 23163 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:46.773622 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:46.774307 15266 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:46.774395 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:46.776638 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:46.777949 23104 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:46.778344 23104 raft_consensus.cc:493] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.778682 23104 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:46.789350 15312 leader_election.cc:336] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:46.790355 15312 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:46.797073 15238 consensus_peers.cc:597] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:46.800987 23104 raft_consensus.cc:515] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:46.790719 15312 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:46.803292 23128 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:46.811668 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:46.813375 15869 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:46.814905 15343 raft_consensus.cc:1275] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:46.816264 23162 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:46.818683 23162 consensus_queue.cc:1048] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:46.825390 23162 raft_consensus.cc:1064] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:46.828410 23162 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 15, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:46.858770 15312 leader_election.cc:336] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.890838 23128 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.891454 23128 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:46.892372 23104 leader_election.cc:290] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:46.893548 23128 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:46.894117 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:46.898162 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:46.898914 15266 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:06:46.899331 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc42a0ccf8934477a1ae58b60a2b2b07" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:46.899925 15264 raft_consensus.cc:3060] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:46.901858 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:46.910248 15264 raft_consensus.cc:2468] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
W20260709 13:06:46.913913 15162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 50269.7us
I20260709 13:06:46.909673 23163 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:46.910606 23104 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.917958 23163 raft_consensus.cc:493] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:46.930943 23163 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:46.927528 23104 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:46.965206 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 57000.2us
I20260709 13:06:46.967772 15869 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEARNER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:46.972499 23104 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:46.979154 15342 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:46.983698 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:46.985445 15264 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:46.983065 23153 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
I20260709 13:06:46.995090 23154 raft_consensus.cc:2955] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:46.982836 15238 consensus_peers.cc:597] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:46.999259 15238 consensus_peers.cc:597] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:46.997689 15309 leader_election.cc:304] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.002104 23177 raft_consensus.cc:2804] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:47.002740 23177 raft_consensus.cc:697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:47.003820 23177 consensus_queue.cc:237] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:47.006243 15312 leader_election.cc:336] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.006939 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:47.014715 15264 raft_consensus.cc:1275] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:06:47.016407 23166 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:47.011916 23128 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:47.018205 23128 raft_consensus.cc:493] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.018608 23128 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.015062 15342 raft_consensus.cc:2955] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:47.027812 23128 raft_consensus.cc:515] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.030167 23128 leader_election.cc:290] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:47.031416 15238 consensus_peers.cc:597] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.031893 15238 consensus_peers.cc:597] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.035878 23163 raft_consensus.cc:515] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.038003 23163 leader_election.cc:290] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:47.044294 15312 leader_election.cc:336] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.051707 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "929e7bd9064e489d8c24157abdd7499c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:47.052574 15268 raft_consensus.cc:3060] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.075452 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb9452f725f479a9fcc08d785cfecbc" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:47.076205 15266 raft_consensus.cc:3060] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.084050 23183 consensus_queue.cc:1048] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:06:47.066275 23166 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.087839 23166 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:47.093715 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.097558 15266 raft_consensus.cc:2468] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 16.
I20260709 13:06:47.102092 15309 leader_election.cc:304] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:47.080669 23162 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.081734 23182 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.111796 23183 raft_consensus.cc:2804] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:47.115873 23183 raft_consensus.cc:697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:47.116847 23183 consensus_queue.cc:237] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.117956 23166 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.098771 23156 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:47.121582 15238 consensus_peers.cc:597] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.115005 15268 raft_consensus.cc:2468] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:47.149380 15309 leader_election.cc:304] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:47.161540 23177 raft_consensus.cc:2804] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:47.162108 23177 raft_consensus.cc:697] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:47.162971 23177 consensus_queue.cc:237] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.129410 23182 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.112491 23162 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.181146 23162 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:47.181831 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.178916 23182 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:47.187171 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.187649 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 93272.9us
I20260709 13:06:47.189646 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:47.192224 15238 consensus_peers.cc:597] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.192792 15238 leader_election.cc:336] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.207594 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.208123 15312 leader_election.cc:336] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.208784 15312 leader_election.cc:336] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.209942 15238 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.211545 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.213912 15095 catalog_manager.cc:5697] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 23 to 24, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 24 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:47.212034 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.219790 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:47.220374 15238 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.220876 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.221335 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.221773 15312 leader_election.cc:336] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.225194 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:06:47.225404 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 104136us
I20260709 13:06:47.225852 15346 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:47.229390 15869 raft_consensus.cc:2955] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:47.222244 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:47.236433 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.241592 15237 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:47.242828 23188 raft_consensus.cc:2749] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:47.242888 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.246922 23192 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:47.247351 23192 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.247735 23192 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.253122 23153 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 LEADER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:47.259276 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.259670 15872 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:47.171388 23156 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.263734 15272 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:47.272321 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.239701 23183 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.275221 23183 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.277351 23179 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:47.283483 23179 raft_consensus.cc:493] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.283897 23179 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.291185 23156 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.287379 15095 catalog_manager.cc:5697] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 12 to 13, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:47.292910 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.292732 23179 raft_consensus.cc:515] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.293848 15337 raft_consensus.cc:2393] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:47.295724 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be765c8e55da41e98042904983ca70dd" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:47.297477 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:47.296344 15266 raft_consensus.cc:3060] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.298179 15272 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 20.
I20260709 13:06:47.302242 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:47.304114 23182 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:47.304006 23192 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.304633 23182 raft_consensus.cc:493] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.305060 23182 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:47.305574 15266 raft_consensus.cc:2468] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:06:47.308081 15309 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:47.311290 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.311853 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.311312 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "708015fd563e4389af835f3aca58eb01" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:47.312686 23104 raft_consensus.cc:2804] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:47.312983 15337 raft_consensus.cc:3060] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.313265 23104 raft_consensus.cc:697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
W20260709 13:06:47.316030 15238 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.314324 23104 consensus_queue.cc:237] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:47.321280 15238 consensus_peers.cc:597] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.321779 15238 leader_election.cc:336] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.329892 15337 raft_consensus.cc:2468] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:47.322180 15238 leader_election.cc:304] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:47.332340 15237 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
W20260709 13:06:47.343281 15238 consensus_peers.cc:597] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.343434 23153 raft_consensus.cc:2749] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:47.335527 23128 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.344779 23128 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:47.318897 23183 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.306883 23192 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.319087 23179 leader_election.cc:290] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.365558 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:47.348634 23127 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.375161 23180 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.370702 23146 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.375761 23180 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.376379 23146 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.376834 23182 raft_consensus.cc:515] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.378381 23180 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:47.381503 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.382027 15337 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 24.
I20260709 13:06:47.351985 23189 raft_consensus.cc:2804] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:47.387970 23189 raft_consensus.cc:697] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:47.388906 23189 consensus_queue.cc:237] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.389744 23112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58400 (request call id 575) took 3273 ms. Trace:
I20260709 13:06:47.390216 23112 rpcz_store.cc:276] 0709 13:06:44.116646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.116836 (+   190us) service_pool.cc:224] Handling call
0709 13:06:44.171589 (+ 54753us) ts_tablet_manager.cc:934] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515)
0709 13:06:47.389676 (+3218087us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":252,"tablet-copy.queue_time_us":25290,"thread_start_us":18865,"threads_started":2}
I20260709 13:06:47.366750 23128 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:47.396669 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.456405 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 45233.8us
I20260709 13:06:47.379235 23146 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.385860 23183 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:47.397789 15842 connection.cc:466] server connection from 127.0.0.1:58400 torn down before Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:58400 (request call id 575) could send its response
W20260709 13:06:47.471295 15238 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.410725 23177 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.464695 23182 leader_election.cc:290] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.475150 23197 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.380429 23127 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.469910 23183 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.516858 23128 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.501495 23192 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.517563 23128 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.517814 23192 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:47.521821 23166 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.522490 23166 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.524891 23166 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.476275 23177 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.546876 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
W20260709 13:06:47.547848 15842 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.548693 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 165023us
W20260709 13:06:47.549697 15312 leader_election.cc:336] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.550199 15312 leader_election.cc:336] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.562361 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.563205 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.563658 15312 leader_election.cc:336] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.564431 15312 leader_election.cc:336] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.565194 15312 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.565615 15312 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:47.567812 23104 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.568421 23104 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.568851 23206 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:47.573285 23183 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.574980 23128 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.508251 23197 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.582003 23177 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:47.592325 15094 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index 17 to 18, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.594951 23162 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.609208 23162 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.612701 23162 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.558538 23198 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:47.591471 23188 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.579023 23197 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.603374 23104 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:47.606352 15238 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.625351 15238 consensus_peers.cc:597] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.582350 23127 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:47.599200 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 67972.1us
I20260709 13:06:47.630759 23192 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.630905 23177 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.631525 23177 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.635160 23163 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.635907 23163 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.633705 23177 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.641623 23190 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:47.642066 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.642566 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.642220 23190 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.634191 23188 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.644538 23190 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.614212 23198 raft_consensus.cc:493] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.646958 23188 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.638809 23163 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:47.651399 23198 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:47.649089 15842 leader_election.cc:336] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.675179 15238 consensus_peers.cc:597] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.685761 23162 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.677798 15090 catalog_manager.cc:5697] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 15 to 16, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 16 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.700965 23162 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.701503 23198 raft_consensus.cc:515] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.701812 15090 catalog_manager.cc:5697] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 23, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 23 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:47.703552 15842 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.705717 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:47.706459 15869 raft_consensus.cc:2393] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 25: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
W20260709 13:06:47.705724 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 312945us
W20260709 13:06:47.707340 15238 leader_election.cc:336] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.708742 15238 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.715481 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:47.716394 15872 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
W20260709 13:06:47.647603 15312 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.723340 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 75760.4us
W20260709 13:06:47.723994 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.729732 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:47.729866 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.730458 15872 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:47.730544 15343 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 24.
I20260709 13:06:47.734341 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.734946 15343 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 25.
W20260709 13:06:47.733937 15238 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.736235 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee71b2a252a4ac8bc26aaed3987219f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:47.736851 15266 raft_consensus.cc:3060] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:47.743610 23211 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.744376 23211 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.747049 23203 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.747655 23203 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.749897 23203 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.746788 23211 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.723003 23162 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.767970 23198 leader_election.cc:290] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.769646 15342 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Committing config change with OpId 25.18: config changed from index 17 to 18, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } attrs { replace: true } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:47.770718 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.771456 15344 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 18.
I20260709 13:06:47.780311 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.783236 23213 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:47.783712 23213 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.784061 23213 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:47.785738 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:47.785920 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:47.786409 15271 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 28.
I20260709 13:06:47.786554 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:47.787359 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:47.787748 15264 raft_consensus.cc:1275] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:06:47.787951 15268 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 18.
I20260709 13:06:47.791555 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.792193 15337 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 25.
I20260709 13:06:47.792260 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:47.792927 15272 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:47.793368 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.793956 15337 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
W20260709 13:06:47.795184 15238 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.795802 15238 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.796285 15238 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.796365 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.796944 15337 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 28.
I20260709 13:06:47.799677 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.799882 15311 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:47.800271 15344 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 22.
I20260709 13:06:47.800848 23104 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:47.801254 23104 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.801628 23104 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:47.781507 15090 catalog_manager.cc:5697] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 19, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 19 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:47.822999 15842 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.823431 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:47.824095 15267 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:06:47.826381 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.827072 15344 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 24.
I20260709 13:06:47.827163 15266 raft_consensus.cc:2468] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:06:47.829006 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:47.829682 15344 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 26.
I20260709 13:06:47.835070 23213 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.838599 15872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c0b675005cd4e229d4415a2bcdf807c" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:47.839351 15872 raft_consensus.cc:3060] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:47.842494 15841 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.843883 15841 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:47.845800 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:47.846357 15312 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.846720 23190 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:06:47.846819 15312 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.847262 23190 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:47.847671 15312 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.847680 23190 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:47.848242 15312 leader_election.cc:336] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.848834 15312 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.849269 15312 leader_election.cc:336] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.849630 15312 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.852847 23104 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.863314 23177 raft_consensus.cc:3060] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:47.865533 23190 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.872395 23177 raft_consensus.cc:2749] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:47.873492 15267 raft_consensus.cc:1275] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:06:47.875227 15267 raft_consensus.cc:1275] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:06:47.875993 15238 consensus_peers.cc:597] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.877089 15872 raft_consensus.cc:2468] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:06:47.877612 23127 raft_consensus.cc:2764] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:06:47.878937 15267 raft_consensus.cc:1275] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:47.880769 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.875172 15266 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.882175 23162 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:47.882567 23162 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.882923 23162 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.883754 15311 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:47.884681 23177 raft_consensus.cc:2804] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:47.885422 23177 raft_consensus.cc:697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:47.886392 23177 consensus_queue.cc:237] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:47.889369 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:47.896261 15869 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 26: Already voted for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in this term.
I20260709 13:06:47.890036 23104 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:47.892020 23213 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:47.902312 15842 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.893676 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:47.895325 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 46066.1us
I20260709 13:06:47.903442 23189 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:47.903838 23189 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.904228 23189 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:47.904412 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.905176 23153 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:47.905553 23153 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.905911 23153 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.903812 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.912308 23189 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.914947 23189 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:47.912249 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:47.918498 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:47.919238 23213 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:47.919688 23213 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:47.919981 15238 leader_election.cc:336] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.920312 23213 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:47.921644 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.922364 23162 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.924474 23162 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:47.925007 15312 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.925523 15312 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.927672 23211 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:47.928166 23211 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.928574 23211 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:47.931257 23177 consensus_queue.cc:1048] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:47.932407 23208 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:47.936757 23211 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.939072 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.940027 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.940894 23188 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:47.941288 23188 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.941643 23188 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.942065 23177 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:47.942564 23177 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.942950 23177 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:47.942164 15090 catalog_manager.cc:5697] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 23, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 23 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.944733 15090 catalog_manager.cc:5697] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 24 to 25, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 25 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.948472 23213 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.949517 23188 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.950731 23213 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.951803 23190 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.954545 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:47.954978 15238 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.955900 23188 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.962200 23177 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:47.913997 23153 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:47.937206 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.938985 23211 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.965560 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:47.971802 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.971984 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
W20260709 13:06:47.973143 15312 leader_election.cc:336] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.973522 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.974978 23153 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:47.975214 23199 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:47.971192 23208 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:47.975670 23199 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
W20260709 13:06:47.975890 14036 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15218)
I20260709 13:06:47.976217 23199 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:47.975920 23208 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.977818 23208 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:47.983868 15238 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.986500 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:47.987201 15872 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:06:47.990669 23104 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:47.991142 23104 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.991530 23104 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:47.994230 23199 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:47.995303 15238 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.995963 15238 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:47.988818 15312 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:47.975632 23153 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:47.996523 23177 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:47.996618 23153 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:47.997152 23153 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:48.003085 23188 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:48.009838 15309 leader_election.cc:304] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:48.011229 23180 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:48.011626 23180 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 5e6eed5c7a6b4571b5f898002fc990d2)
I20260709 13:06:48.017872 23180 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:48.011823 23197 raft_consensus.cc:2804] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:48.024508 23197 raft_consensus.cc:697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:48.024019 23162 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 LEADER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:48.019598 23208 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:48.033524 15312 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:48.029209 15869 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:48.048197 23205 consensus_queue.cc:1048] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:48.026415 23213 consensus_queue.cc:1048] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:06:48.028532 23214 consensus_queue.cc:1048] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:06:48.046366 23104 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:48.057741 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45855d6a21ab45bf98e978ef6a3fd439" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.057849 23208 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:48.067724 15342 raft_consensus.cc:2468] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 25.
I20260709 13:06:48.069283 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.071296 15344 raft_consensus.cc:2393] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 26: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:48.078830 23199 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:48.079907 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:48.080765 15272 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 29: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:48.081941 23153 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:48.082649 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:48.083480 23104 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:48.085995 15272 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 19: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:48.091854 15264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:48.091985 15841 leader_election.cc:304] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:48.095167 23210 raft_consensus.cc:2804] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:48.097334 15264 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 26: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:48.098110 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.026242 23197 consensus_queue.cc:237] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:48.098562 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.103691 15343 raft_consensus.cc:2393] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 26: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:48.099164 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.100111 15345 raft_consensus.cc:2393] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 29: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:48.099982 23210 raft_consensus.cc:697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:06:48.106712 15342 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:06:48.108227 15345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.108846 15345 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:48.109562 15337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e635b488cd4db6bce175bf8230091e" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.110152 15337 raft_consensus.cc:3060] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:48.112514 15841 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:48.113476 15346 raft_consensus.cc:2393] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 19: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:48.114200 15343 raft_consensus.cc:1275] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:48.114411 23212 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:48.115640 23210 consensus_queue.cc:237] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:48.118762 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.130900 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:48.135958 15345 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 23.
I20260709 13:06:48.138211 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:48.141510 15272 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 27: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
W20260709 13:06:48.144057 15312 leader_election.cc:336] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:48.147433 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:48.148640 23156 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:06:48.149993 15237 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:48.152949 15090 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 18 to 19, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 25 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:48.154995 23156 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:48.156550 15337 raft_consensus.cc:2468] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 25.
I20260709 13:06:48.157441 23208 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260709 13:06:48.159143 15312 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:48.166106 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:48.166888 23208 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:06:48.159710 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:48.168449 23180 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:48.169716 15340 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:48.170645 23180 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:48.180413 23153 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:48.183689 15312 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:48.186167 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 99208c2982d748dd8e728ff51c224658 with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:06:48.187665 15238 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:48.202194 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:48.204591 23180 raft_consensus.cc:2749] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:48.208173 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:48.210366 23180 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:48.212602 23199 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:48.215461 15272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:48.216213 15272 raft_consensus.cc:2393] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in current term 23: Already voted for candidate f4ca86ee1d194023b1414bbe226f4798 in this term.
I20260709 13:06:48.218665 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:48.220531 15237 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:48.221030 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:48.221813 15340 raft_consensus.cc:2393] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate f4ca86ee1d194023b1414bbe226f4798 in current term 27: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:06:48.221843 15237 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:48.222761 15090 catalog_manager.cc:5697] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 24 to 25, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 25 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.224624 23156 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:48.225302 23156 consensus_queue.cc:1048] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:48.227193 23156 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:48.227615 23156 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:48.228463 23156 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:48.230196 23203 raft_consensus.cc:2804] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:48.230716 23203 raft_consensus.cc:697] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 25 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:48.231629 23203 consensus_queue.cc:237] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:48.231338 15340 raft_consensus.cc:2955] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Committing config change with OpId 25.19: config changed from index 18 to 19, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:48.254833 15237 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:48.256302 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:48.256590 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 99208c2982d748dd8e728ff51c224658: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:48.257294 23204 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:48.260640 23104 raft_consensus.cc:2749] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:06:48.291903 15238 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:48.316582 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:48.328634 23204 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:48.330278 15094 catalog_manager.cc:5697] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 20 to 21, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 21 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.397090 15869 raft_consensus.cc:1275] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:06:48.411952 23104 consensus_queue.cc:1048] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260709 13:06:48.874270 23213 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.008s	sys 0.012s
W20260709 13:06:48.952706 23213 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.008s	sys 0.012s
W20260709 13:06:49.059784 15268 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.111s	sys 0.097s
W20260709 13:06:49.060738 15268 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.111s	sys 0.097s
W20260709 13:06:49.180751 15264 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.009s	sys 0.004s
W20260709 13:06:49.181856 15264 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.010s	sys 0.005s
W20260709 13:06:49.226213 15842 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111) [suppressed 350 similar messages]
W20260709 13:06:49.257472 15869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.053s	sys 0.163s
W20260709 13:06:49.257934 15869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.054s	sys 0.164s
W20260709 13:06:49.316494 14036 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:49.332302 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 99208c2982d748dd8e728ff51c224658: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:49.344658 15842 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 118427us
I20260709 13:06:49.380649 15094 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 22 to 23, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 23 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.388206 15346 raft_consensus.cc:1275] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:49.390434 15094 catalog_manager.cc:5697] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 24 to 25, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 25 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.373602 23241 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:06:49.448895 15309 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 45218.7us
I20260709 13:06:49.453363 23247 raft_consensus.cc:493] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:49.454094 23247 raft_consensus.cc:515] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.456470 23247 leader_election.cc:290] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.458532 23247 raft_consensus.cc:493] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:49.409410 23241 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:49.485850 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.474649 23247 raft_consensus.cc:515] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.488245 23241 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.489573 23247 leader_election.cc:290] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.510170 23247 raft_consensus.cc:493] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:49.510737 23247 raft_consensus.cc:515] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:49.513406 23247 leader_election.cc:290] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:49.515403 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.523855 15272 raft_consensus.cc:1275] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
W20260709 13:06:49.541651 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 45275.4us
W20260709 13:06:49.546880 15238 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 76115.5us
I20260709 13:06:49.508684 23236 consensus_queue.cc:1048] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:06:49.552287 23239 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:49.564118 23241 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:49.582159 23237 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:49.582769 23237 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:49.585403 23237 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.599148 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d89f71244148538087b141a709ec50" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.600723 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.595256 23239 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:49.607450 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c93533d7be6c4a0e8829e3256295bd39" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.609263 23239 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:49.612376 15874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:49.614527 15343 raft_consensus.cc:1275] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
W20260709 13:06:49.622673 15237 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201): Couldn't send request to peer 2a3d3cf7ed3b453ebeccda54becdb6e1. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2331edb5531f4ed8a202724323d28569. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.624975 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.636400 15342 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:06:49.638054 15842 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.638525 15842 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:49.639268 15344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1011f7cfdb64b11bff42c90ec444dbe" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.645486 23266 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:49.646260 23266 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.652961 23256 consensus_queue.cc:1048] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:49.660074 23239 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:49.668799 23259 raft_consensus.cc:493] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2a3d3cf7ed3b453ebeccda54becdb6e1)
I20260709 13:06:49.669411 23259 raft_consensus.cc:515] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:49.600178 23241 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:49.672900 23241 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.602742 23249 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:49.675710 23249 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.678194 23249 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:49.693540 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e05bb3e986e4b3a8f417f713423b82a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 29 candidate_status { last_received { term: 28 index: 14 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:49.695760 15842 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.700978 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.704985 15237 leader_election.cc:304] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:49.707422 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393a249e3f433db3840189ee7dc630" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:49.707722 23254 raft_consensus.cc:2749] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:49.708029 23251 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.708536 23251 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.710646 23251 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.715297 23248 consensus_queue.cc:1048] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:06:49.716924 23255 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:49.725437 15271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:49.726009 15265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:49.727303 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:49.728765 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fddd7d735c9e4195aee24df42bc25619" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
W20260709 13:06:49.744760 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.745543 15312 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.746068 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:49.746212 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.747123 15343 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 29.
I20260709 13:06:49.748070 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.748544 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:49.751086 23255 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:06:49.751442 23255 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.751832 23255 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:49.754170 23259 leader_election.cc:290] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:49.754784 23250 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:49.756740 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0faaa04570d144c9bd5a7d514ee23dc4" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:49.759435 15237 leader_election.cc:304] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:49.765997 23259 raft_consensus.cc:2749] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:49.777102 15312 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.777626 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:49.779847 23208 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:49.782714 23266 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:49.796365 23255 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.822613 15839 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:49.824472 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:06:49.825026 15238 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:49.825451 23274 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:49.825652 15238 leader_election.cc:336] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.826203 15238 leader_election.cc:304] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:49.826902 23235 raft_consensus.cc:2749] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:49.827003 23274 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:49.828342 15238 leader_election.cc:336] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.828760 15238 leader_election.cc:304] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:49.828650 15839 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:49.829591 23235 raft_consensus.cc:2749] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:49.830422 23237 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:49.831777 23255 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:06:49.837054 15238 consensus_peers.cc:597] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.837639 15238 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.838587 23255 raft_consensus.cc:493] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:49.839169 23255 raft_consensus.cc:515] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:49.845317 15238 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.851845 23259 raft_consensus.cc:493] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:06:49.852397 23259 raft_consensus.cc:515] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.854561 23259 leader_election.cc:290] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.857175 23255 leader_election.cc:290] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.861440 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35a9f3a7e30d4ada878a020a4a8fcdc6" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.863385 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df18975ee214645b49e472675883b73" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:49.864060 15342 raft_consensus.cc:3060] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:49.884534 23235 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.885097 23235 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.887596 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29ea792889204a2e97dc9a7d427af0dc" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.889406 23235 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:49.890271 15342 raft_consensus.cc:2468] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 30.
I20260709 13:06:49.904484 15094 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60922 (request call id 237) took 1551 ms. Trace:
I20260709 13:06:49.907644 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2331edb5531f4ed8a202724323d28569"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58520
I20260709 13:06:49.904991 15094 rpcz_store.cc:276] 0709 13:06:48.352561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:48.352790 (+   229us) service_pool.cc:224] Handling call
0709 13:06:49.904370 (+1551580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:49.514302 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:49.603004 (+ 88702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:49.606736 (+  3732us) write_op.cc:435] Acquired schema lock
0709 13:06:49.626875 (+ 20139us) tablet.cc:662] Decoding operations
0709 13:06:49.654051 (+ 27176us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:49.654126 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:49.654155 (+    29us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:49.654404 (+   249us) tablet.cc:701] Row locks acquired
0709 13:06:49.654425 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:49.654568 (+   143us) write_op.cc:270] Start()
0709 13:06:49.654699 (+   131us) write_op.cc:276] Timestamp: P: 1783602409654520 usec, L: 0
0709 13:06:49.654722 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.655443 (+   721us) log.cc:844] Serialized 980 byte log entry
0709 13:06:49.843693 (+188250us) op_driver.cc:464] REPLICATION: finished
0709 13:06:49.878477 (+ 34784us) write_op.cc:301] APPLY: starting
0709 13:06:49.878573 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:49.880320 (+  1747us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:49.880446 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:49.881791 (+  1345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:49.881990 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:06:49.882031 (+    41us) write_op.cc:312] APPLY: finished
0709 13:06:49.882226 (+   195us) log.cc:844] Serialized 33 byte log entry
0709 13:06:49.895214 (+ 12988us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:49.895312 (+    98us) write_op.cc:454] Released schema lock
0709 13:06:49.895358 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":2850,"reported_tablets":6,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":34531,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12499,"num_ops":2,"prepare.queue_time_us":108414,"prepare.run_cpu_time_us":70585,"prepare.run_wall_time_us":261037,"raft.queue_time_us":22527,"raft.run_cpu_time_us":4209,"raft.run_wall_time_us":39590,"replication_time_us":188822,"spinlock_wait_cycles":68352,"thread_start_us":214118,"threads_started":4,"wal-append.queue_time_us":163872}]]}
I20260709 13:06:49.912976 23266 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.913606 23266 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:06:49.931121 15238 leader_election.cc:336] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.931615 15238 leader_election.cc:304] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:49.932392 23213 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:06:49.932952 23213 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.933259 23255 raft_consensus.cc:2749] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:49.933697 15870 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:06:49.934391 15870 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:49.935694 15311 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:49.936708 23213 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:49.937414 23213 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:49.937809 23213 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.938143 23213 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:49.925285 15342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:49.939308 15342 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 19.
I20260709 13:06:49.939389 23266 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:06:49.973192 15238 leader_election.cc:336] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:49.975864 15237 leader_election.cc:304] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:06:49.978129 15237 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:49.981861 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05375e9e02424e74a5e9fad3c54cb5fa" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:49.980597 23255 raft_consensus.cc:2749] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:49.986244 23262 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.989565 23262 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:49.992062 23262 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:50.000342 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:49.986826 23259 raft_consensus.cc:2804] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:06:50.002889 23259 raft_consensus.cc:697] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 30 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:50.003136 23255 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:50.003316 15238 consensus_peers.cc:597] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.003588 23255 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:50.004832 15238 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:50.006656 23255 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:50.003882 23259 consensus_queue.cc:237] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:50.015813 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.016283 15312 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:50.020354 15267 raft_consensus.cc:606] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:06:50.020821 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:50.021445 15268 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
W20260709 13:06:50.025527 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:50.028754 23213 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:50.032058 23213 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:06:50.033381 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0b08eaff26447e0b420aa798c881192" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:06:50.034057 15869 raft_consensus.cc:3060] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:50.035622 23255 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:50.039346 15312 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:50.051425 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:50.049528 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2331edb5531f4ed8a202724323d28569"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58520
I20260709 13:06:50.051900 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:06:50.052233 15267 raft_consensus.cc:606] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:06:50.048189 15869 raft_consensus.cc:2468] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 27.
I20260709 13:06:50.053364 23262 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:50.053753 23262 raft_consensus.cc:493] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.054121 23262 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:50.058239 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.058822 23255 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:50.061444 23262 raft_consensus.cc:515] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:50.070128 23234 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:50.070320 15311 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:06:50.070748 23262 leader_election.cc:290] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:50.071386 23262 raft_consensus.cc:2804] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:50.071849 23262 raft_consensus.cc:697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:50.072724 23262 consensus_queue.cc:237] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:50.074544 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ca54a37ddc4e00b8e839d0559b4c60" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:50.075165 15268 raft_consensus.cc:3060] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:50.076694 23289 ts_tablet_manager.cc:933] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Initiating tablet copy from peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:50.077996 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2331edb5531f4ed8a202724323d28569"
dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:58520
I20260709 13:06:50.078651 15267 raft_consensus.cc:606] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Received request to transfer leadership
I20260709 13:06:50.087962 15346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50ce7cd90ad42439199d54f3a3d3950" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:50.088546 15346 raft_consensus.cc:3060] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:50.089335 15238 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:50.093528 15268 raft_consensus.cc:2468] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
W20260709 13:06:50.098085 15143 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:06:50.098713 15143 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 2331edb5531f4ed8a202724323d28569 already in progress
W20260709 13:06:50.099148 15143 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2331edb5531f4ed8a202724323d28569 already in progress
I20260709 13:06:50.098240 15095 catalog_manager.cc:5697] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 28 to 30, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 30 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.101301 15346 raft_consensus.cc:2468] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 20.
I20260709 13:06:50.098837 15309 leader_election.cc:304] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:50.111460 23213 raft_consensus.cc:2804] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:50.112177 23213 raft_consensus.cc:697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:50.113035 23213 consensus_queue.cc:237] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:50.114940 23289 tablet_copy_client.cc:323] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Beginning tablet copy session from remote peer at address 127.13.181.2:41191
I20260709 13:06:50.117028 15281 tablet_copy_service.cc:140] P f4ca86ee1d194023b1414bbe226f4798: Received BeginTabletCopySession request for tablet 2331edb5531f4ed8a202724323d28569 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 ({username='slave'} at 127.0.0.1:44984)
I20260709 13:06:50.117583 15281 tablet_copy_service.cc:161] P f4ca86ee1d194023b1414bbe226f4798: Beginning new tablet copy session on tablet 2331edb5531f4ed8a202724323d28569 from peer 2a3d3cf7ed3b453ebeccda54becdb6e1 at {username='slave'} at 127.0.0.1:44984: session id = 2a3d3cf7ed3b453ebeccda54becdb6e1-2331edb5531f4ed8a202724323d28569
W20260709 13:06:50.125888 15312 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:50.131369 15237 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:50.132371 23255 raft_consensus.cc:2804] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:50.132915 23255 raft_consensus.cc:697] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:50.133801 23255 consensus_queue.cc:237] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:50.135396 15281 tablet_copy_source_session.cc:215] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:50.139268 23289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2331edb5531f4ed8a202724323d28569. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:06:50.146726 15897 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8ca0 after lost signal to thread 14039
W20260709 13:06:50.147980 15897 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8c00 after lost signal to thread 15129
W20260709 13:06:50.149300 15897 debug-util.cc:398] Leaking SignalData structure 0x7b0800178a80 after lost signal to thread 15296
W20260709 13:06:50.150455 15897 debug-util.cc:398] Leaking SignalData structure 0x7b080019dbe0 after lost signal to thread 15370
W20260709 13:06:50.139238 15312 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:50.151856 15312 leader_election.cc:336] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:50.151912 15897 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca9a0 after lost signal to thread 15900
I20260709 13:06:50.164865 15095 catalog_manager.cc:5697] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 25 to 27, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 27 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:50.183135 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.191435 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.183109 23289 tablet_copy_client.cc:806] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:50.192576 23289 tablet_copy_client.cc:670] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:50.192693 15094 catalog_manager.cc:5697] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 18 to 20, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 20 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:50.200398 23289 tablet_copy_client.cc:538] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:50.213472 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.227507 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.231333 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.242357 15095 catalog_manager.cc:5697] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 24, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 24 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:50.244957 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.262457 23289 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap starting.
I20260709 13:06:50.266580 23213 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.267207 23213 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:50.270602 23213 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:50.270861 15263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798" is_pre_election: true
I20260709 13:06:50.271665 15263 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:06:50.272801 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:50.272490 23255 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.274353 23255 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:50.278899 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:06:50.279533 15340 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 27.
I20260709 13:06:50.281023 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 
I20260709 13:06:50.277436 23213 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:50.282225 23251 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:50.282296 23213 raft_consensus.cc:493] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.282698 23251 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.277205 23255 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:50.283124 23251 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:50.282814 23213 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:50.290416 23251 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:50.294601 15312 leader_election.cc:336] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:50.297858 15238 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:50.298866 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:50.302912 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "155d48b4318a4f7da7c4bc8ef9b73267" candidate_uuid: "f4ca86ee1d194023b1414bbe226f4798" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:06:50.306815 15340 raft_consensus.cc:3060] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:06:50.306113 15238 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:50.313176 23213 raft_consensus.cc:515] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:50.314456 15340 raft_consensus.cc:2468] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ca86ee1d194023b1414bbe226f4798 in term 28.
I20260709 13:06:50.315632 15237 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:50.316444 23255 raft_consensus.cc:2804] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:50.316957 23255 raft_consensus.cc:697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Becoming Leader. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:50.317775 23255 consensus_queue.cc:237] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:06:50.319101 14036 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15218)
I20260709 13:06:50.323586 23213 leader_election.cc:290] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:06:50.325555 15268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a852937ac964a959721a465a5f36ad9" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:50.326136 15268 raft_consensus.cc:3060] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:50.330652 15312 leader_election.cc:336] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:50.337829 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.349773 15268 raft_consensus.cc:2468] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 27.
I20260709 13:06:50.352816 15309 leader_election.cc:304] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:50.353559 23234 raft_consensus.cc:2804] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:06:50.350390 15238 consensus_peers.cc:597] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.354080 23234 raft_consensus.cc:697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:50.355087 23234 consensus_queue.cc:237] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:06:50.359141 23251 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [CANDIDATE]: Term 28 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:06:50.373030 15095 catalog_manager.cc:5697] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: term changed from 26 to 28, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2). New cstate: current_term: 28 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:50.378104 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.393968 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.398929 15095 catalog_manager.cc:5697] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 25 to 27, leader changed from 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 27 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:50.412602 15238 consensus_peers.cc:597] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.416484 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.422353 15238 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.431068 15238 consensus_peers.cc:597] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.444640 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.505450 15268 raft_consensus.cc:1275] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:50.508092 23234 consensus_queue.cc:1048] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:06:50.508466 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 99208c2982d748dd8e728ff51c224658: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:06:50.511047 15870 raft_consensus.cc:1275] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 27 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:06:50.514200 23234 consensus_queue.cc:1048] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:06:50.520280 15238 consensus_peers.cc:597] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.521378 23254 raft_consensus.cc:993] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: : Instructing follower 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
I20260709 13:06:50.521797 23254 raft_consensus.cc:1081] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Signalling peer 9d785ccef0634edd9f0fbb52fa1c8d27 to start an election
W20260709 13:06:50.523528 15238 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.523607 15340 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2331edb5531f4ed8a202724323d28569"
dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
 from {username='slave'} at 127.0.0.1:34546
I20260709 13:06:50.525375 15340 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:50.525790 15340 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:50.569936 15238 consensus_peers.cc:597] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.572242 15340 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
W20260709 13:06:50.569558 23289 log.cc:927] Time spent T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Append to log took a long time: real 0.083s	user 0.004s	sys 0.000s
I20260709 13:06:50.588886 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: true dest_uuid: "f4ca86ee1d194023b1414bbe226f4798"
I20260709 13:06:50.589716 15267 raft_consensus.cc:3055] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:50.590021 15267 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: f4ca86ee1d194023b1414bbe226f4798, State: Running, Role: LEADER
I20260709 13:06:50.591081 15267 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:50.613067 15267 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:50.617012 15312 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:50.617558 15312 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.631369 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.586735 15340 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Requested vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:06:50.640951 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.641500 15312 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.653724 15238 consensus_peers.cc:597] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.654337 15238 consensus_peers.cc:597] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.641682 15267 raft_consensus.cc:2468] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 24.
I20260709 13:06:50.660593 15309 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798; no voters: 5e6eed5c7a6b4571b5f898002fc990d2
I20260709 13:06:50.684059 23213 raft_consensus.cc:2804] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:50.684617 23213 raft_consensus.cc:697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:06:50.685583 23213 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:50.689004 15344 raft_consensus.cc:1275] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
W20260709 13:06:50.709563 15238 consensus_peers.cc:597] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.699280 23255 consensus_queue.cc:1048] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.012s
I20260709 13:06:50.716441 23289 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:50.717587 23289 tablet_bootstrap.cc:492] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Bootstrap complete.
I20260709 13:06:50.718365 23289 ts_tablet_manager.cc:1403] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent bootstrapping tablet: real 0.456s	user 0.052s	sys 0.005s
W20260709 13:06:50.741197 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 69654.7us
I20260709 13:06:50.745675 15346 raft_consensus.cc:1275] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:50.747185 23235 consensus_queue.cc:1048] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:50.750752 23289 raft_consensus.cc:359] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:50.766759 23289 raft_consensus.cc:740] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Initialized, Role: LEARNER
I20260709 13:06:50.784751 15340 raft_consensus.cc:1275] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
W20260709 13:06:50.790189 15238 consensus_peers.cc:597] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.791764 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.791699 23235 consensus_queue.cc:1048] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:06:50.795399 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.767681 23289 consensus_queue.cc:260] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } }
I20260709 13:06:50.809293 23289 ts_tablet_manager.cc:1434] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.000s
I20260709 13:06:50.811175 15281 tablet_copy_service.cc:342] P f4ca86ee1d194023b1414bbe226f4798: Request end of tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-2331edb5531f4ed8a202724323d28569 received from {username='slave'} at 127.0.0.1:44984
I20260709 13:06:50.811679 15281 tablet_copy_service.cc:434] P f4ca86ee1d194023b1414bbe226f4798: ending tablet copy session 2a3d3cf7ed3b453ebeccda54becdb6e1-2331edb5531f4ed8a202724323d28569 on tablet 2331edb5531f4ed8a202724323d28569 with peer 2a3d3cf7ed3b453ebeccda54becdb6e1
W20260709 13:06:50.813318 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:50.831437 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:50.895833 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:50.923734 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:50.928375 15095 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 23 to 24, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 24 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:50.952127 15238 consensus_peers.cc:597] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.979143 15268 raft_consensus.cc:1275] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260709 13:06:50.985282 23304 consensus_queue.cc:1048] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:06:51.181785 15238 consensus_peers.cc:597] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:51.263423 15870 raft_consensus.cc:3060] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEARNER]: Advancing to term 24
W20260709 13:06:51.274857 15238 consensus_peers.cc:597] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:51.280428 15870 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:51.282706 23302 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: NON_VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:51.308565 15267 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:51.310292 23308 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:51.313037 23246 raft_consensus.cc:1064] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
W20260709 13:06:51.313444 23246 raft_consensus.cc:1068] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: Unable to promote non-voter 2a3d3cf7ed3b453ebeccda54becdb6e1: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:06:51.319510 14036 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15218)
I20260709 13:06:51.341603 15268 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:51.372957 15870 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:51.374488 23259 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:51.384035 15340 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Refusing update from remote peer f4ca86ee1d194023b1414bbe226f4798: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:51.386025 23259 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:51.406167 23252 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 4 to 11, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:51.410617 15876 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 4 to 11, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:51.423017 23304 raft_consensus.cc:1064] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: attempting to promote NON_VOTER 2a3d3cf7ed3b453ebeccda54becdb6e1 to VOTER
I20260709 13:06:51.427639 15079 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a8ef022b8854b68ac36c434a5c64a1f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:06:51.425550 23304 consensus_queue.cc:237] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:06:51.447610 15095 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 reported cstate change: config changed from index 4 to 11, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New cstate: current_term: 14 leader_uuid: "f4ca86ee1d194023b1414bbe226f4798" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.452513 15268 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:51.461522 23234 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:51.469099 15876 raft_consensus.cc:1275] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 LEARNER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:51.470563 23234 consensus_queue.cc:1048] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:51.469734 15340 raft_consensus.cc:2955] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 4 to 11, VOTER 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:51.497651 23234 raft_consensus.cc:2955] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 14 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:51.517557 15870 raft_consensus.cc:2955] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 14 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
I20260709 13:06:51.557647 15267 raft_consensus.cc:2955] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 14 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:51.587050 15238 consensus_peers.cc:597] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:51.601980 15094 catalog_manager.cc:5697] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: config changed from index 14 to 17, 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } } }
W20260709 13:06:51.610311 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1a8ef022b8854b68ac36c434a5c64a1f: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:51.770776 15310 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:51.857287 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.014946 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.015589 15312 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:52.018586 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.048265 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:52.048792 15312 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:52.049389 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:52.138017 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:52.320029 14036 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:52.322789 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.374540 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:52.443872 15238 consensus_peers.cc:597] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:52.464708 15238 consensus_peers.cc:597] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.626902 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:52.736557 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.812490 15238 consensus_peers.cc:597] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:52.823076 15839 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:41191, user_credentials={real_user=slave}} blocked reactor thread for 61192.6us
W20260709 13:06:52.823120 15238 consensus_peers.cc:597] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.876569 15238 consensus_peers.cc:597] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:52.876959 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:52.887342 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:52.937649 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1a8ef022b8854b68ac36c434a5c64a1f: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:52.963228 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.083119 15238 consensus_peers.cc:597] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.092770 15238 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.093389 15238 consensus_peers.cc:597] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.093879 15238 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.123783 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.175408 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.180599 15238 consensus_peers.cc:597] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:53.204644 15238 consensus_peers.cc:597] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.215183 15311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:42201, user_credentials={real_user=slave}} blocked reactor thread for 92714.8us
W20260709 13:06:53.307924 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.320847 14036 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:53.378798 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.399760 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.412191 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.476432 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.477912 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.485323 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.514847 15238 consensus_peers.cc:597] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:53.572990 15238 consensus_peers.cc:597] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.579487 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.627697 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.649253 15312 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:53.857064 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.873083 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.886533 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.906587 15312 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:53.937801 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.960063 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.988189 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.990633 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1a8ef022b8854b68ac36c434a5c64a1f: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:53.990891 15238 consensus_peers.cc:597] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:53.995544 15238 consensus_peers.cc:597] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:54.003288 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.200306 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:54.216969 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:54.233003 15312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111) [suppressed 500 similar messages]
W20260709 13:06:54.248396 15238 consensus_peers.cc:597] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.295835 15312 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:54.322971 14036 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:54.349025 15312 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:54.466202 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.490902 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.503494 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:54.511677 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.856839 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.922051 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:54.957007 15238 consensus_peers.cc:597] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.082866 15238 consensus_peers.cc:597] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.153649 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.221343 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.232642 15238 consensus_peers.cc:597] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.266714 15238 consensus_peers.cc:597] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.295693 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.323542 14036 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:55.379195 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.450228 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.464679 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.514876 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.517546 15238 consensus_peers.cc:597] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.543170 15238 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.612640 15238 consensus_peers.cc:597] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.631736 15238 consensus_peers.cc:597] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.661564 15238 consensus_peers.cc:597] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.673542 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:55.685047 15238 consensus_peers.cc:597] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.887967 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.903987 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.905431 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.904768 15238 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:55.932891 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.038410 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.048488 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.071950 15312 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:56.095479 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.101487 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.108632 15238 consensus_peers.cc:597] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.280802 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1a8ef022b8854b68ac36c434a5c64a1f: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:56.293937 15238 consensus_peers.cc:597] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:56.318728 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.324676 14036 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:56.391623 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.432192 15238 consensus_peers.cc:597] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.467648 15312 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:56.470480 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.483338 15238 consensus_peers.cc:597] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.486282 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.535876 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.593113 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.625334 15841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:46145, user_credentials={real_user=slave}} blocked reactor thread for 101707us
W20260709 13:06:56.655743 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:56.764508 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.840633 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:56.855257 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:56.899328 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:56.969683 15312 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:57.020979 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.074599 15238 consensus_peers.cc:597] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.134338 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.197718 15312 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:57.325184 14036 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:57.369354 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:57.377002 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.459894 15238 consensus_peers.cc:597] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.587875 15238 consensus_peers.cc:597] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:57.686910 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:57.693667 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:57.757225 15238 consensus_peers.cc:597] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:57.777510 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.795856 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:57.981113 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.004249 15238 consensus_peers.cc:597] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.008759 15238 consensus_peers.cc:597] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.019152 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 99208c2982d748dd8e728ff51c224658: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:06:58.058344 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.088052 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.110870 15238 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.138814 15238 consensus_peers.cc:597] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:58.179983 15238 consensus_peers.cc:597] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:58.185420 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:58.231076 15238 consensus_peers.cc:597] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.233734 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.320973 15238 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.325742 14036 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:58.342664 15238 consensus_peers.cc:597] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.370371 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.414582 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.442224 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.473469 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.505537 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.566516 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.629426 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.636853 15312 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:58.689813 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.710539 15238 consensus_peers.cc:597] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.717763 15312 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:58.718212 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.891891 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.925823 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:58.937047 15238 consensus_peers.cc:597] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:58.957325 15238 consensus_peers.cc:597] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.016959 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.026664 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.056427 15238 consensus_peers.cc:597] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.061134 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.223883 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.238582 15312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111) [suppressed 505 similar messages]
W20260709 13:06:59.327068 14036 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 15218)
W20260709 13:06:59.360205 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.369546 15312 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:59.418954 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.475286 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.586107 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.731464 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.739655 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.770380 15238 consensus_peers.cc:597] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.827955 15312 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:59.859367 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.922976 15238 consensus_peers.cc:597] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.065282 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.140504 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.161598 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.223433 15238 consensus_peers.cc:597] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.237368 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.327557 14036 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 15218)
W20260709 13:07:00.439555 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1a8ef022b8854b68ac36c434a5c64a1f: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:00.475965 15238 consensus_peers.cc:597] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.509509 15238 consensus_peers.cc:597] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.553314 15238 consensus_peers.cc:597] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.598075 15238 consensus_peers.cc:597] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.616976 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.622056 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:00.622841 15238 consensus_peers.cc:597] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.661991 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.691233 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.796550 15238 consensus_peers.cc:597] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.798959 15238 consensus_peers.cc:597] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.841348 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.873136 15238 consensus_peers.cc:597] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.903309 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.954450 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:00.984578 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.007706 15238 consensus_peers.cc:597] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.013149 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.065389 15312 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:01.065505 15238 consensus_peers.cc:597] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.125742 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.143020 15312 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:01.154868 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
W20260709 13:07:01.188182 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.193591 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.211570 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.315097 15238 consensus_peers.cc:597] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.344066 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.347846 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.453850 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.522691 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:01.558766 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
W20260709 13:07:01.573067 15839 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.592299 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:01.630012 15309 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.632915 15238 consensus_peers.cc:597] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.634351 15839 consensus_peers.cc:597] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.635856 15309 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.636529 15309 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.646667 15238 consensus_peers.cc:597] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.647296 15238 consensus_peers.cc:597] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:01.674054 15309 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.678813 15309 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.697743 15309 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.700953 15309 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.712749 15309 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.721524 15309 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.739094 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:01.762452 15309 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.763748 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:07:01.771481 15309 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.776959 14036 tablet_replica.cc:333] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.779282 14036 raft_consensus.cc:2243] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.794426 14036 raft_consensus.cc:2272] T fddd7d735c9e4195aee24df42bc25619 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.795107 15839 consensus_peers.cc:597] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.804481 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.805083 15839 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.807483 14036 tablet_replica.cc:333] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
W20260709 13:07:01.810878 15309 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.811707 14036 raft_consensus.cc:2243] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.812940 14036 raft_consensus.cc:2272] T 8ce7d889544e4fcd9cbbf09d13da02b0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.824074 15309 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.829787 14036 tablet_replica.cc:333] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.831403 14036 raft_consensus.cc:2243] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.832533 14036 raft_consensus.cc:2272] T b1d89f71244148538087b141a709ec50 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.840929 14036 tablet_replica.cc:333] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.841845 14036 raft_consensus.cc:2243] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.843214 14036 raft_consensus.cc:2272] T 05375e9e02424e74a5e9fad3c54cb5fa P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.849097 14036 tablet_replica.cc:333] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
W20260709 13:07:01.859628 15309 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.869275 14036 raft_consensus.cc:2243] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.870114 14036 raft_consensus.cc:2272] T 1082dceab99748b0a8dac27ba897e888 P f4ca86ee1d194023b1414bbe226f4798 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.873359 14036 tablet_replica.cc:333] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.874208 14036 raft_consensus.cc:2243] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.874838 14036 raft_consensus.cc:2272] T fc42a0ccf8934477a1ae58b60a2b2b07 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.878005 14036 tablet_replica.cc:333] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.882511 14036 raft_consensus.cc:2243] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.883486 14036 raft_consensus.cc:2272] T 685539345e364189892668dfd1ff7309 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.894083 14036 tablet_replica.cc:333] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.901569 14036 raft_consensus.cc:2243] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.902233 14036 raft_consensus.cc:2272] T be765c8e55da41e98042904983ca70dd P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.905486 14036 tablet_replica.cc:333] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.906286 14036 raft_consensus.cc:2243] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.906939 14036 raft_consensus.cc:2272] T be59fc6c54f44b09ae8f08b1dcb46a62 P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.915262 14036 tablet_replica.cc:333] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.916126 14036 raft_consensus.cc:2243] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:01.919397 14036 raft_consensus.cc:2272] T 061ef1ddcd60472fbf7e0c7c536414d4 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.921099 15309 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.921779 15309 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.922479 14036 tablet_replica.cc:333] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.926209 14036 raft_consensus.cc:2243] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.928190 14036 raft_consensus.cc:2272] T 99208c2982d748dd8e728ff51c224658 P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.931205 14036 tablet_replica.cc:333] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.933342 14036 raft_consensus.cc:2243] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:07:01.935896 15839 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.936522 14036 raft_consensus.cc:2272] T 68dae74f1ecc4da09974ea1562dcd4ea P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:01.937119 15309 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.937727 15309 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.938225 15309 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:01.942281 15312 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:01.944646 14036 tablet_replica.cc:333] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.952028 14036 raft_consensus.cc:2243] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:07:01.966995 14036 raft_consensus.cc:2272] T 49393a249e3f433db3840189ee7dc630 P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:01.974246 14036 tablet_replica.cc:333] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:01.980073 14036 raft_consensus.cc:2243] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:01.981554 15309 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.987929 14036 raft_consensus.cc:2272] T 716a73e82c564a6aa345a1f893caf7df P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.004665 14036 tablet_replica.cc:333] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.005756 14036 raft_consensus.cc:2243] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.008355 14036 raft_consensus.cc:2272] T 708015fd563e4389af835f3aca58eb01 P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.008881 15309 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:02.012718 15309 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.018853 14036 tablet_replica.cc:333] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.023113 14036 raft_consensus.cc:2243] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.026520 14036 raft_consensus.cc:2272] T 3251a863683a43fd9e2d5c154e67b4f5 P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.029358 14036 tablet_replica.cc:333] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.030213 14036 raft_consensus.cc:2243] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:02.037729 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:02.038287 15839 consensus_peers.cc:597] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.040517 14036 raft_consensus.cc:2272] T 5fce2f0ee66247f686730bc62ef5cdfb P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.043366 14036 tablet_replica.cc:333] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.044296 14036 raft_consensus.cc:2243] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.044921 14036 raft_consensus.cc:2272] T 29ea792889204a2e97dc9a7d427af0dc P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.045327 15309 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:02.046974 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:02.047637 14036 tablet_replica.cc:333] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.048493 14036 raft_consensus.cc:2243] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.049775 14036 raft_consensus.cc:2272] T 2331edb5531f4ed8a202724323d28569 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.053023 14036 tablet_replica.cc:333] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.053782 14036 raft_consensus.cc:2243] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.054584 14036 raft_consensus.cc:2272] T aee71b2a252a4ac8bc26aaed3987219f P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.060348 14036 tablet_replica.cc:333] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.061203 14036 raft_consensus.cc:2243] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:02.061461 15309 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.061985 14036 raft_consensus.cc:2272] T 87f2fb4185c84ac7a09a309c58e0c6b5 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.063424 15309 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.064791 14036 tablet_replica.cc:333] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.065670 14036 raft_consensus.cc:2243] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.067245 14036 raft_consensus.cc:2272] T 380c5f9d7ddb4221b333ac415575e7fc P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.069904 14036 tablet_replica.cc:333] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.070730 14036 raft_consensus.cc:2243] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.071944 14036 raft_consensus.cc:2272] T 56be0280937f422d83d9e7889c5f55aa P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.074775 14036 tablet_replica.cc:333] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.075709 14036 raft_consensus.cc:2243] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.076915 14036 raft_consensus.cc:2272] T d932cad3925e47b28537cca64ba27320 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.081748 14036 tablet_replica.cc:333] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.084584 14036 raft_consensus.cc:2243] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.085351 14036 raft_consensus.cc:2272] T c39b63dad5d94468b5872c05e2d72e0d P f4ca86ee1d194023b1414bbe226f4798 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.088140 14036 tablet_replica.cc:333] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.089270 14036 raft_consensus.cc:2243] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.089874 14036 raft_consensus.cc:2272] T bbda06dce1ef4632a18d727a37228d76 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.092473 14036 tablet_replica.cc:333] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.093322 14036 raft_consensus.cc:2243] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.094359 14036 raft_consensus.cc:2272] T 4e05bb3e986e4b3a8f417f713423b82a P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.098625 15309 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:02.110997 14036 tablet_replica.cc:333] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.111948 14036 raft_consensus.cc:2243] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.112594 14036 raft_consensus.cc:2272] T c1011f7cfdb64b11bff42c90ec444dbe P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.116010 14036 tablet_replica.cc:333] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.116848 14036 raft_consensus.cc:2243] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.117868 14036 raft_consensus.cc:2272] T ca0c163c2e66421488cfcf267f5215be P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.120846 14036 tablet_replica.cc:333] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.121644 14036 raft_consensus.cc:2243] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.122670 14036 raft_consensus.cc:2272] T 40f6ff8071574893b4031710ebd49b6d P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.125625 14036 tablet_replica.cc:333] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.126718 14036 raft_consensus.cc:2243] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.127532 14036 raft_consensus.cc:2272] T 0faaa04570d144c9bd5a7d514ee23dc4 P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.130055 14036 tablet_replica.cc:333] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.130801 14036 raft_consensus.cc:2243] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.131433 14036 raft_consensus.cc:2272] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.134433 14036 tablet_replica.cc:333] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.135241 14036 raft_consensus.cc:2243] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.136426 14036 raft_consensus.cc:2272] T 7df15ef5ed244e05887f9af5ba36331a P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.139328 14036 tablet_replica.cc:333] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.140118 14036 raft_consensus.cc:2243] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.141251 14036 raft_consensus.cc:2272] T 5df18975ee214645b49e472675883b73 P f4ca86ee1d194023b1414bbe226f4798 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.144543 14036 tablet_replica.cc:333] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.145344 14036 raft_consensus.cc:2243] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.145964 14036 raft_consensus.cc:2272] T 10c43c77e8974262bb6e378d078a6ab5 P f4ca86ee1d194023b1414bbe226f4798 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.148537 14036 tablet_replica.cc:333] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.149356 14036 raft_consensus.cc:2243] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.150525 14036 raft_consensus.cc:2272] T 1a8ef022b8854b68ac36c434a5c64a1f P f4ca86ee1d194023b1414bbe226f4798 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.160954 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:02.161726 14036 tablet_replica.cc:333] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.162629 14036 raft_consensus.cc:2243] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.164752 14036 raft_consensus.cc:2272] T 155d48b4318a4f7da7c4bc8ef9b73267 P f4ca86ee1d194023b1414bbe226f4798 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.169534 14036 tablet_replica.cc:333] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.170363 14036 raft_consensus.cc:2243] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.171320 14036 raft_consensus.cc:2272] T 35e75f905ad042d89b465e6461b29a5d P f4ca86ee1d194023b1414bbe226f4798 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.174052 14036 tablet_replica.cc:333] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.175199 14036 raft_consensus.cc:2243] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.177322 14036 raft_consensus.cc:2272] T cd30733283c2467f90c340ef580e1d8a P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.181149 14036 tablet_replica.cc:333] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.184799 14036 raft_consensus.cc:2243] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.185978 14036 raft_consensus.cc:2272] T 482b1159f7a94289b838ac9ce3753faa P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.188956 14036 tablet_replica.cc:333] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.189756 14036 raft_consensus.cc:2243] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.190903 14036 raft_consensus.cc:2272] T 659b62cebe2e47e793145022f6eed4ba P f4ca86ee1d194023b1414bbe226f4798 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.193776 14036 tablet_replica.cc:333] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.195237 14036 raft_consensus.cc:2243] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.196516 14036 raft_consensus.cc:2272] T 6056d49d08dc4130887dbf154edc6675 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.199158 14036 tablet_replica.cc:333] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.199925 14036 raft_consensus.cc:2243] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.200551 14036 raft_consensus.cc:2272] T 11ca54a37ddc4e00b8e839d0559b4c60 P f4ca86ee1d194023b1414bbe226f4798 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.204156 14036 tablet_replica.cc:333] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.204917 14036 raft_consensus.cc:2243] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.206650 14036 raft_consensus.cc:2272] T ddce72028fce49eb8627f523baef9ad0 P f4ca86ee1d194023b1414bbe226f4798 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.209378 14036 tablet_replica.cc:333] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.210119 14036 raft_consensus.cc:2243] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.210713 14036 raft_consensus.cc:2272] T 4a852937ac964a959721a465a5f36ad9 P f4ca86ee1d194023b1414bbe226f4798 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.213321 14036 tablet_replica.cc:333] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.214047 14036 raft_consensus.cc:2243] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.215138 14036 raft_consensus.cc:2272] T f50ce7cd90ad42439199d54f3a3d3950 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.217701 14036 tablet_replica.cc:333] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.218446 14036 raft_consensus.cc:2243] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.221004 14036 raft_consensus.cc:2272] T d2e635b488cd4db6bce175bf8230091e P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.224709 14036 tablet_replica.cc:333] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.225515 14036 raft_consensus.cc:2243] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.226128 14036 raft_consensus.cc:2272] T c93533d7be6c4a0e8829e3256295bd39 P f4ca86ee1d194023b1414bbe226f4798 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.230944 14036 tablet_replica.cc:333] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.231729 14036 raft_consensus.cc:2243] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.232388 14036 raft_consensus.cc:2272] T ea59d818ff084b4eb5b080bf57d2e238 P f4ca86ee1d194023b1414bbe226f4798 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.234867 14036 tablet_replica.cc:333] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.235776 14036 raft_consensus.cc:2243] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.237811 14036 raft_consensus.cc:2272] T 9ecbb94961244797af5928bce195f79f P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.240463 14036 tablet_replica.cc:333] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.240976 14036 raft_consensus.cc:2243] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.241920 14036 raft_consensus.cc:2272] T d812963f3df640419e3d4986ba60b35d P f4ca86ee1d194023b1414bbe226f4798 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.244381 14036 tablet_replica.cc:333] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.244978 14036 raft_consensus.cc:2243] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.245533 14036 raft_consensus.cc:2272] T 9eb9452f725f479a9fcc08d785cfecbc P f4ca86ee1d194023b1414bbe226f4798 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.280826 14036 tablet_replica.cc:333] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.281651 14036 raft_consensus.cc:2243] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.282737 14036 raft_consensus.cc:2272] T 929e7bd9064e489d8c24157abdd7499c P f4ca86ee1d194023b1414bbe226f4798 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.299685 14036 tablet_replica.cc:333] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798: stopping tablet replica
I20260709 13:07:02.300345 14036 raft_consensus.cc:2243] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.307346 14036 raft_consensus.cc:2272] T 1bb3da04f8ef4391ab70433e50f9700b P f4ca86ee1d194023b1414bbe226f4798 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.317927 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.348543 15312 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:02.368355 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.411695 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.576076 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:02.603042 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.628113 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:02.892473 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:02.925218 23363 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:02.925907 23363 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:02.935631 23363 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:02.939306 15839 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:02.942548 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:02.973490 23372 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:02.974105 23372 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:02.976699 23372 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:02.977932 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:02.978863 15876 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:07:02.980877 15311 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:02.981765 23372 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:02.982209 23372 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:02.982549 23372 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:02.988406 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:07:02.994194 23372 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:02.995424 15343 raft_consensus.cc:2393] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 23: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:07:02.996431 23372 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:02.999172 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:07:02.999825 15876 raft_consensus.cc:3060] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:03.014570 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:03.020501 15876 raft_consensus.cc:2468] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 23.
I20260709 13:07:03.031014 15311 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:03.032115 23372 raft_consensus.cc:2804] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:03.032660 23372 raft_consensus.cc:697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:07:03.033635 23372 consensus_queue.cc:237] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.049616 15841 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.050907 23363 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:03.051187 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:03.063783 15094 catalog_manager.cc:5697] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 22 to 23, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 23 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.087747 23363 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.088397 23363 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.100287 23363 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:03.103266 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:03.083191 15309 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.108371 15839 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.113044 15842 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.114102 15842 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.113550 23372 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.114877 23372 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.118701 23372 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.119910 23363 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:03.125205 15312 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.141829 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:07:03.148413 15309 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.257421 15309 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.264914 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.267428 23304 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:03.271126 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:03.288352 23363 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.289456 23363 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.290221 23381 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.291674 23381 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.297456 23381 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:07:03.298302 23363 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:07:03.297991 23381 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.299677 23381 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:07:03.300614 15839 leader_election.cc:336] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.301997 23381 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:03.306492 15839 leader_election.cc:336] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.313704 15839 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.325198 23304 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.326259 23304 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.328415 23356 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.329288 23356 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.330870 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:03.331130 23372 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.331792 23356 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:03.332115 23372 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.336184 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:03.337101 15869 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 25.
I20260709 13:07:03.339066 15311 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:03.341593 23364 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:07:03.342079 23364 raft_consensus.cc:493] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.342510 23364 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:03.334950 23372 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.347450 23304 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:03.332010 15876 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:07:03.349773 23304 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.350526 23372 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.350641 23304 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.351770 23372 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.353952 23372 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.354458 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:03.355116 23381 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.355964 23381 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.358201 23381 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.360977 23304 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:03.362435 23367 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.363131 23367 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.365734 23367 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.377002 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:07:03.377414 23381 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.378280 23381 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.381448 23381 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:07:03.389312 23304 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.390144 23304 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.390412 15343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:07:03.395933 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:07:03.396450 23364 raft_consensus.cc:515] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.397699 15343 raft_consensus.cc:2393] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in current term 26: Already voted for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in this term.
I20260709 13:07:03.396082 23304 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:03.404950 15842 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.405161 15839 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.405488 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.406308 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99208c2982d748dd8e728ff51c224658" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
W20260709 13:07:03.406620 15842 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.407248 23382 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:03.407155 15842 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.407073 15876 raft_consensus.cc:3060] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:07:03.408274 23381 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:03.418591 23364 leader_election.cc:290] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:07:03.421149 15839 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.423288 23364 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.434237 23364 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.436182 15841 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.436594 23364 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.428478 23372 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.429811 15876 raft_consensus.cc:2468] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 26.
I20260709 13:07:03.437500 23381 raft_consensus.cc:2749] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:03.438453 15311 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:03.437513 23372 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.439826 23304 raft_consensus.cc:2804] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:07:03.440333 23304 raft_consensus.cc:697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:07:03.440948 23372 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.441655 23304 consensus_queue.cc:237] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:07:03.434739 15312 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.454523 15312 leader_election.cc:336] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.457490 15841 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.458863 23381 raft_consensus.cc:2749] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:03.459838 15312 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.466219 15841 leader_election.cc:304] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.467281 23381 raft_consensus.cc:2749] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:07:03.470803 15312 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.471016 23364 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.471750 23364 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.474696 23364 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.477396 23367 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.478814 23367 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:07:03.483263 14036 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15293)
I20260709 13:07:03.481534 23367 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.477401 23364 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.486949 23364 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.490609 23367 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.490695 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:03.491567 15876 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 14.
I20260709 13:07:03.491500 23367 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.493073 15311 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:03.494494 23367 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.496106 23367 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:03.496523 23367 raft_consensus.cc:493] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.496906 23367 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.501360 23364 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:03.508215 23364 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.508891 23364 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.511209 23364 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.506773 23367 raft_consensus.cc:515] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.521905 23367 leader_election.cc:290] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:03.522193 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a8ef022b8854b68ac36c434a5c64a1f" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:07:03.522861 15876 raft_consensus.cc:3060] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:03.527685 15312 leader_election.cc:336] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.530983 15876 raft_consensus.cc:2468] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 15.
I20260709 13:07:03.544291 15311 leader_election.cc:304] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:03.545109 23367 raft_consensus.cc:2804] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:03.545607 23367 raft_consensus.cc:697] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:07:03.546710 23367 consensus_queue.cc:237] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:07:03.551692 15309 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.554466 15094 catalog_manager.cc:5697] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 25 to 26, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 26 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.555647 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.559998 23364 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:03.560858 15312 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.565369 15312 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.566269 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:03.569226 15312 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.568601 23381 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.569938 23381 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.575173 23381 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:03.580426 15839 leader_election.cc:336] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.564914 15309 leader_election.cc:336] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.581848 15309 leader_election.cc:336] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.582312 15309 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.595296 23304 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:03.597043 15312 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.597831 15309 leader_election.cc:336] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.598924 15309 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.601977 23304 raft_consensus.cc:2749] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:03.602151 15309 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.605993 15309 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.606788 23304 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:03.606937 15309 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.607599 15309 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.608407 23304 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:03.605567 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:03.615065 15312 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.618177 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:03.618645 15309 leader_election.cc:336] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.619338 15312 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.627146 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.627942 23304 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:03.636256 15309 leader_election.cc:336] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.626834 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:03.643253 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:03.646039 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:03.648694 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:07:03.649389 15340 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 20.
I20260709 13:07:03.655970 15094 catalog_manager.cc:5697] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 14 to 15, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 15 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.660640 23304 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.661265 23304 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.663213 23304 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:03.663970 15312 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:03.664498 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:03.666711 15841 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.667841 23381 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:03.668223 23381 raft_consensus.cc:493] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.668612 23381 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:03.702607 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:03.703418 23304 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.703992 23304 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.706941 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:03.707629 15876 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 21.
I20260709 13:07:03.709081 15311 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:03.709836 23304 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:03.709905 23364 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:03.710456 23364 raft_consensus.cc:493] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.710888 23364 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:03.712764 15876 raft_consensus.cc:1275] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:07:03.714375 23367 consensus_queue.cc:1048] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:07:03.720551 15309 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.721058 15309 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.698397 23381 raft_consensus.cc:515] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.725446 23364 raft_consensus.cc:515] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:03.729797 15876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df15ef5ed244e05887f9af5ba36331a" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1"
I20260709 13:07:03.730643 15876 raft_consensus.cc:3060] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:03.736727 15839 leader_election.cc:336] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.747156 23364 leader_election.cc:290] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:03.748688 15876 raft_consensus.cc:2468] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 22.
I20260709 13:07:03.749995 15311 leader_election.cc:304] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 
I20260709 13:07:03.739176 23304 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:03.750900 23364 raft_consensus.cc:2804] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:03.751689 23364 raft_consensus.cc:697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Becoming Leader. State: Replica: 9d785ccef0634edd9f0fbb52fa1c8d27, State: Running, Role: LEADER
I20260709 13:07:03.752703 23364 consensus_queue.cc:237] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:07:03.759563 15309 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.760095 15309 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.760808 23304 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:07:03.762101 15309 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.762495 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:07:03.765311 15312 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:39515, user_credentials={real_user=slave}} blocked reactor thread for 62176.6us
I20260709 13:07:03.768107 23381 leader_election.cc:290] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 election: Requested vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:07:03.779646 23304 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:03.784852 15312 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.785442 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:03.788012 15309 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.789539 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.791922 23304 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:07:03.793256 15309 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.806476 15309 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.806916 15309 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.807662 23364 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:07:03.807263 15094 catalog_manager.cc:5697] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 reported cstate change: term changed from 21 to 22, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3). New cstate: current_term: 22 leader_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:03.807807 15309 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.826087 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
W20260709 13:07:03.827386 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:03.827906 15312 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:03.829902 15309 leader_election.cc:336] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.832984 23367 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:07:03.835660 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:03.839164 23367 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.839854 23367 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.841995 23367 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:03.843828 23367 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:03.844367 23367 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:03.846247 23367 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:03.854060 15309 consensus_peers.cc:597] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:03.878266 15312 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:03.878885 15312 leader_election.cc:336] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:03.885943 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6056d49d08dc4130887dbf154edc6675" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27"
I20260709 13:07:03.886569 15340 raft_consensus.cc:3060] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:03.926945 15340 raft_consensus.cc:2468] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 21.
W20260709 13:07:03.928714 15309 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:03.929265 15309 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:03.930343 23367 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:03.931973 15309 leader_election.cc:336] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:03.933492 15309 leader_election.cc:336] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:04.057539 15869 raft_consensus.cc:1275] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:07:04.060895 15841 leader_election.cc:304] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:04.062083 23381 raft_consensus.cc:2804] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:04.063392 23381 raft_consensus.cc:697] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Becoming Leader. State: Replica: 2a3d3cf7ed3b453ebeccda54becdb6e1, State: Running, Role: LEADER
I20260709 13:07:04.064718 23381 consensus_queue.cc:237] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:04.067116 23356 consensus_queue.cc:1048] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:07:04.076269 15869 raft_consensus.cc:1275] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:07:04.080179 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:04.088621 23356 consensus_queue.cc:1048] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:04.090229 15094 catalog_manager.cc:5697] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 reported cstate change: term changed from 20 to 21, leader changed from f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2) to 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4). New cstate: current_term: 21 leader_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:04.091930 15309 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:04.095237 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:04.098991 23367 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:07:04.099254 15309 leader_election.cc:336] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:04.099983 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:04.100975 23367 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:07:04.101994 15309 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.137385 15309 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:04.149672 15869 raft_consensus.cc:1275] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Refusing update from remote peer 9d785ccef0634edd9f0fbb52fa1c8d27: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 13:07:04.150094 15309 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.150873 15309 consensus_peers.cc:597] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:04.151360 23372 consensus_queue.cc:1048] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:07:04.162623 15309 consensus_peers.cc:597] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:04.167524 15309 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.170696 15309 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.174122 15309 consensus_peers.cc:597] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:04.189667 15839 consensus_peers.cc:597] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.201152 15309 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.201788 15309 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.216672 15309 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.222842 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:04.240159 15309 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.264927 15312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111) [suppressed 661 similar messages]
W20260709 13:07:04.276080 15309 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.291585 15839 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.317337 15309 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.340117 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:04.351832 15309 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.360368 15309 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.376027 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:04.390817 15839 consensus_peers.cc:597] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.397904 15309 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.451902 15839 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.443189 15312 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:04.447886 15309 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.468767 15309 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.482079 15309 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.483990 14036 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 15293)
W20260709 13:07:04.486351 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:07:04.529632 15340 raft_consensus.cc:1275] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Refusing update from remote peer 2a3d3cf7ed3b453ebeccda54becdb6e1: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:07:04.531097 23381 consensus_queue.cc:1048] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:07:04.547420 15309 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.565429 15309 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.580883 15839 consensus_peers.cc:597] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:04.591049 15839 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.612953 15839 consensus_peers.cc:597] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.620961 15309 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.627776 15309 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.635471 15309 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.671936 15309 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.696808 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:04.722198 15309 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.722951 15309 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.732715 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:04.739368 15309 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:04.748581 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:04.839831 23382 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:04.840479 23382 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
W20260709 13:07:04.855480 15839 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:04.856410 15842 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:04.856837 15842 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:04.857681 23381 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:04.865450 23382 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:04.879908 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:07:04.885047 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:07:04.885722 15340 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a3d3cf7ed3b453ebeccda54becdb6e1 in term 19.
W20260709 13:07:04.907717 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:04.915310 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:05.013226 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:05.067469 23382 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:05.068845 23382 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:05.072441 23382 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:05.087761 15842 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:05.108537 15839 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:05.112788 15839 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:05.117805 23382 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:05.148833 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:05.161489 15312 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:05.170517 23372 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:05.171205 23372 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:05.174659 23372 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:05.484529 14036 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 15293)
I20260709 13:07:05.816118 23397 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:05.816833 23397 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:05.819531 23397 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:06.199621 15839 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.212908 15126 debug-util.cc:398] Leaking SignalData structure 0x7b08001785e0 after lost signal to thread 14039
W20260709 13:07:06.242890 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:06.251500 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:06.255550 15126 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8dc0 after lost signal to thread 15129
W20260709 13:07:06.256054 15842 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.256596 15842 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.257498 23397 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:06.269356 15126 debug-util.cc:398] Leaking SignalData structure 0x7b08003a59a0 after lost signal to thread 15370
W20260709 13:07:06.270788 15126 debug-util.cc:398] Leaking SignalData structure 0x7b080035b380 after lost signal to thread 15900
W20260709 13:07:06.282356 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:06.292531 23401 raft_consensus.cc:493] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.293323 23401 raft_consensus.cc:515] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.295994 23401 leader_election.cc:290] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.297853 23401 raft_consensus.cc:493] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.299618 23399 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:07:06.300041 23401 raft_consensus.cc:515] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.300275 23399 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:06.301491 23372 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.302022 23372 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.302973 23399 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:07:06.309370 23405 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:07:06.309702 15839 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.311834 23399 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:07:06.302744 23401 leader_election.cc:290] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.316953 23372 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:06.318274 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 99208c2982d748dd8e728ff51c224658: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.319545 23408 raft_consensus.cc:493] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.339363 23408 raft_consensus.cc:515] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.341735 23408 leader_election.cc:290] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.319270 23409 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.322964 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce7d889544e4fcd9cbbf09d13da02b0" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
I20260709 13:07:06.322048 23405 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.343187 23409 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.321718 23399 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:06.345827 23405 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:06.352816 15842 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.353561 23372 raft_consensus.cc:493] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.354960 23399 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:07:06.329829 23401 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.356161 23401 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.358510 23401 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.354153 23372 raft_consensus.cc:515] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.330857 23413 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
W20260709 13:07:06.363601 15839 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.364130 15839 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.365196 23399 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:06.361065 23372 leader_election.cc:290] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.365729 23408 raft_consensus.cc:493] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.329910 23406 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.345753 23409 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.367518 23405 raft_consensus.cc:493] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.367558 23408 raft_consensus.cc:515] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.367899 23406 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.370154 23408 leader_election.cc:290] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.361079 23413 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.372099 23405 raft_consensus.cc:515] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.373486 23413 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.374393 23405 leader_election.cc:290] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.370489 23406 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:06.365572 23410 raft_consensus.cc:493] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.383481 23410 raft_consensus.cc:515] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:06.386533 23410 leader_election.cc:290] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:06.390395 15312 leader_election.cc:336] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.397109 15309 leader_election.cc:336] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.397593 15309 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.398375 23410 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:06.407342 15841 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.408764 23399 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:06.410462 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2331edb5531f4ed8a202724323d28569" candidate_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" is_pre_election: true
W20260709 13:07:06.420171 15309 leader_election.cc:336] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.420886 15309 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.421432 15309 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.446156 15312 leader_election.cc:336] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.450680 15312 leader_election.cc:304] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.451722 23410 raft_consensus.cc:2749] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:06.451948 15312 leader_election.cc:336] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.452392 15312 leader_election.cc:304] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.453208 23410 raft_consensus.cc:2749] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:06.453610 15312 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.454120 15312 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.454869 23410 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:07:06.455264 15312 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:06.456039 15312 leader_election.cc:336] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.456643 15312 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.457170 15312 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.457718 15312 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:06.458467 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:06.459156 15312 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.460178 15312 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.460346 15309 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.460987 15309 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.466006 15309 leader_election.cc:336] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.466440 15309 leader_election.cc:304] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.467218 23410 raft_consensus.cc:2749] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260709 13:07:06.467350 15309 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.467857 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.468552 23410 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:07:06.468734 15309 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.469201 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.469872 23410 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:06.470312 15309 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.470741 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.471449 23410 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:06.471861 15309 leader_election.cc:336] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.472280 15309 leader_election.cc:304] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.472994 23410 raft_consensus.cc:2749] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:07:06.474225 15309 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.474696 15309 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.475147 15309 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:06.480149 15312 leader_election.cc:336] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.480654 15312 leader_election.cc:304] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.481386 23410 raft_consensus.cc:2749] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:06.482577 15312 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.482995 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.483747 23410 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:07:06.484836 15312 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.485206 14036 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 15293)
I20260709 13:07:06.485283 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.486230 23410 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:06.487330 15312 leader_election.cc:336] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.487754 15312 leader_election.cc:304] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.488459 23410 raft_consensus.cc:2749] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260709 13:07:06.489491 15312 leader_election.cc:336] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.489893 15312 leader_election.cc:304] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.490594 23410 raft_consensus.cc:2749] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:06.537716 23410 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.538288 23410 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:06.544171 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:06.544821 15869 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
W20260709 13:07:06.549237 15309 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.549923 23410 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
W20260709 13:07:06.555061 15312 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:06.555490 15312 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.556298 23410 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:06.829218 23398 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:06.829859 23398 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:06.832093 23398 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:06.872939 15842 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:06.896828 15839 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:06.897326 15839 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:06.906157 23399 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:06.922365 15312 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:06.974951 15312 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:06.988431 15312 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.010115 15312 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.212935 15312 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:07.270648 15839 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.274394 15312 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.284751 15312 consensus_peers.cc:597] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:07.295915 15312 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.301440 15309 consensus_peers.cc:597] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.302024 15309 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.302482 15309 consensus_peers.cc:597] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.344519 15312 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.348483 15312 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.373413 15309 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.384793 15309 consensus_peers.cc:597] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:07.415534 15312 consensus_peers.cc:597] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.430580 15309 consensus_peers.cc:597] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.433458 15309 consensus_peers.cc:597] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:07.439782 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:07.449194 15839 consensus_peers.cc:597] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.462553 15312 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:07.468971 15309 consensus_peers.cc:597] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.469676 15309 consensus_peers.cc:597] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:07.481510 15839 consensus_peers.cc:597] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.485854 14036 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 15293)
W20260709 13:07:07.508986 15309 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.545850 15312 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.603247 15312 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.605382 15309 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.633513 15309 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.650291 15309 consensus_peers.cc:597] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.656270 15312 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:07.666858 15309 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.682044 15839 consensus_peers.cc:597] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:07.714021 15309 consensus_peers.cc:597] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.746176 15312 consensus_peers.cc:597] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.755430 15309 consensus_peers.cc:597] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.821218 15839 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.835706 15312 consensus_peers.cc:597] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:07.838503 15309 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.839058 15309 consensus_peers.cc:597] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.876168 15839 consensus_peers.cc:597] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.884313 15309 consensus_peers.cc:597] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.900813 15839 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.902395 15312 consensus_peers.cc:597] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:07.906944 15309 consensus_peers.cc:597] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:07.918710 23404 raft_consensus.cc:493] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:07.919307 23404 raft_consensus.cc:515] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
W20260709 13:07:07.921061 15309 consensus_peers.cc:597] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:07.921449 23404 leader_election.cc:290] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:07.927107 15309 leader_election.cc:336] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:07.933249 15309 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:07.933295 15312 leader_election.cc:336] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:07.933916 15312 leader_election.cc:304] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:07.934722 23404 raft_consensus.cc:2749] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:07.979015 15309 consensus_peers.cc:597] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:08.035926 15309 consensus_peers.cc:597] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:08.055199 15309 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:08.059321 23406 raft_consensus.cc:493] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.059886 23406 raft_consensus.cc:515] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:08.061954 23406 leader_election.cc:290] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:08.066277 15312 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:08.067181 15309 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:08.072543 15309 leader_election.cc:336] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:08.072973 15309 leader_election.cc:304] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.073661 23406 raft_consensus.cc:2749] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:08.085319 23404 raft_consensus.cc:493] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.085892 23404 raft_consensus.cc:515] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:08.088076 23404 leader_election.cc:290] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:08.093436 15312 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:08.095968 15309 leader_election.cc:336] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:08.096458 15309 leader_election.cc:304] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.097786 23404 raft_consensus.cc:2749] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:07:08.102342 15842 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:07:08.104519 15312 consensus_peers.cc:597] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:08.124473 23404 raft_consensus.cc:493] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.125011 23404 raft_consensus.cc:515] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:08.127100 23404 leader_election.cc:290] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:08.132105 15312 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:08.136328 15309 leader_election.cc:336] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:08.136785 15309 leader_election.cc:304] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.137507 23404 raft_consensus.cc:2749] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:08.164686 23406 raft_consensus.cc:493] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.165217 23406 raft_consensus.cc:515] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:08.167209 23406 leader_election.cc:290] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:08.170639 15312 consensus_peers.cc:597] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:08.173429 15312 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:08.175176 15309 leader_election.cc:336] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:08.177496 15309 leader_election.cc:304] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.178287 23406 raft_consensus.cc:2749] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:08.298525 15312 consensus_peers.cc:597] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:08.299001 15312 consensus_peers.cc:597] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:08.333738 15309 consensus_peers.cc:597] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:08.347102 15312 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:08.417936 15309 consensus_peers.cc:597] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:08.418728 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
W20260709 13:07:08.425536 15842 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:07:08.442782 15312 consensus_peers.cc:597] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:07:08.465116 15312 consensus_peers.cc:597] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:07:08.465620 15312 consensus_peers.cc:597] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:08.532907 15309 consensus_peers.cc:597] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:08.544888 23404 raft_consensus.cc:493] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.545517 23404 raft_consensus.cc:515] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:08.547848 23404 leader_election.cc:290] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:08.557114 15309 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:08.559783 15312 leader_election.cc:336] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:08.560824 15312 leader_election.cc:304] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.562573 23406 raft_consensus.cc:2749] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:07:08.577183 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
W20260709 13:07:08.585845 15841 consensus_peers.cc:597] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Couldn't send request to peer 9d785ccef0634edd9f0fbb52fa1c8d27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:08.619661 15841 consensus_peers.cc:597] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Couldn't send request to peer 9d785ccef0634edd9f0fbb52fa1c8d27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:08.623384 23419 raft_consensus.cc:493] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.623973 23419 raft_consensus.cc:515] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:08.626194 23419 leader_election.cc:290] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:08.633965 15842 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:08.638474 15839 leader_election.cc:336] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:08.638953 15839 leader_election.cc:304] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.640204 23419 raft_consensus.cc:2749] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:08.654129 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:08.655402 14036 tablet_replica.cc:333] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.656651 14036 raft_consensus.cc:2243] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.659222 14036 raft_consensus.cc:2272] T b1d89f71244148538087b141a709ec50 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.662290 14036 tablet_replica.cc:333] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.663287 14036 raft_consensus.cc:2243] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.669111 14036 raft_consensus.cc:2272] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:08.672013 15842 consensus_peers.cc:597] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:07:08.674016 14036 tablet_replica.cc:333] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.675132 14036 raft_consensus.cc:2243] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:08.676386 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1a8ef022b8854b68ac36c434a5c64a1f: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:08.676994 14036 raft_consensus.cc:2272] T 05375e9e02424e74a5e9fad3c54cb5fa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.680038 14036 tablet_replica.cc:333] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.676215 23425 raft_consensus.cc:493] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.680599 23425 raft_consensus.cc:515] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } attrs { replace: true } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:08.683486 23425 leader_election.cc:290] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 2a3d3cf7ed3b453ebeccda54becdb6e1 (127.13.181.4:42201)
I20260709 13:07:08.684691 14036 raft_consensus.cc:2243] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.686198 14036 raft_consensus.cc:2272] T 1082dceab99748b0a8dac27ba897e888 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.689047 14036 tablet_replica.cc:333] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.689814 14036 raft_consensus.cc:2243] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:07:08.690001 15312 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:08.691115 14036 raft_consensus.cc:2272] T fc42a0ccf8934477a1ae58b60a2b2b07 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.694016 14036 tablet_replica.cc:333] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.694846 14036 raft_consensus.cc:2243] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.696237 14036 raft_consensus.cc:2272] T 685539345e364189892668dfd1ff7309 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.697325 15869 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68dae74f1ecc4da09974ea1562dcd4ea" candidate_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" is_pre_election: true
I20260709 13:07:08.697947 15869 raft_consensus.cc:2468] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d785ccef0634edd9f0fbb52fa1c8d27 in term 19.
I20260709 13:07:08.699146 14036 tablet_replica.cc:333] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.700048 14036 raft_consensus.cc:2243] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:07:08.700973 15309 leader_election.cc:336] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:08.701387 15309 leader_election.cc:304] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1, 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.701622 14036 raft_consensus.cc:2272] T be765c8e55da41e98042904983ca70dd P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.702013 23406 raft_consensus.cc:2749] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:08.702315 15309 consensus_peers.cc:597] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:08.704371 14036 tablet_replica.cc:333] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.705255 14036 raft_consensus.cc:2243] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.706380 14036 raft_consensus.cc:2272] T be59fc6c54f44b09ae8f08b1dcb46a62 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.709131 14036 tablet_replica.cc:333] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.709884 14036 raft_consensus.cc:2243] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.711324 14036 raft_consensus.cc:2272] T 929e7bd9064e489d8c24157abdd7499c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.714578 14036 tablet_replica.cc:333] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.715464 14036 raft_consensus.cc:2243] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.716809 14036 raft_consensus.cc:2272] T 9eb9452f725f479a9fcc08d785cfecbc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.719710 14036 tablet_replica.cc:333] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.720726 14036 raft_consensus.cc:2243] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.722663 14036 raft_consensus.cc:2272] T 2331edb5531f4ed8a202724323d28569 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.725455 14036 tablet_replica.cc:333] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.726255 14036 raft_consensus.cc:2243] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.727536 14036 raft_consensus.cc:2272] T aee71b2a252a4ac8bc26aaed3987219f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.730247 14036 tablet_replica.cc:333] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.731104 14036 raft_consensus.cc:2243] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.732172 14036 raft_consensus.cc:2272] T 87f2fb4185c84ac7a09a309c58e0c6b5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.735074 14036 tablet_replica.cc:333] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.735868 14036 raft_consensus.cc:2243] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.736810 14036 raft_consensus.cc:2272] T 81d86ef88f7f41238f3a595588effaca P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.739620 14036 tablet_replica.cc:333] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.740360 14036 raft_consensus.cc:2243] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.742237 14036 raft_consensus.cc:2272] T 99208c2982d748dd8e728ff51c224658 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.744870 14036 tablet_replica.cc:333] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.745695 14036 raft_consensus.cc:2243] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.746867 14036 raft_consensus.cc:2272] T 29ea792889204a2e97dc9a7d427af0dc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.749575 14036 tablet_replica.cc:333] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.750355 14036 raft_consensus.cc:2243] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.751559 14036 raft_consensus.cc:2272] T 061ef1ddcd60472fbf7e0c7c536414d4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.754390 14036 tablet_replica.cc:333] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.755409 14036 raft_consensus.cc:2243] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.756296 14036 raft_consensus.cc:2272] T 380c5f9d7ddb4221b333ac415575e7fc P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.759357 14036 tablet_replica.cc:333] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.760360 14036 raft_consensus.cc:2243] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.761024 14036 raft_consensus.cc:2272] T 56be0280937f422d83d9e7889c5f55aa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.763712 14036 tablet_replica.cc:333] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.764523 14036 raft_consensus.cc:2243] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.765741 14036 raft_consensus.cc:2272] T 3251a863683a43fd9e2d5c154e67b4f5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.768417 14036 tablet_replica.cc:333] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.769210 14036 raft_consensus.cc:2243] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.770334 14036 raft_consensus.cc:2272] T 5fce2f0ee66247f686730bc62ef5cdfb P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.773095 14036 tablet_replica.cc:333] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.773948 14036 raft_consensus.cc:2243] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.775259 14036 raft_consensus.cc:2272] T 4a852937ac964a959721a465a5f36ad9 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.778223 14036 tablet_replica.cc:333] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.778971 14036 raft_consensus.cc:2243] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.779587 14036 raft_consensus.cc:2272] T f50ce7cd90ad42439199d54f3a3d3950 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.782172 14036 tablet_replica.cc:333] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.782943 14036 raft_consensus.cc:2243] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.784061 14036 raft_consensus.cc:2272] T 68dae74f1ecc4da09974ea1562dcd4ea P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:08.784092 15841 consensus_peers.cc:597] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Couldn't send request to peer 9d785ccef0634edd9f0fbb52fa1c8d27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:08.787467 14036 tablet_replica.cc:333] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.788422 14036 raft_consensus.cc:2243] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.789186 14036 raft_consensus.cc:2272] T 49393a249e3f433db3840189ee7dc630 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.792016 14036 tablet_replica.cc:333] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.792855 14036 raft_consensus.cc:2243] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.794062 14036 raft_consensus.cc:2272] T 716a73e82c564a6aa345a1f893caf7df P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.797290 14036 tablet_replica.cc:333] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.798120 14036 raft_consensus.cc:2243] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.798813 14036 raft_consensus.cc:2272] T 708015fd563e4389af835f3aca58eb01 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.801632 14036 tablet_replica.cc:333] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.802457 14036 raft_consensus.cc:2243] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.803164 14036 raft_consensus.cc:2272] T c39b63dad5d94468b5872c05e2d72e0d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.805965 14036 tablet_replica.cc:333] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.806787 14036 raft_consensus.cc:2243] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.808058 14036 raft_consensus.cc:2272] T 0e8a0429d4024b20b2a1dbe68f14d55e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.811079 14036 tablet_replica.cc:333] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.811846 14036 raft_consensus.cc:2243] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.813055 14036 raft_consensus.cc:2272] T bbda06dce1ef4632a18d727a37228d76 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.816195 14036 tablet_replica.cc:333] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.816987 14036 raft_consensus.cc:2243] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.817660 14036 raft_consensus.cc:2272] T c1011f7cfdb64b11bff42c90ec444dbe P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.820799 14036 tablet_replica.cc:333] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.821645 14036 raft_consensus.cc:2243] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 LEADER]: Raft consensus shutting down.
W20260709 13:07:08.821774 15312 consensus_peers.cc:597] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:07:08.823066 14036 raft_consensus.cc:2272] T 7df15ef5ed244e05887f9af5ba36331a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.825779 14036 tablet_replica.cc:333] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.826594 14036 raft_consensus.cc:2243] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.827219 14036 raft_consensus.cc:2272] T 0faaa04570d144c9bd5a7d514ee23dc4 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.829423 23406 raft_consensus.cc:493] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:08.829855 23406 raft_consensus.cc:515] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } }
I20260709 13:07:08.830087 14036 tablet_replica.cc:333] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.831013 14036 raft_consensus.cc:2243] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.831806 23406 leader_election.cc:290] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
I20260709 13:07:08.832299 14036 raft_consensus.cc:2272] T 35a9f3a7e30d4ada878a020a4a8fcdc6 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.836113 14036 tablet_replica.cc:333] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.836985 14036 raft_consensus.cc:2243] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.838189 14036 raft_consensus.cc:2272] T 40f6ff8071574893b4031710ebd49b6d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:08.838578 15309 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:08.839619 15312 leader_election.cc:336] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:08.840035 15312 leader_election.cc:304] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d785ccef0634edd9f0fbb52fa1c8d27; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:08.840744 23406 raft_consensus.cc:2749] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:08.841238 14036 tablet_replica.cc:333] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.842015 14036 raft_consensus.cc:2243] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.842921 14036 raft_consensus.cc:2272] T 9c0b675005cd4e229d4415a2bcdf807c P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.845137 14036 tablet_replica.cc:333] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.845688 14036 raft_consensus.cc:2243] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.846194 14036 raft_consensus.cc:2272] T 659b62cebe2e47e793145022f6eed4ba P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.848595 14036 tablet_replica.cc:333] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.849175 14036 raft_consensus.cc:2243] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.849705 14036 raft_consensus.cc:2272] T 6056d49d08dc4130887dbf154edc6675 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.852013 14036 tablet_replica.cc:333] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.852597 14036 raft_consensus.cc:2243] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.853434 14036 raft_consensus.cc:2272] T 5df18975ee214645b49e472675883b73 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.855801 14036 tablet_replica.cc:333] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.856585 14036 raft_consensus.cc:2243] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.857820 14036 raft_consensus.cc:2272] T 1a8ef022b8854b68ac36c434a5c64a1f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.860512 14036 tablet_replica.cc:333] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.861255 14036 raft_consensus.cc:2243] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.862295 14036 raft_consensus.cc:2272] T 10c43c77e8974262bb6e378d078a6ab5 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.864343 14036 tablet_replica.cc:333] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.864919 14036 raft_consensus.cc:2243] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.865568 14036 raft_consensus.cc:2272] T cd30733283c2467f90c340ef580e1d8a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.868257 14036 tablet_replica.cc:333] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.868952 14036 raft_consensus.cc:2243] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.870009 14036 raft_consensus.cc:2272] T 482b1159f7a94289b838ac9ce3753faa P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:08.870018 15841 consensus_peers.cc:597] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Couldn't send request to peer 9d785ccef0634edd9f0fbb52fa1c8d27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:08.872125 14036 tablet_replica.cc:333] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.872709 14036 raft_consensus.cc:2243] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.873229 14036 raft_consensus.cc:2272] T 155d48b4318a4f7da7c4bc8ef9b73267 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.875383 14036 tablet_replica.cc:333] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.875949 14036 raft_consensus.cc:2243] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.877223 14036 raft_consensus.cc:2272] T e0b08eaff26447e0b420aa798c881192 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.879176 14036 tablet_replica.cc:333] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.879720 14036 raft_consensus.cc:2243] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.880824 14036 raft_consensus.cc:2272] T 11ca54a37ddc4e00b8e839d0559b4c60 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.882761 14036 tablet_replica.cc:333] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.883328 14036 raft_consensus.cc:2243] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.883780 14036 raft_consensus.cc:2272] T d2e635b488cd4db6bce175bf8230091e P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.885759 14036 tablet_replica.cc:333] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.886242 14036 raft_consensus.cc:2243] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.887064 14036 raft_consensus.cc:2272] T c93533d7be6c4a0e8829e3256295bd39 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.888948 14036 tablet_replica.cc:333] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.889447 14036 raft_consensus.cc:2243] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.889935 14036 raft_consensus.cc:2272] T 9ecbb94961244797af5928bce195f79f P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.892068 14036 tablet_replica.cc:333] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.892555 14036 raft_consensus.cc:2243] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.893003 14036 raft_consensus.cc:2272] T 4e05bb3e986e4b3a8f417f713423b82a P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.894680 14036 tablet_replica.cc:333] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.895196 14036 raft_consensus.cc:2243] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.896050 14036 raft_consensus.cc:2272] T 1bb3da04f8ef4391ab70433e50f9700b P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.898087 14036 tablet_replica.cc:333] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.898552 14036 raft_consensus.cc:2243] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.899115 14036 raft_consensus.cc:2272] T d812963f3df640419e3d4986ba60b35d P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.901527 14036 tablet_replica.cc:333] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.902068 14036 raft_consensus.cc:2243] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:08.902803 14036 raft_consensus.cc:2272] T 45855d6a21ab45bf98e978ef6a3fd439 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:08.904882 14036 tablet_replica.cc:333] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27: stopping tablet replica
I20260709 13:07:08.905309 14036 raft_consensus.cc:2243] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:08.906107 14036 raft_consensus.cc:2272] T ea59d818ff084b4eb5b080bf57d2e238 P 9d785ccef0634edd9f0fbb52fa1c8d27 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:08.942631 15841 consensus_peers.cc:597] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Couldn't send request to peer 9d785ccef0634edd9f0fbb52fa1c8d27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:09.093842 15841 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Couldn't send request to peer 9d785ccef0634edd9f0fbb52fa1c8d27. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.3:46145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:09.096905 15842 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:07:09.288378 15839 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111) [suppressed 588 similar messages]
I20260709 13:07:09.723474 23427 raft_consensus.cc:493] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:07:09.724138 23427 raft_consensus.cc:515] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:09.726292 23427 leader_election.cc:290] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:09.730110 15841 leader_election.cc:336] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Network error: Client connection negotiation failed: client connection to 127.13.181.3:46145: connect: Connection refused (error 111)
W20260709 13:07:09.732558 15842 leader_election.cc:336] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:09.732977 15842 leader_election.cc:304] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:07:09.733686 23427 raft_consensus.cc:2749] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:09.776925 23427 raft_consensus.cc:493] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:07:09.777596 23427 raft_consensus.cc:515] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } attrs { replace: true } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:09.780441 23427 leader_election.cc:290] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:09.787124 15841 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Network error: Client connection negotiation failed: client connection to 127.13.181.3:46145: connect: Connection refused (error 111)
W20260709 13:07:09.791476 15842 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:09.793815 15842 leader_election.cc:304] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
W20260709 13:07:09.794535 15839 leader_election.cc:336] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
I20260709 13:07:09.795257 23427 raft_consensus.cc:2749] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:07:09.803445 15839 consensus_peers.cc:597] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:09.805773 23427 raft_consensus.cc:493] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f4ca86ee1d194023b1414bbe226f4798)
I20260709 13:07:09.806394 23427 raft_consensus.cc:515] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:09.808542 23427 leader_election.cc:290] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191)
W20260709 13:07:09.813356 15839 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:09.813895 15842 leader_election.cc:336] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:09.814301 15842 leader_election.cc:304] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:09.814971 23427 raft_consensus.cc:2749] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:09.879767 15839 consensus_peers.cc:597] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:07:09.934865 23427 raft_consensus.cc:493] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:07:09.935454 23427 raft_consensus.cc:515] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f4ca86ee1d194023b1414bbe226f4798" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 41191 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:09.937795 23427 leader_election.cc:290] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:09.942807 15839 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111)
W20260709 13:07:09.943775 15841 leader_election.cc:336] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Network error: Client connection negotiation failed: client connection to 127.13.181.3:46145: connect: Connection refused (error 111)
I20260709 13:07:09.944180 15841 leader_election.cc:304] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 9d785ccef0634edd9f0fbb52fa1c8d27, f4ca86ee1d194023b1414bbe226f4798
I20260709 13:07:09.944888 23427 raft_consensus.cc:2749] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:09.991367 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
W20260709 13:07:10.062453 15842 consensus_peers.cc:597] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Couldn't send request to peer 5e6eed5c7a6b4571b5f898002fc990d2. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:10.071153 15839 consensus_peers.cc:597] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:10.073813 15839 consensus_peers.cc:597] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 -> Peer f4ca86ee1d194023b1414bbe226f4798 (127.13.181.2:41191): Couldn't send request to peer f4ca86ee1d194023b1414bbe226f4798. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:41191: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:10.106604 14036 tablet_server.cc:179] TabletServer@127.13.181.4:0 shutting down...
I20260709 13:07:10.111810 23427 raft_consensus.cc:493] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:07:10.112442 23427 raft_consensus.cc:515] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:10.120779 23427 leader_election.cc:290] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
W20260709 13:07:10.122745 15842 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:10.126504 15841 leader_election.cc:336] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Network error: Client connection negotiation failed: client connection to 127.13.181.3:46145: connect: Connection refused (error 111)
I20260709 13:07:10.126909 15841 leader_election.cc:304] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:07:10.127568 23427 raft_consensus.cc:2749] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:07:10.157303 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:10.158174 14036 tablet_replica.cc:333] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.159307 14036 raft_consensus.cc:2243] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.160106 14036 raft_consensus.cc:2272] T 2331edb5531f4ed8a202724323d28569 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.163372 14036 tablet_replica.cc:333] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.164193 14036 raft_consensus.cc:2243] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.164920 14036 raft_consensus.cc:2272] T 99208c2982d748dd8e728ff51c224658 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.167529 14036 tablet_replica.cc:333] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.168300 14036 raft_consensus.cc:2243] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.168458 23427 raft_consensus.cc:493] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 9d785ccef0634edd9f0fbb52fa1c8d27)
I20260709 13:07:10.169083 14036 raft_consensus.cc:2272] T 8ce7d889544e4fcd9cbbf09d13da02b0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.169111 23427 raft_consensus.cc:515] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5e6eed5c7a6b4571b5f898002fc990d2" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 39515 } } peers { permanent_uuid: "9d785ccef0634edd9f0fbb52fa1c8d27" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 46145 } } peers { permanent_uuid: "2a3d3cf7ed3b453ebeccda54becdb6e1" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 42201 } attrs { promote: false } }
I20260709 13:07:10.172468 14036 tablet_replica.cc:333] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.173513 14036 raft_consensus.cc:2243] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.173593 23427 leader_election.cc:290] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515), 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145)
I20260709 13:07:10.174309 14036 raft_consensus.cc:2272] T 68dae74f1ecc4da09974ea1562dcd4ea P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:10.176018 15841 leader_election.cc:336] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 9d785ccef0634edd9f0fbb52fa1c8d27 (127.13.181.3:46145): Network error: Client connection negotiation failed: client connection to 127.13.181.3:46145: connect: Connection refused (error 111)
W20260709 13:07:10.176626 15842 leader_election.cc:336] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:10.177032 15842 leader_election.cc:304] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a3d3cf7ed3b453ebeccda54becdb6e1; no voters: 5e6eed5c7a6b4571b5f898002fc990d2, 9d785ccef0634edd9f0fbb52fa1c8d27
I20260709 13:07:10.177642 23427 raft_consensus.cc:2749] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:07:10.177877 14036 tablet_replica.cc:333] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.178781 14036 raft_consensus.cc:2243] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.179548 14036 raft_consensus.cc:2272] T 7df15ef5ed244e05887f9af5ba36331a P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.182410 14036 tablet_replica.cc:333] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.183251 14036 raft_consensus.cc:2243] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.184052 14036 raft_consensus.cc:2272] T d932cad3925e47b28537cca64ba27320 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.187001 14036 tablet_replica.cc:333] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.187762 14036 raft_consensus.cc:2243] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.188858 14036 raft_consensus.cc:2272] T ca0c163c2e66421488cfcf267f5215be P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.191627 14036 tablet_replica.cc:333] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.192404 14036 raft_consensus.cc:2243] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.193389 14036 raft_consensus.cc:2272] T c39b63dad5d94468b5872c05e2d72e0d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.195739 14036 tablet_replica.cc:333] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.196471 14036 raft_consensus.cc:2243] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.197597 14036 raft_consensus.cc:2272] T 1a8ef022b8854b68ac36c434a5c64a1f P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.200330 14036 tablet_replica.cc:333] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.201086 14036 raft_consensus.cc:2243] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.202229 14036 raft_consensus.cc:2272] T 45855d6a21ab45bf98e978ef6a3fd439 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.204869 14036 tablet_replica.cc:333] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.205571 14036 raft_consensus.cc:2243] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.206655 14036 raft_consensus.cc:2272] T ddce72028fce49eb8627f523baef9ad0 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.209089 14036 tablet_replica.cc:333] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.209796 14036 raft_consensus.cc:2243] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.210811 14036 raft_consensus.cc:2272] T 35e75f905ad042d89b465e6461b29a5d P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.213403 14036 tablet_replica.cc:333] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.214057 14036 raft_consensus.cc:2243] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.214625 14036 raft_consensus.cc:2272] T 9c0b675005cd4e229d4415a2bcdf807c P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.217203 14036 tablet_replica.cc:333] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.217891 14036 raft_consensus.cc:2243] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.218858 14036 raft_consensus.cc:2272] T 81d86ef88f7f41238f3a595588effaca P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.221468 14036 tablet_replica.cc:333] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.222159 14036 raft_consensus.cc:2243] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.223161 14036 raft_consensus.cc:2272] T c1011f7cfdb64b11bff42c90ec444dbe P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.225730 14036 tablet_replica.cc:333] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.226368 14036 raft_consensus.cc:2243] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.226851 14036 raft_consensus.cc:2272] T 0e8a0429d4024b20b2a1dbe68f14d55e P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.229305 14036 tablet_replica.cc:333] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.229996 14036 raft_consensus.cc:2243] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.230803 14036 raft_consensus.cc:2272] T e0b08eaff26447e0b420aa798c881192 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.233677 14036 tablet_replica.cc:333] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.234341 14036 raft_consensus.cc:2243] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.234987 14036 raft_consensus.cc:2272] T fddd7d735c9e4195aee24df42bc25619 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.237494 14036 tablet_replica.cc:333] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.238137 14036 raft_consensus.cc:2243] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.239291 14036 raft_consensus.cc:2272] T 6056d49d08dc4130887dbf154edc6675 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.242333 14036 tablet_replica.cc:333] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1: stopping tablet replica
I20260709 13:07:10.242925 14036 raft_consensus.cc:2243] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:07:10.243916 14036 raft_consensus.cc:2272] T 0faaa04570d144c9bd5a7d514ee23dc4 P 2a3d3cf7ed3b453ebeccda54becdb6e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.489203 14036 tablet_server.cc:196] TabletServer@127.13.181.4:0 shutdown complete.
I20260709 13:07:10.534296 14036 master.cc:562] Master@127.13.181.62:42621 shutting down...
W20260709 13:07:10.570549 15143 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:07:10.570935 15143 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:07:10.571224 15143 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:07:22.764223 15082 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111) [suppressed 46 similar messages]
W20260709 13:07:22.768054 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 99208c2982d748dd8e728ff51c224658: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
W20260709 13:07:25.095814 15082 catalog_manager.cc:4755] TS 5e6eed5c7a6b4571b5f898002fc990d2 (127.13.181.1:39515): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1a8ef022b8854b68ac36c434a5c64a1f: Network error: Client connection negotiation failed: client connection to 127.13.181.1:39515: connect: Connection refused (error 111)
I20260709 13:07:27.581907 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:27.583048 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:27.583467 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P d7ef35df06e147c6a6e7757620253191: stopping tablet replica
I20260709 13:07:27.785529 14036 master.cc:584] Master@127.13.181.62:42621 shutdown complete.
I20260709 13:07:27.839840 14036 test_util.cc:182] -----------------------------------------------
I20260709 13:07:27.840056 14036 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602164044135-14036-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (258463 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:07:27.843688 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:37179
I20260709 13:07:27.844789 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:27.850946 23436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:27.851106 23437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:27.851974 23439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:27.852703 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:27.855448 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:27.855638 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:27.855805 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602447855790 us; error 0 us; skew 500 ppm
I20260709 13:07:27.856339 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:27.858834 14036 webserver.cc:533] Webserver started at http://127.13.181.62:43919/ using document root <none> and password file <none>
I20260709 13:07:27.859400 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:27.859586 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:27.859869 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:27.861084 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "44c15f33e918460e830d0cbabdacfee8"
format_stamp: "Formatted at 2026-07-09 13:07:27 on dist-test-slave-28ks"
I20260709 13:07:27.865722 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:27.869205 23444 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:27.869951 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:27.870252 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "44c15f33e918460e830d0cbabdacfee8"
format_stamp: "Formatted at 2026-07-09 13:07:27 on dist-test-slave-28ks"
I20260709 13:07:27.870539 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:27.891760 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:27.893035 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:27.933905 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:37179
I20260709 13:07:27.934005 23495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:37179 every 8 connection(s)
I20260709 13:07:27.938162 23496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:27.949688 23496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8: Bootstrap starting.
I20260709 13:07:27.954751 23496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.959275 23496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8: No bootstrap required, opened a new log
I20260709 13:07:27.961500 23496 raft_consensus.cc:359] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c15f33e918460e830d0cbabdacfee8" member_type: VOTER }
I20260709 13:07:27.961951 23496 raft_consensus.cc:385] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.962134 23496 raft_consensus.cc:740] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c15f33e918460e830d0cbabdacfee8, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.962644 23496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c15f33e918460e830d0cbabdacfee8" member_type: VOTER }
I20260709 13:07:27.963152 23496 raft_consensus.cc:399] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:27.963380 23496 raft_consensus.cc:493] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:27.963608 23496 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.968550 23496 raft_consensus.cc:515] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c15f33e918460e830d0cbabdacfee8" member_type: VOTER }
I20260709 13:07:27.969055 23496 leader_election.cc:304] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44c15f33e918460e830d0cbabdacfee8; no voters: 
I20260709 13:07:27.970230 23496 leader_election.cc:290] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:27.970671 23499 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.972088 23499 raft_consensus.cc:697] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 1 LEADER]: Becoming Leader. State: Replica: 44c15f33e918460e830d0cbabdacfee8, State: Running, Role: LEADER
I20260709 13:07:27.972869 23499 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c15f33e918460e830d0cbabdacfee8" member_type: VOTER }
I20260709 13:07:27.973495 23496 sys_catalog.cc:565] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:27.980687 23501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44c15f33e918460e830d0cbabdacfee8. Latest consensus state: current_term: 1 leader_uuid: "44c15f33e918460e830d0cbabdacfee8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c15f33e918460e830d0cbabdacfee8" member_type: VOTER } }
I20260709 13:07:27.981236 23501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:27.981598 23500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44c15f33e918460e830d0cbabdacfee8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c15f33e918460e830d0cbabdacfee8" member_type: VOTER } }
I20260709 13:07:27.982280 23500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:27.983434 23509 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:27.991633 23509 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:27.992652 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:28.001192 23509 catalog_manager.cc:1383] Generated new cluster ID: 4796a3187e424fd4817b1f4127c93851
I20260709 13:07:28.001521 23509 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:28.018389 23509 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:28.019726 23509 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:28.034042 23509 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8: Generated new TSK 0
I20260709 13:07:28.034646 23509 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:28.059487 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:28.065778 23517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:28.066840 23518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:28.067907 23520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:28.069777 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:28.072407 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:28.072613 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:28.072736 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602448072724 us; error 0 us; skew 500 ppm
I20260709 13:07:28.073312 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:28.075760 14036 webserver.cc:533] Webserver started at http://127.13.181.1:38381/ using document root <none> and password file <none>
I20260709 13:07:28.076195 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:28.076349 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:28.076567 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:28.077713 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "156aacba33d94250a5a0a6721246551e"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.082206 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:28.085752 23525 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.086591 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:28.086910 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "156aacba33d94250a5a0a6721246551e"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.087283 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:28.112916 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:28.114174 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:28.115737 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:28.118263 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:28.118495 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.118741 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:28.118927 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.161700 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:43543
I20260709 13:07:28.161796 23587 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:43543 every 8 connection(s)
I20260709 13:07:28.167057 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:28.174602 23592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:28.175007 23593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:28.179847 23595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:28.180472 23588 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37179
I20260709 13:07:28.180888 23588 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:28.181262 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:28.181915 23588 heartbeater.cc:507] Master 127.13.181.62:37179 requested a full tablet report, sending...
I20260709 13:07:28.184124 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:28.184473 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:28.184361 23461 ts_manager.cc:194] Registered new tserver with Master: 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:28.184762 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602448184742 us; error 0 us; skew 500 ppm
I20260709 13:07:28.185637 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:28.187002 23461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39688
I20260709 13:07:28.188607 14036 webserver.cc:533] Webserver started at http://127.13.181.2:45961/ using document root <none> and password file <none>
I20260709 13:07:28.189304 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:28.189527 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:28.189807 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:28.190932 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.195392 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:28.198776 23600 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.199530 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:07:28.199810 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.200066 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:28.243232 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:28.244562 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:28.246037 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:28.248293 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:28.248471 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.248765 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:28.248906 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.292711 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:35595
I20260709 13:07:28.292802 23662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:35595 every 8 connection(s)
I20260709 13:07:28.297731 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:28.305871 23666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:28.306541 23667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:28.314309 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:28.314435 23663 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37179
I20260709 13:07:28.315080 23663 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:28.316025 23663 heartbeater.cc:507] Master 127.13.181.62:37179 requested a full tablet report, sending...
W20260709 13:07:28.316735 23669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:28.318455 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:28.318500 23461 ts_manager.cc:194] Registered new tserver with Master: 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
W20260709 13:07:28.318766 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:28.319069 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602448319029 us; error 0 us; skew 500 ppm
I20260709 13:07:28.319725 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:28.320305 23461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39704
I20260709 13:07:28.322686 14036 webserver.cc:533] Webserver started at http://127.13.181.3:35925/ using document root <none> and password file <none>
I20260709 13:07:28.323292 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:28.323493 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:28.323753 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:28.324941 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "2fa39659edab417ebd04cb981cf61549"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.329453 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:28.333194 23674 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.334213 14036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:28.334496 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "2fa39659edab417ebd04cb981cf61549"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.334815 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:28.355115 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:28.356338 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:28.357789 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:28.360180 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:28.360359 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.360664 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:28.360824 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.404050 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:33247
I20260709 13:07:28.404134 23736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:33247 every 8 connection(s)
I20260709 13:07:28.409054 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:28.417250 23740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:28.418641 23741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:28.422259 23743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:28.422315 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:28.423300 23737 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37179
I20260709 13:07:28.423765 23737 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:28.423775 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:28.424258 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:28.424502 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602448424482 us; error 0 us; skew 500 ppm
I20260709 13:07:28.424938 23737 heartbeater.cc:507] Master 127.13.181.62:37179 requested a full tablet report, sending...
I20260709 13:07:28.425447 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:28.427608 23461 ts_manager.cc:194] Registered new tserver with Master: 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:28.428779 14036 webserver.cc:533] Webserver started at http://127.13.181.4:42855/ using document root <none> and password file <none>
I20260709 13:07:28.429538 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:28.429641 23461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39716
I20260709 13:07:28.429817 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:28.430296 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:28.432221 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-3-root/instance:
uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.437270 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:07:28.440660 23748 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.441481 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:28.441812 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-3-root
uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:28.442071 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:28.456511 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:28.457775 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:28.459365 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:28.461537 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:28.461743 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.461985 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:28.462138 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:28.506444 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.4:35419
I20260709 13:07:28.506558 23810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.4:35419 every 8 connection(s)
I20260709 13:07:28.520412 23811 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37179
I20260709 13:07:28.520783 23811 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:28.521571 23811 heartbeater.cc:507] Master 127.13.181.62:37179 requested a full tablet report, sending...
I20260709 13:07:28.523469 23461 ts_manager.cc:194] Registered new tserver with Master: 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:28.523613 14036 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013798358s
I20260709 13:07:28.524835 23461 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39722
I20260709 13:07:28.550563 23461 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39724:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:07:28.792608 23776 tablet_service.cc:1511] Processing CreateTablet for tablet a1be00bf028b40acabfa2fcad430301d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:28.794207 23776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1be00bf028b40acabfa2fcad430301d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.794987 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 70e52cc6079649abb36ed7bc7bbacaca (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:28.796674 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e52cc6079649abb36ed7bc7bbacaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.799204 23553 tablet_service.cc:1511] Processing CreateTablet for tablet a1be00bf028b40acabfa2fcad430301d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:28.800930 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1be00bf028b40acabfa2fcad430301d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.799327 23552 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee2fe61752e4fd6a11c4e1dc2857051 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:28.802776 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee2fe61752e4fd6a11c4e1dc2857051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.806252 23774 tablet_service.cc:1511] Processing CreateTablet for tablet d6db2b37fa4a42eca168f8bcfda497a0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:28.807920 23774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6db2b37fa4a42eca168f8bcfda497a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.811269 23773 tablet_service.cc:1511] Processing CreateTablet for tablet 265102913f834db596bb95ebf8d031dd (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:28.812747 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265102913f834db596bb95ebf8d031dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.824396 23772 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9732b9e0d94f8d9386a523a65e9519 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:28.826651 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 70e52cc6079649abb36ed7bc7bbacaca (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:28.828286 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e52cc6079649abb36ed7bc7bbacaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.828339 23550 tablet_service.cc:1511] Processing CreateTablet for tablet f0ef366a73c0412fa3f7e3966917d438 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:28.829875 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ef366a73c0412fa3f7e3966917d438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.830040 23771 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4f5b98e071431492a1a258fddd2ef3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:28.832495 23549 tablet_service.cc:1511] Processing CreateTablet for tablet 265102913f834db596bb95ebf8d031dd (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:28.835062 23548 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9732b9e0d94f8d9386a523a65e9519 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:28.837419 23547 tablet_service.cc:1511] Processing CreateTablet for tablet f090d4df44ad48388a56df9972462932 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:28.838253 23626 tablet_service.cc:1511] Processing CreateTablet for tablet d6db2b37fa4a42eca168f8bcfda497a0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:28.830236 23628 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee2fe61752e4fd6a11c4e1dc2857051 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:28.843050 23625 tablet_service.cc:1511] Processing CreateTablet for tablet f0ef366a73c0412fa3f7e3966917d438 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:28.845772 23623 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4f5b98e071431492a1a258fddd2ef3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:28.846202 23770 tablet_service.cc:1511] Processing CreateTablet for tablet 982a36e8097b4dbfb315b9527072e1aa (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:28.848062 23624 tablet_service.cc:1511] Processing CreateTablet for tablet 265102913f834db596bb95ebf8d031dd (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:28.850812 23622 tablet_service.cc:1511] Processing CreateTablet for tablet f090d4df44ad48388a56df9972462932 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:28.853181 23551 tablet_service.cc:1511] Processing CreateTablet for tablet 70e52cc6079649abb36ed7bc7bbacaca (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:28.855847 23626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6db2b37fa4a42eca168f8bcfda497a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.859220 23628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee2fe61752e4fd6a11c4e1dc2857051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.861439 23623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4f5b98e071431492a1a258fddd2ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.863278 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f090d4df44ad48388a56df9972462932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.864149 23549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265102913f834db596bb95ebf8d031dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.866339 23624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265102913f834db596bb95ebf8d031dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.867262 23548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9732b9e0d94f8d9386a523a65e9519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.868353 23625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ef366a73c0412fa3f7e3966917d438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.872325 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f090d4df44ad48388a56df9972462932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.872332 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 982a36e8097b4dbfb315b9527072e1aa (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:28.873436 23551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e52cc6079649abb36ed7bc7bbacaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.874064 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982a36e8097b4dbfb315b9527072e1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.826681 23772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9732b9e0d94f8d9386a523a65e9519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.876905 23770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982a36e8097b4dbfb315b9527072e1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.877290 23621 tablet_service.cc:1511] Processing CreateTablet for tablet 982a36e8097b4dbfb315b9527072e1aa (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:28.878476 23771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4f5b98e071431492a1a258fddd2ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.879094 23621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 982a36e8097b4dbfb315b9527072e1aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.916581 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 883d3fdac6bf46478c2f6999beaa7fb0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:28.918067 23620 tablet_service.cc:1511] Processing CreateTablet for tablet a6b9ad5291bf45a1978822097056ff57 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:28.919512 23620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b9ad5291bf45a1978822097056ff57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.918053 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883d3fdac6bf46478c2f6999beaa7fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.924832 23776 tablet_service.cc:1511] Processing CreateTablet for tablet a6b9ad5291bf45a1978822097056ff57 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:28.926183 23776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b9ad5291bf45a1978822097056ff57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.926668 23544 tablet_service.cc:1511] Processing CreateTablet for tablet f331d8701aa747479e33e661ec648a30 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:28.928038 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331d8701aa747479e33e661ec648a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.928283 23619 tablet_service.cc:1511] Processing CreateTablet for tablet f331d8701aa747479e33e661ec648a30 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:28.929625 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331d8701aa747479e33e661ec648a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.931764 23773 tablet_service.cc:1511] Processing CreateTablet for tablet 883d3fdac6bf46478c2f6999beaa7fb0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:28.933146 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883d3fdac6bf46478c2f6999beaa7fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.938455 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 7353eea058f4496792494b7c5b54707b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:28.947885 23831 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:28.957965 23769 tablet_service.cc:1511] Processing CreateTablet for tablet ecbb921a20f742f58e9b8ebf7822cc87 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:28.939916 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7353eea058f4496792494b7c5b54707b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.969817 23625 tablet_service.cc:1511] Processing CreateTablet for tablet 7353eea058f4496792494b7c5b54707b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:28.971493 23769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbb921a20f742f58e9b8ebf7822cc87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:28.985100 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:28.990351 23832 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:28.992296 23702 tablet_service.cc:1511] Processing CreateTablet for tablet a1be00bf028b40acabfa2fcad430301d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:29.016114 23702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1be00bf028b40acabfa2fcad430301d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.994150 23701 tablet_service.cc:1511] Processing CreateTablet for tablet 4ee2fe61752e4fd6a11c4e1dc2857051 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:29.018224 23701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ee2fe61752e4fd6a11c4e1dc2857051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.995986 23700 tablet_service.cc:1511] Processing CreateTablet for tablet d6db2b37fa4a42eca168f8bcfda497a0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:29.020141 23625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7353eea058f4496792494b7c5b54707b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.020222 23700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6db2b37fa4a42eca168f8bcfda497a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.997768 23699 tablet_service.cc:1511] Processing CreateTablet for tablet f0ef366a73c0412fa3f7e3966917d438 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:29.022710 23699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0ef366a73c0412fa3f7e3966917d438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:28.999778 23698 tablet_service.cc:1511] Processing CreateTablet for tablet 7e9732b9e0d94f8d9386a523a65e9519 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:29.024952 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e9732b9e0d94f8d9386a523a65e9519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.001610 23697 tablet_service.cc:1511] Processing CreateTablet for tablet 9f4f5b98e071431492a1a258fddd2ef3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:29.027149 23697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f4f5b98e071431492a1a258fddd2ef3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.003391 23696 tablet_service.cc:1511] Processing CreateTablet for tablet f090d4df44ad48388a56df9972462932 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:29.005537 23695 tablet_service.cc:1511] Processing CreateTablet for tablet 883d3fdac6bf46478c2f6999beaa7fb0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:29.007426 23694 tablet_service.cc:1511] Processing CreateTablet for tablet a6b9ad5291bf45a1978822097056ff57 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:29.009148 23693 tablet_service.cc:1511] Processing CreateTablet for tablet f331d8701aa747479e33e661ec648a30 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:29.029222 23696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f090d4df44ad48388a56df9972462932. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.023625 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 36f60dc2cd934d1da48a665aad1c13d3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:29.030045 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f331d8701aa747479e33e661ec648a30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.030391 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f60dc2cd934d1da48a665aad1c13d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.031486 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6b9ad5291bf45a1978822097056ff57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.034353 23695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 883d3fdac6bf46478c2f6999beaa7fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.010906 23553 tablet_service.cc:1511] Processing CreateTablet for tablet 7353eea058f4496792494b7c5b54707b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:29.055262 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7353eea058f4496792494b7c5b54707b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:29.088713 23447 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 69210.1us
I20260709 13:07:29.091812 23772 tablet_service.cc:1511] Processing CreateTablet for tablet 36f60dc2cd934d1da48a665aad1c13d3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:29.092733 23831 tablet_bootstrap.cc:654] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.093291 23772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f60dc2cd934d1da48a665aad1c13d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.091830 23545 tablet_service.cc:1511] Processing CreateTablet for tablet ecbb921a20f742f58e9b8ebf7822cc87 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:29.098274 23770 tablet_service.cc:1511] Processing CreateTablet for tablet 6d840fb6d5bb459dadc6e033bf997f5e (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:29.105752 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbb921a20f742f58e9b8ebf7822cc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.106102 23832 tablet_bootstrap.cc:654] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.115108 23770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d840fb6d5bb459dadc6e033bf997f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.155857 23833 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:29.157871 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 6d840fb6d5bb459dadc6e033bf997f5e (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:29.161175 23626 tablet_service.cc:1511] Processing CreateTablet for tablet bf53bc01d1484dbd95722162c9827f6d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:29.164147 23552 tablet_service.cc:1511] Processing CreateTablet for tablet bf53bc01d1484dbd95722162c9827f6d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:29.176461 23626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf53bc01d1484dbd95722162c9827f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.187593 23628 tablet_service.cc:1511] Processing CreateTablet for tablet 6d840fb6d5bb459dadc6e033bf997f5e (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:29.190092 23588 heartbeater.cc:499] Master 127.13.181.62:37179 was elected leader, sending a full tablet report...
I20260709 13:07:29.191484 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d840fb6d5bb459dadc6e033bf997f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.195561 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf53bc01d1484dbd95722162c9827f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.213750 23544 tablet_service.cc:1511] Processing CreateTablet for tablet ae1a0dfb08d64fbb85f81c33ab57e9e1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:29.227751 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1a0dfb08d64fbb85f81c33ab57e9e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.222729 23833 tablet_bootstrap.cc:654] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.224576 23771 tablet_service.cc:1511] Processing CreateTablet for tablet ae1a0dfb08d64fbb85f81c33ab57e9e1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:29.217692 23628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d840fb6d5bb459dadc6e033bf997f5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.239884 23619 tablet_service.cc:1511] Processing CreateTablet for tablet 3214eda030c94c39a590e4a7c3fb8ccc (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:29.247797 23771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1a0dfb08d64fbb85f81c33ab57e9e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.249315 23832 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:29.247797 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3214eda030c94c39a590e4a7c3fb8ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.250108 23832 ts_tablet_manager.cc:1403] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.260s	user 0.017s	sys 0.000s
I20260709 13:07:29.250891 23700 tablet_service.cc:1511] Processing CreateTablet for tablet bf53bc01d1484dbd95722162c9827f6d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:29.251710 23696 tablet_service.cc:1511] Processing CreateTablet for tablet ecbb921a20f742f58e9b8ebf7822cc87 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:29.277283 23831 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:29.278090 23697 tablet_service.cc:1511] Processing CreateTablet for tablet ae1a0dfb08d64fbb85f81c33ab57e9e1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:29.294934 23831 ts_tablet_manager.cc:1403] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.347s	user 0.004s	sys 0.017s
I20260709 13:07:29.279675 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 3214eda030c94c39a590e4a7c3fb8ccc (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:29.296139 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3214eda030c94c39a590e4a7c3fb8ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.298084 23831 raft_consensus.cc:359] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.262657 23695 tablet_service.cc:1511] Processing CreateTablet for tablet 36f60dc2cd934d1da48a665aad1c13d3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:29.298888 23831 raft_consensus.cc:385] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.300076 23831 raft_consensus.cc:740] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.299319 23832 raft_consensus.cc:359] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.301364 23831 consensus_queue.cc:260] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.302772 23622 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe0677c45254e81bbad8dc085ffb64c (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:29.304083 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe0677c45254e81bbad8dc085ffb64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.301285 23832 raft_consensus.cc:385] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.307471 23832 raft_consensus.cc:740] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.308270 23832 consensus_queue.cc:260] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.309295 23773 tablet_service.cc:1511] Processing CreateTablet for tablet a43ac9d400274111ab086900b40199f0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:29.310698 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43ac9d400274111ab086900b40199f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.313571 23776 tablet_service.cc:1511] Processing CreateTablet for tablet b46b913ff5404592be0ac2df69ce2498 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:29.325341 23700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf53bc01d1484dbd95722162c9827f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.328166 23776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46b913ff5404592be0ac2df69ce2498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.332872 23663 heartbeater.cc:499] Master 127.13.181.62:37179 was elected leader, sending a full tablet report...
I20260709 13:07:29.348313 23550 tablet_service.cc:1511] Processing CreateTablet for tablet b46b913ff5404592be0ac2df69ce2498 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:29.348630 23774 tablet_service.cc:1511] Processing CreateTablet for tablet e4351d83f6f0478a9d56121d733ff753 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:29.349923 23621 tablet_service.cc:1511] Processing CreateTablet for tablet a43ac9d400274111ab086900b40199f0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:29.352661 23833 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:29.353190 23833 ts_tablet_manager.cc:1403] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.198s	user 0.019s	sys 0.033s
I20260709 13:07:29.355351 23702 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe0677c45254e81bbad8dc085ffb64c (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:29.355671 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe0677c45254e81bbad8dc085ffb64c (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:29.358314 23833 raft_consensus.cc:359] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:29.359364 23774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4351d83f6f0478a9d56121d733ff753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.349984 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46b913ff5404592be0ac2df69ce2498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.362639 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe0677c45254e81bbad8dc085ffb64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.363693 23625 tablet_service.cc:1511] Processing CreateTablet for tablet e4351d83f6f0478a9d56121d733ff753 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:29.334511 23547 tablet_service.cc:1511] Processing CreateTablet for tablet a43ac9d400274111ab086900b40199f0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:29.370975 23625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4351d83f6f0478a9d56121d733ff753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.376865 23693 tablet_service.cc:1511] Processing CreateTablet for tablet 3214eda030c94c39a590e4a7c3fb8ccc (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:29.378957 23621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43ac9d400274111ab086900b40199f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.380101 23831 ts_tablet_manager.cc:1434] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.023s
I20260709 13:07:29.359407 23833 raft_consensus.cc:385] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.381109 23833 raft_consensus.cc:740] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.381956 23833 consensus_queue.cc:260] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:29.383858 23836 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:29.387890 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a43ac9d400274111ab086900b40199f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.390113 23811 heartbeater.cc:499] Master 127.13.181.62:37179 was elected leader, sending a full tablet report...
I20260709 13:07:29.397909 23831 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:29.403211 23695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36f60dc2cd934d1da48a665aad1c13d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.407368 23702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe0677c45254e81bbad8dc085ffb64c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.411394 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3214eda030c94c39a590e4a7c3fb8ccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.415498 23694 tablet_service.cc:1511] Processing CreateTablet for tablet b46b913ff5404592be0ac2df69ce2498 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:29.416036 23553 tablet_service.cc:1511] Processing CreateTablet for tablet 3e66f85de59d4ac4b676edfe803876b8 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:29.416903 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46b913ff5404592be0ac2df69ce2498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.417356 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e66f85de59d4ac4b676edfe803876b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.392000 23832 ts_tablet_manager.cc:1434] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.141s	user 0.019s	sys 0.015s
I20260709 13:07:29.421741 23832 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:29.422612 23698 tablet_service.cc:1511] Processing CreateTablet for tablet e4351d83f6f0478a9d56121d733ff753 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:29.423985 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4351d83f6f0478a9d56121d733ff753. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.433168 23737 heartbeater.cc:499] Master 127.13.181.62:37179 was elected leader, sending a full tablet report...
I20260709 13:07:29.439970 23697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae1a0dfb08d64fbb85f81c33ab57e9e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.444141 23696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbb921a20f742f58e9b8ebf7822cc87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.451587 23831 tablet_bootstrap.cc:654] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.452967 23620 tablet_service.cc:1511] Processing CreateTablet for tablet 3e66f85de59d4ac4b676edfe803876b8 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:29.491972 23620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e66f85de59d4ac4b676edfe803876b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.464097 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce328dcc310474c82fd1fc598402f51 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:29.469595 23833 ts_tablet_manager.cc:1434] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.116s	user 0.012s	sys 0.008s
I20260709 13:07:29.495235 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce328dcc310474c82fd1fc598402f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.496101 23833 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:29.496343 23699 tablet_service.cc:1511] Processing CreateTablet for tablet 6a112ab003b24103ae2a7b922dc31f3d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:29.497799 23699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a112ab003b24103ae2a7b922dc31f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.484777 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce328dcc310474c82fd1fc598402f51 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:29.499902 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce328dcc310474c82fd1fc598402f51. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:29.514015 23812 tablet.cc:2406] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:29.484843 23836 tablet_bootstrap.cc:654] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.519292 23833 tablet_bootstrap.cc:654] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.490267 23701 tablet_service.cc:1511] Processing CreateTablet for tablet 3e66f85de59d4ac4b676edfe803876b8 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:29.490821 23832 tablet_bootstrap.cc:654] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.523103 23701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e66f85de59d4ac4b676edfe803876b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.535064 23831 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:29.535705 23831 ts_tablet_manager.cc:1403] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.000s
I20260709 13:07:29.536999 23832 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:29.537737 23832 ts_tablet_manager.cc:1403] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.116s	user 0.004s	sys 0.016s
I20260709 13:07:29.541261 23832 raft_consensus.cc:359] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:29.542253 23832 raft_consensus.cc:385] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.542701 23832 raft_consensus.cc:740] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.543413 23619 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce328dcc310474c82fd1fc598402f51 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:29.543663 23832 consensus_queue.cc:260] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:29.545109 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce328dcc310474c82fd1fc598402f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.546897 23832 ts_tablet_manager.cc:1434] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:29.548190 23832 tablet_bootstrap.cc:492] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:29.552224 23547 tablet_service.cc:1511] Processing CreateTablet for tablet 6a112ab003b24103ae2a7b922dc31f3d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:29.552985 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 202fa208bd5c4307aaa9589effb21dcd (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:29.553436 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 202fa208bd5c4307aaa9589effb21dcd (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:29.553943 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a112ab003b24103ae2a7b922dc31f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.554421 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202fa208bd5c4307aaa9589effb21dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.554775 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202fa208bd5c4307aaa9589effb21dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.558943 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 202fa208bd5c4307aaa9589effb21dcd (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:29.560727 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202fa208bd5c4307aaa9589effb21dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.564867 23833 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:29.565514 23833 ts_tablet_manager.cc:1403] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.004s
I20260709 13:07:29.569087 23833 raft_consensus.cc:359] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.569949 23833 raft_consensus.cc:385] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.569464 23831 raft_consensus.cc:359] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.570762 23831 raft_consensus.cc:385] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.571169 23831 raft_consensus.cc:740] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.572055 23831 consensus_queue.cc:260] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.572445 23770 tablet_service.cc:1511] Processing CreateTablet for tablet 6a112ab003b24103ae2a7b922dc31f3d (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:29.584754 23770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a112ab003b24103ae2a7b922dc31f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.576870 23832 tablet_bootstrap.cc:654] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.598878 23552 tablet_service.cc:1511] Processing CreateTablet for tablet 82de114cc0774d5d8ca8d4cd0d87972b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:29.600400 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82de114cc0774d5d8ca8d4cd0d87972b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.577075 23836 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:29.601639 23836 ts_tablet_manager.cc:1403] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.218s	user 0.008s	sys 0.006s
I20260709 13:07:29.570333 23833 raft_consensus.cc:740] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.603838 23833 consensus_queue.cc:260] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.605014 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 871dc3bda4c344b9bd080bf3fae3d085 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:29.606602 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871dc3bda4c344b9bd080bf3fae3d085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.611485 23836 raft_consensus.cc:359] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:29.612454 23836 raft_consensus.cc:385] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.612785 23836 raft_consensus.cc:740] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.613655 23836 consensus_queue.cc:260] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:29.574530 23831 ts_tablet_manager.cc:1434] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:07:29.617489 23831 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:29.616102 23696 tablet_service.cc:1511] Processing CreateTablet for tablet 82de114cc0774d5d8ca8d4cd0d87972b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:29.622478 23696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82de114cc0774d5d8ca8d4cd0d87972b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.628865 23550 tablet_service.cc:1511] Processing CreateTablet for tablet 871dc3bda4c344b9bd080bf3fae3d085 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:29.630353 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871dc3bda4c344b9bd080bf3fae3d085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.632748 23771 tablet_service.cc:1511] Processing CreateTablet for tablet daafd10eea854105a7b5af409dcac409 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:29.634155 23771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daafd10eea854105a7b5af409dcac409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.633159 23694 tablet_service.cc:1511] Processing CreateTablet for tablet daafd10eea854105a7b5af409dcac409 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:29.636183 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daafd10eea854105a7b5af409dcac409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.634538 23619 tablet_service.cc:1511] Processing CreateTablet for tablet 871dc3bda4c344b9bd080bf3fae3d085 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:29.639925 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 871dc3bda4c344b9bd080bf3fae3d085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.606648 23833 ts_tablet_manager.cc:1434] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.003s
I20260709 13:07:29.640563 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 82de114cc0774d5d8ca8d4cd0d87972b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:29.641369 23833 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:29.645509 23553 tablet_service.cc:1511] Processing CreateTablet for tablet daafd10eea854105a7b5af409dcac409 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:29.655447 23832 tablet_bootstrap.cc:492] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:29.655566 23838 raft_consensus.cc:493] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.649395 23620 tablet_service.cc:1511] Processing CreateTablet for tablet 61dc47e97be24944ac16d6a564a62da1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:29.656293 23832 ts_tablet_manager.cc:1403] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.007s
I20260709 13:07:29.656340 23838 raft_consensus.cc:515] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.657390 23620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61dc47e97be24944ac16d6a564a62da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.659343 23838 leader_election.cc:290] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:29.661048 23701 tablet_service.cc:1511] Processing CreateTablet for tablet 61dc47e97be24944ac16d6a564a62da1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:29.662665 23701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61dc47e97be24944ac16d6a564a62da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.656462 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet daafd10eea854105a7b5af409dcac409. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.669179 23833 tablet_bootstrap.cc:654] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.671609 23773 tablet_service.cc:1511] Processing CreateTablet for tablet 61dc47e97be24944ac16d6a564a62da1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:29.673247 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61dc47e97be24944ac16d6a564a62da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.683746 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82de114cc0774d5d8ca8d4cd0d87972b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.687243 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 0bfaaac6cef24fd9837185a2710b1823 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:29.688745 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bfaaac6cef24fd9837185a2710b1823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.690058 23840 raft_consensus.cc:493] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.690671 23840 raft_consensus.cc:515] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:29.693701 23840 leader_election.cc:290] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:29.709709 23832 raft_consensus.cc:359] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:29.710942 23832 raft_consensus.cc:385] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.711444 23832 raft_consensus.cc:740] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.725653 23625 tablet_service.cc:1511] Processing CreateTablet for tablet 0bfaaac6cef24fd9837185a2710b1823 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:29.729676 23836 ts_tablet_manager.cc:1434] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.128s	user 0.005s	sys 0.004s
I20260709 13:07:29.730778 23698 tablet_service.cc:1511] Processing CreateTablet for tablet 0bfaaac6cef24fd9837185a2710b1823 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:29.732188 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bfaaac6cef24fd9837185a2710b1823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.735108 23625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bfaaac6cef24fd9837185a2710b1823. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.712574 23832 consensus_queue.cc:260] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:29.742471 23836 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:29.744328 23771 tablet_service.cc:1511] Processing CreateTablet for tablet ce9adf205be04005b843fa29a8aa6cbe (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:29.760366 23771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9adf205be04005b843fa29a8aa6cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.752463 23547 tablet_service.cc:1511] Processing CreateTablet for tablet ce9adf205be04005b843fa29a8aa6cbe (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:29.762710 23832 ts_tablet_manager.cc:1434] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.002s
I20260709 13:07:29.764079 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9adf205be04005b843fa29a8aa6cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.764426 23832 tablet_bootstrap.cc:492] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:29.767325 23850 raft_consensus.cc:493] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.767871 23850 raft_consensus.cc:515] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:29.770648 23850 leader_election.cc:290] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:29.754771 23621 tablet_service.cc:1511] Processing CreateTablet for tablet ce9adf205be04005b843fa29a8aa6cbe (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:29.757720 23831 tablet_bootstrap.cc:654] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.795941 23621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9adf205be04005b843fa29a8aa6cbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.800012 23699 tablet_service.cc:1511] Processing CreateTablet for tablet dedb6c9f912b48b1aaac6a3b8947e308 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:29.801470 23699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dedb6c9f912b48b1aaac6a3b8947e308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.808681 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1be00bf028b40acabfa2fcad430301d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:29.809458 23836 tablet_bootstrap.cc:654] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.809536 23563 raft_consensus.cc:2468] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:29.812067 23775 tablet_service.cc:1511] Processing CreateTablet for tablet dedb6c9f912b48b1aaac6a3b8947e308 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:29.813612 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dedb6c9f912b48b1aaac6a3b8947e308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.812233 23751 leader_election.cc:304] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:29.815626 23838 raft_consensus.cc:2804] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.816035 23838 raft_consensus.cc:493] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.816272 23839 raft_consensus.cc:493] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.816406 23838 raft_consensus.cc:3060] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.817073 23839 raft_consensus.cc:515] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.830505 23832 tablet_bootstrap.cc:654] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.843534 23622 tablet_service.cc:1511] Processing CreateTablet for tablet 28355fbc03cd49a9aa2080b53afbd142 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:29.844873 23833 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:29.844740 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:29.852890 23833 ts_tablet_manager.cc:1403] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.005s
I20260709 13:07:29.855494 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28355fbc03cd49a9aa2080b53afbd142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.849573 23839 leader_election.cc:290] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:29.878546 23698 tablet_service.cc:1511] Processing CreateTablet for tablet 28355fbc03cd49a9aa2080b53afbd142 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:29.883697 23550 tablet_service.cc:1511] Processing CreateTablet for tablet dedb6c9f912b48b1aaac6a3b8947e308 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:29.885514 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dedb6c9f912b48b1aaac6a3b8947e308. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.887820 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28355fbc03cd49a9aa2080b53afbd142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:29.896584 23839 raft_consensus.cc:493] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.897392 23839 raft_consensus.cc:515] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:29.842286 23838 raft_consensus.cc:515] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.946730 23773 tablet_service.cc:1511] Processing CreateTablet for tablet 28355fbc03cd49a9aa2080b53afbd142 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:29.947712 23831 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:29.948256 23831 ts_tablet_manager.cc:1403] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.331s	user 0.021s	sys 0.002s
I20260709 13:07:29.948312 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28355fbc03cd49a9aa2080b53afbd142. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:29.966988 23447 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 77408.3us
I20260709 13:07:29.968588 23832 tablet_bootstrap.cc:492] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:29.969192 23832 ts_tablet_manager.cc:1403] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.205s	user 0.012s	sys 0.002s
I20260709 13:07:29.971474 23859 raft_consensus.cc:493] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.972072 23859 raft_consensus.cc:515] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:29.968683 23831 raft_consensus.cc:359] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:29.973901 23831 raft_consensus.cc:385] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.974223 23831 raft_consensus.cc:740] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.980302 23833 raft_consensus.cc:359] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:29.980859 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:29.981314 23833 raft_consensus.cc:385] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.981670 23833 raft_consensus.cc:740] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
W20260709 13:07:29.982957 23751 leader_election.cc:343] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:29.991344 23528 leader_election.cc:343] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.989993 23838 leader_election.cc:290] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:29.992803 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1be00bf028b40acabfa2fcad430301d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:29.993429 23563 raft_consensus.cc:3060] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.994477 23839 leader_election.cc:290] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:29.982456 23833 consensus_queue.cc:260] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:29.988075 23859 leader_election.cc:290] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:29.996642 23831 consensus_queue.cc:260] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.003819 23831 ts_tablet_manager.cc:1434] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.004s
W20260709 13:07:30.016731 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:30.017694 23831 tablet_bootstrap.cc:492] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:30.020681 23771 tablet_service.cc:1511] Processing CreateTablet for tablet 6ecbdd1056594932b785458e6cd595c3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:30.022173 23771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ecbdd1056594932b785458e6cd595c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.022001 23620 tablet_service.cc:1511] Processing CreateTablet for tablet e8de4fb2abe04956b7c4ecb7e8c66e15 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:30.007470 23839 raft_consensus.cc:493] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.035109 23839 raft_consensus.cc:515] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.035960 23620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8de4fb2abe04956b7c4ecb7e8c66e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.037542 23839 leader_election.cc:290] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:30.009021 23832 raft_consensus.cc:359] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.012863 23546 tablet_service.cc:1511] Processing CreateTablet for tablet e8de4fb2abe04956b7c4ecb7e8c66e15 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:30.038209 23832 raft_consensus.cc:385] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.038574 23832 raft_consensus.cc:740] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.039077 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8de4fb2abe04956b7c4ecb7e8c66e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.039557 23832 consensus_queue.cc:260] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.013871 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:30.043728 23527 leader_election.cc:343] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.044210 23527 leader_election.cc:304] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:30.045336 23832 ts_tablet_manager.cc:1434] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.003s
I20260709 13:07:30.045472 23840 raft_consensus.cc:2749] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.046514 23832 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:30.024777 23859 raft_consensus.cc:493] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.047063 23859 raft_consensus.cc:515] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.028213 23699 tablet_service.cc:1511] Processing CreateTablet for tablet e8de4fb2abe04956b7c4ecb7e8c66e15 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:30.048815 23547 tablet_service.cc:1511] Processing CreateTablet for tablet 6ecbdd1056594932b785458e6cd595c3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:30.055753 23831 tablet_bootstrap.cc:654] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.056491 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ecbdd1056594932b785458e6cd595c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.057691 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:30.050273 23701 tablet_service.cc:1511] Processing CreateTablet for tablet ec1ae450a6974af090cea14009c262d2 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:30.050338 23621 tablet_service.cc:1511] Processing CreateTablet for tablet 6ecbdd1056594932b785458e6cd595c3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:30.054669 23840 raft_consensus.cc:493] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.059464 23701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1ae450a6974af090cea14009c262d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.059237 23840 raft_consensus.cc:515] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.006950 23833 ts_tablet_manager.cc:1434] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.144s	user 0.004s	sys 0.009s
I20260709 13:07:30.059464 23621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ecbdd1056594932b785458e6cd595c3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:30.069279 23751 leader_election.cc:343] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.076157 23773 tablet_service.cc:1511] Processing CreateTablet for tablet ec1ae450a6974af090cea14009c262d2 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:30.077562 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1ae450a6974af090cea14009c262d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.082573 23833 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:30.083320 23859 leader_election.cc:290] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:30.085008 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:30.086410 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:30.088239 23603 leader_election.cc:343] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:30.088968 23603 leader_election.cc:343] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.095112 23840 leader_election.cc:290] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:30.099444 23699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8de4fb2abe04956b7c4ecb7e8c66e15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.100137 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:30.100828 23786 raft_consensus.cc:2468] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:30.101013 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:30.102957 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db2b37fa4a42eca168f8bcfda497a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:30.106081 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 85de537a84e841488dfe245e698eab3a (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:07:30.103071 23528 leader_election.cc:343] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.107451 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85de537a84e841488dfe245e698eab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.108081 23602 leader_election.cc:304] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:30.109006 23839 raft_consensus.cc:2804] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.109364 23839 raft_consensus.cc:493] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.109740 23839 raft_consensus.cc:3060] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.112780 23553 tablet_service.cc:1511] Processing CreateTablet for tablet 6641b8962e66467ba062e7c2b419d873 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:30.113497 23696 tablet_service.cc:1511] Processing CreateTablet for tablet 6641b8962e66467ba062e7c2b419d873 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:30.114200 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6641b8962e66467ba062e7c2b419d873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.114851 23696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6641b8962e66467ba062e7c2b419d873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.115767 23563 raft_consensus.cc:2468] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:30.116097 23552 tablet_service.cc:1511] Processing CreateTablet for tablet 42d42bf20cfb4ca3a1c99680e76288b1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:30.117154 23751 leader_election.cc:304] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:30.118057 23859 raft_consensus.cc:2804] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.118521 23859 raft_consensus.cc:697] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:30.119524 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 42d42bf20cfb4ca3a1c99680e76288b1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:30.117398 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d42bf20cfb4ca3a1c99680e76288b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.120800 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d42bf20cfb4ca3a1c99680e76288b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.120802 23769 tablet_service.cc:1511] Processing CreateTablet for tablet 42d42bf20cfb4ca3a1c99680e76288b1 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:30.124481 23769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42d42bf20cfb4ca3a1c99680e76288b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.119408 23859 consensus_queue.cc:237] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.143383 23625 tablet_service.cc:1511] Processing CreateTablet for tablet 85de537a84e841488dfe245e698eab3a (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:30.144340 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:30.144855 23625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85de537a84e841488dfe245e698eab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.148960 23696 tablet_service.cc:1511] Processing CreateTablet for tablet 5a142d068a8e4383af2a8ec2986b9c06 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:07:30.151281 23528 leader_election.cc:343] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.157326 23528 leader_election.cc:304] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:30.158545 23840 raft_consensus.cc:2749] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.104028 23770 tablet_service.cc:1511] Processing CreateTablet for tablet 85de537a84e841488dfe245e698eab3a (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:30.160112 23770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85de537a84e841488dfe245e698eab3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.152534 23550 tablet_service.cc:1511] Processing CreateTablet for tablet ec1ae450a6974af090cea14009c262d2 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:30.162438 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec1ae450a6974af090cea14009c262d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.152770 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:30.153657 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:30.166711 23751 leader_election.cc:343] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.167235 23751 leader_election.cc:304] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:30.168437 23838 raft_consensus.cc:2749] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.168927 23832 tablet_bootstrap.cc:654] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.171222 23839 raft_consensus.cc:515] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.172827 23638 raft_consensus.cc:2393] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fdf2efb58be4c0c9cbc722e57a73975 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:30.176517 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1be00bf028b40acabfa2fcad430301d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:30.177237 23751 leader_election.cc:304] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:30.177634 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:30.177937 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1be00bf028b40acabfa2fcad430301d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:30.178434 23838 raft_consensus.cc:3060] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:30.179697 23677 leader_election.cc:343] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:30.180509 23751 leader_election.cc:343] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:30.183894 23602 leader_election.cc:343] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:30.185813 23751 leader_election.cc:343] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.159767 23619 tablet_service.cc:1511] Processing CreateTablet for tablet 6641b8962e66467ba062e7c2b419d873 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:30.197293 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6641b8962e66467ba062e7c2b419d873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.199303 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:30.200918 23677 leader_election.cc:343] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.201400 23677 leader_election.cc:304] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:30.202311 23850 raft_consensus.cc:2749] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.193274 23696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a142d068a8e4383af2a8ec2986b9c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.210664 23839 leader_election.cc:290] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:30.212038 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:30.213331 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
W20260709 13:07:30.225266 23603 leader_election.cc:343] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.228992 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 5a142d068a8e4383af2a8ec2986b9c06 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:30.229856 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db2b37fa4a42eca168f8bcfda497a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:30.230455 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a142d068a8e4383af2a8ec2986b9c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.233060 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:30.234313 23603 leader_election.cc:343] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.234819 23603 leader_election.cc:304] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
W20260709 13:07:30.236716 23603 leader_election.cc:343] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.236927 23774 tablet_service.cc:1511] Processing CreateTablet for tablet 30353e6381ee498baaa0333b4b016c28 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:30.237236 23603 leader_election.cc:304] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:30.238440 23774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30353e6381ee498baaa0333b4b016c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.238368 23866 raft_consensus.cc:2749] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.239355 23866 raft_consensus.cc:2749] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.239238 23460 catalog_manager.cc:5697] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.241649 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 5a142d068a8e4383af2a8ec2986b9c06 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:30.242972 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a142d068a8e4383af2a8ec2986b9c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.244400 23838 raft_consensus.cc:2749] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.234606 23622 tablet_service.cc:1511] Processing CreateTablet for tablet 30353e6381ee498baaa0333b4b016c28 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:30.245811 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30353e6381ee498baaa0333b4b016c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.246209 23698 tablet_service.cc:1511] Processing CreateTablet for tablet 30353e6381ee498baaa0333b4b016c28 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:30.225579 23833 tablet_bootstrap.cc:654] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.250175 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30353e6381ee498baaa0333b4b016c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.255462 23785 raft_consensus.cc:2468] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:30.257089 23831 tablet_bootstrap.cc:492] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:30.257980 23602 leader_election.cc:304] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:30.259392 23831 ts_tablet_manager.cc:1403] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.009s
I20260709 13:07:30.262640 23836 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:30.259922 23839 raft_consensus.cc:2804] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.264338 23839 raft_consensus.cc:697] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:30.265298 23839 consensus_queue.cc:237] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.270025 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 4db0967cdcf34bd1a951b3e732ba51ae (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:30.271451 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db0967cdcf34bd1a951b3e732ba51ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.272949 23836 ts_tablet_manager.cc:1403] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.531s	user 0.018s	sys 0.018s
I20260709 13:07:30.273411 23626 tablet_service.cc:1511] Processing CreateTablet for tablet 4db0967cdcf34bd1a951b3e732ba51ae (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:30.275471 23626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db0967cdcf34bd1a951b3e732ba51ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.307627 23831 raft_consensus.cc:359] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.308526 23831 raft_consensus.cc:385] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.309015 23831 raft_consensus.cc:740] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.309747 23693 tablet_service.cc:1511] Processing CreateTablet for tablet 4db0967cdcf34bd1a951b3e732ba51ae (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:30.316202 23553 tablet_service.cc:1511] Processing CreateTablet for tablet 56fd318ba74c4199a62e26d48ff01f46 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:30.316222 23621 tablet_service.cc:1511] Processing CreateTablet for tablet 56fd318ba74c4199a62e26d48ff01f46 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:30.318066 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fd318ba74c4199a62e26d48ff01f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.318158 23621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fd318ba74c4199a62e26d48ff01f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.319221 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db0967cdcf34bd1a951b3e732ba51ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.309938 23831 consensus_queue.cc:260] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.336052 23770 tablet_service.cc:1511] Processing CreateTablet for tablet 56fd318ba74c4199a62e26d48ff01f46 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:30.337407 23770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fd318ba74c4199a62e26d48ff01f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.339241 23700 tablet_service.cc:1511] Processing CreateTablet for tablet 0870de63fd864cf8b6cd8448ac80634b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:30.340683 23700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0870de63fd864cf8b6cd8448ac80634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.340289 23836 raft_consensus.cc:359] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.341118 23836 raft_consensus.cc:385] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.341431 23836 raft_consensus.cc:740] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.342144 23836 consensus_queue.cc:260] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.344312 23836 ts_tablet_manager.cc:1434] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:07:30.346493 23831 ts_tablet_manager.cc:1434] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:07:30.353739 23836 tablet_bootstrap.cc:492] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:30.372723 23550 tablet_service.cc:1511] Processing CreateTablet for tablet 0870de63fd864cf8b6cd8448ac80634b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:30.374194 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0870de63fd864cf8b6cd8448ac80634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.374382 23461 catalog_manager.cc:5697] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.375233 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 037f0f88df364595893585d30b8a23e0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:30.375280 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 037f0f88df364595893585d30b8a23e0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:30.376907 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037f0f88df364595893585d30b8a23e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.377359 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037f0f88df364595893585d30b8a23e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.385667 23833 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:30.386250 23833 ts_tablet_manager.cc:1403] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.304s	user 0.010s	sys 0.007s
I20260709 13:07:30.390372 23833 raft_consensus.cc:359] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.391292 23833 raft_consensus.cc:385] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.391724 23833 raft_consensus.cc:740] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.375991 23832 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:30.399524 23832 ts_tablet_manager.cc:1403] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.353s	user 0.017s	sys 0.002s
I20260709 13:07:30.399320 23833 consensus_queue.cc:260] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.399945 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 0870de63fd864cf8b6cd8448ac80634b (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:30.406590 23547 tablet_service.cc:1511] Processing CreateTablet for tablet b4df4d5bfaa14060b865c3d19e9fa828 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:30.407897 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4df4d5bfaa14060b865c3d19e9fa828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.410148 23773 tablet_service.cc:1511] Processing CreateTablet for tablet e719beac9bca41db843477aa2eabb1a0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:30.410166 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0870de63fd864cf8b6cd8448ac80634b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.412524 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e719beac9bca41db843477aa2eabb1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.414518 23552 tablet_service.cc:1511] Processing CreateTablet for tablet e719beac9bca41db843477aa2eabb1a0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:30.402665 23832 raft_consensus.cc:359] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.415541 23832 raft_consensus.cc:385] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.415859 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e719beac9bca41db843477aa2eabb1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.415860 23832 raft_consensus.cc:740] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.418737 23832 consensus_queue.cc:260] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.419821 23833 ts_tablet_manager.cc:1434] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:07:30.421010 23832 ts_tablet_manager.cc:1434] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:07:30.422137 23832 tablet_bootstrap.cc:492] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:30.410148 23769 tablet_service.cc:1511] Processing CreateTablet for tablet 037f0f88df364595893585d30b8a23e0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:30.423910 23769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 037f0f88df364595893585d30b8a23e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.429828 23836 tablet_bootstrap.cc:654] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.431051 23833 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:30.436136 23626 tablet_service.cc:1511] Processing CreateTablet for tablet b4df4d5bfaa14060b865c3d19e9fa828 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:30.437620 23626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4df4d5bfaa14060b865c3d19e9fa828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.364084 23831 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:30.444113 23619 tablet_service.cc:1511] Processing CreateTablet for tablet e719beac9bca41db843477aa2eabb1a0 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:30.450382 23699 tablet_service.cc:1511] Processing CreateTablet for tablet 0641dafd5a7041a0b0d2cfebe0b4306e (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:30.451584 23773 tablet_service.cc:1511] Processing CreateTablet for tablet 0641dafd5a7041a0b0d2cfebe0b4306e (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:30.452935 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0641dafd5a7041a0b0d2cfebe0b4306e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.453718 23833 tablet_bootstrap.cc:654] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.442538 23696 tablet_service.cc:1511] Processing CreateTablet for tablet b4df4d5bfaa14060b865c3d19e9fa828 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:30.458715 23831 tablet_bootstrap.cc:654] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.462790 23619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e719beac9bca41db843477aa2eabb1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.463248 23699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0641dafd5a7041a0b0d2cfebe0b4306e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.466984 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 934afa29ceb24bb8a35260dfb5e22e6a (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:30.468318 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 934afa29ceb24bb8a35260dfb5e22e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.475966 23698 tablet_service.cc:1511] Processing CreateTablet for tablet 934afa29ceb24bb8a35260dfb5e22e6a (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:30.480847 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 934afa29ceb24bb8a35260dfb5e22e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.486312 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 0641dafd5a7041a0b0d2cfebe0b4306e (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:30.488780 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0641dafd5a7041a0b0d2cfebe0b4306e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.489598 23833 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:30.490191 23833 ts_tablet_manager.cc:1403] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.002s
I20260709 13:07:30.491685 23839 raft_consensus.cc:493] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.492192 23839 raft_consensus.cc:515] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.494269 23839 leader_election.cc:290] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:30.494382 23833 raft_consensus.cc:359] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.495416 23833 raft_consensus.cc:385] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.495798 23833 raft_consensus.cc:740] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.500257 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4f5b98e071431492a1a258fddd2ef3" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:30.500381 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4f5b98e071431492a1a258fddd2ef3" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:30.502076 23603 leader_election.cc:343] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:30.504232 23602 leader_election.cc:343] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.504700 23602 leader_election.cc:304] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:30.506878 23850 raft_consensus.cc:493] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.507411 23850 raft_consensus.cc:515] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.509482 23850 leader_election.cc:290] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:30.509922 23839 raft_consensus.cc:2749] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.510160 23622 tablet_service.cc:1511] Processing CreateTablet for tablet 934afa29ceb24bb8a35260dfb5e22e6a (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:30.510661 23838 consensus_queue.cc:1048] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:30.518280 23833 consensus_queue.cc:260] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.518867 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f090d4df44ad48388a56df9972462932" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:30.519214 23696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4df4d5bfaa14060b865c3d19e9fa828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.519582 23621 tablet_service.cc:1511] Processing CreateTablet for tablet ada29c39e396475e91dfcfdc5a412adc (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:30.527247 23836 tablet_bootstrap.cc:492] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:30.527871 23836 ts_tablet_manager.cc:1403] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.004s
W20260709 13:07:30.532989 23677 leader_election.cc:343] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.533775 23621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada29c39e396475e91dfcfdc5a412adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.534665 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 934afa29ceb24bb8a35260dfb5e22e6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.534655 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f090d4df44ad48388a56df9972462932" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:30.538777 23700 tablet_service.cc:1511] Processing CreateTablet for tablet ada29c39e396475e91dfcfdc5a412adc (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:30.539520 23831 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:30.540017 23831 ts_tablet_manager.cc:1403] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.002s
I20260709 13:07:30.540153 23700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada29c39e396475e91dfcfdc5a412adc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:30.543869 23677 leader_election.cc:343] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.543252 23831 raft_consensus.cc:359] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.534205 23836 raft_consensus.cc:359] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.550256 23832 tablet_bootstrap.cc:654] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.557008 23552 tablet_service.cc:1511] Processing CreateTablet for tablet 9208e7a4c72e41c9bd0a231c9f25ecbf (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:30.562809 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 43f58740da23409abe43f3768bfac6e3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:30.564360 23552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9208e7a4c72e41c9bd0a231c9f25ecbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.565066 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f58740da23409abe43f3768bfac6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.544349 23677 leader_election.cc:304] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:30.567569 23850 raft_consensus.cc:2749] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.551851 23769 tablet_service.cc:1511] Processing CreateTablet for tablet 9208e7a4c72e41c9bd0a231c9f25ecbf (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:30.567852 23773 tablet_service.cc:1511] Processing CreateTablet for tablet 43f58740da23409abe43f3768bfac6e3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:30.568997 23769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9208e7a4c72e41c9bd0a231c9f25ecbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.569576 23773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f58740da23409abe43f3768bfac6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.551937 23831 raft_consensus.cc:385] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.573107 23627 tablet_service.cc:1511] Processing CreateTablet for tablet 9208e7a4c72e41c9bd0a231c9f25ecbf (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:30.574378 23627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9208e7a4c72e41c9bd0a231c9f25ecbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.579126 23831 raft_consensus.cc:740] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.580075 23831 consensus_queue.cc:260] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.582507 23831 ts_tablet_manager.cc:1434] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:07:30.590569 23693 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9c72ca943445cbb12a3eaaa3989ef6 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:30.590996 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9c72ca943445cbb12a3eaaa3989ef6 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:30.592013 23693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9c72ca943445cbb12a3eaaa3989ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.592147 23833 ts_tablet_manager.cc:1434] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.000s
I20260709 13:07:30.592023 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9c72ca943445cbb12a3eaaa3989ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.592311 23838 raft_consensus.cc:493] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.594192 23838 raft_consensus.cc:515] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.595213 23626 tablet_service.cc:1511] Processing CreateTablet for tablet 9a9c72ca943445cbb12a3eaaa3989ef6 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:30.595396 23545 tablet_service.cc:1511] Processing CreateTablet for tablet ada29c39e396475e91dfcfdc5a412adc (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:30.596447 23838 leader_election.cc:290] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:30.596652 23626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a9c72ca943445cbb12a3eaaa3989ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.599094 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db2b37fa4a42eca168f8bcfda497a0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:30.599797 23638 raft_consensus.cc:2468] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:30.600853 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db2b37fa4a42eca168f8bcfda497a0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:30.602133 23751 leader_election.cc:304] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:30.602259 23550 tablet_service.cc:1511] Processing CreateTablet for tablet 62d63b259d0c43e8bfb2c9f89cfa8e86 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:30.602694 23547 tablet_service.cc:1511] Processing CreateTablet for tablet 43f58740da23409abe43f3768bfac6e3 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:30.603163 23838 raft_consensus.cc:2804] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.603581 23838 raft_consensus.cc:493] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.603937 23838 raft_consensus.cc:3060] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.596793 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ada29c39e396475e91dfcfdc5a412adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.558845 23836 raft_consensus.cc:385] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.599370 23831 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:30.623277 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43f58740da23409abe43f3768bfac6e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.624027 23550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d63b259d0c43e8bfb2c9f89cfa8e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.609862 23836 raft_consensus.cc:740] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.626855 23836 consensus_queue.cc:260] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.633538 23833 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:30.636961 23836 ts_tablet_manager.cc:1434] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.000s
I20260709 13:07:30.632861 23831 tablet_bootstrap.cc:654] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.635690 23711 raft_consensus.cc:2468] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:30.687098 23832 tablet_bootstrap.cc:492] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:30.636425 23694 tablet_service.cc:1511] Processing CreateTablet for tablet 62d63b259d0c43e8bfb2c9f89cfa8e86 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:30.639976 23621 tablet_service.cc:1511] Processing CreateTablet for tablet 62d63b259d0c43e8bfb2c9f89cfa8e86 (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:30.687652 23832 ts_tablet_manager.cc:1403] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.266s	user 0.013s	sys 0.003s
I20260709 13:07:30.695232 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 47b6e1ada0a04d7990b4fd562dd4cc7f (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:30.701392 23694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d63b259d0c43e8bfb2c9f89cfa8e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.701732 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b6e1ada0a04d7990b4fd562dd4cc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.703176 23622 tablet_service.cc:1511] Processing CreateTablet for tablet 47b6e1ada0a04d7990b4fd562dd4cc7f (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:30.704030 23832 raft_consensus.cc:359] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.704862 23832 raft_consensus.cc:385] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.705243 23832 raft_consensus.cc:740] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.697942 23770 tablet_service.cc:1511] Processing CreateTablet for tablet 2188519be6684f4b8f46b07846fba5ab (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:30.696214 23553 tablet_service.cc:1511] Processing CreateTablet for tablet 2188519be6684f4b8f46b07846fba5ab (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:30.689699 23775 tablet_service.cc:1511] Processing CreateTablet for tablet 47b6e1ada0a04d7990b4fd562dd4cc7f (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:30.710435 23775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b6e1ada0a04d7990b4fd562dd4cc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.712610 23553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2188519be6684f4b8f46b07846fba5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.715806 23832 consensus_queue.cc:260] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
W20260709 13:07:30.720593 23751 consensus_peers.cc:597] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:30.720993 23832 ts_tablet_manager.cc:1434] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:07:30.710431 23836 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:30.731914 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b6e1ada0a04d7990b4fd562dd4cc7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.732847 23833 tablet_bootstrap.cc:654] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.735675 23621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62d63b259d0c43e8bfb2c9f89cfa8e86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.736600 23832 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:30.740267 23698 tablet_service.cc:1511] Processing CreateTablet for tablet 2188519be6684f4b8f46b07846fba5ab (DEFAULT_TABLE table=test-workload [id=e5dcbfea8830402d96b238ec5ede9fef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:30.742210 23698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2188519be6684f4b8f46b07846fba5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.743988 23770 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2188519be6684f4b8f46b07846fba5ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.745973 23840 raft_consensus.cc:493] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.746481 23840 raft_consensus.cc:515] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.748553 23840 leader_election.cc:290] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:30.738646 23838 raft_consensus.cc:515] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.758667 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883d3fdac6bf46478c2f6999beaa7fb0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:30.759400 23446 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 45485.3us
I20260709 13:07:30.759830 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db2b37fa4a42eca168f8bcfda497a0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:30.759997 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883d3fdac6bf46478c2f6999beaa7fb0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:30.760430 23712 raft_consensus.cc:3060] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.759093 23838 leader_election.cc:290] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:30.751207 23832 tablet_bootstrap.cc:654] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:30.767490 23528 leader_election.cc:343] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:30.773108 23527 leader_election.cc:343] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.775399 23527 leader_election.cc:304] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:30.767056 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6db2b37fa4a42eca168f8bcfda497a0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:30.776280 23840 raft_consensus.cc:2749] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.776445 23638 raft_consensus.cc:3060] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.781185 23839 consensus_queue.cc:1048] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:30.787947 23712 raft_consensus.cc:2468] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:30.771773 23836 tablet_bootstrap.cc:654] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.798743 23839 raft_consensus.cc:493] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.799336 23839 raft_consensus.cc:515] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.808856 23839 leader_election.cc:290] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:30.809589 23831 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:30.810215 23831 ts_tablet_manager.cc:1403] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.211s	user 0.014s	sys 0.017s
I20260709 13:07:30.810981 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:30.811434 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:30.812143 23786 raft_consensus.cc:2468] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:30.810232 23751 leader_election.cc:304] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:30.813520 23602 leader_election.cc:304] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:30.814374 23839 raft_consensus.cc:2804] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.814755 23839 raft_consensus.cc:493] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.815095 23839 raft_consensus.cc:3060] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:30.815979 23603 leader_election.cc:343] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.818300 23838 raft_consensus.cc:2804] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.818830 23838 raft_consensus.cc:697] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:30.819888 23838 consensus_queue.cc:237] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.822829 23831 raft_consensus.cc:359] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.829319 23638 raft_consensus.cc:2468] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:30.829380 23831 raft_consensus.cc:385] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.837999 23831 raft_consensus.cc:740] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.840260 23831 consensus_queue.cc:260] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.843458 23882 raft_consensus.cc:493] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.844048 23882 raft_consensus.cc:515] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.845261 23836 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:30.845784 23836 ts_tablet_manager.cc:1403] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.163s	user 0.010s	sys 0.005s
I20260709 13:07:30.846150 23882 leader_election.cc:290] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:30.843559 23831 ts_tablet_manager.cc:1434] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.005s
I20260709 13:07:30.848803 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:30.851836 23751 leader_election.cc:343] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.855520 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:30.855849 23831 tablet_bootstrap.cc:492] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:30.856717 23836 raft_consensus.cc:359] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.857467 23836 raft_consensus.cc:385] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.857764 23836 raft_consensus.cc:740] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.860481 23832 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:30.861083 23832 ts_tablet_manager.cc:1403] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.125s	user 0.020s	sys 0.011s
I20260709 13:07:30.863757 23831 tablet_bootstrap.cc:654] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.863013 23459 catalog_manager.cc:5697] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:30.863837 23751 leader_election.cc:343] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.864573 23751 leader_election.cc:304] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:30.864490 23832 raft_consensus.cc:359] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.865540 23882 raft_consensus.cc:2749] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.867954 23833 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:30.868674 23833 ts_tablet_manager.cc:1403] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.235s	user 0.020s	sys 0.017s
I20260709 13:07:30.871769 23839 raft_consensus.cc:515] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.865592 23832 raft_consensus.cc:385] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.874998 23832 raft_consensus.cc:740] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.876024 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:30.876317 23832 consensus_queue.cc:260] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.877267 23785 raft_consensus.cc:3060] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.880507 23839 leader_election.cc:290] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:30.882128 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:30.883502 23836 consensus_queue.cc:260] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:30.882124 23833 raft_consensus.cc:359] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.885172 23833 raft_consensus.cc:385] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:30.885527 23603 leader_election.cc:343] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.885776 23838 raft_consensus.cc:493] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.886399 23838 raft_consensus.cc:515] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.888465 23832 ts_tablet_manager.cc:1434] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 13:07:30.888589 23838 leader_election.cc:290] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:30.891058 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:30.891737 23563 raft_consensus.cc:2468] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:30.891600 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:30.893146 23751 leader_election.cc:304] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
W20260709 13:07:30.894178 23751 leader_election.cc:343] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.895058 23838 raft_consensus.cc:2804] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.895479 23838 raft_consensus.cc:493] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.895833 23838 raft_consensus.cc:3060] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.885550 23833 raft_consensus.cc:740] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.901567 23785 raft_consensus.cc:2468] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:30.903424 23602 leader_election.cc:304] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:30.900422 23833 consensus_queue.cc:260] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:30.907754 23833 ts_tablet_manager.cc:1434] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.002s
I20260709 13:07:30.902845 23838 raft_consensus.cc:515] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.920353 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:30.920946 23563 raft_consensus.cc:3060] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.914860 23836 ts_tablet_manager.cc:1434] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.002s
W20260709 13:07:30.915588 23603 consensus_peers.cc:597] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:30.916730 23832 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:30.928422 23563 raft_consensus.cc:2468] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:30.917368 23895 raft_consensus.cc:2804] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.929550 23751 leader_election.cc:304] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:30.930084 23895 raft_consensus.cc:697] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:30.930481 23882 raft_consensus.cc:2804] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.929265 23833 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:30.930976 23882 raft_consensus.cc:697] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:30.931888 23882 consensus_queue.cc:237] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.937153 23838 leader_election.cc:290] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:30.938428 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
W20260709 13:07:30.940326 23751 leader_election.cc:343] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.940742 23836 tablet_bootstrap.cc:492] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:30.944154 23895 consensus_queue.cc:237] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.950572 23831 tablet_bootstrap.cc:492] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:30.951174 23831 ts_tablet_manager.cc:1403] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.010s
I20260709 13:07:30.951994 23833 tablet_bootstrap.cc:654] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.954528 23831 raft_consensus.cc:359] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.955879 23831 raft_consensus.cc:385] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.956163 23459 catalog_manager.cc:5697] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.957686 23832 tablet_bootstrap.cc:654] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.956195 23831 raft_consensus.cc:740] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.968626 23831 consensus_queue.cc:260] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:30.970904 23831 ts_tablet_manager.cc:1434] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 13:07:30.974013 23460 catalog_manager.cc:5697] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.975251 23836 tablet_bootstrap.cc:654] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.981580 23832 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:30.982388 23832 ts_tablet_manager.cc:1403] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.012s
I20260709 13:07:30.985937 23832 raft_consensus.cc:359] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.986757 23832 raft_consensus.cc:385] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.987133 23832 raft_consensus.cc:740] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.988130 23832 consensus_queue.cc:260] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:30.991093 23832 ts_tablet_manager.cc:1434] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:07:30.992549 23832 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:30.994351 23831 tablet_bootstrap.cc:492] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:31.000701 23832 tablet_bootstrap.cc:654] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.003798 23831 tablet_bootstrap.cc:654] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.004040 23833 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:31.004784 23833 ts_tablet_manager.cc:1403] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.033s
I20260709 13:07:31.007781 23895 raft_consensus.cc:493] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.008513 23895 raft_consensus.cc:515] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.009049 23833 raft_consensus.cc:359] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.010133 23833 raft_consensus.cc:385] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.010540 23833 raft_consensus.cc:740] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.011413 23895 leader_election.cc:290] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:31.012758 23840 raft_consensus.cc:493] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.013371 23840 raft_consensus.cc:515] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.013641 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.013891 23836 tablet_bootstrap.cc:492] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.014493 23836 ts_tablet_manager.cc:1403] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.076s	user 0.019s	sys 0.010s
I20260709 13:07:31.015528 23840 leader_election.cc:290] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.015823 23831 tablet_bootstrap.cc:492] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:31.016448 23831 ts_tablet_manager.cc:1403] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:07:31.016625 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "982a36e8097b4dbfb315b9527072e1aa" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:31.017570 23563 raft_consensus.cc:2393] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:31.017643 23836 raft_consensus.cc:359] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.018429 23836 raft_consensus.cc:385] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.018707 23836 raft_consensus.cc:740] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.019199 23831 raft_consensus.cc:359] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.019719 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.019469 23836 consensus_queue.cc:260] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.020001 23831 raft_consensus.cc:385] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:31.020423 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:31.021562 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.021870 23836 ts_tablet_manager.cc:1434] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
W20260709 13:07:31.022202 23528 leader_election.cc:343] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.022302 23638 raft_consensus.cc:2468] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:31.023208 23836 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:31.023589 23528 leader_election.cc:304] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:31.021581 23603 leader_election.cc:304] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:31.026046 23895 raft_consensus.cc:3060] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.030431 23836 tablet_bootstrap.cc:654] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.031343 23840 raft_consensus.cc:2804] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.031898 23840 raft_consensus.cc:493] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.032346 23840 raft_consensus.cc:3060] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.020356 23831 raft_consensus.cc:740] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.040977 23831 consensus_queue.cc:260] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.042320 23836 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.042846 23836 ts_tablet_manager.cc:1403] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:07:31.043079 23831 ts_tablet_manager.cc:1434] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:07:31.044153 23831 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:31.046052 23836 raft_consensus.cc:359] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.046794 23836 raft_consensus.cc:385] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.047189 23836 raft_consensus.cc:740] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.046947 23895 raft_consensus.cc:2749] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.049949 23831 tablet_bootstrap.cc:654] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.051433 23840 raft_consensus.cc:515] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.055353 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:31.055212 23833 consensus_queue.cc:260] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.055922 23638 raft_consensus.cc:3060] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.058578 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
W20260709 13:07:31.060009 23528 leader_election.cc:343] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.060595 23840 leader_election.cc:290] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.048158 23836 consensus_queue.cc:260] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.063428 23638 raft_consensus.cc:2468] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:31.064666 23528 leader_election.cc:304] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:31.066886 23836 ts_tablet_manager.cc:1434] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:07:31.067989 23836 tablet_bootstrap.cc:492] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:31.068434 23840 raft_consensus.cc:2804] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.068949 23840 raft_consensus.cc:697] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:31.069819 23840 consensus_queue.cc:237] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.074786 23832 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:31.075388 23832 ts_tablet_manager.cc:1403] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.083s	user 0.044s	sys 0.009s
I20260709 13:07:31.075501 23833 ts_tablet_manager.cc:1434] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 13:07:31.075690 23836 tablet_bootstrap.cc:654] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.077564 23833 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:31.078789 23832 raft_consensus.cc:359] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.079577 23832 raft_consensus.cc:385] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.079902 23832 raft_consensus.cc:740] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.080982 23832 consensus_queue.cc:260] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.081691 23831 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:31.082172 23831 ts_tablet_manager.cc:1403] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.011s
I20260709 13:07:31.082828 23836 tablet_bootstrap.cc:492] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.083333 23836 ts_tablet_manager.cc:1403] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:07:31.083366 23832 ts_tablet_manager.cc:1434] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:31.084723 23832 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:31.085000 23831 raft_consensus.cc:359] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.085705 23831 raft_consensus.cc:385] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.085979 23831 raft_consensus.cc:740] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.086457 23836 raft_consensus.cc:359] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.086653 23831 consensus_queue.cc:260] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.087239 23836 raft_consensus.cc:385] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.090055 23836 raft_consensus.cc:740] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.090968 23836 consensus_queue.cc:260] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.092187 23832 tablet_bootstrap.cc:654] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.088697 23831 ts_tablet_manager.cc:1434] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:07:31.096449 23836 ts_tablet_manager.cc:1434] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:31.097581 23836 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:31.106513 23832 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:31.107203 23832 ts_tablet_manager.cc:1403] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:07:31.108886 23836 tablet_bootstrap.cc:654] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.109891 23831 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:31.109622 23461 catalog_manager.cc:5697] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.107211 23712 raft_consensus.cc:3060] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.109936 23832 raft_consensus.cc:359] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.115022 23832 raft_consensus.cc:385] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.115345 23832 raft_consensus.cc:740] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.116074 23832 consensus_queue.cc:260] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.118105 23832 ts_tablet_manager.cc:1434] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 13:07:31.118677 23831 tablet_bootstrap.cc:654] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.121660 23832 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:31.128116 23833 tablet_bootstrap.cc:654] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.130236 23895 raft_consensus.cc:493] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.130781 23895 raft_consensus.cc:515] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.132999 23895 leader_election.cc:290] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:31.135099 23832 tablet_bootstrap.cc:654] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.138160 23836 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.138677 23836 ts_tablet_manager.cc:1403] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.011s
I20260709 13:07:31.142428 23836 raft_consensus.cc:359] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.143224 23836 raft_consensus.cc:385] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.143599 23836 raft_consensus.cc:740] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.144555 23836 consensus_queue.cc:260] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.146239 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.147282 23836 ts_tablet_manager.cc:1434] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:07:31.148674 23836 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:31.135449 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:31.153098 23603 leader_election.cc:343] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:31.154296 23602 leader_election.cc:343] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.154451 23850 raft_consensus.cc:493] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.154947 23602 leader_election.cc:304] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:31.155267 23850 raft_consensus.cc:515] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.156333 23896 raft_consensus.cc:493] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.157009 23896 raft_consensus.cc:515] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.160980 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4f5b98e071431492a1a258fddd2ef3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.161952 23638 raft_consensus.cc:2468] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:31.163776 23677 leader_election.cc:304] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:31.169296 23896 leader_election.cc:290] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:31.171005 23896 raft_consensus.cc:2749] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.172746 23850 leader_election.cc:290] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:31.175120 23850 raft_consensus.cc:2804] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.175609 23850 raft_consensus.cc:493] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.176064 23850 raft_consensus.cc:3060] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.173707 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b9ad5291bf45a1978822097056ff57" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.179467 23785 raft_consensus.cc:2468] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:31.183681 23840 raft_consensus.cc:493] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.184233 23840 raft_consensus.cc:515] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.184999 23602 leader_election.cc:304] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:31.184171 23833 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:31.186692 23833 ts_tablet_manager.cc:1403] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.002s
I20260709 13:07:31.188490 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.189172 23711 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:31.189551 23833 raft_consensus.cc:359] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.190227 23833 raft_consensus.cc:385] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.190498 23833 raft_consensus.cc:740] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.190780 23528 leader_election.cc:304] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:31.192175 23907 raft_consensus.cc:2804] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.192648 23907 raft_consensus.cc:493] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.193035 23907 raft_consensus.cc:3060] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.195267 23896 raft_consensus.cc:2804] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.195780 23896 raft_consensus.cc:493] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.196213 23896 raft_consensus.cc:3060] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.198793 23831 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:31.199479 23831 ts_tablet_manager.cc:1403] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.090s	user 0.042s	sys 0.027s
I20260709 13:07:31.200938 23833 consensus_queue.cc:260] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.203424 23831 raft_consensus.cc:359] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.204196 23831 raft_consensus.cc:385] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.204514 23831 raft_consensus.cc:740] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.205343 23831 consensus_queue.cc:260] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.186844 23840 leader_election.cc:290] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.213021 23831 ts_tablet_manager.cc:1434] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:31.214437 23831 tablet_bootstrap.cc:492] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:31.219537 23882 consensus_queue.cc:1048] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:31.225178 23907 raft_consensus.cc:515] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.220669 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.220890 23896 raft_consensus.cc:515] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
W20260709 13:07:31.229089 23677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 65449.4us
I20260709 13:07:31.239249 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b9ad5291bf45a1978822097056ff57" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.206753 23850 raft_consensus.cc:515] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.239928 23712 raft_consensus.cc:2468] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
W20260709 13:07:31.229414 23528 leader_election.cc:343] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.243909 23882 raft_consensus.cc:493] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.244442 23882 raft_consensus.cc:515] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.245334 23832 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:31.245669 23831 tablet_bootstrap.cc:654] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.245847 23832 ts_tablet_manager.cc:1403] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.124s	user 0.030s	sys 0.041s
I20260709 13:07:31.245913 23896 leader_election.cc:290] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:31.246557 23882 leader_election.cc:290] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:31.247375 23907 leader_election.cc:290] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.248505 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b9ad5291bf45a1978822097056ff57" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:31.249125 23785 raft_consensus.cc:3060] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.248885 23832 raft_consensus.cc:359] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.249639 23832 raft_consensus.cc:385] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.249938 23832 raft_consensus.cc:740] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.251137 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883d3fdac6bf46478c2f6999beaa7fb0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.251791 23712 raft_consensus.cc:2468] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:31.252080 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883d3fdac6bf46478c2f6999beaa7fb0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:31.252714 23563 raft_consensus.cc:2468] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:31.253173 23850 leader_election.cc:290] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:31.253700 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:31.254398 23836 tablet_bootstrap.cc:654] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.253767 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:31.255024 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6b9ad5291bf45a1978822097056ff57" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:31.255723 23711 raft_consensus.cc:3060] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.256790 23833 ts_tablet_manager.cc:1434] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.019s
I20260709 13:07:31.254739 23751 leader_election.cc:304] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:31.254621 23832 consensus_queue.cc:260] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.257781 23833 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:31.258637 23838 raft_consensus.cc:2804] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.260664 23638 raft_consensus.cc:3060] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.253168 23882 raft_consensus.cc:493] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.261312 23882 raft_consensus.cc:515] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.263473 23882 leader_election.cc:290] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:31.259482 23636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4f5b98e071431492a1a258fddd2ef3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:31.264055 23636 raft_consensus.cc:3060] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.267786 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4f5b98e071431492a1a258fddd2ef3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.268491 23833 tablet_bootstrap.cc:654] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.268497 23786 raft_consensus.cc:2468] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:31.269958 23896 raft_consensus.cc:493] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.270092 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f4f5b98e071431492a1a258fddd2ef3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:31.259795 23838 raft_consensus.cc:493] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.271296 23838 raft_consensus.cc:3060] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.270459 23896 raft_consensus.cc:515] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.270711 23786 raft_consensus.cc:3060] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.286243 23832 ts_tablet_manager.cc:1434] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:07:31.287299 23832 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:31.288182 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f090d4df44ad48388a56df9972462932" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:31.289122 23561 raft_consensus.cc:2468] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:31.279561 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:31.277602 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.281944 23711 raft_consensus.cc:2468] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:31.299618 23836 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.255085 23712 raft_consensus.cc:3060] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.300107 23836 ts_tablet_manager.cc:1403] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.152s	user 0.022s	sys 0.006s
I20260709 13:07:31.302591 23896 leader_election.cc:290] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.299543 23635 raft_consensus.cc:2468] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:31.310799 23896 raft_consensus.cc:493] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.311290 23832 tablet_bootstrap.cc:654] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.311328 23896 raft_consensus.cc:515] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.298506 23603 leader_election.cc:304] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:31.312659 23895 raft_consensus.cc:2804] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.313033 23895 raft_consensus.cc:493] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.313344 23895 raft_consensus.cc:3060] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.313552 23896 leader_election.cc:290] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:31.304446 23751 leader_election.cc:343] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.316115 23838 raft_consensus.cc:515] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.318157 23838 leader_election.cc:290] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:31.313287 23603 leader_election.cc:304] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:31.319762 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883d3fdac6bf46478c2f6999beaa7fb0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:31.320431 23710 raft_consensus.cc:3060] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.321548 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:31.322187 23563 raft_consensus.cc:2468] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:31.322728 23836 raft_consensus.cc:359] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.323431 23836 raft_consensus.cc:385] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.323719 23836 raft_consensus.cc:740] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.323748 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.324107 23603 leader_election.cc:304] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:31.324565 23836 consensus_queue.cc:260] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.324580 23896 raft_consensus.cc:2804] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.325778 23839 raft_consensus.cc:2804] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.326136 23839 raft_consensus.cc:493] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.326601 23836 ts_tablet_manager.cc:1434] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.000s
I20260709 13:07:31.326673 23839 raft_consensus.cc:3060] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.327131 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "883d3fdac6bf46478c2f6999beaa7fb0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:31.311743 23636 raft_consensus.cc:2468] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:31.326051 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f090d4df44ad48388a56df9972462932" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.320048 23831 tablet_bootstrap.cc:492] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:31.328188 23836 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:31.328735 23831 ts_tablet_manager.cc:1403] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.115s	user 0.023s	sys 0.016s
I20260709 13:07:31.331187 23895 raft_consensus.cc:515] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.332144 23751 leader_election.cc:304] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:31.332579 23677 leader_election.cc:304] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:31.334184 23882 raft_consensus.cc:2804] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.334561 23882 raft_consensus.cc:493] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.334872 23882 raft_consensus.cc:3060] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.335709 23850 raft_consensus.cc:2804] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.336654 23850 raft_consensus.cc:697] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:31.337517 23850 consensus_queue.cc:237] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.339397 23895 leader_election.cc:290] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.339905 23838 consensus_queue.cc:1048] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.329147 23563 raft_consensus.cc:3060] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.342348 23638 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:31.348201 23882 raft_consensus.cc:515] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.350310 23882 leader_election.cc:290] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:31.329214 23711 raft_consensus.cc:2468] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:31.350829 23920 raft_consensus.cc:493] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.351358 23920 raft_consensus.cc:515] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.353124 23786 raft_consensus.cc:2468] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:31.353523 23920 leader_election.cc:290] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:31.318904 23785 raft_consensus.cc:2468] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:31.327710 23896 raft_consensus.cc:697] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:31.355002 23831 raft_consensus.cc:359] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.355716 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:31.356173 23603 leader_election.cc:343] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.355983 23831 raft_consensus.cc:385] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.358834 23831 raft_consensus.cc:740] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.360385 23711 raft_consensus.cc:2468] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:31.360241 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f090d4df44ad48388a56df9972462932" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:31.360992 23831 consensus_queue.cc:260] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.362731 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:31.364725 23561 raft_consensus.cc:3060] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.365871 23528 leader_election.cc:304] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:31.365986 23636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:31.366633 23636 raft_consensus.cc:3060] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.366834 23920 raft_consensus.cc:2804] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.367300 23920 raft_consensus.cc:493] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.367616 23920 raft_consensus.cc:3060] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.369110 23882 consensus_queue.cc:1048] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.355867 23896 consensus_queue.cc:237] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.370570 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f090d4df44ad48388a56df9972462932" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:31.371212 23708 raft_consensus.cc:3060] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.371222 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.372406 23785 raft_consensus.cc:2468] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:31.374353 23528 leader_election.cc:304] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:31.375207 23907 raft_consensus.cc:2804] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.375763 23907 raft_consensus.cc:697] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:31.376593 23907 consensus_queue.cc:237] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:31.372349 23751 leader_election.cc:343] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.378885 23708 raft_consensus.cc:2468] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:31.380791 23833 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:31.381247 23833 ts_tablet_manager.cc:1403] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.009s
I20260709 13:07:31.374895 23839 raft_consensus.cc:515] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.387943 23831 ts_tablet_manager.cc:1434] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:07:31.388983 23831 tablet_bootstrap.cc:492] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:31.391134 23603 leader_election.cc:304] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:31.391955 23895 raft_consensus.cc:2804] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.392467 23895 raft_consensus.cc:697] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:31.393356 23895 consensus_queue.cc:237] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.383968 23710 raft_consensus.cc:2468] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:31.395552 23751 leader_election.cc:304] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:31.396356 23859 raft_consensus.cc:2804] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.383883 23882 raft_consensus.cc:493] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.403681 23882 raft_consensus.cc:515] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.401290 23920 raft_consensus.cc:515] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.402981 23833 raft_consensus.cc:359] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.430622 23833 raft_consensus.cc:385] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.431242 23833 raft_consensus.cc:740] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.438910 23561 raft_consensus.cc:2468] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:31.405138 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:31.408269 23859 raft_consensus.cc:697] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:31.445570 23833 consensus_queue.cc:260] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.408847 23838 consensus_queue.cc:1048] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:07:31.442457 23839 leader_election.cc:290] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.451865 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:31.452598 23832 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:31.453503 23859 consensus_queue.cc:237] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.459456 23561 raft_consensus.cc:3060] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.459745 23712 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:31.458778 23461 catalog_manager.cc:5697] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:31.461515 23930 log.cc:927] Time spent T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:31.461896 23833 ts_tablet_manager.cc:1434] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.004s
I20260709 13:07:31.462484 23636 raft_consensus.cc:2468] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:31.447062 23563 raft_consensus.cc:2468] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:31.462973 23836 tablet_bootstrap.cc:654] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.463665 23832 ts_tablet_manager.cc:1403] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.016s
W20260709 13:07:31.472050 23603 leader_election.cc:343] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.486272 23832 raft_consensus.cc:359] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.488161 23751 leader_election.cc:304] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:31.488890 23831 tablet_bootstrap.cc:654] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.489162 23883 raft_consensus.cc:2804] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.486944 23832 raft_consensus.cc:385] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.490489 23832 raft_consensus.cc:740] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.466781 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.466394 23459 catalog_manager.cc:5697] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.474730 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.475287 23882 leader_election.cc:290] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.476383 23850 raft_consensus.cc:493] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.480762 23833 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:31.449668 23562 raft_consensus.cc:3060] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.492753 23832 consensus_queue.cc:260] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.516309 23832 ts_tablet_manager.cc:1434] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:07:31.517131 23832 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
W20260709 13:07:31.517982 23751 leader_election.cc:343] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:31.519563 23751 leader_election.cc:343] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.519686 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:31.519985 23751 leader_election.cc:304] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:31.520292 23710 raft_consensus.cc:3060] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.520584 23836 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.521046 23836 ts_tablet_manager.cc:1403] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.193s	user 0.006s	sys 0.008s
I20260709 13:07:31.513818 23883 raft_consensus.cc:697] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:31.503355 23850 raft_consensus.cc:515] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.534915 23920 leader_election.cc:290] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:31.536088 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:31.528396 23839 consensus_queue.cc:1048] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:07:31.540413 23785 raft_consensus.cc:3060] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.542128 23935 raft_consensus.cc:2749] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.538641 23460 catalog_manager.cc:5697] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.547132 23833 tablet_bootstrap.cc:654] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.549039 23850 leader_election.cc:290] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:31.544701 23883 consensus_queue.cc:237] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.550729 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:31.550956 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.551700 23638 raft_consensus.cc:2393] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
I20260709 13:07:31.552932 23677 leader_election.cc:304] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:31.542050 23458 catalog_manager.cc:5697] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.555965 23562 raft_consensus.cc:2468] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
W20260709 13:07:31.546351 23603 consensus_peers.cc:597] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:31.557315 23603 leader_election.cc:304] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:31.558172 23839 raft_consensus.cc:2804] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.558835 23839 raft_consensus.cc:697] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:31.559799 23839 consensus_queue.cc:237] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.563344 23850 raft_consensus.cc:3060] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.578459 23832 tablet_bootstrap.cc:654] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.579510 23461 catalog_manager.cc:5697] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.589986 23850 raft_consensus.cc:2749] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.603220 23831 tablet_bootstrap.cc:492] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:31.603745 23831 ts_tablet_manager.cc:1403] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.002s
I20260709 13:07:31.625829 23831 raft_consensus.cc:359] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.626881 23831 raft_consensus.cc:385] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.627331 23831 raft_consensus.cc:740] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.628278 23831 consensus_queue.cc:260] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.643914 23833 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:31.632741 23836 raft_consensus.cc:359] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.644562 23836 raft_consensus.cc:385] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.644917 23836 raft_consensus.cc:740] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.645100 23907 consensus_queue.cc:1048] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.645758 23836 consensus_queue.cc:260] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.647778 23836 ts_tablet_manager.cc:1434] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.126s	user 0.006s	sys 0.001s
I20260709 13:07:31.647821 23833 ts_tablet_manager.cc:1403] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.017s
I20260709 13:07:31.648854 23836 tablet_bootstrap.cc:492] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:31.650768 23833 raft_consensus.cc:359] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.651520 23833 raft_consensus.cc:385] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.651863 23833 raft_consensus.cc:740] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.652722 23833 consensus_queue.cc:260] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.640792 23832 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:31.631767 23785 raft_consensus.cc:2468] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:31.623652 23710 raft_consensus.cc:2468] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:31.654911 23833 ts_tablet_manager.cc:1434] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:31.656052 23833 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:31.656461 23836 tablet_bootstrap.cc:654] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.657729 23831 ts_tablet_manager.cc:1434] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:07:31.657678 23460 catalog_manager.cc:5697] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.655061 23832 ts_tablet_manager.cc:1403] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.138s	user 0.036s	sys 0.026s
I20260709 13:07:31.658797 23831 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:31.661507 23832 raft_consensus.cc:359] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.662179 23832 raft_consensus.cc:385] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.662318 23833 tablet_bootstrap.cc:654] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.662493 23832 raft_consensus.cc:740] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.663300 23832 consensus_queue.cc:260] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.666355 23832 ts_tablet_manager.cc:1434] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:31.667634 23832 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:31.654970 23527 leader_election.cc:304] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:31.675951 23907 raft_consensus.cc:2804] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.676487 23907 raft_consensus.cc:697] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:31.677321 23907 consensus_queue.cc:237] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.681447 23832 tablet_bootstrap.cc:654] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.692802 23831 tablet_bootstrap.cc:654] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.704463 23920 consensus_queue.cc:1048] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.759872 23832 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:31.760542 23832 ts_tablet_manager.cc:1403] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.017s
I20260709 13:07:31.767242 23840 raft_consensus.cc:493] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.768100 23840 raft_consensus.cc:515] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.822120 23836 tablet_bootstrap.cc:492] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.822703 23836 ts_tablet_manager.cc:1403] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.174s	user 0.044s	sys 0.034s
I20260709 13:07:31.749280 23459 catalog_manager.cc:5697] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.824038 23833 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:31.832893 23833 ts_tablet_manager.cc:1403] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.177s	user 0.031s	sys 0.069s
I20260709 13:07:31.833719 23840 leader_election.cc:290] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:31.834766 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbb921a20f742f58e9b8ebf7822cc87" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:31.836416 23527 leader_election.cc:343] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.837990 23831 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:31.838555 23831 ts_tablet_manager.cc:1403] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.027s
I20260709 13:07:31.839097 23836 raft_consensus.cc:359] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.839771 23836 raft_consensus.cc:385] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.840067 23836 raft_consensus.cc:740] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.841015 23832 raft_consensus.cc:359] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.841714 23832 raft_consensus.cc:385] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.841409 23831 raft_consensus.cc:359] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.841997 23832 raft_consensus.cc:740] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.842204 23831 raft_consensus.cc:385] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.842609 23831 raft_consensus.cc:740] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.842830 23833 raft_consensus.cc:359] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.843530 23833 raft_consensus.cc:385] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.843305 23831 consensus_queue.cc:260] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.843811 23833 raft_consensus.cc:740] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.844406 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbb921a20f742f58e9b8ebf7822cc87" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.844847 23833 consensus_queue.cc:260] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.845719 23850 consensus_queue.cc:1048] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.846410 23831 ts_tablet_manager.cc:1434] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:31.846346 23907 consensus_queue.cc:1048] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:31.846800 23528 leader_election.cc:343] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.847289 23528 leader_election.cc:304] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:31.847659 23831 tablet_bootstrap.cc:492] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:31.848304 23907 raft_consensus.cc:2749] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.849023 23836 consensus_queue.cc:260] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.849467 23832 consensus_queue.cc:260] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.851138 23833 ts_tablet_manager.cc:1434] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:07:31.852120 23833 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:31.852519 23832 ts_tablet_manager.cc:1434] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.003s
I20260709 13:07:31.853437 23832 tablet_bootstrap.cc:492] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:31.855162 23831 tablet_bootstrap.cc:654] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.859055 23832 tablet_bootstrap.cc:654] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.867609 23836 ts_tablet_manager.cc:1434] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 13:07:31.869041 23838 consensus_queue.cc:1048] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:31.869019 23836 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:31.872058 23838 raft_consensus.cc:493] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.872576 23838 raft_consensus.cc:515] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.879568 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3214eda030c94c39a590e4a7c3fb8ccc" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:31.874769 23461 catalog_manager.cc:5697] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.881544 23833 tablet_bootstrap.cc:654] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:31.881431 23751 leader_election.cc:343] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.877336 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3214eda030c94c39a590e4a7c3fb8ccc" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.879222 23896 consensus_queue.cc:1048] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:07:31.885452 23751 leader_election.cc:343] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.886054 23751 leader_election.cc:304] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:31.887130 23882 raft_consensus.cc:2749] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.888880 23836 tablet_bootstrap.cc:654] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.893643 23907 raft_consensus.cc:493] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.876338 23838 leader_election.cc:290] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:31.895150 23907 raft_consensus.cc:515] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.898378 23907 leader_election.cc:290] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:31.898279 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.901927 23850 consensus_queue.cc:1048] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.903008 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7353eea058f4496792494b7c5b54707b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.904042 23638 raft_consensus.cc:2393] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 156aacba33d94250a5a0a6721246551e in current term 1: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:31.906991 23528 leader_election.cc:304] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:31.907851 23907 raft_consensus.cc:3060] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.911136 23833 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:31.911645 23833 ts_tablet_manager.cc:1403] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.007s
I20260709 13:07:31.914889 23833 raft_consensus.cc:359] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.915568 23833 raft_consensus.cc:385] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.915823 23833 raft_consensus.cc:740] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.917708 23833 consensus_queue.cc:260] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.919739 23833 ts_tablet_manager.cc:1434] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:07:31.919840 23920 consensus_queue.cc:1048] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.923933 23891 consensus_queue.cc:1048] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.927578 23839 raft_consensus.cc:493] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.928324 23920 raft_consensus.cc:493] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.928154 23839 raft_consensus.cc:515] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.928829 23920 raft_consensus.cc:515] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:31.930440 23839 leader_election.cc:290] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:31.932529 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.932529 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:31.936059 23603 leader_election.cc:343] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.930979 23920 leader_election.cc:290] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:31.937836 23907 raft_consensus.cc:2749] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.940239 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:31.940572 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:31.941598 23602 leader_election.cc:343] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.942219 23602 leader_election.cc:304] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:31.943742 23896 raft_consensus.cc:2749] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.945494 23528 leader_election.cc:304] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:31.946591 23920 raft_consensus.cc:2749] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.947221 23882 consensus_queue.cc:1048] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:31.951668 23965 raft_consensus.cc:493] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.952188 23965 raft_consensus.cc:515] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:31.953143 23832 tablet_bootstrap.cc:492] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:31.953648 23832 ts_tablet_manager.cc:1403] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.009s
I20260709 13:07:31.954978 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:31.957808 23833 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:31.959003 23839 consensus_queue.cc:1048] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:31.961395 23710 raft_consensus.cc:3060] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.964636 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:31.965521 23562 raft_consensus.cc:2393] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:31.971458 23677 leader_election.cc:304] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:31.980532 23836 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:31.981083 23836 ts_tablet_manager.cc:1403] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.112s	user 0.007s	sys 0.011s
I20260709 13:07:31.989038 23965 leader_election.cc:290] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:31.990327 23965 raft_consensus.cc:2749] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.993671 23836 raft_consensus.cc:359] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:31.994410 23836 raft_consensus.cc:385] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.994652 23836 raft_consensus.cc:740] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.995525 23832 raft_consensus.cc:359] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:31.996279 23832 raft_consensus.cc:385] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.996567 23832 raft_consensus.cc:740] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.996873 23561 raft_consensus.cc:3060] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.997174 23832 consensus_queue.cc:260] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.001139 23831 tablet_bootstrap.cc:492] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:32.001668 23831 ts_tablet_manager.cc:1403] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.154s	user 0.014s	sys 0.060s
I20260709 13:07:32.001755 23836 consensus_queue.cc:260] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.003999 23836 ts_tablet_manager.cc:1434] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:07:32.004940 23836 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:32.004686 23831 raft_consensus.cc:359] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.005399 23831 raft_consensus.cc:385] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.005681 23831 raft_consensus.cc:740] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.006604 23882 consensus_queue.cc:1048] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.006302 23831 consensus_queue.cc:260] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.009356 23833 tablet_bootstrap.cc:654] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.009717 23831 ts_tablet_manager.cc:1434] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:32.010854 23831 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:32.011700 23832 ts_tablet_manager.cc:1434] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.001s
I20260709 13:07:32.012691 23832 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.017091 23896 consensus_queue.cc:1048] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:32.059545 23896 raft_consensus.cc:493] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.060316 23677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 88938.4us
I20260709 13:07:32.071427 23831 tablet_bootstrap.cc:654] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.060600 23896 raft_consensus.cc:515] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.073947 23839 consensus_queue.cc:1048] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.077431 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.077765 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:32.077813 23832 tablet_bootstrap.cc:654] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.075093 23896 leader_election.cc:290] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:32.080648 23838 raft_consensus.cc:493] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.079478 23891 consensus_queue.cc:1048] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:32.081266 23838 raft_consensus.cc:515] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.082443 23836 tablet_bootstrap.cc:654] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.088967 23838 leader_election.cc:290] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:32.089249 23603 leader_election.cc:343] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.090759 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:32.092352 23751 leader_election.cc:343] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.094190 23882 consensus_queue.cc:1048] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.105495 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:32.114516 23603 leader_election.cc:343] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.114113 23907 consensus_queue.cc:1048] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:07:32.128173 23603 leader_election.cc:304] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:32.135752 23896 raft_consensus.cc:2749] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.140383 23839 raft_consensus.cc:493] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.146147 23839 raft_consensus.cc:515] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.148404 23839 leader_election.cc:290] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
W20260709 13:07:32.129750 23751 leader_election.cc:343] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.155834 23833 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.156493 23833 ts_tablet_manager.cc:1403] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.199s	user 0.014s	sys 0.010s
I20260709 13:07:32.156828 23751 leader_election.cc:304] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:32.161463 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3214eda030c94c39a590e4a7c3fb8ccc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.161712 23882 raft_consensus.cc:2749] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.162186 23786 raft_consensus.cc:2468] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:32.165206 23602 leader_election.cc:304] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:32.165287 23833 raft_consensus.cc:359] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.166666 23895 raft_consensus.cc:2804] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.167192 23895 raft_consensus.cc:493] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.167580 23895 raft_consensus.cc:3060] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.169970 23833 raft_consensus.cc:385] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.170337 23833 raft_consensus.cc:740] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.172768 23833 consensus_queue.cc:260] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.174865 23833 ts_tablet_manager.cc:1434] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.018s	user 0.000s	sys 0.004s
I20260709 13:07:32.175392 23839 raft_consensus.cc:493] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.175902 23833 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.175971 23839 raft_consensus.cc:515] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.179423 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3214eda030c94c39a590e4a7c3fb8ccc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.180096 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe0677c45254e81bbad8dc085ffb64c" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:32.181354 23839 leader_election.cc:290] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:32.181387 23603 leader_election.cc:343] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.183640 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe0677c45254e81bbad8dc085ffb64c" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.185302 23833 tablet_bootstrap.cc:654] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.191252 23962 raft_consensus.cc:493] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.191792 23962 raft_consensus.cc:515] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.192277 23836 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:32.192858 23836 ts_tablet_manager.cc:1403] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.188s	user 0.022s	sys 0.009s
I20260709 13:07:32.194089 23962 leader_election.cc:290] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.195245 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46b913ff5404592be0ac2df69ce2498" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:32.195693 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46b913ff5404592be0ac2df69ce2498" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.196712 23786 raft_consensus.cc:2468] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:32.196576 23836 raft_consensus.cc:359] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.197405 23836 raft_consensus.cc:385] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.197710 23836 raft_consensus.cc:740] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.198267 23676 leader_election.cc:304] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:32.198447 23833 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.198560 23836 consensus_queue.cc:260] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.199185 23833 ts_tablet_manager.cc:1403] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 13:07:32.201715 23836 ts_tablet_manager.cc:1434] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:07:32.199180 23962 raft_consensus.cc:2804] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.202452 23962 raft_consensus.cc:493] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.202247 23833 raft_consensus.cc:359] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.203074 23833 raft_consensus.cc:385] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.203387 23833 raft_consensus.cc:740] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
W20260709 13:07:32.203747 23603 leader_election.cc:343] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.202888 23962 raft_consensus.cc:3060] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.204111 23833 consensus_queue.cc:260] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
W20260709 13:07:32.204759 23603 leader_election.cc:343] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.205230 23968 raft_consensus.cc:493] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.205289 23603 leader_election.cc:304] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
W20260709 13:07:32.201709 23677 leader_election.cc:343] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.205865 23968 raft_consensus.cc:515] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.206729 23833 ts_tablet_manager.cc:1434] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:32.207862 23833 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.208086 23896 raft_consensus.cc:2749] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.208078 23968 leader_election.cc:290] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.209832 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.210511 23786 raft_consensus.cc:2468] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:32.211817 23676 leader_election.cc:304] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:32.212589 23968 raft_consensus.cc:2804] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.212687 23836 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:32.213016 23968 raft_consensus.cc:493] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.213411 23968 raft_consensus.cc:3060] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.213749 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:32.214133 23833 tablet_bootstrap.cc:654] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:32.215466 23677 leader_election.cc:343] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.221354 23836 tablet_bootstrap.cc:654] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.224838 23962 raft_consensus.cc:515] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.225666 23833 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.226184 23833 ts_tablet_manager.cc:1403] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:07:32.228246 23962 leader_election.cc:290] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.230108 23833 raft_consensus.cc:359] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.231248 23833 raft_consensus.cc:385] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.231565 23962 raft_consensus.cc:493] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.231662 23833 raft_consensus.cc:740] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.232156 23962 raft_consensus.cc:515] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.234331 23962 leader_election.cc:290] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:32.233884 23833 consensus_queue.cc:260] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.230105 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46b913ff5404592be0ac2df69ce2498" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:32.235674 23786 raft_consensus.cc:3060] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.237792 23907 raft_consensus.cc:493] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.238600 23907 raft_consensus.cc:515] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.240463 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe0677c45254e81bbad8dc085ffb64c" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:32.241163 23562 raft_consensus.cc:2468] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:32.241668 23907 leader_election.cc:290] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.243546 23677 leader_election.cc:304] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:32.244535 23962 raft_consensus.cc:2804] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.244632 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.245002 23962 raft_consensus.cc:493] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.245523 23962 raft_consensus.cc:3060] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:32.248989 23527 leader_election.cc:343] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.251411 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.237589 23833 ts_tablet_manager.cc:1434] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:07:32.253654 23833 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.220234 23895 raft_consensus.cc:515] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.226298 23831 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:32.255664 23831 ts_tablet_manager.cc:1403] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.245s	user 0.019s	sys 0.024s
W20260709 13:07:32.259853 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:32.263275 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe0677c45254e81bbad8dc085ffb64c" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:32.264220 23833 tablet_bootstrap.cc:654] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.264294 23635 raft_consensus.cc:2468] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:32.267869 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3214eda030c94c39a590e4a7c3fb8ccc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
W20260709 13:07:32.265652 23528 leader_election.cc:343] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.271732 23784 raft_consensus.cc:3060] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.266723 23895 leader_election.cc:290] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.258674 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46b913ff5404592be0ac2df69ce2498" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:32.271943 23528 leader_election.cc:304] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.275231 23832 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.275734 23832 ts_tablet_manager.cc:1403] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.263s	user 0.014s	sys 0.008s
I20260709 13:07:32.277638 23832 raft_consensus.cc:359] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.278131 23832 raft_consensus.cc:385] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.278357 23832 raft_consensus.cc:740] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.270938 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3214eda030c94c39a590e4a7c3fb8ccc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:32.279951 23920 raft_consensus.cc:2749] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:32.280783 23603 leader_election.cc:343] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.278992 23832 consensus_queue.cc:260] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.284296 23840 consensus_queue.cc:1048] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.285738 23832 ts_tablet_manager.cc:1434] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:07:32.287485 23832 tablet_bootstrap.cc:492] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.270022 23831 raft_consensus.cc:359] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.287979 23831 raft_consensus.cc:385] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.288271 23831 raft_consensus.cc:740] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.290160 23962 raft_consensus.cc:515] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.285738 23784 raft_consensus.cc:2468] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:32.288937 23831 consensus_queue.cc:260] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.293287 23962 leader_election.cc:290] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:32.293572 23602 leader_election.cc:304] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:32.294355 23891 raft_consensus.cc:2804] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.294812 23891 raft_consensus.cc:697] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:32.295655 23891 consensus_queue.cc:237] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.298262 23831 ts_tablet_manager.cc:1434] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.003s
I20260709 13:07:32.302587 23831 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:32.306206 23836 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:32.306752 23836 ts_tablet_manager.cc:1403] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.024s
I20260709 13:07:32.309566 23836 raft_consensus.cc:359] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.310417 23836 raft_consensus.cc:385] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:32.286526 23677 leader_election.cc:343] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.310803 23836 raft_consensus.cc:740] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.312809 23836 consensus_queue.cc:260] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.316357 23836 ts_tablet_manager.cc:1434] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:07:32.287331 23968 raft_consensus.cc:515] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.316864 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe0677c45254e81bbad8dc085ffb64c" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:32.317166 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe0677c45254e81bbad8dc085ffb64c" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:32.323721 23561 raft_consensus.cc:3060] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.323807 23635 raft_consensus.cc:3060] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.324383 23836 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:32.317607 23786 raft_consensus.cc:2468] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:32.328001 23968 leader_election.cc:290] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.329129 23832 tablet_bootstrap.cc:654] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.330394 23833 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.330916 23833 ts_tablet_manager.cc:1403] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.006s
I20260709 13:07:32.335348 23676 leader_election.cc:304] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:32.335951 23833 raft_consensus.cc:359] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.336383 23962 raft_consensus.cc:2804] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.336689 23833 raft_consensus.cc:385] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.336894 23962 raft_consensus.cc:697] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:32.336987 23833 raft_consensus.cc:740] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.337785 23962 consensus_queue.cc:237] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.338712 23833 consensus_queue.cc:260] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.346664 23833 ts_tablet_manager.cc:1434] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:07:32.348451 23833 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.354235 23833 tablet_bootstrap.cc:654] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.356899 23561 raft_consensus.cc:2468] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:32.369984 23836 tablet_bootstrap.cc:654] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.362088 23635 raft_consensus.cc:2468] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:32.365108 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:32.358821 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:32.376391 23831 tablet_bootstrap.cc:654] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.379448 23786 raft_consensus.cc:3060] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:32.380065 23677 leader_election.cc:343] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.380837 23677 leader_election.cc:304] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:32.381778 23968 raft_consensus.cc:2804] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.382284 23968 raft_consensus.cc:697] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:32.383140 23968 consensus_queue.cc:237] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.390347 23833 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.390934 23833 ts_tablet_manager.cc:1403] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.010s
I20260709 13:07:32.394692 23459 catalog_manager.cc:5697] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.398890 23832 tablet_bootstrap.cc:492] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.400017 23832 ts_tablet_manager.cc:1403] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.008s
I20260709 13:07:32.400096 23833 raft_consensus.cc:359] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.400813 23833 raft_consensus.cc:385] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.401083 23833 raft_consensus.cc:740] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.403901 23460 catalog_manager.cc:5697] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.405488 23832 raft_consensus.cc:359] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.406195 23832 raft_consensus.cc:385] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.406457 23832 raft_consensus.cc:740] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.409894 23786 raft_consensus.cc:2468] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:32.410152 23832 consensus_queue.cc:260] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.411206 23833 consensus_queue.cc:260] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.411666 23676 leader_election.cc:304] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:32.412540 23832 ts_tablet_manager.cc:1434] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:32.412853 23962 raft_consensus.cc:2804] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.413369 23962 raft_consensus.cc:697] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:32.414309 23962 consensus_queue.cc:237] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.419435 23882 raft_consensus.cc:493] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.419793 23832 tablet_bootstrap.cc:492] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.419996 23882 raft_consensus.cc:515] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.422008 23882 leader_election.cc:290] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.423911 23831 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:32.423942 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbb921a20f742f58e9b8ebf7822cc87" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:32.424522 23831 ts_tablet_manager.cc:1403] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.007s
I20260709 13:07:32.424991 23561 raft_consensus.cc:2468] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:32.426112 23832 tablet_bootstrap.cc:654] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.426301 23836 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:32.426924 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbb921a20f742f58e9b8ebf7822cc87" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.427002 23751 leader_election.cc:304] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:32.427424 23831 raft_consensus.cc:359] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.428099 23882 raft_consensus.cc:2804] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.428318 23831 raft_consensus.cc:385] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.428678 23882 raft_consensus.cc:493] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.429563 23882 raft_consensus.cc:3060] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.413488 23833 ts_tablet_manager.cc:1434] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
W20260709 13:07:32.434021 23751 leader_election.cc:343] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.435127 23833 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.435508 23836 ts_tablet_manager.cc:1403] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.000s
I20260709 13:07:32.437630 23832 tablet_bootstrap.cc:492] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.438117 23832 ts_tablet_manager.cc:1403] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:07:32.440752 23980 raft_consensus.cc:493] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.440994 23832 raft_consensus.cc:359] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.441283 23980 raft_consensus.cc:515] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.441771 23832 raft_consensus.cc:385] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.444360 23832 raft_consensus.cc:740] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.445202 23980 leader_election.cc:290] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.447263 23836 raft_consensus.cc:359] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.448038 23836 raft_consensus.cc:385] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.448343 23836 raft_consensus.cc:740] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.448983 23836 consensus_queue.cc:260] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.450006 23833 tablet_bootstrap.cc:654] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.447712 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ac9d400274111ab086900b40199f0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:32.450891 23561 raft_consensus.cc:2468] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:32.453104 23603 leader_election.cc:304] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:32.453929 23891 raft_consensus.cc:2804] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.454324 23891 raft_consensus.cc:493] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.454694 23891 raft_consensus.cc:3060] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.456105 23833 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.456600 23833 ts_tablet_manager.cc:1403] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 13:07:32.456881 23832 consensus_queue.cc:260] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.451376 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ac9d400274111ab086900b40199f0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.459641 23833 raft_consensus.cc:359] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.460345 23833 raft_consensus.cc:385] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.460618 23833 raft_consensus.cc:740] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.460999 23832 ts_tablet_manager.cc:1434] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:07:32.461450 23833 consensus_queue.cc:260] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.462003 23832 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.462190 23891 raft_consensus.cc:515] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.463900 23833 ts_tablet_manager.cc:1434] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:07:32.464942 23833 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.464970 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ac9d400274111ab086900b40199f0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:32.428799 23831 raft_consensus.cc:740] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.468235 23831 consensus_queue.cc:260] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.470335 23786 raft_consensus.cc:2468] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:32.475425 23831 ts_tablet_manager.cc:1434] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:07:32.476517 23831 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:32.477381 23832 tablet_bootstrap.cc:654] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.474438 23882 raft_consensus.cc:515] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.480465 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ac9d400274111ab086900b40199f0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:32.481401 23561 raft_consensus.cc:3060] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.482015 23891 leader_election.cc:290] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.482853 23850 raft_consensus.cc:493] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.483377 23850 raft_consensus.cc:515] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.485463 23850 leader_election.cc:290] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.488242 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:32.488929 23562 raft_consensus.cc:2468] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:32.489380 23833 tablet_bootstrap.cc:654] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.490286 23677 leader_election.cc:304] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:32.493454 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbb921a20f742f58e9b8ebf7822cc87" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:32.494076 23708 raft_consensus.cc:3060] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.495512 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.497160 23850 raft_consensus.cc:2804] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.497746 23850 raft_consensus.cc:493] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.498189 23850 raft_consensus.cc:3060] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.502344 23833 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.502849 23833 ts_tablet_manager.cc:1403] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.009s
W20260709 13:07:32.504715 23676 leader_election.cc:343] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.505569 23833 raft_consensus.cc:359] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.506234 23833 raft_consensus.cc:385] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.506477 23833 raft_consensus.cc:740] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.507325 23833 consensus_queue.cc:260] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.509575 23833 ts_tablet_manager.cc:1434] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:32.510509 23833 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.510951 23850 raft_consensus.cc:515] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.513837 23708 raft_consensus.cc:2468] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:32.516431 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
W20260709 13:07:32.520870 23676 leader_election.cc:343] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.520973 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:32.521773 23560 raft_consensus.cc:3060] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.516445 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbb921a20f742f58e9b8ebf7822cc87" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:32.517153 23833 tablet_bootstrap.cc:654] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.523907 23562 raft_consensus.cc:3060] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.518299 23836 ts_tablet_manager.cc:1434] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.000s
I20260709 13:07:32.527314 23836 tablet_bootstrap.cc:492] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:32.519120 23850 leader_election.cc:290] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.539619 23836 tablet_bootstrap.cc:654] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.491655 23561 raft_consensus.cc:2468] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:32.517177 23882 leader_election.cc:290] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.545539 23603 leader_election.cc:304] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.547748 23751 leader_election.cc:304] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:32.548815 23560 raft_consensus.cc:2468] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:32.548974 23882 raft_consensus.cc:2804] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.549827 23882 raft_consensus.cc:697] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:32.550438 23677 leader_election.cc:304] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.551016 23882 consensus_queue.cc:237] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.552536 23891 raft_consensus.cc:2804] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.554891 23850 raft_consensus.cc:2804] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.555070 23891 raft_consensus.cc:697] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:32.555711 23850 raft_consensus.cc:697] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:32.556905 23891 consensus_queue.cc:237] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.558529 23907 raft_consensus.cc:493] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.559234 23907 raft_consensus.cc:515] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.563433 23907 leader_election.cc:290] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:32.563687 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:32.564383 23635 raft_consensus.cc:2468] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:32.565531 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.565682 23528 leader_election.cc:304] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
W20260709 13:07:32.567188 23527 leader_election.cc:343] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.557955 23850 consensus_queue.cc:237] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.572613 23907 raft_consensus.cc:2804] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.573190 23907 raft_consensus.cc:493] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.573550 23907 raft_consensus.cc:3060] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.573582 23840 raft_consensus.cc:493] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.574224 23840 raft_consensus.cc:515] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.576363 23840 leader_election.cc:290] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:32.578054 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:32.578939 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:32.579713 23528 leader_election.cc:343] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:32.580413 23527 leader_election.cc:343] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.580972 23527 leader_election.cc:304] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.581935 23840 raft_consensus.cc:2749] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.585820 23562 raft_consensus.cc:2468] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:32.586259 23832 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.588708 23832 ts_tablet_manager.cc:1403] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.127s	user 0.021s	sys 0.031s
I20260709 13:07:32.589499 23840 raft_consensus.cc:493] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.590003 23840 raft_consensus.cc:515] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.591615 23832 raft_consensus.cc:359] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.592290 23832 raft_consensus.cc:385] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.592541 23832 raft_consensus.cc:740] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.593061 23840 leader_election.cc:290] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.593222 23832 consensus_queue.cc:260] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.598171 23832 ts_tablet_manager.cc:1434] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:07:32.594300 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46b913ff5404592be0ac2df69ce2498" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.599192 23832 tablet_bootstrap.cc:492] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.594602 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46b913ff5404592be0ac2df69ce2498" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.547799 23831 tablet_bootstrap.cc:654] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.599825 23786 raft_consensus.cc:2393] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 156aacba33d94250a5a0a6721246551e in current term 1: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:32.604311 23907 raft_consensus.cc:515] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.606938 23907 leader_election.cc:290] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:32.607528 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:32.607985 23635 raft_consensus.cc:3060] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.609241 23459 catalog_manager.cc:5697] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.612428 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:32.612920 23831 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:32.612246 23457 catalog_manager.cc:5697] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.613394 23831 ts_tablet_manager.cc:1403] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.001s
I20260709 13:07:32.613878 23459 catalog_manager.cc:5697] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.615144 23635 raft_consensus.cc:2468] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:32.615748 23832 tablet_bootstrap.cc:654] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.635775 23833 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.635932 23832 tablet_bootstrap.cc:492] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.636385 23833 ts_tablet_manager.cc:1403] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.126s	user 0.027s	sys 0.036s
I20260709 13:07:32.636624 23832 ts_tablet_manager.cc:1403] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.017s
I20260709 13:07:32.626679 23528 leader_election.cc:304] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:32.630462 23527 leader_election.cc:304] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.640144 23836 tablet_bootstrap.cc:492] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
W20260709 13:07:32.640216 23527 leader_election.cc:343] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.640903 23836 ts_tablet_manager.cc:1403] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.021s
I20260709 13:07:32.640793 23832 raft_consensus.cc:359] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.641356 23907 raft_consensus.cc:3060] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.641556 23832 raft_consensus.cc:385] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.641938 23832 raft_consensus.cc:740] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.644121 23832 consensus_queue.cc:260] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.645412 23840 raft_consensus.cc:2804] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.645947 23840 raft_consensus.cc:697] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:32.646119 23832 ts_tablet_manager.cc:1434] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:07:32.647022 23832 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.648341 23831 raft_consensus.cc:359] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.649026 23831 raft_consensus.cc:385] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.649277 23831 raft_consensus.cc:740] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.649928 23831 consensus_queue.cc:260] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.649963 23984 raft_consensus.cc:493] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.651510 23984 raft_consensus.cc:515] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.652364 23458 catalog_manager.cc:5697] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.653333 23984 leader_election.cc:290] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:32.653604 23832 tablet_bootstrap.cc:654] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.654129 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:32.654753 23635 raft_consensus.cc:2468] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:32.656483 23528 leader_election.cc:304] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:32.658004 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.646771 23840 consensus_queue.cc:237] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.663270 23907 raft_consensus.cc:2749] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.662528 23984 raft_consensus.cc:2804] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.669709 23836 raft_consensus.cc:359] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.670820 23836 raft_consensus.cc:385] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.675899 23831 ts_tablet_manager.cc:1434] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.003s
I20260709 13:07:32.676812 23831 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:32.671212 23836 raft_consensus.cc:740] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.678174 23836 consensus_queue.cc:260] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
W20260709 13:07:32.666389 23528 leader_election.cc:343] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.672066 23984 raft_consensus.cc:493] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.686456 23833 raft_consensus.cc:359] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.687711 23833 raft_consensus.cc:385] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.687767 23836 ts_tablet_manager.cc:1434] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:07:32.682873 23984 raft_consensus.cc:3060] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.689392 23836 tablet_bootstrap.cc:492] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:32.687986 23833 raft_consensus.cc:740] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.695614 23831 tablet_bootstrap.cc:654] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.705386 23832 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.706822 23832 ts_tablet_manager.cc:1403] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.060s	user 0.019s	sys 0.012s
I20260709 13:07:32.707535 23836 tablet_bootstrap.cc:654] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.698752 23833 consensus_queue.cc:260] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.710301 23833 ts_tablet_manager.cc:1434] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.002s
I20260709 13:07:32.717434 23833 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.714373 23832 raft_consensus.cc:359] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.725512 23832 raft_consensus.cc:385] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.726068 23832 raft_consensus.cc:740] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.727231 23832 consensus_queue.cc:260] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.730532 23832 ts_tablet_manager.cc:1434] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:07:32.732028 23832 tablet_bootstrap.cc:492] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.733527 23833 tablet_bootstrap.cc:654] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.746742 23832 tablet_bootstrap.cc:654] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.747208 23459 catalog_manager.cc:5697] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.758118 23895 raft_consensus.cc:493] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.758751 23895 raft_consensus.cc:515] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.760354 23833 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.761129 23833 ts_tablet_manager.cc:1403] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.002s
I20260709 13:07:32.762007 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.762862 23708 raft_consensus.cc:2468] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:32.764261 23891 raft_consensus.cc:493] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.764801 23891 raft_consensus.cc:515] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.768836 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.769107 23461 catalog_manager.cc:5697] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.770033 23786 raft_consensus.cc:2393] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:32.773572 23603 leader_election.cc:304] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:32.766669 23833 raft_consensus.cc:359] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.775223 23896 raft_consensus.cc:2804] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.775993 23896 raft_consensus.cc:493] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.776449 23896 raft_consensus.cc:3060] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.783497 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36f60dc2cd934d1da48a665aad1c13d3" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.786217 23980 consensus_queue.cc:1048] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:32.790376 23895 leader_election.cc:290] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.790889 23984 raft_consensus.cc:515] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.793648 23984 leader_election.cc:290] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:32.795989 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:32.796708 23785 raft_consensus.cc:2468] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:32.797076 23831 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:32.797284 23832 tablet_bootstrap.cc:492] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.797572 23831 ts_tablet_manager.cc:1403] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.121s	user 0.040s	sys 0.060s
I20260709 13:07:32.797976 23832 ts_tablet_manager.cc:1403] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.000s
I20260709 13:07:32.799199 23896 raft_consensus.cc:515] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.767007 23891 leader_election.cc:290] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.798827 23603 leader_election.cc:304] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.801815 23832 raft_consensus.cc:359] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.802170 23891 raft_consensus.cc:3060] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.802553 23832 raft_consensus.cc:385] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.775019 23833 raft_consensus.cc:385] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.803381 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:32.805472 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:32.802896 23832 raft_consensus.cc:740] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.806098 23635 raft_consensus.cc:3060] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.806689 23832 consensus_queue.cc:260] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.810432 23896 leader_election.cc:290] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.800583 23831 raft_consensus.cc:359] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.811364 23831 raft_consensus.cc:385] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.811758 23831 raft_consensus.cc:740] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.812233 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:32.812866 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:32.812893 23712 raft_consensus.cc:3060] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.813567 23786 raft_consensus.cc:3060] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:32.814716 23528 leader_election.cc:343] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.817154 23831 consensus_queue.cc:260] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
W20260709 13:07:32.811249 23603 consensus_peers.cc:597] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:32.803376 23833 raft_consensus.cc:740] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.825083 23786 raft_consensus.cc:2468] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:32.822335 23833 consensus_queue.cc:260] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:32.827348 23602 leader_election.cc:304] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:32.826148 23831 ts_tablet_manager.cc:1434] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.002s
I20260709 13:07:32.829497 23831 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:32.829640 23833 ts_tablet_manager.cc:1434] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 13:07:32.830189 23832 ts_tablet_manager.cc:1434] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 13:07:32.830675 23833 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:32.831130 23832 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.833405 23836 tablet_bootstrap.cc:492] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:32.833907 23836 ts_tablet_manager.cc:1403] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.145s	user 0.025s	sys 0.024s
I20260709 13:07:32.835336 23712 raft_consensus.cc:2468] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:32.837329 23831 tablet_bootstrap.cc:654] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.831208 23896 raft_consensus.cc:2804] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.838299 23896 raft_consensus.cc:697] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:32.839110 23896 consensus_queue.cc:237] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.837335 23635 raft_consensus.cc:2468] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:32.836664 23836 raft_consensus.cc:359] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.841845 23836 raft_consensus.cc:385] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.842154 23836 raft_consensus.cc:740] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.842972 23836 consensus_queue.cc:260] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.848800 23528 leader_election.cc:304] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:32.851619 23891 raft_consensus.cc:2749] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.856911 23832 tablet_bootstrap.cc:654] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.856676 23850 consensus_queue.cc:1048] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.857319 23833 tablet_bootstrap.cc:654] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.860016 23836 ts_tablet_manager.cc:1434] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:07:32.861320 23836 tablet_bootstrap.cc:492] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:32.851385 23984 raft_consensus.cc:2804] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.864796 23984 raft_consensus.cc:697] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:32.865825 23984 consensus_queue.cc:237] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:32.879541 23891 raft_consensus.cc:493] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.880924 23891 raft_consensus.cc:515] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:32.884598 23891 leader_election.cc:290] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:32.892254 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:32.896082 23602 leader_election.cc:343] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.897058 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:32.897729 23850 consensus_queue.cc:1048] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:32.898831 23962 consensus_queue.cc:1048] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:32.899053 23603 leader_election.cc:343] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.915098 23832 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:32.915678 23832 ts_tablet_manager.cc:1403] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.003s
I20260709 13:07:32.903023 23603 leader_election.cc:304] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.919598 23980 raft_consensus.cc:2749] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.919510 23458 catalog_manager.cc:5697] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.918833 23832 raft_consensus.cc:359] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.921702 23832 raft_consensus.cc:385] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.922073 23832 raft_consensus.cc:740] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.922991 23832 consensus_queue.cc:260] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.925451 23832 ts_tablet_manager.cc:1434] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:32.926632 23832 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:32.927479 23831 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:32.928849 23831 ts_tablet_manager.cc:1403] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.008s
I20260709 13:07:32.931407 23962 consensus_queue.cc:1048] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.932796 23459 catalog_manager.cc:5697] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.936830 23962 consensus_queue.cc:1048] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.941422 23962 consensus_queue.cc:1048] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.948748 23832 tablet_bootstrap.cc:654] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.957701 23896 raft_consensus.cc:493] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.958243 23896 raft_consensus.cc:515] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.960400 23896 leader_election.cc:290] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:32.961110 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:32.962980 23602 leader_election.cc:343] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.964402 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:32.965982 23603 leader_election.cc:343] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.966594 23603 leader_election.cc:304] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:32.967738 23896 raft_consensus.cc:2749] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.932194 23831 raft_consensus.cc:359] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.981245 23831 raft_consensus.cc:385] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.981856 23831 raft_consensus.cc:740] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.988372 23831 consensus_queue.cc:260] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:32.992839 23833 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:32.993629 23833 ts_tablet_manager.cc:1403] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.163s	user 0.022s	sys 0.016s
I20260709 13:07:33.001261 23831 ts_tablet_manager.cc:1434] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.000s
I20260709 13:07:33.002450 23831 tablet_bootstrap.cc:492] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:33.007251 23896 raft_consensus.cc:493] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.018397 23831 tablet_bootstrap.cc:654] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.009537 23896 raft_consensus.cc:515] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.013239 23980 raft_consensus.cc:493] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.023942 23980 raft_consensus.cc:515] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.028137 23896 leader_election.cc:290] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:33.040877 23785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:33.041600 23785 raft_consensus.cc:2468] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:33.033202 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:33.042371 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e66f85de59d4ac4b676edfe803876b8" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:33.043234 23561 raft_consensus.cc:2468] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:33.044034 23602 leader_election.cc:304] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:33.044948 23891 raft_consensus.cc:2804] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.042393 23563 raft_consensus.cc:2468] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:33.045354 23891 raft_consensus.cc:493] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.045730 23891 raft_consensus.cc:3060] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.046056 23603 leader_election.cc:304] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:33.047323 23836 tablet_bootstrap.cc:654] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.047273 23895 raft_consensus.cc:2804] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.047812 23895 raft_consensus.cc:493] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.048182 23895 raft_consensus.cc:3060] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.053618 23832 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:33.054193 23832 ts_tablet_manager.cc:1403] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.128s	user 0.025s	sys 0.023s
I20260709 13:07:33.113230 23831 tablet_bootstrap.cc:492] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:33.113802 23831 ts_tablet_manager.cc:1403] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.112s	user 0.020s	sys 0.004s
I20260709 13:07:33.117762 23836 tablet_bootstrap.cc:492] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
W20260709 13:07:33.120205 24028 log.cc:927] Time spent T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 13:07:33.112270 23602 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 59403.2us
I20260709 13:07:33.120697 23836 ts_tablet_manager.cc:1403] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.260s	user 0.016s	sys 0.025s
I20260709 13:07:33.124583 23833 raft_consensus.cc:359] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.125659 23833 raft_consensus.cc:385] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.113637 23935 raft_consensus.cc:493] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.113961 23968 raft_consensus.cc:493] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.126019 23833 raft_consensus.cc:740] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.117354 23980 leader_election.cc:290] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:33.130162 24026 log.cc:927] Time spent T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:07:33.136982 23833 consensus_queue.cc:260] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.134716 23831 raft_consensus.cc:359] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.137928 23831 raft_consensus.cc:385] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.138257 23831 raft_consensus.cc:740] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.131371 23882 raft_consensus.cc:493] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.141166 23831 consensus_queue.cc:260] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
W20260709 13:07:33.129087 23677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 89193.2us
I20260709 13:07:33.147837 23833 ts_tablet_manager.cc:1434] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.154s	user 0.008s	sys 0.002s
I20260709 13:07:33.131121 23935 raft_consensus.cc:515] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:33.146771 23882 raft_consensus.cc:515] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.159742 23935 leader_election.cc:290] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:33.139442 23896 raft_consensus.cc:493] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.161338 23882 leader_election.cc:290] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:33.163130 23832 raft_consensus.cc:359] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.163885 23832 raft_consensus.cc:385] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.164165 23832 raft_consensus.cc:740] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.161446 23786 raft_consensus.cc:3060] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.166425 23840 raft_consensus.cc:493] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.166910 23840 raft_consensus.cc:515] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:33.169008 23840 leader_election.cc:290] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:33.169310 23785 raft_consensus.cc:3060] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.165872 23832 consensus_queue.cc:260] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.165514 23833 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:33.161417 23896 raft_consensus.cc:515] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.176681 23896 leader_election.cc:290] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:33.154750 23891 raft_consensus.cc:515] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.179075 23891 leader_election.cc:290] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:33.132352 23968 raft_consensus.cc:515] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.178921 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:33.180090 23784 raft_consensus.cc:2468] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:33.181126 23968 leader_election.cc:290] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:33.172248 23831 ts_tablet_manager.cc:1434] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:07:33.182785 23831 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:33.181391 23895 raft_consensus.cc:515] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.188536 24035 consensus_queue.cc:1048] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.189366 23832 ts_tablet_manager.cc:1434] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.135s	user 0.008s	sys 0.000s
I20260709 13:07:33.190062 23783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:33.191723 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a112ab003b24103ae2a7b922dc31f3d" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:33.204691 23832 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:33.200305 23836 raft_consensus.cc:359] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.205717 23836 raft_consensus.cc:385] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.207234 23783 raft_consensus.cc:2468] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:33.208581 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e66f85de59d4ac4b676edfe803876b8" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:33.208904 23676 leader_election.cc:304] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:33.209820 24039 raft_consensus.cc:2804] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.210237 24039 raft_consensus.cc:493] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.210590 24039 raft_consensus.cc:3060] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:33.211699 23528 leader_election.cc:343] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.213714 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:33.214324 23560 raft_consensus.cc:3060] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.216760 23895 leader_election.cc:290] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:33.218586 24039 raft_consensus.cc:515] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.221906 23783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:33.222509 23783 raft_consensus.cc:3060] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.225409 23784 raft_consensus.cc:3060] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.226613 23602 leader_election.cc:304] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:33.226681 23840 consensus_queue.cc:1048] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.226787 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e66f85de59d4ac4b676edfe803876b8" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:33.206113 23836 raft_consensus.cc:740] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.227936 23563 raft_consensus.cc:3060] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.231539 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:33.232259 23782 raft_consensus.cc:3060] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.230624 23896 raft_consensus.cc:2804] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.235608 23896 raft_consensus.cc:493] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.235965 23896 raft_consensus.cc:3060] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.236392 24041 consensus_queue.cc:1048] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.242681 23560 raft_consensus.cc:2468] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:33.254805 23968 consensus_queue.cc:1048] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:33.257109 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:33.258216 23708 raft_consensus.cc:2393] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:33.259081 23782 raft_consensus.cc:2468] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:33.260303 23602 leader_election.cc:304] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:33.231230 23836 consensus_queue.cc:260] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.261845 24039 leader_election.cc:290] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:33.271103 23836 ts_tablet_manager.cc:1434] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.147s	user 0.009s	sys 0.000s
I20260709 13:07:33.273036 23836 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:33.267422 24035 raft_consensus.cc:2804] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.296761 24035 raft_consensus.cc:697] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:33.297669 24035 consensus_queue.cc:237] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.300112 23563 raft_consensus.cc:2468] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:33.300653 23896 raft_consensus.cc:515] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.302928 23710 raft_consensus.cc:3060] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.309072 23833 tablet_bootstrap.cc:654] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.312197 23832 tablet_bootstrap.cc:654] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.268905 23783 raft_consensus.cc:2468] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
W20260709 13:07:33.324126 23603 leader_election.cc:343] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.325812 23831 tablet_bootstrap.cc:654] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.328161 23676 leader_election.cc:304] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:33.329262 24039 raft_consensus.cc:2804] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.331110 23636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:33.332139 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:33.332583 24039 raft_consensus.cc:697] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:33.333630 24039 consensus_queue.cc:237] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:33.335323 24036 consensus_queue.cc:1048] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.329135 23603 leader_election.cc:304] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:33.343478 23891 raft_consensus.cc:2804] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.344000 23891 raft_consensus.cc:697] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:33.344833 23891 consensus_queue.cc:237] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.346268 23896 leader_election.cc:290] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:33.348297 23836 tablet_bootstrap.cc:654] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.354815 23636 raft_consensus.cc:2393] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:33.356438 23783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:33.357499 23783 raft_consensus.cc:2393] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:33.435248 23882 consensus_queue.cc:1048] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.437637 23783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a112ab003b24103ae2a7b922dc31f3d" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:33.446187 23832 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:33.446362 23833 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:33.447022 23832 ts_tablet_manager.cc:1403] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.246s	user 0.009s	sys 0.010s
I20260709 13:07:33.447243 23833 ts_tablet_manager.cc:1403] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.297s	user 0.021s	sys 0.014s
I20260709 13:07:33.415000 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:33.498690 23528 consensus_peers.cc:597] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.507702 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:33.498829 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:33.533455 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202fa208bd5c4307aaa9589effb21dcd" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:33.539778 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:33.556505 23603 leader_election.cc:304] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:33.538620 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e66f85de59d4ac4b676edfe803876b8" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:33.569334 24035 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.570585 24035 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:33.579684 23527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 62820.1us
I20260709 13:07:33.580246 23836 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:33.587128 23895 raft_consensus.cc:2749] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.590332 23984 consensus_queue.cc:1048] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
W20260709 13:07:33.639343 23676 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 58102.3us
W20260709 13:07:33.641510 23602 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 50327.6us
W20260709 13:07:33.644191 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 82935.8us
I20260709 13:07:33.646474 23751 leader_election.cc:304] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:33.654645 24035 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:33.657231 23836 ts_tablet_manager.cc:1403] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.384s	user 0.022s	sys 0.012s
I20260709 13:07:33.456910 23832 raft_consensus.cc:359] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.658641 24063 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.659478 24063 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.658739 23832 raft_consensus.cc:385] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.663968 23832 raft_consensus.cc:740] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.665064 23832 consensus_queue.cc:260] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.671597 23882 raft_consensus.cc:2749] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.671096 24063 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:33.673903 23882 consensus_queue.cc:1048] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:33.679662 23751 leader_election.cc:304] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:33.681488 23882 raft_consensus.cc:2749] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.684612 23832 ts_tablet_manager.cc:1434] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.236s	user 0.009s	sys 0.000s
I20260709 13:07:33.687776 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:33.698104 23833 raft_consensus.cc:359] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:33.698376 23980 consensus_queue.cc:1048] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.699106 23833 raft_consensus.cc:385] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.699501 23833 raft_consensus.cc:740] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.700352 23833 consensus_queue.cc:260] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:33.632129 23528 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 108952us
W20260709 13:07:33.678777 23603 leader_election.cc:343] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.678387 23836 raft_consensus.cc:359] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.710155 23836 raft_consensus.cc:385] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.710505 23836 raft_consensus.cc:740] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.708823 23833 ts_tablet_manager.cc:1434] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.260s	user 0.013s	sys 0.000s
I20260709 13:07:33.721709 23831 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
W20260709 13:07:33.706121 23527 leader_election.cc:343] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.727403 23836 consensus_queue.cc:260] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:33.731674 23603 leader_election.cc:343] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.725085 24035 consensus_queue.cc:1048] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:07:33.741132 23833 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:33.731505 23527 leader_election.cc:304] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:33.752166 24065 raft_consensus.cc:2749] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:33.752552 23527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 46790.1us
I20260709 13:07:33.760023 23831 ts_tablet_manager.cc:1403] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.577s	user 0.027s	sys 0.009s
W20260709 13:07:33.763546 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 84069.5us
I20260709 13:07:33.764703 23836 ts_tablet_manager.cc:1434] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.107s	user 0.006s	sys 0.003s
I20260709 13:07:33.765357 23832 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:33.767938 23836 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
W20260709 13:07:33.772887 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:33.773168 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:33.774098 23638 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:33.776285 23968 consensus_queue.cc:1048] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.779685 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:33.784268 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:33.791049 23562 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:33.794811 24041 consensus_queue.cc:1048] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.809346 23712 raft_consensus.cc:3060] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.789916 23831 raft_consensus.cc:359] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.815897 23831 raft_consensus.cc:385] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.817922 23831 raft_consensus.cc:740] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.823457 24065 consensus_queue.cc:1048] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.831547 23528 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:33.832599 23840 raft_consensus.cc:2804] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:33.832911 23528 leader_election.cc:343] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.833088 23836 tablet_bootstrap.cc:654] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.832991 23840 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.833690 23840 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.837446 23603 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:33.837754 23831 consensus_queue.cc:260] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.838538 24041 raft_consensus.cc:2804] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.839075 24041 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.839522 24041 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.829407 23833 tablet_bootstrap.cc:654] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.850107 23831 ts_tablet_manager.cc:1434] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 13:07:33.877068 24041 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.895920 24041 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:33.896721 23458 catalog_manager.cc:5697] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.899327 23832 tablet_bootstrap.cc:654] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.858433 23840 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.924279 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:33.925123 23638 raft_consensus.cc:2393] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 156aacba33d94250a5a0a6721246551e in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:33.929466 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:33.932111 23831 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:33.932631 24043 consensus_queue.cc:1048] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.937440 23836 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:33.937695 23980 raft_consensus.cc:493] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.937994 23836 ts_tablet_manager.cc:1403] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.170s	user 0.012s	sys 0.002s
I20260709 13:07:33.938174 23980 raft_consensus.cc:515] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:33.941258 23980 leader_election.cc:290] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:33.943790 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871dc3bda4c344b9bd080bf3fae3d085" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:33.944700 23782 raft_consensus.cc:2468] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:33.946246 23602 leader_election.cc:304] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:33.947252 24035 raft_consensus.cc:2804] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.947649 24035 raft_consensus.cc:493] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.955741 24035 raft_consensus.cc:3060] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.971710 23831 tablet_bootstrap.cc:654] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.957461 23840 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:33.979836 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:33.982820 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:33.983755 23561 raft_consensus.cc:2393] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
W20260709 13:07:33.986099 23528 leader_election.cc:343] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.986997 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871dc3bda4c344b9bd080bf3fae3d085" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:33.977584 23836 raft_consensus.cc:359] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:33.986655 23528 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:33.990446 23836 raft_consensus.cc:385] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.991089 23836 raft_consensus.cc:740] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.991698 23984 raft_consensus.cc:493] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.992224 23984 raft_consensus.cc:515] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:33.992628 23980 consensus_queue.cc:1048] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:33.997215 23984 leader_election.cc:290] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:33.998149 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:33.992880 24065 raft_consensus.cc:2749] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:07:33.994328 23603 consensus_peers.cc:597] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:34.000255 23603 leader_election.cc:343] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.991863 23836 consensus_queue.cc:260] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:34.002559 23528 leader_election.cc:343] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.004943 23836 ts_tablet_manager.cc:1434] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:07:34.006354 23836 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:34.006824 23833 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:34.007107 23832 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:34.007323 23833 ts_tablet_manager.cc:1403] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.267s	user 0.023s	sys 0.005s
I20260709 13:07:34.007606 23832 ts_tablet_manager.cc:1403] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.285s	user 0.018s	sys 0.013s
I20260709 13:07:34.010453 23833 raft_consensus.cc:359] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.011206 23833 raft_consensus.cc:385] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.011482 23833 raft_consensus.cc:740] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.015337 23831 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.015874 23831 ts_tablet_manager.cc:1403] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.004s
I20260709 13:07:34.014513 24035 raft_consensus.cc:515] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.016992 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:34.019116 23603 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:34.019841 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871dc3bda4c344b9bd080bf3fae3d085" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:34.019747 23831 raft_consensus.cc:359] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.020537 23782 raft_consensus.cc:3060] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.021207 23833 consensus_queue.cc:260] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.023522 23980 raft_consensus.cc:2749] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.024456 23833 ts_tablet_manager.cc:1434] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:07:34.025790 23833 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
W20260709 13:07:34.028205 23603 leader_election.cc:343] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.032970 23833 tablet_bootstrap.cc:654] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.020601 23831 raft_consensus.cc:385] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.033654 23831 raft_consensus.cc:740] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.013435 23832 raft_consensus.cc:359] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.034245 23832 raft_consensus.cc:385] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.034572 23832 raft_consensus.cc:740] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.034785 23831 consensus_queue.cc:260] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.034910 23980 consensus_queue.cc:1048] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:34.036301 23782 raft_consensus.cc:2468] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:34.039885 23602 leader_election.cc:304] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:34.042773 23836 tablet_bootstrap.cc:654] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.042562 23831 ts_tablet_manager.cc:1434] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
W20260709 13:07:34.032893 23527 leader_election.cc:343] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.047866 24041 raft_consensus.cc:2804] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.048661 23831 tablet_bootstrap.cc:492] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.050365 23527 leader_election.cc:304] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:34.050513 24041 raft_consensus.cc:697] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:34.052079 23832 consensus_queue.cc:260] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.052770 24041 consensus_queue.cc:237] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.053927 23984 raft_consensus.cc:2749] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.062922 23832 ts_tablet_manager.cc:1434] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.055s	user 0.003s	sys 0.004s
I20260709 13:07:34.066304 23832 tablet_bootstrap.cc:492] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:34.067809 24041 raft_consensus.cc:493] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.068414 24041 raft_consensus.cc:515] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.072078 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bfaaac6cef24fd9837185a2710b1823" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:34.073529 23603 leader_election.cc:343] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.076943 24035 leader_election.cc:290] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:34.077345 24041 leader_election.cc:290] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:34.080827 23833 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:34.081512 23833 ts_tablet_manager.cc:1403] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.000s
I20260709 13:07:34.091730 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bfaaac6cef24fd9837185a2710b1823" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.092141 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "871dc3bda4c344b9bd080bf3fae3d085" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:34.093328 23563 raft_consensus.cc:3060] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.091876 23833 raft_consensus.cc:359] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.096338 23833 raft_consensus.cc:385] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.096698 23833 raft_consensus.cc:740] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.102622 23833 consensus_queue.cc:260] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.104182 23560 raft_consensus.cc:2468] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:34.108536 23831 tablet_bootstrap.cc:654] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.111662 23603 leader_election.cc:304] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:34.112682 23980 raft_consensus.cc:2804] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.113312 23980 raft_consensus.cc:493] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.113739 23980 raft_consensus.cc:3060] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.117357 23563 raft_consensus.cc:2468] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:34.124346 23836 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:34.124902 23836 ts_tablet_manager.cc:1403] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.039s
I20260709 13:07:34.112676 23833 ts_tablet_manager.cc:1434] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.004s
I20260709 13:07:34.126577 23833 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:34.125211 23832 tablet_bootstrap.cc:654] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.124157 23980 raft_consensus.cc:515] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.127923 23836 raft_consensus.cc:359] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.128664 23836 raft_consensus.cc:385] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.128928 23836 raft_consensus.cc:740] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.130092 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bfaaac6cef24fd9837185a2710b1823" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:34.130761 23563 raft_consensus.cc:3060] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.129813 23836 consensus_queue.cc:260] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.136730 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bfaaac6cef24fd9837185a2710b1823" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
W20260709 13:07:34.138567 23603 leader_election.cc:343] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.139262 23836 ts_tablet_manager.cc:1434] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:07:34.140784 23836 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:34.141420 23563 raft_consensus.cc:2468] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:34.142760 23603 leader_election.cc:304] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:34.144287 24035 raft_consensus.cc:2804] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.144603 23833 tablet_bootstrap.cc:654] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.144806 24035 raft_consensus.cc:697] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:34.137451 23980 leader_election.cc:290] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:34.145686 24035 consensus_queue.cc:237] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.150699 23836 tablet_bootstrap.cc:654] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.155475 23832 tablet_bootstrap.cc:492] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:34.156014 23832 ts_tablet_manager.cc:1403] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.009s
I20260709 13:07:34.156950 23833 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:34.157455 23833 ts_tablet_manager.cc:1403] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 13:07:34.160406 23833 raft_consensus.cc:359] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.161144 23833 raft_consensus.cc:385] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.161448 23833 raft_consensus.cc:740] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.162252 23833 consensus_queue.cc:260] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.164674 23833 ts_tablet_manager.cc:1434] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:34.166363 23833 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:34.167151 23831 tablet_bootstrap.cc:492] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.167645 23831 ts_tablet_manager.cc:1403] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.010s
I20260709 13:07:34.168970 23461 catalog_manager.cc:5697] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } }
I20260709 13:07:34.171746 23831 raft_consensus.cc:359] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.172582 23831 raft_consensus.cc:385] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.172847 23831 raft_consensus.cc:740] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.173617 23831 consensus_queue.cc:260] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.178457 23831 ts_tablet_manager.cc:1434] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:07:34.180089 23831 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.184298 23836 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:34.184921 23836 ts_tablet_manager.cc:1403] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.009s
I20260709 13:07:34.186475 23833 tablet_bootstrap.cc:654] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.187109 23831 tablet_bootstrap.cc:654] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.190289 23832 raft_consensus.cc:359] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.191138 23832 raft_consensus.cc:385] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.191471 23832 raft_consensus.cc:740] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.193136 23836 raft_consensus.cc:359] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.193881 23836 raft_consensus.cc:385] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.194141 23836 raft_consensus.cc:740] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.194818 23836 consensus_queue.cc:260] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.197270 23836 ts_tablet_manager.cc:1434] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:07:34.198956 23836 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:34.206091 23836 tablet_bootstrap.cc:654] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.200995 23832 consensus_queue.cc:260] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.213168 23832 ts_tablet_manager.cc:1434] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:07:34.214584 23832 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:34.216230 23457 catalog_manager.cc:5697] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.218328 23831 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.219089 23831 ts_tablet_manager.cc:1403] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.039s	user 0.005s	sys 0.007s
I20260709 13:07:34.221014 23832 tablet_bootstrap.cc:654] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.221690 23833 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:34.222348 23833 ts_tablet_manager.cc:1403] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.013s
I20260709 13:07:34.222234 23831 raft_consensus.cc:359] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.223239 23831 raft_consensus.cc:385] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.223502 23831 raft_consensus.cc:740] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.224298 23831 consensus_queue.cc:260] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.225186 23833 raft_consensus.cc:359] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.226073 23833 raft_consensus.cc:385] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.226310 23833 raft_consensus.cc:740] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.226666 23831 ts_tablet_manager.cc:1434] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:07:34.228375 23831 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.229287 23833 consensus_queue.cc:260] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.231789 23833 ts_tablet_manager.cc:1434] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:07:34.233074 23833 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:34.236743 23831 tablet_bootstrap.cc:654] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.238256 23836 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:34.238799 23836 ts_tablet_manager.cc:1403] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.003s
I20260709 13:07:34.242738 23832 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:34.242254 23836 raft_consensus.cc:359] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.243294 23836 raft_consensus.cc:385] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.243368 23832 ts_tablet_manager.cc:1403] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 13:07:34.243625 23836 raft_consensus.cc:740] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.246712 23833 tablet_bootstrap.cc:654] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.248106 23832 raft_consensus.cc:359] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.248797 23832 raft_consensus.cc:385] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.248981 23984 raft_consensus.cc:493] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.249656 23984 raft_consensus.cc:515] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.251839 23984 leader_election.cc:290] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:34.244998 23836 consensus_queue.cc:260] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.257453 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dedb6c9f912b48b1aaac6a3b8947e308" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.257764 23836 ts_tablet_manager.cc:1434] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:07:34.249053 23832 raft_consensus.cc:740] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.259377 23836 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:34.265770 23836 tablet_bootstrap.cc:654] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.258657 23882 raft_consensus.cc:493] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.267853 23882 raft_consensus.cc:515] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.268597 24035 raft_consensus.cc:493] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.269157 24035 raft_consensus.cc:515] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.270177 23882 leader_election.cc:290] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:34.271381 24035 leader_election.cc:290] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:34.273850 23832 consensus_queue.cc:260] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.273383 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.276548 23832 ts_tablet_manager.cc:1434] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.004s
I20260709 13:07:34.277698 23832 tablet_bootstrap.cc:492] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:34.278173 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dedb6c9f912b48b1aaac6a3b8947e308" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:34.278203 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.280719 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:34.281230 23560 raft_consensus.cc:2468] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:34.282696 24042 raft_consensus.cc:493] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.283282 24042 raft_consensus.cc:515] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:34.283828 23602 leader_election.cc:343] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.284853 23832 tablet_bootstrap.cc:654] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.285526 24042 leader_election.cc:290] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
W20260709 13:07:34.286372 23603 leader_election.cc:343] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.286468 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e66f85de59d4ac4b676edfe803876b8" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.286896 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.286904 23603 leader_election.cc:304] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:34.289561 24035 raft_consensus.cc:2749] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.291487 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e66f85de59d4ac4b676edfe803876b8" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:34.293780 23528 leader_election.cc:343] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.295651 23751 leader_election.cc:304] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:34.296080 23882 raft_consensus.cc:493] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.296736 23882 raft_consensus.cc:515] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.297165 24046 raft_consensus.cc:2804] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.297685 24046 raft_consensus.cc:493] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.298071 24046 raft_consensus.cc:3060] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.298636 23882 leader_election.cc:290] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:34.303795 23831 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.304472 23831 ts_tablet_manager.cc:1403] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.077s	user 0.005s	sys 0.012s
I20260709 13:07:34.314970 23831 raft_consensus.cc:359] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.315706 23831 raft_consensus.cc:385] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.316107 23831 raft_consensus.cc:740] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.316983 23831 consensus_queue.cc:260] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.322576 24042 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.323707 24042 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.325696 24042 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:34.326882 23831 ts_tablet_manager.cc:1434] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:07:34.328380 23831 tablet_bootstrap.cc:492] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.338091 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.339293 23562 raft_consensus.cc:2393] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
I20260709 13:07:34.344520 23677 leader_election.cc:304] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:34.345676 24042 raft_consensus.cc:2749] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:34.347316 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 50428.5us
W20260709 13:07:34.348492 23527 leader_election.cc:343] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.349066 23527 leader_election.cc:304] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:34.350586 24064 raft_consensus.cc:2749] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.355369 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a112ab003b24103ae2a7b922dc31f3d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.356238 23563 raft_consensus.cc:2468] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
W20260709 13:07:34.360217 23751 leader_election.cc:343] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.361060 23831 tablet_bootstrap.cc:654] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.376183 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:34.377344 23637 raft_consensus.cc:2393] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:34.380959 23831 tablet_bootstrap.cc:492] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.381500 23831 ts_tablet_manager.cc:1403] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.000s
I20260709 13:07:34.384407 23831 raft_consensus.cc:359] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.385315 23831 raft_consensus.cc:385] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.385660 23831 raft_consensus.cc:740] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.386780 23831 consensus_queue.cc:260] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
W20260709 13:07:34.398554 23677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 51522.6us
I20260709 13:07:34.405825 23831 ts_tablet_manager.cc:1434] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:07:34.406994 23831 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.406795 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a112ab003b24103ae2a7b922dc31f3d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.407544 23712 raft_consensus.cc:2468] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:34.410794 23677 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:34.426030 24035 raft_consensus.cc:493] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.426831 24035 raft_consensus.cc:515] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.432678 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:34.433650 23784 raft_consensus.cc:2468] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:34.435775 23602 leader_election.cc:304] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:34.437027 24041 raft_consensus.cc:2804] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.437601 24041 raft_consensus.cc:493] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.438468 24041 raft_consensus.cc:3060] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.439254 23831 tablet_bootstrap.cc:654] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.453107 23831 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.453763 23831 ts_tablet_manager.cc:1403] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.006s
I20260709 13:07:34.457471 23831 raft_consensus.cc:359] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.458441 23831 raft_consensus.cc:385] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.458789 23831 raft_consensus.cc:740] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.470110 23831 consensus_queue.cc:260] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.472113 23831 ts_tablet_manager.cc:1434] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:07:34.424896 23751 leader_election.cc:304] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:34.473379 23831 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.474350 24041 raft_consensus.cc:515] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.497123 24041 leader_election.cc:290] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:34.478860 24035 leader_election.cc:290] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
W20260709 13:07:34.479878 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 55137.8us
I20260709 13:07:34.486828 23831 tablet_bootstrap.cc:654] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.500089 23836 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:34.500522 23836 ts_tablet_manager.cc:1403] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.241s	user 0.014s	sys 0.101s
I20260709 13:07:34.503232 23836 raft_consensus.cc:359] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.503646 23832 tablet_bootstrap.cc:492] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:34.503753 23836 raft_consensus.cc:385] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.504184 23836 raft_consensus.cc:740] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.505023 23836 consensus_queue.cc:260] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:34.490480 23677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 79807.8us
I20260709 13:07:34.507164 23836 ts_tablet_manager.cc:1434] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:34.491122 24042 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.508654 23836 tablet_bootstrap.cc:492] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:34.510069 23712 raft_consensus.cc:3060] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.510637 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:34.516455 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.489385 24046 raft_consensus.cc:515] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.519124 24046 leader_election.cc:290] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
W20260709 13:07:34.521219 23603 leader_election.cc:343] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.524063 23836 tablet_bootstrap.cc:654] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:34.524272 23603 leader_election.cc:343] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.524693 24042 raft_consensus.cc:2749] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.504206 23832 ts_tablet_manager.cc:1403] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.227s	user 0.050s	sys 0.063s
I20260709 13:07:34.479782 23882 raft_consensus.cc:2804] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.530934 23882 raft_consensus.cc:493] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.531375 23882 raft_consensus.cc:3060] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.506094 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:34.535249 23832 raft_consensus.cc:359] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.536016 23832 raft_consensus.cc:385] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.536367 23832 raft_consensus.cc:740] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.536996 24043 raft_consensus.cc:493] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.537145 23832 consensus_queue.cc:260] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.537580 24043 raft_consensus.cc:515] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.493330 23833 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:34.535856 23782 raft_consensus.cc:3060] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.539181 23833 ts_tablet_manager.cc:1403] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.306s	user 0.056s	sys 0.097s
I20260709 13:07:34.540225 24064 raft_consensus.cc:493] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.542687 24043 leader_election.cc:290] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:34.546519 23882 raft_consensus.cc:515] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.548990 23882 leader_election.cc:290] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:34.551286 24064 raft_consensus.cc:515] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.551728 23980 raft_consensus.cc:493] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.564838 23980 raft_consensus.cc:515] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.566329 24064 leader_election.cc:290] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:34.567217 23980 leader_election.cc:290] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:34.568303 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:34.569003 23708 raft_consensus.cc:3060] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.554133 23782 raft_consensus.cc:2468] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:34.559345 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a112ab003b24103ae2a7b922dc31f3d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:34.569685 23563 raft_consensus.cc:3060] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.572011 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ecbdd1056594932b785458e6cd595c3" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.560233 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:34.575377 23562 raft_consensus.cc:3060] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.560760 23833 raft_consensus.cc:359] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.562701 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bfaaac6cef24fd9837185a2710b1823" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.580751 23833 raft_consensus.cc:385] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.540345 23460 catalog_manager.cc:5697] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.581349 23833 raft_consensus.cc:740] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.590260 23832 ts_tablet_manager.cc:1434] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.003s
W20260709 13:07:34.591073 23603 leader_election.cc:343] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.592445 23833 consensus_queue.cc:260] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.596102 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bfaaac6cef24fd9837185a2710b1823" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:34.597549 23560 raft_consensus.cc:2393] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:34.591837 24046 raft_consensus.cc:493] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.599157 24046 raft_consensus.cc:515] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.601231 24046 leader_election.cc:290] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:34.594561 23460 catalog_manager.cc:5697] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.608125 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a112ab003b24103ae2a7b922dc31f3d" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:34.608142 23833 ts_tablet_manager.cc:1434] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.069s	user 0.008s	sys 0.000s
I20260709 13:07:34.610023 23602 leader_election.cc:304] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:34.608989 23709 raft_consensus.cc:3060] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.611299 23833 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:34.612180 24041 raft_consensus.cc:2804] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.612710 24041 raft_consensus.cc:697] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:34.608458 23832 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:34.613940 24041 consensus_queue.cc:237] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.623365 23708 raft_consensus.cc:2468] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:34.619490 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:34.620013 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ecbdd1056594932b785458e6cd595c3" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:34.623688 23831 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.626250 23831 ts_tablet_manager.cc:1403] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.010s
I20260709 13:07:34.627699 23637 raft_consensus.cc:2468] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:34.629200 23677 leader_election.cc:304] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:34.630486 24115 raft_consensus.cc:3060] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.636627 23836 tablet_bootstrap.cc:492] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:34.630829 23831 raft_consensus.cc:359] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.637154 23831 raft_consensus.cc:385] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.637472 23831 raft_consensus.cc:740] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.637779 23528 leader_election.cc:304] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:34.639231 24064 raft_consensus.cc:2804] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.639705 24064 raft_consensus.cc:493] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.640059 24064 raft_consensus.cc:3060] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.639091 23831 consensus_queue.cc:260] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.643101 23831 ts_tablet_manager.cc:1434] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:07:34.644407 23831 tablet_bootstrap.cc:492] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.650113 23751 leader_election.cc:304] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:34.650467 23831 tablet_bootstrap.cc:654] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.650285 23980 consensus_queue.cc:1048] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:34.637257 23836 ts_tablet_manager.cc:1403] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.129s	user 0.044s	sys 0.041s
I20260709 13:07:34.633584 23832 tablet_bootstrap.cc:654] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:34.638207 23602 leader_election.cc:343] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.657941 24115 raft_consensus.cc:2749] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.659660 23833 tablet_bootstrap.cc:654] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.659740 23836 raft_consensus.cc:359] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.661187 23836 raft_consensus.cc:385] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.661712 23836 raft_consensus.cc:740] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.662626 23836 consensus_queue.cc:260] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.655009 23602 leader_election.cc:304] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:34.662756 24064 raft_consensus.cc:515] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.632709 23562 raft_consensus.cc:2468] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:34.665706 23980 raft_consensus.cc:2749] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.668586 24116 raft_consensus.cc:2804] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.669164 24116 raft_consensus.cc:697] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:34.670058 24116 consensus_queue.cc:237] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.674827 23563 raft_consensus.cc:2468] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:34.675627 23836 ts_tablet_manager.cc:1434] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:07:34.683749 23836 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:34.694672 24064 leader_election.cc:290] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:34.696704 23709 raft_consensus.cc:2468] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:34.706651 23836 tablet_bootstrap.cc:654] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.708168 24046 raft_consensus.cc:493] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.708818 24046 raft_consensus.cc:515] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.711099 24046 leader_election.cc:290] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:34.736598 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:34.742547 23637 raft_consensus.cc:3060] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.750773 23832 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:34.751312 23832 ts_tablet_manager.cc:1403] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.144s	user 0.021s	sys 0.004s
I20260709 13:07:34.760835 23459 catalog_manager.cc:5697] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.745532 23457 catalog_manager.cc:5697] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.771842 23833 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:34.772423 23833 ts_tablet_manager.cc:1403] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.161s	user 0.042s	sys 0.031s
I20260709 13:07:34.774780 24046 raft_consensus.cc:493] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.775507 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.777446 23751 leader_election.cc:304] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:34.778548 23882 raft_consensus.cc:493] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.779393 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:34.779297 23882 raft_consensus.cc:515] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.780345 24044 raft_consensus.cc:2804] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.780882 24044 raft_consensus.cc:697] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:34.781781 24044 consensus_queue.cc:237] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.782197 23882 leader_election.cc:290] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:34.778539 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:34.778904 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ecbdd1056594932b785458e6cd595c3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.786334 23637 raft_consensus.cc:2468] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:34.792891 23831 tablet_bootstrap.cc:492] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:34.786463 23784 raft_consensus.cc:3060] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.775367 24046 raft_consensus.cc:515] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.799196 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:34.799588 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ecbdd1056594932b785458e6cd595c3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:34.795305 23832 raft_consensus.cc:359] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.805006 23832 raft_consensus.cc:385] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.805315 23832 raft_consensus.cc:740] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.806131 23831 ts_tablet_manager.cc:1403] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.025s
I20260709 13:07:34.805727 23638 raft_consensus.cc:2468] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:34.809603 23832 consensus_queue.cc:260] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.804435 24064 raft_consensus.cc:493] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.807147 23528 leader_election.cc:304] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:34.804407 23635 raft_consensus.cc:2468] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:34.819872 23840 raft_consensus.cc:2804] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.829829 23832 ts_tablet_manager.cc:1434] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.003s
I20260709 13:07:34.830533 24041 consensus_queue.cc:1048] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:34.831203 24046 leader_election.cc:290] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:34.838835 23833 raft_consensus.cc:359] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.815749 24064 raft_consensus.cc:515] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:34.840487 23833 raft_consensus.cc:385] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.840991 23833 raft_consensus.cc:740] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.838829 23840 raft_consensus.cc:697] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:34.844146 23832 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:34.838228 23980 consensus_queue.cc:1048] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:34.845141 24064 leader_election.cc:290] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:34.846309 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.860745 23836 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:34.861234 23836 ts_tablet_manager.cc:1403] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.178s	user 0.023s	sys 0.015s
W20260709 13:07:34.861653 23528 leader_election.cc:343] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.864054 23836 raft_consensus.cc:359] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.864813 23836 raft_consensus.cc:385] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.865082 23836 raft_consensus.cc:740] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.854247 23784 raft_consensus.cc:2468] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
W20260709 13:07:34.855090 23751 leader_election.cc:343] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.856626 23831 raft_consensus.cc:359] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.857772 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:34.873270 23831 raft_consensus.cc:385] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.873716 23831 raft_consensus.cc:740] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.859272 23833 consensus_queue.cc:260] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.849948 24041 consensus_queue.cc:1048] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:34.876592 24124 raft_consensus.cc:493] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.877091 24124 raft_consensus.cc:515] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.877301 23831 consensus_queue.cc:260] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.879092 24124 leader_election.cc:290] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:34.879472 23831 ts_tablet_manager.cc:1434] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.003s
I20260709 13:07:34.871277 23836 consensus_queue.cc:260] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:34.888234 23836 ts_tablet_manager.cc:1434] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:07:34.844825 23840 consensus_queue.cc:237] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.901198 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dedb6c9f912b48b1aaac6a3b8947e308" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.901929 23560 raft_consensus.cc:2468] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:34.902161 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.900969 23457 catalog_manager.cc:5697] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.910243 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:34.911183 23635 raft_consensus.cc:2393] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fdf2efb58be4c0c9cbc722e57a73975 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
I20260709 13:07:34.906031 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dedb6c9f912b48b1aaac6a3b8947e308" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:34.912055 23831 tablet_bootstrap.cc:492] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:34.911190 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d42bf20cfb4ca3a1c99680e76288b1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:34.912170 23708 raft_consensus.cc:2468] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:34.912572 23563 raft_consensus.cc:2468] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:34.921195 23751 leader_election.cc:304] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:34.922521 23751 leader_election.cc:304] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:34.923424 23603 leader_election.cc:304] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:34.923702 24046 raft_consensus.cc:2804] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.924145 24046 raft_consensus.cc:493] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.931196 23836 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:34.929811 24035 raft_consensus.cc:2804] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.924368 23882 raft_consensus.cc:2804] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.924476 24046 raft_consensus.cc:3060] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.962023 23836 tablet_bootstrap.cc:654] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.937492 24035 raft_consensus.cc:493] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.964885 24035 raft_consensus.cc:3060] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.942889 23882 raft_consensus.cc:493] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.967337 23882 raft_consensus.cc:3060] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:34.933444 23528 leader_election.cc:343] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.971428 23528 leader_election.cc:304] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:34.972592 24128 raft_consensus.cc:2749] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.940572 24041 raft_consensus.cc:493] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.973718 24041 raft_consensus.cc:515] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.977494 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85de537a84e841488dfe245e698eab3a" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:34.979305 23603 leader_election.cc:343] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.942042 23833 ts_tablet_manager.cc:1434] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.169s	user 0.005s	sys 0.006s
I20260709 13:07:34.964701 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d42bf20cfb4ca3a1c99680e76288b1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:34.985978 23602 leader_election.cc:343] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.986264 24035 raft_consensus.cc:515] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:34.994567 23831 tablet_bootstrap.cc:654] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:34.951632 23751 leader_election.cc:343] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.992440 24041 leader_election.cc:290] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:34.990000 23882 raft_consensus.cc:515] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:34.996436 23833 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:34.964432 23832 tablet_bootstrap.cc:654] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:35.006285 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 54690.5us
I20260709 13:07:35.019527 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85de537a84e841488dfe245e698eab3a" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:35.038589 24046 raft_consensus.cc:515] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.057004 23833 tablet_bootstrap.cc:654] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.064332 23832 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:35.065138 23832 ts_tablet_manager.cc:1403] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.225s	user 0.009s	sys 0.009s
I20260709 13:07:35.045595 23781 raft_consensus.cc:2468] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:35.073239 23457 catalog_manager.cc:5697] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.078578 23751 leader_election.cc:304] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:35.082405 23751 leader_election.cc:304] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:35.083244 24044 raft_consensus.cc:2804] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.083729 24044 raft_consensus.cc:493] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.084110 24044 raft_consensus.cc:3060] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.088129 24046 leader_election.cc:290] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:35.093389 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:35.093701 24035 leader_election.cc:290] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:35.094139 23635 raft_consensus.cc:3060] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.094765 23882 leader_election.cc:290] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:35.100003 24117 raft_consensus.cc:2749] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.101245 23833 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:35.101776 23833 ts_tablet_manager.cc:1403] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.005s
I20260709 13:07:35.101815 23832 raft_consensus.cc:359] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.102638 23832 raft_consensus.cc:385] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.102923 23832 raft_consensus.cc:740] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.103832 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ecbdd1056594932b785458e6cd595c3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:35.103716 23832 consensus_queue.cc:260] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.104372 23638 raft_consensus.cc:3060] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.105396 23831 tablet_bootstrap.cc:492] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:35.106438 23831 ts_tablet_manager.cc:1403] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.195s	user 0.014s	sys 0.019s
I20260709 13:07:35.107484 23635 raft_consensus.cc:2468] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
W20260709 13:07:35.112571 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:35.112792 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d42bf20cfb4ca3a1c99680e76288b1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:35.113528 23562 raft_consensus.cc:3060] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.113762 23836 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:35.114292 23836 ts_tablet_manager.cc:1403] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.200s	user 0.022s	sys 0.009s
I20260709 13:07:35.114329 23831 raft_consensus.cc:359] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.115183 24042 raft_consensus.cc:493] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.115264 23831 raft_consensus.cc:385] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.115796 24042 raft_consensus.cc:515] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.115829 23831 raft_consensus.cc:740] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.118734 23831 consensus_queue.cc:260] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.119869 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ecbdd1056594932b785458e6cd595c3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:35.120483 23832 ts_tablet_manager.cc:1434] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.002s
I20260709 13:07:35.120759 23831 ts_tablet_manager.cc:1434] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:07:35.121505 23832 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:35.122042 23831 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:35.123732 23751 leader_election.cc:304] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:35.125203 24126 raft_consensus.cc:2804] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.125885 24126 raft_consensus.cc:697] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:35.125155 23836 raft_consensus.cc:359] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.126523 23836 raft_consensus.cc:385] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.126812 23836 raft_consensus.cc:740] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.127720 23836 consensus_queue.cc:260] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.126756 24126 consensus_queue.cc:237] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.129905 23836 ts_tablet_manager.cc:1434] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:07:35.130887 23836 tablet_bootstrap.cc:492] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
W20260709 13:07:35.131363 23751 leader_election.cc:343] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.139518 24042 leader_election.cc:290] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:35.141255 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:35.135120 23602 leader_election.cc:304] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:35.146242 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:35.150166 23782 raft_consensus.cc:2393] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:35.149916 24124 consensus_queue.cc:1048] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.147308 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d42bf20cfb4ca3a1c99680e76288b1" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:35.148108 23895 raft_consensus.cc:2804] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.152308 23895 raft_consensus.cc:493] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.152633 23895 raft_consensus.cc:3060] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.145195 23833 raft_consensus.cc:359] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.156574 23833 raft_consensus.cc:385] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.156880 23833 raft_consensus.cc:740] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.156997 23638 raft_consensus.cc:2468] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:35.160569 24046 consensus_queue.cc:1048] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.165728 23751 leader_election.cc:304] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:35.167686 23882 raft_consensus.cc:2804] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.159291 23833 consensus_queue.cc:260] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.168239 23882 raft_consensus.cc:697] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:35.167965 23562 raft_consensus.cc:2468] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:35.166255 23895 raft_consensus.cc:515] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.159512 24044 raft_consensus.cc:515] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.176553 23831 tablet_bootstrap.cc:654] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.174026 23882 consensus_queue.cc:237] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.190205 23833 ts_tablet_manager.cc:1434] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.005s
I20260709 13:07:35.192350 23603 leader_election.cc:304] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:35.191341 24041 raft_consensus.cc:493] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.200425 23980 raft_consensus.cc:2804] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.204487 23833 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:35.204833 23980 raft_consensus.cc:697] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:35.206573 24041 raft_consensus.cc:515] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.206816 23980 consensus_queue.cc:237] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.208716 24041 leader_election.cc:290] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:35.197486 23895 leader_election.cc:290] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:35.212987 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:35.213743 23562 raft_consensus.cc:2468] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:35.216574 23832 tablet_bootstrap.cc:654] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:35.218235 23602 leader_election.cc:343] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.227164 23833 tablet_bootstrap.cc:654] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.216584 23836 tablet_bootstrap.cc:654] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.235685 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:35.235975 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85de537a84e841488dfe245e698eab3a" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:35.236539 23782 raft_consensus.cc:3060] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.238657 23459 catalog_manager.cc:5697] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.245016 24126 consensus_queue.cc:1048] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.235909 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85de537a84e841488dfe245e698eab3a" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
W20260709 13:07:35.263423 23751 leader_election.cc:343] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.266794 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:35.268343 23603 leader_election.cc:304] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
W20260709 13:07:35.277573 23603 leader_election.cc:343] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.288846 23459 catalog_manager.cc:5697] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.277514 23677 leader_election.cc:304] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:35.270347 23709 raft_consensus.cc:3060] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.289506 23980 raft_consensus.cc:2804] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.305580 23980 raft_consensus.cc:493] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.309317 23980 raft_consensus.cc:3060] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.310099 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dedb6c9f912b48b1aaac6a3b8947e308" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:35.310747 23563 raft_consensus.cc:3060] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.307818 24044 leader_election.cc:290] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:35.321044 23782 raft_consensus.cc:2468] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:35.321267 24042 raft_consensus.cc:2749] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.329363 23602 leader_election.cc:304] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:35.334721 24141 raft_consensus.cc:2804] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.336509 23457 catalog_manager.cc:5697] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.338413 23563 raft_consensus.cc:2468] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
W20260709 13:07:35.339316 23603 leader_election.cc:343] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.341604 23833 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:35.342316 23833 ts_tablet_manager.cc:1403] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.143s	user 0.022s	sys 0.007s
I20260709 13:07:35.339264 24141 raft_consensus.cc:697] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:35.345093 24141 consensus_queue.cc:237] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.351742 24044 consensus_queue.cc:1048] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:35.353240 24044 consensus_queue.cc:1048] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.355508 24041 consensus_queue.cc:1048] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.360044 23980 raft_consensus.cc:515] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.361017 23751 leader_election.cc:304] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:35.364914 24044 raft_consensus.cc:2804] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.366984 23984 raft_consensus.cc:493] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.366845 24044 raft_consensus.cc:697] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:35.367553 23984 raft_consensus.cc:515] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.368076 24044 consensus_queue.cc:237] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.369426 23980 leader_election.cc:290] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:35.369827 23984 leader_election.cc:290] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:35.370183 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dedb6c9f912b48b1aaac6a3b8947e308" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:35.373101 23831 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:35.370784 23709 raft_consensus.cc:3060] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.374111 23832 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:35.374176 23831 ts_tablet_manager.cc:1403] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.252s	user 0.037s	sys 0.046s
I20260709 13:07:35.374908 23832 ts_tablet_manager.cc:1403] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.254s	user 0.021s	sys 0.024s
I20260709 13:07:35.376605 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1ae450a6974af090cea14009c262d2" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:35.378062 23528 leader_election.cc:343] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.377847 23832 raft_consensus.cc:359] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.378540 23832 raft_consensus.cc:385] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.378829 23832 raft_consensus.cc:740] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.378887 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:35.385699 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1ae450a6974af090cea14009c262d2" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:35.388298 23984 consensus_queue.cc:1048] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.396319 23836 tablet_bootstrap.cc:492] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:35.396852 23836 ts_tablet_manager.cc:1403] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.266s	user 0.025s	sys 0.019s
I20260709 13:07:35.379550 23563 raft_consensus.cc:3060] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.403115 23836 raft_consensus.cc:359] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.404939 23836 raft_consensus.cc:385] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.405360 23836 raft_consensus.cc:740] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.406286 23836 consensus_queue.cc:260] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.398891 23832 consensus_queue.cc:260] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.410543 23832 ts_tablet_manager.cc:1434] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:07:35.421562 23836 ts_tablet_manager.cc:1434] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 13:07:35.430711 23836 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:35.437685 23709 raft_consensus.cc:2468] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:35.441269 23706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
W20260709 13:07:35.444252 23603 leader_election.cc:343] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.447434 23459 catalog_manager.cc:5697] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.434150 23833 raft_consensus.cc:359] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.452862 23833 raft_consensus.cc:385] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.453195 23833 raft_consensus.cc:740] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
W20260709 13:07:35.458683 23527 leader_election.cc:343] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.459213 23527 leader_election.cc:304] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:35.458215 23831 raft_consensus.cc:359] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.460877 23831 raft_consensus.cc:385] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.454202 23833 consensus_queue.cc:260] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.461153 23831 raft_consensus.cc:740] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.462244 23833 ts_tablet_manager.cc:1434] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.120s	user 0.003s	sys 0.004s
I20260709 13:07:35.462502 23831 consensus_queue.cc:260] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.464990 23831 ts_tablet_manager.cc:1434] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.001s
I20260709 13:07:35.466176 24144 raft_consensus.cc:493] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.460618 23984 raft_consensus.cc:2749] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.466687 24144 raft_consensus.cc:515] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.469141 24144 leader_election.cc:290] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:35.470803 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6641b8962e66467ba062e7c2b419d873" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:35.466563 23831 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:35.478794 23833 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:35.479568 23559 raft_consensus.cc:2468] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:35.482491 23832 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:35.484563 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6641b8962e66467ba062e7c2b419d873" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:35.479663 23458 catalog_manager.cc:5697] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.487347 24042 raft_consensus.cc:493] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.498014 24042 raft_consensus.cc:515] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.501528 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
W20260709 13:07:35.502151 23677 leader_election.cc:343] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.502914 23677 leader_election.cc:304] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:35.489005 23836 tablet_bootstrap.cc:654] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.504519 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:35.505661 24042 leader_election.cc:290] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:35.506153 23638 raft_consensus.cc:2393] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:35.507170 24144 raft_consensus.cc:2804] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.507602 24144 raft_consensus.cc:493] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.507922 24144 raft_consensus.cc:3060] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.511869 23831 tablet_bootstrap.cc:654] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.501585 23833 tablet_bootstrap.cc:654] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.516356 23563 raft_consensus.cc:2468] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:35.518512 23603 leader_election.cc:304] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:35.519431 24141 raft_consensus.cc:2804] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.519976 24141 raft_consensus.cc:697] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:35.520920 24141 consensus_queue.cc:237] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.523552 23831 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:35.524091 23831 ts_tablet_manager.cc:1403] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.002s
I20260709 13:07:35.526999 23831 raft_consensus.cc:359] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.531503 23831 raft_consensus.cc:385] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.531775 23831 raft_consensus.cc:740] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.532474 23831 consensus_queue.cc:260] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.534591 23831 ts_tablet_manager.cc:1434] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 13:07:35.529697 23833 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:35.535602 23833 ts_tablet_manager.cc:1403] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.003s
I20260709 13:07:35.543152 23836 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:35.543711 23836 ts_tablet_manager.cc:1403] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.119s	user 0.019s	sys 0.007s
I20260709 13:07:35.549353 23833 raft_consensus.cc:359] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.550098 23833 raft_consensus.cc:385] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.550390 23833 raft_consensus.cc:740] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.550537 24128 consensus_queue.cc:1048] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.551183 23833 consensus_queue.cc:260] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.553359 23833 ts_tablet_manager.cc:1434] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:07:35.554260 23831 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
W20260709 13:07:35.555704 23677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 52861.1us
I20260709 13:07:35.560623 23677 leader_election.cc:304] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:35.563552 24042 raft_consensus.cc:3060] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.560918 23831 tablet_bootstrap.cc:654] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.566962 24116 raft_consensus.cc:493] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.569643 24116 raft_consensus.cc:515] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.571815 24116 leader_election.cc:290] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:35.537142 24144 raft_consensus.cc:515] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.561915 23833 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:35.576354 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1ae450a6974af090cea14009c262d2" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:35.577064 23563 raft_consensus.cc:2468] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:35.546556 23836 raft_consensus.cc:359] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.579083 23751 leader_election.cc:304] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:35.579375 23836 raft_consensus.cc:385] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.579828 23836 raft_consensus.cc:740] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.579989 24116 raft_consensus.cc:2804] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.580466 24116 raft_consensus.cc:493] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.580806 24116 raft_consensus.cc:3060] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.580818 23836 consensus_queue.cc:260] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.586611 23836 ts_tablet_manager.cc:1434] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:07:35.587918 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1ae450a6974af090cea14009c262d2" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:35.588541 23711 raft_consensus.cc:2468] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:35.590381 23882 consensus_queue.cc:1048] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.712062 23980 consensus_queue.cc:1048] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:35.600979 23836 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:35.620303 23559 raft_consensus.cc:3060] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.718202 24141 raft_consensus.cc:493] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.718803 24141 raft_consensus.cc:515] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.720854 24141 leader_election.cc:290] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:35.625702 23831 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:35.721689 23831 ts_tablet_manager.cc:1403] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.168s	user 0.049s	sys 0.027s
I20260709 13:07:35.614805 23459 catalog_manager.cc:5697] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.724644 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:35.726975 23603 leader_election.cc:343] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.727157 23831 raft_consensus.cc:359] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.727842 23831 raft_consensus.cc:385] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.728104 23831 raft_consensus.cc:740] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.728718 23831 consensus_queue.cc:260] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.723249 23836 tablet_bootstrap.cc:654] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.613231 23832 tablet_bootstrap.cc:654] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.594215 23833 tablet_bootstrap.cc:654] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.596345 24144 leader_election.cc:290] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:35.608807 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6641b8962e66467ba062e7c2b419d873" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:35.737726 23563 raft_consensus.cc:3060] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.738452 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:35.739061 23831 ts_tablet_manager.cc:1434] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:07:35.606338 24042 raft_consensus.cc:2749] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.641295 24046 consensus_queue.cc:1048] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.083s
I20260709 13:07:35.606842 24116 raft_consensus.cc:515] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.616603 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6641b8962e66467ba062e7c2b419d873" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:35.741973 24116 leader_election.cc:290] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
W20260709 13:07:35.742583 23603 leader_election.cc:343] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.743218 23603 leader_election.cc:304] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:35.747409 24141 raft_consensus.cc:2749] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.597589 24126 raft_consensus.cc:493] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.745097 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1ae450a6974af090cea14009c262d2" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:35.752689 23562 raft_consensus.cc:3060] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.751902 24044 consensus_queue.cc:1048] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:35.745244 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec1ae450a6974af090cea14009c262d2" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:35.744295 23782 raft_consensus.cc:3060] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.761530 24046 raft_consensus.cc:493] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.762344 24046 raft_consensus.cc:515] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.765522 24046 leader_election.cc:290] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:35.768236 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:35.754139 24116 consensus_queue.cc:1048] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:07:35.771561 23711 raft_consensus.cc:3060] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.775103 23712 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:35.775228 23831 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:35.808002 24126 raft_consensus.cc:515] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:35.810447 24126 leader_election.cc:290] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:35.812454 23751 leader_election.cc:343] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:35.814632 23751 leader_election.cc:343] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.819696 23751 leader_election.cc:304] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:35.817056 24044 consensus_queue.cc:1048] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:07:35.828742 23706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:35.832674 23751 leader_election.cc:343] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.834092 23563 raft_consensus.cc:2468] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:35.835515 23677 leader_election.cc:304] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:35.836401 24042 raft_consensus.cc:2804] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.836886 24042 raft_consensus.cc:697] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:35.830623 24046 raft_consensus.cc:2749] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.837203 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:35.854276 23562 raft_consensus.cc:2468] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:35.857882 24042 consensus_queue.cc:237] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.859470 23836 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:35.860088 23836 ts_tablet_manager.cc:1403] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.259s	user 0.022s	sys 0.050s
I20260709 13:07:35.863130 24117 raft_consensus.cc:493] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.863646 24117 raft_consensus.cc:515] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:35.864135 23833 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:35.864636 23833 ts_tablet_manager.cc:1403] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.303s	user 0.014s	sys 0.008s
I20260709 13:07:35.868482 23832 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:35.869163 23832 ts_tablet_manager.cc:1403] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.409s	user 0.032s	sys 0.026s
I20260709 13:07:35.877166 23831 tablet_bootstrap.cc:654] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.879901 23833 raft_consensus.cc:359] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:35.888167 23833 raft_consensus.cc:385] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.888541 23833 raft_consensus.cc:740] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.891440 23833 consensus_queue.cc:260] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:35.893983 23677 leader_election.cc:343] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.894524 23836 raft_consensus.cc:359] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.895130 23836 raft_consensus.cc:385] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.895394 23836 raft_consensus.cc:740] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.896070 23836 consensus_queue.cc:260] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:35.878836 24117 leader_election.cc:290] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
W20260709 13:07:36.009716 23602 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 109508us
I20260709 13:07:36.022485 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d42bf20cfb4ca3a1c99680e76288b1" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:36.028620 23751 leader_election.cc:304] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
W20260709 13:07:36.029479 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 119444us
I20260709 13:07:36.030360 24117 raft_consensus.cc:2804] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.031718 24117 raft_consensus.cc:697] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:36.032653 24117 consensus_queue.cc:237] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:36.030419 23751 leader_election.cc:343] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.042229 23751 leader_election.cc:304] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:36.043517 23833 ts_tablet_manager.cc:1434] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.179s	user 0.012s	sys 0.005s
I20260709 13:07:36.049306 23836 ts_tablet_manager.cc:1434] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.189s	user 0.007s	sys 0.008s
I20260709 13:07:36.050843 23832 raft_consensus.cc:359] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.052999 23832 raft_consensus.cc:385] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.053340 23832 raft_consensus.cc:740] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.056360 23832 consensus_queue.cc:260] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.059182 23836 tablet_bootstrap.cc:492] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:36.059095 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42d42bf20cfb4ca3a1c99680e76288b1" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:36.047178 24046 raft_consensus.cc:2749] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.035434 24175 consensus_queue.cc:1048] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:07:36.051661 23711 raft_consensus.cc:2468] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:36.077543 23833 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
W20260709 13:07:36.088524 24181 log.cc:927] Time spent T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:07:36.091365 24182 log.cc:927] Time spent T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:36.094131 23836 tablet_bootstrap.cc:654] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.131397 23832 ts_tablet_manager.cc:1434] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.262s	user 0.027s	sys 0.016s
I20260709 13:07:36.134029 24183 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.134742 24183 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:36.141844 23677 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 241680us
I20260709 13:07:36.142104 24183 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:36.155221 23602 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 103684us
I20260709 13:07:36.153156 23751 leader_election.cc:304] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:36.162688 23832 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:36.161650 24046 raft_consensus.cc:2749] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:36.180641 24184 consensus_queue.cc:1048] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:36.191823 23833 tablet_bootstrap.cc:654] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.194133 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:36.194846 23709 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:36.195283 23836 tablet_bootstrap.cc:492] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:36.195828 23836 ts_tablet_manager.cc:1403] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.005s
I20260709 13:07:36.198774 24175 consensus_queue.cc:1048] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.199290 23980 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.199765 23980 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.200420 23831 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:36.200925 23831 ts_tablet_manager.cc:1403] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.426s	user 0.039s	sys 0.016s
I20260709 13:07:36.201845 23980 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:36.198477 23836 raft_consensus.cc:359] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.202981 23836 raft_consensus.cc:385] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.203466 23836 raft_consensus.cc:740] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.203671 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:36.204381 23562 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:36.204713 23836 consensus_queue.cc:260] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.205569 23603 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:36.206982 24041 raft_consensus.cc:2804] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:36.207386 24041 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.207713 24041 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.209437 23836 ts_tablet_manager.cc:1434] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.004s
I20260709 13:07:36.211336 24183 raft_consensus.cc:493] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.211496 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:36.211947 23832 tablet_bootstrap.cc:654] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.211884 24183 raft_consensus.cc:515] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.214018 23836 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:36.213989 24183 leader_election.cc:290] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:36.229211 23457 catalog_manager.cc:5697] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:36.237849 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 50959.1us
W20260709 13:07:36.248814 23603 consensus_peers.cc:597] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.269434 24041 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.269986 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:36.270421 23706 raft_consensus.cc:3060] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.270756 23707 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:36.280112 23831 raft_consensus.cc:359] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.281148 23831 raft_consensus.cc:385] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.281486 23831 raft_consensus.cc:740] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.274331 23637 raft_consensus.cc:2393] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 156aacba33d94250a5a0a6721246551e in current term 2: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:36.289923 23831 consensus_queue.cc:260] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.297982 23836 tablet_bootstrap.cc:654] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:36.306435 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 51552.9us
I20260709 13:07:36.300555 23783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:36.311836 24115 consensus_queue.cc:1048] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:07:36.318344 24170 consensus_queue.cc:1048] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:36.320806 23895 raft_consensus.cc:493] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.321350 23895 raft_consensus.cc:515] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.324383 23833 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:36.324611 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:36.324935 23833 ts_tablet_manager.cc:1403] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.263s	user 0.020s	sys 0.031s
I20260709 13:07:36.315336 23783 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:36.327632 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6641b8962e66467ba062e7c2b419d873" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:36.327996 23833 raft_consensus.cc:359] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.328442 23561 raft_consensus.cc:2393] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:36.330255 23833 raft_consensus.cc:385] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.330574 23833 raft_consensus.cc:740] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.332337 23562 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:36.332969 23562 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.336330 23833 consensus_queue.cc:260] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.338867 23527 leader_election.cc:304] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:36.340036 24183 raft_consensus.cc:2804] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.340396 24183 raft_consensus.cc:493] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.340701 24183 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.341106 23833 ts_tablet_manager.cc:1434] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:07:36.342211 23833 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:36.342760 24041 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:36.343750 23895 leader_election.cc:290] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:36.356505 24180 raft_consensus.cc:493] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.357121 24180 raft_consensus.cc:515] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:36.360659 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:36.364423 24180 leader_election.cc:290] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:36.365402 23831 ts_tablet_manager.cc:1434] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.164s	user 0.007s	sys 0.002s
I20260709 13:07:36.366683 23831 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:36.383734 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6641b8962e66467ba062e7c2b419d873" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:36.384068 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:36.385442 23831 tablet_bootstrap.cc:654] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.386281 23603 leader_election.cc:304] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:36.373733 23895 consensus_queue.cc:1048] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:07:36.391292 23980 raft_consensus.cc:3060] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.397029 23562 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:36.405614 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8de4fb2abe04956b7c4ecb7e8c66e15" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:36.415599 23833 tablet_bootstrap.cc:654] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.416507 23603 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:36.417377 24141 raft_consensus.cc:2804] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.417878 24141 raft_consensus.cc:697] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:36.418853 24141 consensus_queue.cc:237] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.426332 23836 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:36.426671 23677 leader_election.cc:304] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:36.426920 23836 ts_tablet_manager.cc:1403] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.003s
I20260709 13:07:36.429291 23832 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:36.429793 23832 ts_tablet_manager.cc:1403] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.270s	user 0.010s	sys 0.009s
I20260709 13:07:36.429986 24199 raft_consensus.cc:2749] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:36.432614 23832 raft_consensus.cc:359] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.433279 23832 raft_consensus.cc:385] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.433561 23832 raft_consensus.cc:740] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.440543 23832 consensus_queue.cc:260] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.445417 23980 raft_consensus.cc:2749] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.435467 23706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:36.407437 23528 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:36.454881 23836 raft_consensus.cc:359] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.475306 23836 raft_consensus.cc:385] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.475757 23836 raft_consensus.cc:740] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.483294 23832 ts_tablet_manager.cc:1434] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.001s
I20260709 13:07:36.470573 23706 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.484753 23836 consensus_queue.cc:260] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.455752 24183 raft_consensus.cc:515] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.499365 24183 leader_election.cc:290] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:36.489459 24187 raft_consensus.cc:2764] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:07:36.501520 24195 consensus_queue.cc:1048] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:36.503522 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:36.504252 23781 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.513903 23832 tablet_bootstrap.cc:492] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
W20260709 13:07:36.525835 24197 log.cc:927] Time spent T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:07:36.481668 23528 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 80372.8us
W20260709 13:07:36.532964 23528 leader_election.cc:343] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.534621 24043 consensus_queue.cc:1048] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:36.489112 24141 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.551587 23836 ts_tablet_manager.cc:1434] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.000s
I20260709 13:07:36.563884 23832 tablet_bootstrap.cc:654] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.524832 23781 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:36.571269 23836 tablet_bootstrap.cc:492] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:36.577901 23836 tablet_bootstrap.cc:654] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.581645 23833 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:36.582233 23833 ts_tablet_manager.cc:1403] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.240s	user 0.025s	sys 0.023s
I20260709 13:07:36.586577 23706 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:36.544090 24141 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.598443 23706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:36.599244 23706 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.603770 24141 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:36.606189 23527 leader_election.cc:304] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:36.606079 23833 raft_consensus.cc:359] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.606951 23833 raft_consensus.cc:385] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.607192 24183 raft_consensus.cc:2804] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.607268 23833 raft_consensus.cc:740] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.614070 23833 consensus_queue.cc:260] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.607765 24183 raft_consensus.cc:697] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:36.639719 23833 ts_tablet_manager.cc:1434] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:07:36.630066 24116 raft_consensus.cc:493] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.647665 24042 raft_consensus.cc:493] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.677505 24042 raft_consensus.cc:515] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.680137 23831 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:36.680655 23831 ts_tablet_manager.cc:1403] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.314s	user 0.043s	sys 0.033s
I20260709 13:07:36.682597 23833 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:36.692413 24064 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.695449 24064 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.697839 23831 raft_consensus.cc:359] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.698559 23831 raft_consensus.cc:385] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.698699 23636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85de537a84e841488dfe245e698eab3a" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:36.684852 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:36.698840 23831 raft_consensus.cc:740] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.645253 24191 consensus_queue.cc:1048] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.044s
I20260709 13:07:36.691150 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:36.676302 24116 raft_consensus.cc:515] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.717301 23563 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:36.702500 24064 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:36.729707 23833 tablet_bootstrap.cc:654] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.716144 23831 consensus_queue.cc:260] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.692762 24183 consensus_queue.cc:237] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.738375 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:36.738552 24042 leader_election.cc:290] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:36.743683 23831 ts_tablet_manager.cc:1434] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.001s
I20260709 13:07:36.758445 23831 tablet_bootstrap.cc:492] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:36.763448 23709 raft_consensus.cc:3060] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.755631 24064 raft_consensus.cc:493] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.771481 24064 raft_consensus.cc:515] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.773510 24064 leader_election.cc:290] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:36.736743 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:36.775997 23635 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:36.756323 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85de537a84e841488dfe245e698eab3a" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:36.777222 23460 catalog_manager.cc:5697] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.779229 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:36.780784 24116 leader_election.cc:290] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:36.780838 23676 leader_election.cc:304] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
W20260709 13:07:36.782409 23528 leader_election.cc:343] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:36.790736 23602 leader_election.cc:343] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.802330 23706 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
W20260709 13:07:36.758517 23527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 54932.2us
I20260709 13:07:36.804917 23528 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
W20260709 13:07:36.805733 23527 leader_election.cc:343] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.807047 24187 raft_consensus.cc:2804] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.807497 24187 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.807806 24187 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.808831 23560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:36.812252 23832 tablet_bootstrap.cc:492] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:36.812775 23832 ts_tablet_manager.cc:1403] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.320s	user 0.020s	sys 0.012s
W20260709 13:07:36.813824 23751 leader_election.cc:343] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.819938 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:36.820770 23635 raft_consensus.cc:2468] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:36.824221 23836 tablet_bootstrap.cc:492] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:36.824757 23836 ts_tablet_manager.cc:1403] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.256s	user 0.034s	sys 0.009s
I20260709 13:07:36.827301 23832 raft_consensus.cc:359] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.828060 23832 raft_consensus.cc:385] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.828334 23832 raft_consensus.cc:740] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.829013 23832 consensus_queue.cc:260] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.831352 23831 tablet_bootstrap.cc:654] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:36.836593 23603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 75508.6us
I20260709 13:07:36.838979 23528 leader_election.cc:304] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:36.837561 23836 raft_consensus.cc:359] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.840516 23836 raft_consensus.cc:385] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.840902 23836 raft_consensus.cc:740] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.841351 23832 ts_tablet_manager.cc:1434] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:07:36.847338 23603 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:36.850503 23836 consensus_queue.cc:260] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.851576 24220 raft_consensus.cc:493] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.851878 24221 raft_consensus.cc:2804] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.852505 24221 raft_consensus.cc:493] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.852154 24220 raft_consensus.cc:515] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.853052 23832 tablet_bootstrap.cc:492] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:36.854384 24220 leader_election.cc:290] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:36.855127 24221 raft_consensus.cc:3060] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.863453 24175 raft_consensus.cc:2804] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.863966 24175 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.864369 24175 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.869325 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:36.870092 23786 raft_consensus.cc:2468] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:36.873380 23836 ts_tablet_manager.cc:1434] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 13:07:36.874567 23836 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:36.884655 23833 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:36.885394 23833 ts_tablet_manager.cc:1403] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.209s	user 0.011s	sys 0.009s
I20260709 13:07:36.887017 23602 leader_election.cc:304] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:36.893570 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:36.897547 24188 raft_consensus.cc:2804] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:36.898062 24188 raft_consensus.cc:493] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.898181 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:36.898514 24188 raft_consensus.cc:3060] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.898931 23711 raft_consensus.cc:2468] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:36.904402 23833 raft_consensus.cc:359] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.911216 23833 raft_consensus.cc:385] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.914938 23833 raft_consensus.cc:740] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.915741 23833 consensus_queue.cc:260] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:36.916443 24175 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.918285 23833 ts_tablet_manager.cc:1434] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:07:36.918569 24175 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:36.919555 23833 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:36.920796 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:36.921315 24042 raft_consensus.cc:2749] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:36.922524 23602 leader_election.cc:343] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.906193 23458 catalog_manager.cc:5697] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.913297 23832 tablet_bootstrap.cc:654] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.914036 24187 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:36.914273 24188 raft_consensus.cc:515] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.909448 24221 raft_consensus.cc:515] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:36.926487 24187 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:36.927791 24221 leader_election.cc:290] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:36.928633 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:36.928876 24188 leader_election.cc:290] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:36.929464 23635 raft_consensus.cc:2393] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 156aacba33d94250a5a0a6721246551e in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:36.929235 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:36.930088 23633 raft_consensus.cc:3060] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.930357 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
W20260709 13:07:36.931931 23528 leader_election.cc:343] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.935070 23833 tablet_bootstrap.cc:654] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.938510 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
W20260709 13:07:36.939822 23527 leader_election.cc:343] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.943794 23633 raft_consensus.cc:2468] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:36.945860 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:36.946585 23782 raft_consensus.cc:3060] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.959367 23528 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:36.960378 24221 raft_consensus.cc:2749] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.961606 23709 raft_consensus.cc:1275] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:36.962139 23528 leader_election.cc:304] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:36.962920 24221 raft_consensus.cc:2804] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.963517 24221 raft_consensus.cc:697] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:36.964484 24221 consensus_queue.cc:237] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:36.965803 23751 leader_election.cc:343] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:36.966379 23751 leader_election.cc:304] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:36.968312 24191 raft_consensus.cc:2749] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.969192 23832 tablet_bootstrap.cc:492] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:36.969727 23832 ts_tablet_manager.cc:1403] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.121s	user 0.014s	sys 0.002s
I20260709 13:07:36.976833 23782 raft_consensus.cc:2468] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:36.977893 24175 consensus_queue.cc:1048] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:36.978122 23602 leader_election.cc:304] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:36.987287 24188 raft_consensus.cc:2804] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:36.986824 23457 catalog_manager.cc:5697] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.988085 24188 raft_consensus.cc:697] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:36.989127 23831 tablet_bootstrap.cc:492] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:36.989687 23831 ts_tablet_manager.cc:1403] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.003s
I20260709 13:07:36.989315 24188 consensus_queue.cc:237] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.979075 23832 raft_consensus.cc:359] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.991216 23832 raft_consensus.cc:385] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.991520 23832 raft_consensus.cc:740] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.992194 23832 consensus_queue.cc:260] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.993551 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:36.993731 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:36.994341 23559 raft_consensus.cc:2393] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
I20260709 13:07:36.994354 23709 raft_consensus.cc:3060] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.995072 23831 raft_consensus.cc:359] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:36.996055 23831 raft_consensus.cc:385] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.996091 23832 ts_tablet_manager.cc:1434] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:07:36.997193 23832 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:37.007107 23709 raft_consensus.cc:2468] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:36.996443 23831 raft_consensus.cc:740] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.009804 23831 consensus_queue.cc:260] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.014720 23831 ts_tablet_manager.cc:1434] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:07:37.015815 23831 tablet_bootstrap.cc:492] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:37.015957 23836 tablet_bootstrap.cc:654] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.008040 23832 tablet_bootstrap.cc:654] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.015815 23558 raft_consensus.cc:1275] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:37.024628 23603 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:37.025455 24175 raft_consensus.cc:2749] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.027205 23831 tablet_bootstrap.cc:654] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.028149 23832 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:37.028652 23832 ts_tablet_manager.cc:1403] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.002s
I20260709 13:07:37.030602 23833 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:37.031394 23832 raft_consensus.cc:359] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.032094 23832 raft_consensus.cc:385] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.032341 23832 raft_consensus.cc:740] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.033048 23832 consensus_queue.cc:260] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.031414 23833 ts_tablet_manager.cc:1403] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.112s	user 0.028s	sys 0.017s
I20260709 13:07:37.033432 24175 consensus_queue.cc:1048] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:37.037352 23459 catalog_manager.cc:5697] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.038101 23833 raft_consensus.cc:359] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.038774 23833 raft_consensus.cc:385] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.039108 23833 raft_consensus.cc:740] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.039731 23833 consensus_queue.cc:260] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.042032 23832 ts_tablet_manager.cc:1434] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:07:37.043154 23832 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:37.072646 23459 catalog_manager.cc:5697] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.075685 23833 ts_tablet_manager.cc:1434] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:07:37.086052 23836 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:37.087071 23836 ts_tablet_manager.cc:1403] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.009s
I20260709 13:07:37.094718 24188 raft_consensus.cc:493] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.099232 24188 raft_consensus.cc:515] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.100871 23831 tablet_bootstrap.cc:492] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:37.101243 24188 leader_election.cc:290] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:37.101413 23831 ts_tablet_manager.cc:1403] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.086s	user 0.018s	sys 0.035s
I20260709 13:07:37.107131 23832 tablet_bootstrap.cc:654] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.107693 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:37.111603 23603 leader_election.cc:343] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.112003 24170 raft_consensus.cc:493] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.112555 24170 raft_consensus.cc:515] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.113238 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:37.114630 24170 leader_election.cc:290] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
W20260709 13:07:37.115851 23603 leader_election.cc:343] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.116286 23603 leader_election.cc:304] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:37.117386 24175 raft_consensus.cc:2749] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.123327 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0870de63fd864cf8b6cd8448ac80634b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:37.124066 23833 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:37.123327 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0870de63fd864cf8b6cd8448ac80634b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:37.124781 23751 leader_election.cc:343] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.125030 23559 raft_consensus.cc:2468] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:37.127880 23751 leader_election.cc:304] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:37.130237 24116 raft_consensus.cc:2804] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.114652 23831 raft_consensus.cc:359] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.132890 23831 raft_consensus.cc:385] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.133280 23831 raft_consensus.cc:740] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.134142 23831 consensus_queue.cc:260] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.131938 24116 raft_consensus.cc:493] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.135675 24116 raft_consensus.cc:3060] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.144593 23836 raft_consensus.cc:359] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.150249 23833 tablet_bootstrap.cc:654] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.154002 23836 raft_consensus.cc:385] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.154457 23836 raft_consensus.cc:740] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.158169 23832 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:37.158733 23832 ts_tablet_manager.cc:1403] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.017s
I20260709 13:07:37.161669 23832 raft_consensus.cc:359] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.162422 23832 raft_consensus.cc:385] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.162700 23832 raft_consensus.cc:740] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.163368 23832 consensus_queue.cc:260] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.165432 23832 ts_tablet_manager.cc:1434] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:37.167410 23832 tablet_bootstrap.cc:492] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:37.155560 23836 consensus_queue.cc:260] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.169090 23831 ts_tablet_manager.cc:1434] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 13:07:37.166757 24116 raft_consensus.cc:515] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.174222 23831 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:37.175699 23832 tablet_bootstrap.cc:654] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.176610 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0870de63fd864cf8b6cd8448ac80634b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:37.177310 23558 raft_consensus.cc:3060] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.182885 23831 tablet_bootstrap.cc:654] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.184019 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0870de63fd864cf8b6cd8448ac80634b" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
W20260709 13:07:37.185621 23751 leader_election.cc:343] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.175585 24116 leader_election.cc:290] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.188403 23832 tablet_bootstrap.cc:492] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:37.191849 23836 ts_tablet_manager.cc:1434] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.002s
I20260709 13:07:37.197259 24221 consensus_queue.cc:1048] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:37.212597 24116 raft_consensus.cc:493] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.213166 24116 raft_consensus.cc:515] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.215658 24116 leader_election.cc:290] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:37.216315 23832 ts_tablet_manager.cc:1403] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.007s
I20260709 13:07:37.219370 23836 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:37.221220 23558 raft_consensus.cc:2468] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:37.219636 23832 raft_consensus.cc:359] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.234426 23832 raft_consensus.cc:385] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.224711 23831 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:37.225566 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934afa29ceb24bb8a35260dfb5e22e6a" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:37.227811 24221 consensus_queue.cc:1048] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.234975 23832 raft_consensus.cc:740] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.235558 23831 ts_tablet_manager.cc:1403] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.029s
I20260709 13:07:37.241786 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934afa29ceb24bb8a35260dfb5e22e6a" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:37.242715 23832 consensus_queue.cc:260] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.243719 23638 raft_consensus.cc:2468] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:37.247874 23751 leader_election.cc:304] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
W20260709 13:07:37.252801 23751 leader_election.cc:343] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.254045 23751 leader_election.cc:304] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:37.254817 24116 raft_consensus.cc:2804] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.255650 24116 raft_consensus.cc:697] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:37.256529 24116 consensus_queue.cc:237] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.259802 24170 raft_consensus.cc:2804] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.260267 24170 raft_consensus.cc:493] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.260625 24170 raft_consensus.cc:3060] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.264416 23832 ts_tablet_manager.cc:1434] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:07:37.265487 23832 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:37.271574 23882 raft_consensus.cc:493] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.273072 23836 tablet_bootstrap.cc:654] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.272248 23882 raft_consensus.cc:515] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.279053 23831 raft_consensus.cc:359] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.280081 23831 raft_consensus.cc:385] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.280396 23831 raft_consensus.cc:740] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.281154 23831 consensus_queue.cc:260] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.283205 23831 ts_tablet_manager.cc:1434] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:07:37.284183 23831 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:37.288964 23882 leader_election.cc:290] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:37.295611 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:37.296366 23635 raft_consensus.cc:2468] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:37.298308 23751 leader_election.cc:304] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:37.298938 23882 raft_consensus.cc:2804] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.299360 23882 raft_consensus.cc:493] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.299688 23882 raft_consensus.cc:3060] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.304504 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:37.308065 23751 leader_election.cc:343] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.310436 23833 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:37.310904 23833 ts_tablet_manager.cc:1403] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.214s	user 0.014s	sys 0.011s
I20260709 13:07:37.316802 23831 tablet_bootstrap.cc:654] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.316740 24170 raft_consensus.cc:515] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.321964 24170 leader_election.cc:290] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:37.323141 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934afa29ceb24bb8a35260dfb5e22e6a" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:37.325219 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934afa29ceb24bb8a35260dfb5e22e6a" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:37.328549 23633 raft_consensus.cc:3060] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.334017 23833 raft_consensus.cc:359] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:37.337349 23751 leader_election.cc:343] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.348448 23833 raft_consensus.cc:385] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.349392 23833 raft_consensus.cc:740] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.352053 23882 raft_consensus.cc:515] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.356253 23457 catalog_manager.cc:5697] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.360046 23832 tablet_bootstrap.cc:654] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.368324 23882 leader_election.cc:290] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:37.368701 23836 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:37.373265 24042 raft_consensus.cc:493] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.373793 24042 raft_consensus.cc:515] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.371416 23633 raft_consensus.cc:2468] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:37.375896 24042 leader_election.cc:290] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:37.376870 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:37.378288 23638 raft_consensus.cc:3060] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.377667 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:37.377086 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:37.378894 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:37.380177 23635 raft_consensus.cc:2393] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
I20260709 13:07:37.373276 23836 ts_tablet_manager.cc:1403] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.154s	user 0.010s	sys 0.006s
I20260709 13:07:37.383447 23836 raft_consensus.cc:359] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.383729 23751 leader_election.cc:304] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:37.384095 23836 raft_consensus.cc:385] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.384413 23836 raft_consensus.cc:740] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.385071 23882 raft_consensus.cc:2804] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.385730 23882 raft_consensus.cc:697] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:37.386500 23882 consensus_queue.cc:237] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.388710 23836 consensus_queue.cc:260] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.363444 23833 consensus_queue.cc:260] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.401501 23833 ts_tablet_manager.cc:1434] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.003s
I20260709 13:07:37.403677 23638 raft_consensus.cc:2468] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:37.405203 23833 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:37.405098 23751 leader_election.cc:304] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:37.406978 24170 raft_consensus.cc:2804] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.407554 24170 raft_consensus.cc:697] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:37.408440 24170 consensus_queue.cc:237] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.412326 23836 ts_tablet_manager.cc:1434] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:07:37.413375 23836 tablet_bootstrap.cc:492] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:37.422633 23836 tablet_bootstrap.cc:654] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:37.423272 23751 leader_election.cc:343] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.430684 23677 leader_election.cc:304] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:37.432621 24042 raft_consensus.cc:3060] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.435256 24221 raft_consensus.cc:493] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.435756 24221 raft_consensus.cc:515] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.437796 24221 leader_election.cc:290] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:37.439682 24116 raft_consensus.cc:493] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.440207 24116 raft_consensus.cc:515] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.442214 24116 leader_election.cc:290] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.445372 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0641dafd5a7041a0b0d2cfebe0b4306e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:37.446079 23558 raft_consensus.cc:2468] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:37.448062 23751 leader_election.cc:304] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:37.448915 24042 raft_consensus.cc:2749] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.449108 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:37.449779 23782 raft_consensus.cc:2468] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:37.450987 23527 leader_election.cc:304] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:37.453930 24116 raft_consensus.cc:2804] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.454298 24116 raft_consensus.cc:493] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.454298 24221 raft_consensus.cc:2804] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.454664 24116 raft_consensus.cc:3060] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.454905 24221 raft_consensus.cc:493] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.455295 24221 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.459385 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0641dafd5a7041a0b0d2cfebe0b4306e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:37.460246 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:37.460705 23751 leader_election.cc:343] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.465046 23528 leader_election.cc:343] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.474594 23831 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:37.463969 24221 raft_consensus.cc:515] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.476426 24187 consensus_queue.cc:1048] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.477349 23831 ts_tablet_manager.cc:1403] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.193s	user 0.024s	sys 0.053s
I20260709 13:07:37.479260 23459 catalog_manager.cc:5697] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.480131 23831 raft_consensus.cc:359] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.481030 23831 raft_consensus.cc:385] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.481966 24221 leader_election.cc:290] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:37.481302 23831 raft_consensus.cc:740] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.481623 23459 catalog_manager.cc:5697] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.482736 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:37.483013 23831 consensus_queue.cc:260] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.471778 23832 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:37.483629 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:37.484038 23832 ts_tablet_manager.cc:1403] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.001s
I20260709 13:07:37.483489 23782 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:37.485213 23528 leader_election.cc:343] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.485512 23831 ts_tablet_manager.cc:1434] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:37.486754 23831 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:37.462884 24116 raft_consensus.cc:515] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.488826 23833 tablet_bootstrap.cc:654] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.492754 23782 raft_consensus.cc:2468] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:37.494158 24116 leader_election.cc:290] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.495810 23831 tablet_bootstrap.cc:654] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.515569 23836 tablet_bootstrap.cc:492] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:37.516160 23836 ts_tablet_manager.cc:1403] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.001s
I20260709 13:07:37.518903 23836 raft_consensus.cc:359] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.522399 23836 raft_consensus.cc:385] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.522754 23836 raft_consensus.cc:740] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.523499 23836 consensus_queue.cc:260] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.494808 23832 raft_consensus.cc:359] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.494746 23527 leader_election.cc:304] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:37.527522 23832 raft_consensus.cc:385] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.527978 23832 raft_consensus.cc:740] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.528064 24216 raft_consensus.cc:2804] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.528574 24216 raft_consensus.cc:697] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:37.528945 23832 consensus_queue.cc:260] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.529386 24216 consensus_queue.cc:237] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.531641 23832 ts_tablet_manager.cc:1434] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:07:37.538547 23832 tablet_bootstrap.cc:492] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:37.495575 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0641dafd5a7041a0b0d2cfebe0b4306e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:37.499806 24179 raft_consensus.cc:493] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.541005 24179 raft_consensus.cc:515] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.542891 24179 leader_election.cc:290] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:37.547814 23751 leader_election.cc:343] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.547907 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:37.549382 23603 leader_election.cc:343] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.549731 23527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 55067.5us
I20260709 13:07:37.550613 23832 tablet_bootstrap.cc:654] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.498687 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0641dafd5a7041a0b0d2cfebe0b4306e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:37.526240 24221 consensus_queue.cc:1048] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.522068 23833 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:37.551620 23833 ts_tablet_manager.cc:1403] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.147s	user 0.011s	sys 0.000s
I20260709 13:07:37.552572 23558 raft_consensus.cc:3060] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.554610 23833 raft_consensus.cc:359] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.555365 23833 raft_consensus.cc:385] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.555636 23833 raft_consensus.cc:740] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.556221 23833 consensus_queue.cc:260] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.557749 23833 ts_tablet_manager.cc:1434] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:07:37.558692 23833 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:37.533375 23836 ts_tablet_manager.cc:1434] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:07:37.561057 24175 consensus_queue.cc:1048] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.561412 23836 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:37.562182 23556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:37.563237 24179 consensus_queue.cc:1048] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.578862 23836 tablet_bootstrap.cc:654] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:37.585741 23603 leader_election.cc:343] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.586464 23603 leader_election.cc:304] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:37.590425 23831 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:37.590947 23831 ts_tablet_manager.cc:1403] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.020s
I20260709 13:07:37.590833 24144 raft_consensus.cc:493] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.591444 24144 raft_consensus.cc:515] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.588996 24175 raft_consensus.cc:2749] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.600344 23831 raft_consensus.cc:359] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.601089 23831 raft_consensus.cc:385] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.601374 23831 raft_consensus.cc:740] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.601998 23831 consensus_queue.cc:260] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.603099 23833 tablet_bootstrap.cc:654] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.609777 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0870de63fd864cf8b6cd8448ac80634b" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:37.611312 24144 leader_election.cc:290] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.613229 23831 ts_tablet_manager.cc:1434] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:07:37.614267 23831 tablet_bootstrap.cc:492] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:37.618278 23556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0870de63fd864cf8b6cd8448ac80634b" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:37.619140 23556 raft_consensus.cc:2393] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:37.620966 23677 leader_election.cc:304] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:37.627013 23831 tablet_bootstrap.cc:654] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.628746 24144 raft_consensus.cc:3060] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.653043 24144 raft_consensus.cc:2749] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.661888 24042 raft_consensus.cc:493] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.668043 24042 raft_consensus.cc:515] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.669566 24116 consensus_queue.cc:1048] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.671396 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:37.672258 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:37.672907 23832 tablet_bootstrap.cc:492] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:37.673043 23638 raft_consensus.cc:2393] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:37.673434 23832 ts_tablet_manager.cc:1403] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.003s
I20260709 13:07:37.674839 23677 leader_election.cc:304] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:37.673406 24042 leader_election.cc:290] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:37.675729 24042 raft_consensus.cc:3060] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.680377 23832 raft_consensus.cc:359] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.681192 23832 raft_consensus.cc:385] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.681512 23832 raft_consensus.cc:740] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.666350 23558 raft_consensus.cc:2468] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:37.689435 23751 leader_election.cc:304] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:37.692281 24170 raft_consensus.cc:2804] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.692816 24170 raft_consensus.cc:697] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:37.693655 24170 consensus_queue.cc:237] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.700371 23836 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:37.701045 23836 ts_tablet_manager.cc:1403] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.140s	user 0.014s	sys 0.002s
I20260709 13:07:37.701092 24116 consensus_queue.cc:1048] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:37.682248 23832 consensus_queue.cc:260] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.708877 23833 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:37.709456 23833 ts_tablet_manager.cc:1403] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.151s	user 0.011s	sys 0.002s
I20260709 13:07:37.710326 23831 tablet_bootstrap.cc:492] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:37.710924 23831 ts_tablet_manager.cc:1403] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.097s	user 0.012s	sys 0.006s
I20260709 13:07:37.715010 23832 ts_tablet_manager.cc:1434] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:07:37.716188 23832 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:37.718509 24042 raft_consensus.cc:2749] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.718621 23458 catalog_manager.cc:5697] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.714975 23831 raft_consensus.cc:359] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.722324 23831 raft_consensus.cc:385] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.722599 23831 raft_consensus.cc:740] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.729394 23831 consensus_queue.cc:260] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:37.735209 23832 tablet_bootstrap.cc:654] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.737758 24116 raft_consensus.cc:493] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.738292 24116 raft_consensus.cc:515] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:37.739845 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:37.740303 24116 leader_election.cc:290] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.741922 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:37.743453 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:37.744853 23751 leader_election.cc:343] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:37.745602 23751 leader_election.cc:343] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.745944 23751 leader_election.cc:304] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:37.747310 24116 raft_consensus.cc:2749] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.751802 23831 ts_tablet_manager.cc:1434] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.041s	user 0.002s	sys 0.003s
I20260709 13:07:37.755086 23831 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:37.761267 23836 raft_consensus.cc:359] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.761475 23833 raft_consensus.cc:359] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.762019 23836 raft_consensus.cc:385] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.762251 23833 raft_consensus.cc:385] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.762429 23836 raft_consensus.cc:740] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.762650 23833 raft_consensus.cc:740] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.763397 23833 consensus_queue.cc:260] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.767275 23833 ts_tablet_manager.cc:1434] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 13:07:37.768353 23833 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:37.763415 24216 raft_consensus.cc:493] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.772202 24216 raft_consensus.cc:515] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.772630 23836 consensus_queue.cc:260] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.775938 23832 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:37.777194 23832 ts_tablet_manager.cc:1403] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.004s
I20260709 13:07:37.777552 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:37.776685 23831 tablet_bootstrap.cc:654] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.778177 23638 raft_consensus.cc:2468] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:37.779439 23528 leader_election.cc:304] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:37.781910 23832 raft_consensus.cc:359] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.782430 23705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:37.783275 24221 raft_consensus.cc:2804] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.784768 23833 tablet_bootstrap.cc:654] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.784870 24221 raft_consensus.cc:493] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.785368 24221 raft_consensus.cc:3060] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:37.785545 23528 leader_election.cc:343] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.779775 24216 leader_election.cc:290] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:37.793097 24221 raft_consensus.cc:515] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.795783 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:37.796347 23638 raft_consensus.cc:3060] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.803216 23832 raft_consensus.cc:385] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.803567 23832 raft_consensus.cc:740] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.804258 23832 consensus_queue.cc:260] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.805648 23638 raft_consensus.cc:2468] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:37.812911 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:37.812887 23528 leader_election.cc:304] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:37.814950 23832 ts_tablet_manager.cc:1434] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.002s
W20260709 13:07:37.815186 23528 leader_election.cc:343] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.816085 23832 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:37.817885 23984 raft_consensus.cc:2804] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.818579 23984 raft_consensus.cc:697] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:37.818604 24221 leader_election.cc:290] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:37.805648 23836 ts_tablet_manager.cc:1434] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.004s
I20260709 13:07:37.820015 23984 consensus_queue.cc:237] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:37.823736 23460 catalog_manager.cc:5697] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 1 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.826396 23831 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:37.827104 23831 ts_tablet_manager.cc:1403] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.004s
I20260709 13:07:37.831446 23831 raft_consensus.cc:359] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.826947 24141 raft_consensus.cc:493] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.832347 23831 raft_consensus.cc:385] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.832762 24141 raft_consensus.cc:515] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.832791 23831 raft_consensus.cc:740] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:37.844276 23831 consensus_queue.cc:260] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:37.846650 23832 tablet_bootstrap.cc:654] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.851060 23831 ts_tablet_manager.cc:1434] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:07:37.823757 23836 tablet_bootstrap.cc:492] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:37.852466 23831 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:37.878949 24262 raft_consensus.cc:493] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.879541 24262 raft_consensus.cc:515] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.881569 24262 leader_election.cc:290] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.883963 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:37.883354 24141 leader_election.cc:290] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.884308 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:37.902240 23677 leader_election.cc:343] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.889882 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:37.903254 23782 raft_consensus.cc:2393] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
I20260709 13:07:37.906741 23882 consensus_queue.cc:1048] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:37.907932 23602 leader_election.cc:304] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:37.908994 24188 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.884363 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:37.909919 23781 raft_consensus.cc:2468] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 0.
I20260709 13:07:37.911162 23676 leader_election.cc:304] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:37.912129 24262 raft_consensus.cc:2804] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:37.912520 24262 raft_consensus.cc:493] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.912842 24262 raft_consensus.cc:3060] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.929901 24188 raft_consensus.cc:2749] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:37.926518 24262 raft_consensus.cc:515] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.933997 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:37.934715 23782 raft_consensus.cc:3060] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.942852 23782 raft_consensus.cc:2468] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:37.943974 23676 leader_election.cc:304] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:37.944981 24263 raft_consensus.cc:2804] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:37.945590 24263 raft_consensus.cc:697] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:37.946688 24263 consensus_queue.cc:237] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:37.960151 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
W20260709 13:07:37.961855 23677 leader_election.cc:343] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:37.963165 23836 tablet_bootstrap.cc:654] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.969272 24262 leader_election.cc:290] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:37.958791 23832 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:37.978209 23832 ts_tablet_manager.cc:1403] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.001s
I20260709 13:07:37.983908 23831 tablet_bootstrap.cc:654] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:37.997037 23833 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:37.997542 23833 ts_tablet_manager.cc:1403] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.229s	user 0.047s	sys 0.075s
I20260709 13:07:38.000341 23833 raft_consensus.cc:359] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.001022 23833 raft_consensus.cc:385] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:37.997303 23458 catalog_manager.cc:5697] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.001298 23833 raft_consensus.cc:740] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.002121 23833 consensus_queue.cc:260] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.005632 23833 ts_tablet_manager.cc:1434] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:38.006747 23833 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:38.009774 23832 raft_consensus.cc:359] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.012030 23459 catalog_manager.cc:5697] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.012821 23984 raft_consensus.cc:493] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.026281 23984 raft_consensus.cc:515] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.026950 23831 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:38.013113 23833 tablet_bootstrap.cc:654] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.028406 23984 leader_election.cc:290] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:38.029450 23832 raft_consensus.cc:385] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.030175 23832 raft_consensus.cc:740] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.037356 23882 consensus_queue.cc:1048] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.038862 23833 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:38.039079 23836 tablet_bootstrap.cc:492] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:38.030663 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:38.031047 23831 ts_tablet_manager.cc:1403] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.175s	user 0.012s	sys 0.001s
I20260709 13:07:38.036088 23832 consensus_queue.cc:260] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.040373 24141 raft_consensus.cc:493] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.039408 23833 ts_tablet_manager.cc:1403] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.004s
I20260709 13:07:38.039881 23984 raft_consensus.cc:493] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.041654 23984 raft_consensus.cc:515] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.042150 23832 ts_tablet_manager.cc:1434] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 13:07:38.043275 23633 raft_consensus.cc:2468] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:38.044026 23984 leader_election.cc:290] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:38.046983 23751 consensus_peers.cc:597] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:38.045300 23833 raft_consensus.cc:359] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.049257 23833 raft_consensus.cc:385] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.049805 23833 raft_consensus.cc:740] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.050392 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:38.050432 23833 consensus_queue.cc:260] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.045836 23831 raft_consensus.cc:359] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.040832 24141 raft_consensus.cc:515] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.052862 23833 ts_tablet_manager.cc:1434] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:07:38.039592 23836 ts_tablet_manager.cc:1403] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.216s	user 0.008s	sys 0.005s
I20260709 13:07:38.056002 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:38.056772 24141 leader_election.cc:290] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:38.057802 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:38.058437 23558 raft_consensus.cc:2468] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:38.059702 23603 leader_election.cc:304] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:38.060674 24188 raft_consensus.cc:2804] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.061136 24188 raft_consensus.cc:493] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.061549 24188 raft_consensus.cc:3060] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.062577 23833 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:38.063616 23832 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29: Bootstrap starting.
I20260709 13:07:38.049197 23528 leader_election.cc:304] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
W20260709 13:07:38.065107 23528 leader_election.cc:343] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.065802 24215 raft_consensus.cc:2804] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.066205 24215 raft_consensus.cc:493] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.066689 24215 raft_consensus.cc:3060] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.052004 23831 raft_consensus.cc:385] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.067169 23831 raft_consensus.cc:740] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.067754 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:38.068507 23781 raft_consensus.cc:2468] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:38.068856 23836 raft_consensus.cc:359] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:38.069548 23836 raft_consensus.cc:385] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.069862 23836 raft_consensus.cc:740] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.067848 23831 consensus_queue.cc:260] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.071655 23782 raft_consensus.cc:2468] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:38.071579 24179 raft_consensus.cc:493] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.073877 24179 raft_consensus.cc:515] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:38.074349 23833 tablet_bootstrap.cc:654] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.076010 24179 leader_election.cc:290] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:38.077630 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:38.080030 23831 ts_tablet_manager.cc:1434] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:07:38.080310 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:38.080967 23781 raft_consensus.cc:2468] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:38.083617 23602 leader_election.cc:304] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:38.084694 24175 raft_consensus.cc:2804] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.085071 24175 raft_consensus.cc:493] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.085427 24175 raft_consensus.cc:3060] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.082015 23836 consensus_queue.cc:260] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:38.086294 23711 raft_consensus.cc:2468] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:38.088877 24116 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.089429 24116 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.091660 24116 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:38.095417 23836 ts_tablet_manager.cc:1434] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:07:38.096999 23836 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:38.099465 23984 consensus_queue.cc:1048] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.100044 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:38.100806 23633 raft_consensus.cc:2468] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:38.102991 23528 leader_election.cc:304] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:38.104038 23984 raft_consensus.cc:2804] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.104394 23984 raft_consensus.cc:493] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.104807 23984 raft_consensus.cc:3060] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.113857 24215 raft_consensus.cc:515] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.117627 23836 tablet_bootstrap.cc:654] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.118103 24175 raft_consensus.cc:515] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:38.114781 23833 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:38.119688 24215 leader_election.cc:290] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:38.120085 23833 ts_tablet_manager.cc:1403] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.026s
I20260709 13:07:38.116027 24188 raft_consensus.cc:515] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.120707 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:38.121300 23633 raft_consensus.cc:3060] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.123533 23558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:38.123924 23831 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975: Bootstrap starting.
I20260709 13:07:38.124191 23558 raft_consensus.cc:3060] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.129822 23633 raft_consensus.cc:2468] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:38.130957 23882 consensus_queue.cc:1048] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.137102 24187 consensus_queue.cc:1048] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:38.137406 23528 leader_election.cc:304] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:38.138342 24221 raft_consensus.cc:2804] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.138828 24221 raft_consensus.cc:697] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:38.139703 24221 consensus_queue.cc:237] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.122898 23833 raft_consensus.cc:359] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.146277 23833 raft_consensus.cc:385] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.146590 23833 raft_consensus.cc:740] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.147289 23833 consensus_queue.cc:260] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.147949 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:38.148839 23711 raft_consensus.cc:3060] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.156950 23831 tablet_bootstrap.cc:654] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.160629 23833 ts_tablet_manager.cc:1434] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:07:38.161875 23833 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:38.166054 23558 raft_consensus.cc:2468] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:38.123697 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:38.168282 23559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:38.170403 24188 leader_election.cc:290] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:38.170928 23836 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:38.175570 23836 ts_tablet_manager.cc:1403] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.079s	user 0.015s	sys 0.005s
I20260709 13:07:38.172436 23782 raft_consensus.cc:3060] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.182807 23782 raft_consensus.cc:2468] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:38.189025 23602 leader_election.cc:304] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:38.203894 24282 raft_consensus.cc:2804] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.206496 24282 raft_consensus.cc:697] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:38.211089 24282 consensus_queue.cc:237] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
W20260709 13:07:38.218940 24276 log.cc:927] Time spent T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:38.218823 23984 raft_consensus.cc:515] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.220000 23559 raft_consensus.cc:2393] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fdf2efb58be4c0c9cbc722e57a73975 in current term 1: Already voted for candidate 156aacba33d94250a5a0a6721246551e in this term.
I20260709 13:07:38.221626 23457 catalog_manager.cc:5697] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.223409 23711 raft_consensus.cc:2468] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:38.214071 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:38.267746 23833 tablet_bootstrap.cc:654] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.241627 24175 leader_election.cc:290] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:38.257097 23832 tablet_bootstrap.cc:654] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.271418 23603 leader_election.cc:304] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:38.249735 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:38.276525 23527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 51801.7us
I20260709 13:07:38.275382 23781 raft_consensus.cc:3060] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:38.288039 23528 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 59244.8us
I20260709 13:07:38.284204 23836 raft_consensus.cc:359] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.291486 23836 raft_consensus.cc:385] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.291895 23836 raft_consensus.cc:740] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.254478 24170 consensus_queue.cc:1048] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:07:38.298602 23836 consensus_queue.cc:260] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.309921 23831 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975: No bootstrap required, opened a new log
I20260709 13:07:38.310632 23831 ts_tablet_manager.cc:1403] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent bootstrapping tablet: real 0.187s	user 0.028s	sys 0.032s
I20260709 13:07:38.296501 24179 raft_consensus.cc:2804] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.307169 23633 raft_consensus.cc:2393] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fdf2efb58be4c0c9cbc722e57a73975 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:38.323963 23831 raft_consensus.cc:359] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.327859 24221 raft_consensus.cc:493] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.332821 23831 raft_consensus.cc:385] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.333271 23831 raft_consensus.cc:740] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.336944 23831 consensus_queue.cc:260] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.344272 23831 ts_tablet_manager.cc:1434] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 13:07:38.339671 24179 raft_consensus.cc:697] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:38.368212 23781 raft_consensus.cc:2468] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:38.341658 24221 raft_consensus.cc:515] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.376688 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:38.382895 23836 ts_tablet_manager.cc:1434] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.207s	user 0.014s	sys 0.017s
I20260709 13:07:38.386260 23751 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:38.388314 23882 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.389591 23833 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:38.390067 23833 ts_tablet_manager.cc:1403] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.228s	user 0.014s	sys 0.009s
I20260709 13:07:38.383327 23984 leader_election.cc:290] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:38.385958 23635 raft_consensus.cc:3060] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.395831 23836 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:38.379981 24179 consensus_queue.cc:237] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:38.390810 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:38.400803 24221 leader_election.cc:290] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
W20260709 13:07:38.431438 23528 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:35595, user_credentials={real_user=slave}} blocked reactor thread for 50415us
I20260709 13:07:38.424443 23781 raft_consensus.cc:3060] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.440842 23833 raft_consensus.cc:359] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.445323 23833 raft_consensus.cc:385] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.445766 23833 raft_consensus.cc:740] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.446681 23833 consensus_queue.cc:260] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:38.459400 23527 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.4:35419, user_credentials={real_user=slave}} blocked reactor thread for 68395.5us
I20260709 13:07:38.460538 23882 raft_consensus.cc:2749] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.447520 23635 raft_consensus.cc:2468] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:38.469269 23833 ts_tablet_manager.cc:1434] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.002s
I20260709 13:07:38.475383 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:38.452574 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:38.484875 23528 leader_election.cc:343] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.487250 24170 raft_consensus.cc:493] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.487875 24170 raft_consensus.cc:515] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:38.490960 23528 consensus_peers.cc:597] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:38.497192 23528 leader_election.cc:304] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:38.498214 23832 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29: No bootstrap required, opened a new log
I20260709 13:07:38.499532 23832 ts_tablet_manager.cc:1403] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent bootstrapping tablet: real 0.436s	user 0.012s	sys 0.010s
W20260709 13:07:38.499878 23528 leader_election.cc:343] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.501794 24296 raft_consensus.cc:2804] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:38.511680 24296 raft_consensus.cc:697] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:38.512549 24296 consensus_queue.cc:237] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.498211 23709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:38.524605 23781 raft_consensus.cc:2468] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:38.525203 23833 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
W20260709 13:07:38.527108 23528 leader_election.cc:343] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.527545 23528 leader_election.cc:304] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 156aacba33d94250a5a0a6721246551e; no voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:38.530756 24170 leader_election.cc:290] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:38.540293 24289 raft_consensus.cc:2749] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.557011 24216 consensus_queue.cc:1048] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:07:38.565650 24215 raft_consensus.cc:493] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.586447 23832 raft_consensus.cc:359] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.587762 23832 raft_consensus.cc:385] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.587957 23832 raft_consensus.cc:740] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.603760 23832 consensus_queue.cc:260] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.610118 23563 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:38.619325 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:38.619659 23833 tablet_bootstrap.cc:654] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.611836 24304 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.591145 24215 raft_consensus.cc:515] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
W20260709 13:07:38.643669 23603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 50153.1us
I20260709 13:07:38.646777 23563 raft_consensus.cc:2468] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 0.
I20260709 13:07:38.669070 23836 tablet_bootstrap.cc:654] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.632120 24304 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
W20260709 13:07:38.666718 24307 log.cc:927] Time spent T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
I20260709 13:07:38.662756 24263 raft_consensus.cc:493] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.682040 23751 leader_election.cc:343] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:38.679006 24310 log.cc:927] Time spent T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:38.681770 24263 raft_consensus.cc:515] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.707111 23711 raft_consensus.cc:3060] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.705535 24304 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:38.739358 24215 leader_election.cc:290] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:38.779201 24293 consensus_queue.cc:1048] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:38.781942 24308 log.cc:927] Time spent T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:07:38.751647 24263 leader_election.cc:290] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:38.765812 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:38.794346 24299 consensus_queue.cc:1048] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.800827 23836 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:38.801467 23836 ts_tablet_manager.cc:1403] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.409s	user 0.025s	sys 0.021s
I20260709 13:07:38.803865 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:38.804641 23786 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:38.805256 23781 raft_consensus.cc:2468] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 0.
I20260709 13:07:38.808200 23833 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: No bootstrap required, opened a new log
I20260709 13:07:38.809463 23833 ts_tablet_manager.cc:1403] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.284s	user 0.022s	sys 0.011s
I20260709 13:07:38.810010 23602 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:38.811605 24286 raft_consensus.cc:2804] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:38.812151 24286 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.812603 24286 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.821498 23836 raft_consensus.cc:359] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.828780 23836 raft_consensus.cc:385] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.830493 23836 raft_consensus.cc:740] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.833465 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0641dafd5a7041a0b0d2cfebe0b4306e" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:38.834247 23836 consensus_queue.cc:260] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.856809 23527 leader_election.cc:304] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:38.857712 24289 raft_consensus.cc:2804] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:38.858155 24289 raft_consensus.cc:493] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:38.858536 24289 raft_consensus.cc:3060] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.858825 23833 raft_consensus.cc:359] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.859836 23833 raft_consensus.cc:385] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:38.860162 23833 raft_consensus.cc:740] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:38.860913 23833 consensus_queue.cc:260] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.875006 24286 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:38.878083 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:38.878672 23782 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.881943 23836 ts_tablet_manager.cc:1434] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 13:07:38.883126 23832 ts_tablet_manager.cc:1434] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29: Time spent starting tablet: real 0.383s	user 0.005s	sys 0.016s
I20260709 13:07:38.885210 23833 ts_tablet_manager.cc:1434] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:07:38.885957 23782 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:38.887147 23602 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:38.887914 24301 raft_consensus.cc:2804] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.888398 24301 raft_consensus.cc:697] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:38.889261 24301 consensus_queue.cc:237] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
W20260709 13:07:38.896010 23528 consensus_peers.cc:597] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:38.870075 24289 raft_consensus.cc:515] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:38.898742 23459 catalog_manager.cc:5697] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.899601 24286 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:38.902168 23704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:38.903650 23708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
W20260709 13:07:38.903895 23528 leader_election.cc:343] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:38.906158 23528 leader_election.cc:343] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:38.910231 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:38.912120 23561 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:38.920326 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:38.921087 23561 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.924943 23559 raft_consensus.cc:3060] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.928444 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:38.929157 23782 raft_consensus.cc:3060] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:38.910848 23836 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:38.951814 24289 leader_election.cc:290] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:38.965200 24141 raft_consensus.cc:493] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.967258 24141 raft_consensus.cc:515] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.969996 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0641dafd5a7041a0b0d2cfebe0b4306e" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:38.972532 24263 raft_consensus.cc:493] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.973284 24263 raft_consensus.cc:515] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:38.975695 24263 leader_election.cc:290] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:38.976439 24141 leader_election.cc:290] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:38.979058 24221 consensus_queue.cc:1048] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:38.965854 23836 tablet_bootstrap.cc:654] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:38.991663 23561 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:38.976799 23782 raft_consensus.cc:2468] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 1.
I20260709 13:07:38.995366 23676 leader_election.cc:304] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:38.996632 24263 raft_consensus.cc:2749] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:38.999716 24321 consensus_queue.cc:1048] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:39.002168 23527 leader_election.cc:304] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:39.003302 24289 raft_consensus.cc:2804] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:39.003820 24289 raft_consensus.cc:697] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:39.004932 24289 consensus_queue.cc:237] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:39.007932 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:39.014766 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:39.016675 24221 consensus_queue.cc:1048] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.019229 24301 consensus_queue.cc:1048] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.020608 23836 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:39.021525 23836 ts_tablet_manager.cc:1403] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.001s
I20260709 13:07:39.023010 23677 leader_election.cc:304] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:39.023545 23751 leader_election.cc:304] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:39.024569 24116 raft_consensus.cc:2764] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:07:39.024551 23836 raft_consensus.cc:359] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:39.026448 24301 consensus_queue.cc:1048] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:39.027391 24290 raft_consensus.cc:2749] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:39.039817 24290 consensus_queue.cc:1048] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.041031 23836 raft_consensus.cc:385] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.041898 23836 raft_consensus.cc:740] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.043481 23836 consensus_queue.cc:260] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:39.045887 23460 catalog_manager.cc:5697] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.053323 23836 ts_tablet_manager.cc:1434] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:07:39.054382 23836 tablet_bootstrap.cc:492] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:39.115159 23836 tablet_bootstrap.cc:654] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.117713 23460 catalog_manager.cc:5697] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 0 to 1, leader changed from <none> to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 1 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:39.126546 23508 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:39.138724 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:39.139789 23561 raft_consensus.cc:2468] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 0.
I20260709 13:07:39.152072 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:39.178647 23460 catalog_manager.cc:5697] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } }
I20260709 13:07:39.207151 24175 consensus_queue.cc:1048] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:39.208822 23603 leader_election.cc:343] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.222214 24286 consensus_queue.cc:1048] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.223707 23836 tablet_bootstrap.cc:492] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:39.224220 23836 ts_tablet_manager.cc:1403] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.170s	user 0.025s	sys 0.032s
I20260709 13:07:39.222218 23603 leader_election.cc:304] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:39.225750 24141 raft_consensus.cc:2804] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:39.226198 24141 raft_consensus.cc:493] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.226636 24141 raft_consensus.cc:3060] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.226776 23836 raft_consensus.cc:359] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:39.227977 23836 raft_consensus.cc:385] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.228243 23836 raft_consensus.cc:740] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.228994 23836 consensus_queue.cc:260] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:39.231024 23836 ts_tablet_manager.cc:1434] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:39.232010 23836 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:39.249091 24141 raft_consensus.cc:515] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:39.259104 23836 tablet_bootstrap.cc:654] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.248713 23458 catalog_manager.cc:5697] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.287624 24141 leader_election.cc:290] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:39.288755 23706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:39.291141 23836 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:39.291674 23836 ts_tablet_manager.cc:1403] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:07:39.294468 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:39.295137 23561 raft_consensus.cc:3060] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.294360 23836 raft_consensus.cc:359] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:39.295589 23836 raft_consensus.cc:385] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.296224 23836 raft_consensus.cc:740] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
W20260709 13:07:39.297708 23603 leader_election.cc:343] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:39.304832 23561 raft_consensus.cc:2468] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:39.305997 23836 consensus_queue.cc:260] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:39.308439 23836 ts_tablet_manager.cc:1434] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:07:39.308631 23603 leader_election.cc:304] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:39.313253 24286 raft_consensus.cc:2804] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:39.313714 24286 raft_consensus.cc:697] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:39.314484 24286 consensus_queue.cc:237] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:39.336753 23836 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549: Bootstrap starting.
I20260709 13:07:39.337229 23458 catalog_manager.cc:5697] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:39.343216 23836 tablet_bootstrap.cc:654] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:39.348646 23836 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549: No bootstrap required, opened a new log
I20260709 13:07:39.349056 23836 ts_tablet_manager.cc:1403] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.007s
I20260709 13:07:39.351190 23836 raft_consensus.cc:359] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:39.351691 23836 raft_consensus.cc:385] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:39.351949 23836 raft_consensus.cc:740] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Initialized, Role: FOLLOWER
I20260709 13:07:39.352546 23836 consensus_queue.cc:260] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:39.354624 23836 ts_tablet_manager.cc:1434] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:07:39.378415 23561 raft_consensus.cc:1275] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:39.380225 24286 consensus_queue.cc:1048] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.381991 24263 raft_consensus.cc:493] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.382535 24263 raft_consensus.cc:515] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:39.384727 24263 leader_election.cc:290] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:39.385299 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934afa29ceb24bb8a35260dfb5e22e6a" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:39.386255 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "934afa29ceb24bb8a35260dfb5e22e6a" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:39.388000 23676 leader_election.cc:304] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:39.388795 24263 raft_consensus.cc:2749] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:39.389632 24293 raft_consensus.cc:493] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.390136 24293 raft_consensus.cc:515] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:39.392096 24293 leader_election.cc:290] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:39.392357 23781 raft_consensus.cc:1275] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:39.394594 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:39.393786 24188 consensus_queue.cc:1048] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:39.396629 23561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:39.397568 23561 raft_consensus.cc:2393] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 1: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:39.398486 23677 leader_election.cc:304] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:39.399515 24293 raft_consensus.cc:3060] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.406322 24293 raft_consensus.cc:2749] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:39.439248 23711 raft_consensus.cc:3060] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.445971 23706 raft_consensus.cc:3060] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.590977 23706 raft_consensus.cc:3060] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.600638 24216 consensus_queue.cc:1048] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:39.609473 23711 raft_consensus.cc:3060] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:39.617908 24289 consensus_queue.cc:1048] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.915082 24141 consensus_queue.cc:1048] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:39.918579 24141 consensus_queue.cc:1048] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:40.901917 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
W20260709 13:07:40.913532 23677 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:07:40.917438 23677 consensus_peers.cc:597] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.949359 23603 consensus_peers.cc:597] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.962873 23603 consensus_peers.cc:597] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.965330 23603 consensus_peers.cc:597] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.971639 23751 consensus_peers.cc:597] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.975198 23751 consensus_peers.cc:597] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.977046 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:07:40.977785 23751 consensus_peers.cc:597] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.978171 14036 tablet_replica.cc:333] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:40.978905 14036 raft_consensus.cc:2243] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:40.979302 23751 consensus_peers.cc:597] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.979421 14036 raft_consensus.cc:2272] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.981403 14036 tablet_replica.cc:333] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:40.982044 14036 raft_consensus.cc:2243] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.982810 14036 raft_consensus.cc:2272] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.984923 14036 tablet_replica.cc:333] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:40.985520 14036 raft_consensus.cc:2243] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.986244 14036 raft_consensus.cc:2272] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.988322 14036 tablet_replica.cc:333] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:40.989135 14036 raft_consensus.cc:2243] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.989591 14036 raft_consensus.cc:2272] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.991629 14036 tablet_replica.cc:333] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:40.992239 14036 raft_consensus.cc:2243] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.992964 14036 raft_consensus.cc:2272] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.994652 14036 tablet_replica.cc:333] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:40.995289 14036 raft_consensus.cc:2243] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.995692 14036 raft_consensus.cc:2272] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.997421 14036 tablet_replica.cc:333] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:40.998023 14036 raft_consensus.cc:2243] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.998416 14036 raft_consensus.cc:2272] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.000152 14036 tablet_replica.cc:333] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.000833 14036 raft_consensus.cc:2243] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.001242 14036 raft_consensus.cc:2272] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.002967 14036 tablet_replica.cc:333] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.003573 14036 raft_consensus.cc:2243] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.004024 14036 raft_consensus.cc:2272] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.005692 14036 tablet_replica.cc:333] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.006253 14036 raft_consensus.cc:2243] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.006711 14036 raft_consensus.cc:2272] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.008984 14036 tablet_replica.cc:333] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.009573 14036 raft_consensus.cc:2243] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.010299 14036 raft_consensus.cc:2272] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.012182 14036 tablet_replica.cc:333] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.012956 14036 raft_consensus.cc:2243] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.013430 14036 raft_consensus.cc:2272] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.015640 14036 tablet_replica.cc:333] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.016175 14036 raft_consensus.cc:2243] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.017086 14036 raft_consensus.cc:2272] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.018741 14036 tablet_replica.cc:333] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.019407 14036 raft_consensus.cc:2243] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.019814 14036 raft_consensus.cc:2272] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:41.019919 23603 consensus_peers.cc:597] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.021663 14036 tablet_replica.cc:333] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.022576 14036 raft_consensus.cc:2243] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.023588 14036 raft_consensus.cc:2272] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.026139 14036 tablet_replica.cc:333] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.026894 14036 raft_consensus.cc:2243] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.027462 14036 raft_consensus.cc:2272] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.029441 14036 tablet_replica.cc:333] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.030059 14036 raft_consensus.cc:2243] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.030401 14036 raft_consensus.cc:2272] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.032323 14036 tablet_replica.cc:333] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.033088 14036 raft_consensus.cc:2243] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.033581 14036 raft_consensus.cc:2272] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:41.035825 23603 consensus_peers.cc:597] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.036257 14036 tablet_replica.cc:333] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.036828 14036 raft_consensus.cc:2243] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.037196 14036 raft_consensus.cc:2272] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.039136 14036 tablet_replica.cc:333] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.039810 14036 raft_consensus.cc:2243] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.040297 14036 raft_consensus.cc:2272] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.042236 14036 tablet_replica.cc:333] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.042927 14036 raft_consensus.cc:2243] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.043874 14036 raft_consensus.cc:2272] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.045879 14036 tablet_replica.cc:333] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.046383 14036 raft_consensus.cc:2243] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.047089 14036 raft_consensus.cc:2272] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.048848 14036 tablet_replica.cc:333] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.049330 14036 raft_consensus.cc:2243] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.049681 14036 raft_consensus.cc:2272] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.051813 14036 tablet_replica.cc:333] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.052354 14036 raft_consensus.cc:2243] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.052753 14036 raft_consensus.cc:2272] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:41.053306 23603 consensus_peers.cc:597] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.054898 14036 tablet_replica.cc:333] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.055634 14036 raft_consensus.cc:2243] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.056133 14036 raft_consensus.cc:2272] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.058750 14036 tablet_replica.cc:333] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.059410 14036 raft_consensus.cc:2243] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.059911 14036 raft_consensus.cc:2272] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.062224 14036 tablet_replica.cc:333] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.062817 14036 raft_consensus.cc:2243] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.063256 14036 raft_consensus.cc:2272] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.065239 14036 tablet_replica.cc:333] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.065755 14036 raft_consensus.cc:2243] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.066202 14036 raft_consensus.cc:2272] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.068590 14036 tablet_replica.cc:333] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.069185 14036 raft_consensus.cc:2243] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.069684 14036 raft_consensus.cc:2272] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.072191 14036 tablet_replica.cc:333] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.072917 14036 raft_consensus.cc:2243] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.073724 14036 raft_consensus.cc:2272] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.075651 14036 tablet_replica.cc:333] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.076323 14036 raft_consensus.cc:2243] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.077184 14036 raft_consensus.cc:2272] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.079686 14036 tablet_replica.cc:333] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.080430 14036 raft_consensus.cc:2243] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.080914 14036 raft_consensus.cc:2272] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:41.082104 23677 consensus_peers.cc:597] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.083312 14036 tablet_replica.cc:333] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.084125 14036 raft_consensus.cc:2243] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.085034 14036 raft_consensus.cc:2272] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:41.085394 23603 consensus_peers.cc:597] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.087448 14036 tablet_replica.cc:333] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.088299 14036 raft_consensus.cc:2243] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:41.088303 23751 consensus_peers.cc:597] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.088961 14036 raft_consensus.cc:2272] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.091329 14036 tablet_replica.cc:333] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.092060 14036 raft_consensus.cc:2243] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.092538 14036 raft_consensus.cc:2272] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.094941 14036 tablet_replica.cc:333] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
W20260709 13:07:41.095189 23603 consensus_peers.cc:597] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.095707 14036 raft_consensus.cc:2243] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:41.096062 23603 consensus_peers.cc:597] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.096349 14036 raft_consensus.cc:2272] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.098536 14036 tablet_replica.cc:333] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.099162 14036 raft_consensus.cc:2243] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.099570 14036 raft_consensus.cc:2272] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.101497 14036 tablet_replica.cc:333] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.102185 14036 raft_consensus.cc:2243] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.102713 14036 raft_consensus.cc:2272] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.104867 14036 tablet_replica.cc:333] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.105434 14036 raft_consensus.cc:2243] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.106256 14036 raft_consensus.cc:2272] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.108234 14036 tablet_replica.cc:333] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.108772 14036 raft_consensus.cc:2243] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.109170 14036 raft_consensus.cc:2272] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.110767 14036 tablet_replica.cc:333] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.111364 14036 raft_consensus.cc:2243] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.111760 14036 raft_consensus.cc:2272] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.113358 14036 tablet_replica.cc:333] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.113790 14036 raft_consensus.cc:2243] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.114130 14036 raft_consensus.cc:2272] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.115870 14036 tablet_replica.cc:333] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.116282 14036 raft_consensus.cc:2243] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.116669 14036 raft_consensus.cc:2272] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.118796 14036 tablet_replica.cc:333] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.119441 14036 raft_consensus.cc:2243] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:41.120244 14036 raft_consensus.cc:2272] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:41.122596 14036 tablet_replica.cc:333] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: stopping tablet replica
I20260709 13:07:41.123204 14036 raft_consensus.cc:2243] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:41.123610 14036 raft_consensus.cc:2272] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:41.141551 23751 consensus_peers.cc:597] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.156628 23751 consensus_peers.cc:597] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.189209 23677 consensus_peers.cc:597] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.193007 23603 consensus_peers.cc:597] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.193559 23603 consensus_peers.cc:597] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.194053 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
W20260709 13:07:41.248806 23603 consensus_peers.cc:597] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.247632 23677 consensus_peers.cc:597] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.254292 23603 consensus_peers.cc:597] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.278765 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:41.282220 23751 consensus_peers.cc:597] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.286794 24370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:41.287973 24371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:41.291592 24373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:41.292424 23677 consensus_peers.cc:597] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.293390 14036 server_base.cc:1061] running on GCE node
W20260709 13:07:41.294888 23751 consensus_peers.cc:597] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.296512 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:41.296762 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:41.296913 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602461296902 us; error 0 us; skew 500 ppm
I20260709 13:07:41.297449 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:41.300468 14036 webserver.cc:533] Webserver started at http://127.13.181.1:38381/ using document root <none> and password file <none>
I20260709 13:07:41.301067 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:41.301319 14036 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:07:41.305747 14036 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:07:41.314472 24378 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.315549 14036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:07:41.315994 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "156aacba33d94250a5a0a6721246551e"
format_stamp: "Formatted at 2026-07-09 13:07:28 on dist-test-slave-28ks"
I20260709 13:07:41.316612 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:07:41.321411 23751 consensus_peers.cc:597] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.351271 23603 consensus_peers.cc:597] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.351893 23603 consensus_peers.cc:597] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.358788 23751 consensus_peers.cc:597] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:41.360924 23751 consensus_peers.cc:597] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:41.363464 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:41.365012 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:41.366745 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:41.371820 24386 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:07:41.656885 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:07:41.657238 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.286s	user 0.001s	sys 0.008s
I20260709 13:07:41.657593 14036 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:07:41.664372 24386 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.684371 24386 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.685211 24386 tablet_bootstrap.cc:492] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.685793 24386 ts_tablet_manager.cc:1403] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.022s	user 0.003s	sys 0.013s
I20260709 13:07:41.688248 24386 raft_consensus.cc:359] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.688863 24386 raft_consensus.cc:740] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.689509 24386 consensus_queue.cc:260] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.691922 24386 ts_tablet_manager.cc:1434] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:07:41.692725 24386 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.719951 24386 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.721151 24386 tablet_bootstrap.cc:492] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.721800 24386 ts_tablet_manager.cc:1403] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.007s
I20260709 13:07:41.724252 24386 raft_consensus.cc:359] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.724920 24386 raft_consensus.cc:740] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.725548 24386 consensus_queue.cc:260] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.727344 24386 ts_tablet_manager.cc:1434] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:41.728137 24386 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.752601 24386 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.753679 24386 tablet_bootstrap.cc:492] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.754405 24386 ts_tablet_manager.cc:1403] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.004s
I20260709 13:07:41.757145 24386 raft_consensus.cc:359] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.757912 24386 raft_consensus.cc:740] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.758817 24386 consensus_queue.cc:260] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.760751 24386 ts_tablet_manager.cc:1434] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:41.761637 24386 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.775938 24386 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.776813 24386 tablet_bootstrap.cc:492] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.777436 24386 ts_tablet_manager.cc:1403] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:07:41.779831 24386 raft_consensus.cc:359] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.780491 24386 raft_consensus.cc:740] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.781088 24386 consensus_queue.cc:260] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.783990 24386 ts_tablet_manager.cc:1434] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:41.784737 24386 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.809815 24386 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.810856 24386 tablet_bootstrap.cc:492] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.811532 24386 ts_tablet_manager.cc:1403] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.004s
I20260709 13:07:41.814541 24386 raft_consensus.cc:359] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.815269 24386 raft_consensus.cc:740] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.816009 24386 consensus_queue.cc:260] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.818324 24386 ts_tablet_manager.cc:1434] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:41.819274 24386 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.850606 24386 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.851696 24386 tablet_bootstrap.cc:492] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.852377 24386 ts_tablet_manager.cc:1403] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.011s
I20260709 13:07:41.854941 24386 raft_consensus.cc:359] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.855688 24386 raft_consensus.cc:740] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.856339 24386 consensus_queue.cc:260] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.857973 24386 ts_tablet_manager.cc:1434] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:41.858559 24386 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.872160 24386 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.873095 24386 tablet_bootstrap.cc:492] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.873682 24386 ts_tablet_manager.cc:1403] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 13:07:41.875964 24386 raft_consensus.cc:359] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.876659 24386 raft_consensus.cc:740] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.877260 24386 consensus_queue.cc:260] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.878985 24386 ts_tablet_manager.cc:1434] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 13:07:41.879721 24386 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.894169 24386 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.895105 24386 tablet_bootstrap.cc:492] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.895696 24386 ts_tablet_manager.cc:1403] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:07:41.898170 24386 raft_consensus.cc:359] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.898823 24386 raft_consensus.cc:740] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.899533 24386 consensus_queue.cc:260] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.901465 24386 ts_tablet_manager.cc:1434] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:41.902120 24386 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.921872 14036 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:07:41.922312 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.265s	user 0.252s	sys 0.000s
I20260709 13:07:41.934425 24386 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.935442 24386 tablet_bootstrap.cc:492] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.936012 24386 ts_tablet_manager.cc:1403] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.023s
I20260709 13:07:41.938211 24386 raft_consensus.cc:359] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.938897 24386 raft_consensus.cc:740] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.939687 24386 consensus_queue.cc:260] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:41.941318 24386 ts_tablet_manager.cc:1434] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:07:41.941946 24386 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.968628 24386 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.969538 24386 tablet_bootstrap.cc:492] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.970129 24386 ts_tablet_manager.cc:1403] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.015s
I20260709 13:07:41.973481 24386 raft_consensus.cc:359] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.974140 24386 raft_consensus.cc:740] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.974892 24386 consensus_queue.cc:260] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.977108 24386 ts_tablet_manager.cc:1434] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:41.977737 24386 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:41.990425 24386 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:41.991438 24386 tablet_bootstrap.cc:492] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:41.992079 24386 ts_tablet_manager.cc:1403] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:07:41.996481 24362 raft_consensus.cc:493] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:41.996394 24386 raft_consensus.cc:359] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.997241 24386 raft_consensus.cc:740] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.997062 24362 raft_consensus.cc:515] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.998111 24386 consensus_queue.cc:260] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:41.999276 24362 leader_election.cc:290] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.000403 24386 ts_tablet_manager.cc:1434] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:42.001307 24386 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.002831 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
W20260709 13:07:42.009184 23677 leader_election.cc:336] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111)
I20260709 13:07:42.009604 23677 leader_election.cc:304] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:42.014669 24362 raft_consensus.cc:2749] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.020205 24386 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.021474 24386 tablet_bootstrap.cc:492] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.022400 24386 ts_tablet_manager.cc:1403] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:07:42.025993 24386 raft_consensus.cc:359] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.026922 24386 raft_consensus.cc:740] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.028039 24386 consensus_queue.cc:260] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.031015 24386 ts_tablet_manager.cc:1434] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:07:42.031934 24386 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.051503 24386 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.052834 24386 tablet_bootstrap.cc:492] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.053596 24386 ts_tablet_manager.cc:1403] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:07:42.055821 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:43543
I20260709 13:07:42.055917 24459 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:43543 every 8 connection(s)
I20260709 13:07:42.056602 24386 raft_consensus.cc:359] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.057389 24386 raft_consensus.cc:740] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.058063 24386 consensus_queue.cc:260] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.060649 24386 ts_tablet_manager.cc:1434] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 13:07:42.061654 24386 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.075682 24386 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.076604 24386 tablet_bootstrap.cc:492] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.076730 24389 raft_consensus.cc:493] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.077280 24386 ts_tablet_manager.cc:1403] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:07:42.077270 24389 raft_consensus.cc:515] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.079558 24389 leader_election.cc:290] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.081040 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.080125 24386 raft_consensus.cc:359] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.082650 24386 raft_consensus.cc:740] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.083480 24386 consensus_queue.cc:260] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.085503 24386 ts_tablet_manager.cc:1434] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:07:42.087356 24386 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.089170 24362 raft_consensus.cc:493] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.089774 24362 raft_consensus.cc:515] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.092979 24460 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37179
I20260709 13:07:42.100927 24460 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:42.101855 24460 heartbeater.cc:507] Master 127.13.181.62:37179 requested a full tablet report, sending...
I20260709 13:07:42.110743 24293 raft_consensus.cc:493] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.111582 24293 raft_consensus.cc:515] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.120677 24386 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.121402 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:42.121670 24386 tablet_bootstrap.cc:492] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.122478 24386 ts_tablet_manager.cc:1403] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.015s
I20260709 13:07:42.124923 24386 raft_consensus.cc:359] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.125520 24386 raft_consensus.cc:740] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.126257 24386 consensus_queue.cc:260] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.127892 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.128495 24293 leader_election.cc:290] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.129915 24141 raft_consensus.cc:493] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.130033 24386 ts_tablet_manager.cc:1434] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:42.133149 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.134487 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:42.134696 23677 leader_election.cc:343] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.135185 24431 raft_consensus.cc:2468] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:42.136237 24434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.136965 24434 raft_consensus.cc:2468] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.135200 23677 leader_election.cc:304] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:42.138388 24293 raft_consensus.cc:2749] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.138811 23677 leader_election.cc:304] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:42.130440 24141 raft_consensus.cc:515] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.139586 24293 raft_consensus.cc:2804] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.140094 24293 raft_consensus.cc:493] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.140519 24293 raft_consensus.cc:3060] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.140666 24141 leader_election.cc:290] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.142117 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:42.143466 24362 leader_election.cc:290] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.147130 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.149966 24293 raft_consensus.cc:515] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.152952 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:42.146714 23603 leader_election.cc:304] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:42.154067 24389 raft_consensus.cc:2804] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.154460 24389 raft_consensus.cc:493] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
W20260709 13:07:42.154865 23603 leader_election.cc:343] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.154866 24389 raft_consensus.cc:3060] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.155913 23603 leader_election.cc:304] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:42.157809 24141 raft_consensus.cc:2749] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.161463 24293 leader_election.cc:290] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.164430 23458 ts_manager.cc:194] Re-registered known tserver with Master: 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.168170 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.168829 24431 raft_consensus.cc:3060] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.170379 24141 raft_consensus.cc:493] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.171651 24309 raft_consensus.cc:493] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.153288 24386 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.172214 24309 raft_consensus.cc:515] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.171021 24141 raft_consensus.cc:515] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.175132 24434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.175864 24309 leader_election.cc:290] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
W20260709 13:07:42.176947 23751 leader_election.cc:343] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.177793 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:42.178954 24141 leader_election.cc:290] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.180660 24431 raft_consensus.cc:2468] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:42.181466 24434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.183629 23677 leader_election.cc:304] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:42.180910 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.184396 24293 raft_consensus.cc:2804] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.185649 24293 raft_consensus.cc:697] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
W20260709 13:07:42.185847 23603 leader_election.cc:343] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.186460 23603 leader_election.cc:304] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:42.186668 24293 consensus_queue.cc:237] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.189155 24141 raft_consensus.cc:2749] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.189905 23751 leader_election.cc:304] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:42.180828 24389 raft_consensus.cc:515] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.191233 24309 raft_consensus.cc:2749] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.192996 24389 leader_election.cc:290] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.193396 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.194085 24432 raft_consensus.cc:3060] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.194922 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:42.203797 24432 raft_consensus.cc:2468] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:42.206101 23603 leader_election.cc:304] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:42.207078 24389 raft_consensus.cc:2804] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.207657 24389 raft_consensus.cc:697] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:42.208561 24389 consensus_queue.cc:237] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.211686 24386 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.212842 24386 tablet_bootstrap.cc:492] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.213663 24386 ts_tablet_manager.cc:1403] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.001s
I20260709 13:07:42.216566 24386 raft_consensus.cc:359] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.217312 24386 raft_consensus.cc:740] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.218030 24386 consensus_queue.cc:260] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.220300 24386 ts_tablet_manager.cc:1434] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:42.219734 23460 catalog_manager.cc:5697] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.221171 24386 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.222530 23459 catalog_manager.cc:5697] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.229949 24309 raft_consensus.cc:493] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.230558 24309 raft_consensus.cc:515] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.233788 24293 raft_consensus.cc:493] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.234658 24293 raft_consensus.cc:515] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.235792 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.232833 24309 leader_election.cc:290] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.236466 24432 raft_consensus.cc:2468] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:42.234325 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.237804 24293 leader_election.cc:290] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.241537 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.244356 23751 leader_election.cc:304] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:42.246400 24309 raft_consensus.cc:2804] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.246790 24309 raft_consensus.cc:493] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.247262 24309 raft_consensus.cc:3060] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.246851 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:42.248903 23677 leader_election.cc:343] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.249341 23677 leader_election.cc:304] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:42.251418 24362 raft_consensus.cc:2749] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.252745 24362 raft_consensus.cc:493] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.253238 24362 raft_consensus.cc:515] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.255996 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:42.256664 24362 leader_election.cc:290] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.258921 24141 raft_consensus.cc:493] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.259155 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.259519 24141 raft_consensus.cc:515] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.259825 24431 raft_consensus.cc:2468] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:42.261404 24141 leader_election.cc:290] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.262295 23677 leader_election.cc:304] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:42.263958 24382 raft_consensus.cc:2804] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.264492 24382 raft_consensus.cc:493] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.264832 24382 raft_consensus.cc:3060] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.270198 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.271093 23707 raft_consensus.cc:2468] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.271174 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.272035 24433 raft_consensus.cc:2468] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.273080 24388 raft_consensus.cc:493] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.274000 24388 raft_consensus.cc:515] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.275158 23603 leader_election.cc:304] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:42.276080 24141 raft_consensus.cc:2804] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.276438 24141 raft_consensus.cc:493] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.276796 24141 raft_consensus.cc:3060] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.278127 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:42.278925 23786 raft_consensus.cc:2468] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.280000 23602 leader_election.cc:304] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:42.281430 24179 raft_consensus.cc:2804] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.281754 24179 raft_consensus.cc:493] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.282070 24179 raft_consensus.cc:3060] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.282539 24388 leader_election.cc:290] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.284737 24388 raft_consensus.cc:493] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.287586 24382 raft_consensus.cc:515] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.288651 24179 raft_consensus.cc:515] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.287199 24388 raft_consensus.cc:515] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.290266 24382 leader_election.cc:290] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.288941 24309 raft_consensus.cc:515] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.291200 23786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:42.292251 23781 raft_consensus.cc:2393] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 2: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:42.293227 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.293782 24431 raft_consensus.cc:3060] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.295605 24179 leader_election.cc:290] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.296147 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.296550 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:42.298584 23781 raft_consensus.cc:3060] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.299690 23458 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47374
W20260709 13:07:42.297572 23603 leader_election.cc:343] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.297935 24434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d840fb6d5bb459dadc6e033bf997f5e" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.304375 24460 heartbeater.cc:499] Master 127.13.181.62:37179 was elected leader, sending a full tablet report...
I20260709 13:07:42.309207 24388 leader_election.cc:290] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.314554 24431 raft_consensus.cc:2468] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:42.311460 24179 raft_consensus.cc:493] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.316531 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:42.316455 24179 raft_consensus.cc:515] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.316831 23677 leader_election.cc:304] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:42.317348 23707 raft_consensus.cc:2393] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8fdf2efb58be4c0c9cbc722e57a73975 in current term 2: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:42.317621 24386 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.312227 23781 raft_consensus.cc:2468] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:42.318629 24386 tablet_bootstrap.cc:492] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.318845 23602 leader_election.cc:304] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:42.319420 24386 ts_tablet_manager.cc:1403] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.027s
I20260709 13:07:42.310099 24309 leader_election.cc:290] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.317770 24382 raft_consensus.cc:2804] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.319677 24179 leader_election.cc:290] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.320170 24388 raft_consensus.cc:2804] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.320263 24382 raft_consensus.cc:697] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:42.326000 24141 raft_consensus.cc:515] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.322263 24386 raft_consensus.cc:359] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.328137 24386 raft_consensus.cc:740] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.329000 24386 consensus_queue.cc:260] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.330930 24386 ts_tablet_manager.cc:1434] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:42.331862 24386 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.331225 24382 consensus_queue.cc:237] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.324280 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2188519be6684f4b8f46b07846fba5ab" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.336264 24431 raft_consensus.cc:2393] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8fdf2efb58be4c0c9cbc722e57a73975 in current term 2: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:42.337234 24141 leader_election.cc:290] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.338294 23751 leader_election.cc:304] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
W20260709 13:07:42.339304 23603 leader_election.cc:343] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.340011 24366 raft_consensus.cc:2749] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.342440 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.343878 24434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.344576 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.345665 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.345944 24433 raft_consensus.cc:3060] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.346478 23710 raft_consensus.cc:2468] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.344998 24388 raft_consensus.cc:697] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:42.348510 24388 consensus_queue.cc:237] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.346493 24179 raft_consensus.cc:493] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.351943 24179 raft_consensus.cc:515] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.354182 24179 leader_election.cc:290] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.354866 24433 raft_consensus.cc:2468] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:42.356593 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4df4d5bfaa14060b865c3d19e9fa828" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:42.357280 23711 raft_consensus.cc:3060] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.364466 23711 raft_consensus.cc:2468] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:42.345678 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.372918 24179 raft_consensus.cc:493] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.373472 24179 raft_consensus.cc:515] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.375205 24382 raft_consensus.cc:493] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.385133 24382 raft_consensus.cc:515] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.387897 24389 raft_consensus.cc:493] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.388490 24389 raft_consensus.cc:515] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.389379 24382 leader_election.cc:290] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.375408 24179 leader_election.cc:290] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.391927 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.392246 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:42.390565 24389 leader_election.cc:290] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.392788 24433 raft_consensus.cc:2393] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 2: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:42.392884 23781 raft_consensus.cc:2468] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.395298 23602 leader_election.cc:304] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:42.396536 24389 raft_consensus.cc:2804] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.396962 24389 raft_consensus.cc:493] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.396766 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db0967cdcf34bd1a951b3e732ba51ae" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.397616 24366 raft_consensus.cc:493] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.398141 24366 raft_consensus.cc:515] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.400244 24366 leader_election.cc:290] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.397589 24389 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.406831 24366 raft_consensus.cc:493] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.407647 24366 raft_consensus.cc:515] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.410099 24366 leader_election.cc:290] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.413262 24386 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.414390 24386 tablet_bootstrap.cc:492] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.415623 24386 ts_tablet_manager.cc:1403] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.000s
I20260709 13:07:42.416528 24366 raft_consensus.cc:493] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.418996 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.419369 24366 raft_consensus.cc:515] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.419763 24431 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:42.421650 24366 leader_election.cc:290] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.422835 23677 leader_election.cc:304] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:42.424060 24293 raft_consensus.cc:3060] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.424666 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.426739 23751 leader_election.cc:304] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:42.428699 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.429451 24433 raft_consensus.cc:2393] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fdf2efb58be4c0c9cbc722e57a73975 in current term 2: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:42.430430 24366 raft_consensus.cc:2804] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.430830 24366 raft_consensus.cc:493] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.431226 24366 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.432150 24386 raft_consensus.cc:359] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.432868 24386 raft_consensus.cc:740] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.433876 24386 consensus_queue.cc:260] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.436134 24386 ts_tablet_manager.cc:1434] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:07:42.436924 24386 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.437376 24389 raft_consensus.cc:515] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.439196 24293 raft_consensus.cc:2749] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.439390 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
W20260709 13:07:42.443166 23603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 98060.2us
I20260709 13:07:42.443805 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e9732b9e0d94f8d9386a523a65e9519" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.444407 23603 leader_election.cc:304] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:42.445281 24141 raft_consensus.cc:2804] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.445663 24141 raft_consensus.cc:493] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.445999 24141 raft_consensus.cc:3060] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.453876 24141 raft_consensus.cc:515] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.455233 24293 raft_consensus.cc:493] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.456187 24293 raft_consensus.cc:515] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.458259 23751 leader_election.cc:304] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:42.459226 24387 raft_consensus.cc:3060] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:42.459512 23751 leader_election.cc:343] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.464056 24386 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.465042 24386 tablet_bootstrap.cc:492] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.465682 24386 ts_tablet_manager.cc:1403] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
I20260709 13:07:42.466431 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:42.467017 23781 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.468225 23603 leader_election.cc:304] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:42.470508 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.471535 24478 raft_consensus.cc:2804] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.473162 24478 raft_consensus.cc:697] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:42.474237 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.474048 24478 consensus_queue.cc:237] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.474915 24432 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.475807 24389 leader_election.cc:290] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.476076 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.477360 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.476979 23460 catalog_manager.cc:5697] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.478101 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549" is_pre_election: true
I20260709 13:07:42.478750 23710 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.466107 23459 catalog_manager.cc:5697] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.471195 23711 raft_consensus.cc:2468] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 1.
I20260709 13:07:42.490263 23781 raft_consensus.cc:2468] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:42.491847 23602 leader_election.cc:304] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:42.494405 24179 raft_consensus.cc:2804] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.495196 24179 raft_consensus.cc:697] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:42.497531 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.494486 24141 leader_election.cc:290] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.498427 23638 raft_consensus.cc:2468] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:42.496209 24179 consensus_queue.cc:237] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.511679 24382 raft_consensus.cc:493] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.512029 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.512224 24293 leader_election.cc:290] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.512295 24382 raft_consensus.cc:515] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.512769 24433 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:42.514047 23677 leader_election.cc:304] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:42.514221 24387 raft_consensus.cc:2749] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.514413 24382 leader_election.cc:290] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
W20260709 13:07:42.516001 23603 leader_election.cc:343] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.518512 23637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.518621 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.520277 23637 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:42.520750 23634 raft_consensus.cc:2468] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 1.
I20260709 13:07:42.521211 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.522326 24382 raft_consensus.cc:2804] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.522703 24382 raft_consensus.cc:493] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.522744 23677 leader_election.cc:304] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:42.523183 24382 raft_consensus.cc:3060] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:42.524034 23677 leader_election.cc:343] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.524677 24386 raft_consensus.cc:359] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.523844 24387 raft_consensus.cc:493] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.525688 24387 raft_consensus.cc:515] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.527980 24387 leader_election.cc:290] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
W20260709 13:07:42.517987 23603 leader_election.cc:343] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.529119 23603 leader_election.cc:304] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:42.530236 24386 raft_consensus.cc:740] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.531148 24386 consensus_queue.cc:260] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.533648 24386 ts_tablet_manager.cc:1434] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:07:42.531622 23603 leader_election.cc:304] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:42.535485 24141 raft_consensus.cc:2804] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:42.535607 23603 leader_election.cc:343] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.535915 24141 raft_consensus.cc:493] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.536326 24141 raft_consensus.cc:3060] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:42.536617 23603 leader_election.cc:343] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.529490 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.539686 24431 raft_consensus.cc:2468] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:42.532603 24389 raft_consensus.cc:2749] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.507062 24366 raft_consensus.cc:515] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.544736 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:42.547535 23711 raft_consensus.cc:3060] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.542990 23751 leader_election.cc:304] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
W20260709 13:07:42.646070 23751 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:43543, user_credentials={real_user=slave}} blocked reactor thread for 103162us
I20260709 13:07:42.648123 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.648761 24430 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.532842 24293 raft_consensus.cc:2804] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:42.623219 23603 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.3:33247, user_credentials={real_user=slave}} blocked reactor thread for 75968.3us
I20260709 13:07:42.653857 24293 raft_consensus.cc:493] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.654383 24293 raft_consensus.cc:3060] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.654498 23603 leader_election.cc:304] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:42.656968 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" is_pre_election: true
I20260709 13:07:42.657660 23634 raft_consensus.cc:2468] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 1.
I20260709 13:07:42.658499 23710 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:42.661450 24478 raft_consensus.cc:2804] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.662056 24478 raft_consensus.cc:493] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.662547 24478 raft_consensus.cc:3060] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.637010 24362 raft_consensus.cc:493] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.637889 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.639596 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf53bc01d1484dbd95722162c9827f6d" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.664343 24362 raft_consensus.cc:515] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.640446 24141 raft_consensus.cc:515] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.665344 23710 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.666472 24141 leader_election.cc:290] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.667153 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" is_pre_election: true
I20260709 13:07:42.645011 24432 raft_consensus.cc:1275] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.667868 23781 raft_consensus.cc:2393] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 2: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:42.629739 23711 raft_consensus.cc:2468] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:42.635398 24366 leader_election.cc:290] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.669126 24366 raft_consensus.cc:2804] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.669209 24430 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 2.
I20260709 13:07:42.669482 24362 leader_election.cc:290] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543)
I20260709 13:07:42.669579 24366 raft_consensus.cc:493] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.670133 24366 raft_consensus.cc:3060] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.672973 23710 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 2.
I20260709 13:07:42.673887 24432 raft_consensus.cc:1275] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.675139 24382 raft_consensus.cc:515] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.677208 24382 leader_election.cc:290] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.678050 24366 raft_consensus.cc:515] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.680634 24386 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
W20260709 13:07:42.680598 23603 leader_election.cc:343] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:42.681628 23603 leader_election.cc:343] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.682438 24141 consensus_queue.cc:1048] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.686050 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e" is_pre_election: true
I20260709 13:07:42.686285 23751 leader_election.cc:304] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:42.687106 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.687827 24433 raft_consensus.cc:3060] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.689006 24387 raft_consensus.cc:2804] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:42.689381 24387 raft_consensus.cc:493] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 156aacba33d94250a5a0a6721246551e)
I20260709 13:07:42.689730 24387 raft_consensus.cc:3060] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.692221 23706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:42.693279 23706 raft_consensus.cc:2393] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5801d6e785774cafb5fd3d8bbc1caf29 in current term 2: Already voted for candidate 2fa39659edab417ebd04cb981cf61549 in this term.
I20260709 13:07:42.694413 24431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
W20260709 13:07:42.700593 24484 log.cc:927] Time spent T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: Append to log took a long time: real 0.081s	user 0.004s	sys 0.008s
I20260709 13:07:42.707734 23603 leader_election.cc:304] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:42.708238 23711 raft_consensus.cc:1275] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.710062 24366 leader_election.cc:290] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.710799 24389 raft_consensus.cc:2804] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.711880 24430 raft_consensus.cc:2393] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 2: Already voted for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in this term.
I20260709 13:07:42.712138 24389 raft_consensus.cc:697] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:42.713886 23603 leader_election.cc:304] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:42.715742 24433 raft_consensus.cc:2468] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:42.716773 24478 raft_consensus.cc:515] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.717581 24141 raft_consensus.cc:2749] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.727986 24478 leader_election.cc:290] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:42.730337 24387 raft_consensus.cc:515] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.730923 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.731056 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f331d8701aa747479e33e661ec648a30" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:42.731969 23634 raft_consensus.cc:2393] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2fa39659edab417ebd04cb981cf61549 in current term 2: Already voted for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in this term.
I20260709 13:07:42.733837 23459 catalog_manager.cc:5697] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.735622 23459 catalog_manager.cc:5697] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:42.737174 23603 leader_election.cc:343] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.737646 23751 leader_election.cc:304] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:42.738624 24366 raft_consensus.cc:2804] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.737247 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:42.739890 23634 raft_consensus.cc:3060] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.747622 24366 raft_consensus.cc:697] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:42.749014 24387 leader_election.cc:290] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.719929 24430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce9adf205be04005b843fa29a8aa6cbe" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.757906 24486 consensus_queue.cc:1048] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:42.758406 24430 raft_consensus.cc:3060] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.764647 24293 raft_consensus.cc:515] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.766779 24293 leader_election.cc:290] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:42.769475 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ada29c39e396475e91dfcfdc5a412adc" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:42.770267 23711 raft_consensus.cc:3060] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.725782 24386 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.776361 23677 leader_election.cc:304] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549; no voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975
I20260709 13:07:42.725728 24485 consensus_queue.cc:1048] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:42.750649 23781 raft_consensus.cc:1275] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.777132 24386 tablet_bootstrap.cc:492] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:42.777901 24386 ts_tablet_manager.cc:1403] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.097s	user 0.010s	sys 0.004s
I20260709 13:07:42.780519 24386 raft_consensus.cc:359] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.781176 24386 raft_consensus.cc:740] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.751494 24366 consensus_queue.cc:237] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:42.781852 24386 consensus_queue.cc:260] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.757455 23634 raft_consensus.cc:2468] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 2.
I20260709 13:07:42.714134 24389 consensus_queue.cc:237] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.784467 24432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
I20260709 13:07:42.785822 24362 raft_consensus.cc:2749] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:42.786592 24362 consensus_queue.cc:1048] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.790270 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9208e7a4c72e41c9bd0a231c9f25ecbf" candidate_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:42.790905 23638 raft_consensus.cc:3060] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.791668 23677 leader_election.cc:304] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:42.795691 23711 raft_consensus.cc:2468] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:42.804575 23638 raft_consensus.cc:2468] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 2.
I20260709 13:07:42.806454 24386 ts_tablet_manager.cc:1434] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:07:42.807720 24386 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:42.811527 24293 raft_consensus.cc:2804] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.812642 23633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:42.821550 24433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0ef366a73c0412fa3f7e3966917d438" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "156aacba33d94250a5a0a6721246551e"
W20260709 13:07:42.827793 23603 consensus_peers.cc:597] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.828742 23781 raft_consensus.cc:1275] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.827260 23633 raft_consensus.cc:3060] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:42.835289 23603 leader_election.cc:304] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:42.836385 24486 raft_consensus.cc:2804] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.836921 24486 raft_consensus.cc:697] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:42.837749 24486 consensus_queue.cc:237] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.839190 24430 raft_consensus.cc:2468] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fdf2efb58be4c0c9cbc722e57a73975 in term 2.
I20260709 13:07:42.820276 24293 raft_consensus.cc:697] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
W20260709 13:07:42.850978 23751 leader_election.cc:343] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.855757 23786 raft_consensus.cc:1275] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.834245 24485 consensus_queue.cc:1048] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:07:42.862071 23751 leader_election.cc:304] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:42.873878 23751 leader_election.cc:304] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5801d6e785774cafb5fd3d8bbc1caf29, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:42.873251 24497 raft_consensus.cc:2804] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.877656 24497 raft_consensus.cc:697] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:42.860910 23633 raft_consensus.cc:2468] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:42.878510 24497 consensus_queue.cc:237] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
W20260709 13:07:42.869990 23677 leader_election.cc:343] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.886571 23677 leader_election.cc:304] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 156aacba33d94250a5a0a6721246551e
I20260709 13:07:42.895340 23458 catalog_manager.cc:5697] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 2 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.896265 24502 raft_consensus.cc:2804] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.901033 24293 consensus_queue.cc:237] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.905344 23460 catalog_manager.cc:5697] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.901103 24361 raft_consensus.cc:2804] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:42.885334 24389 consensus_queue.cc:1048] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:07:42.910543 24502 raft_consensus.cc:697] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:42.937459 24431 raft_consensus.cc:1275] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.949448 24502 consensus_queue.cc:237] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:42.950335 24389 consensus_queue.cc:1048] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.978281 24361 raft_consensus.cc:697] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Becoming Leader. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:42.985868 24361 consensus_queue.cc:237] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:42.991255 24386 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.001366 24386 tablet_bootstrap.cc:492] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.002086 24386 ts_tablet_manager.cc:1403] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.195s	user 0.021s	sys 0.003s
I20260709 13:07:43.005491 23782 raft_consensus.cc:1275] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.020431 24386 raft_consensus.cc:359] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.021178 24386 raft_consensus.cc:740] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.024295 24386 consensus_queue.cc:260] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.026908 24386 ts_tablet_manager.cc:1434] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:07:43.029390 24386 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.018991 24488 consensus_queue.cc:1048] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:07:43.041007 24431 raft_consensus.cc:1275] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.050770 24293 consensus_queue.cc:1048] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:43.072477 23603 consensus_peers.cc:597] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:43.067602 23457 catalog_manager.cc:5697] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.083293 23460 catalog_manager.cc:5697] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 2 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.091717 23460 catalog_manager.cc:5697] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4). New cstate: current_term: 2 leader_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.109071 23707 raft_consensus.cc:1275] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.110556 23459 catalog_manager.cc:5697] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.112396 23459 catalog_manager.cc:5697] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 156aacba33d94250a5a0a6721246551e (127.13.181.1) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.113698 24486 consensus_queue.cc:1048] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.164024 24386 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.165031 24386 tablet_bootstrap.cc:492] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.165670 24386 ts_tablet_manager.cc:1403] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.000s
I20260709 13:07:43.168159 24386 raft_consensus.cc:359] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.168860 24386 raft_consensus.cc:740] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.169544 24386 consensus_queue.cc:260] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.176165 24386 ts_tablet_manager.cc:1434] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:43.177006 24386 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.190296 23707 raft_consensus.cc:1275] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.191748 24389 consensus_queue.cc:1048] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.196596 24386 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.199240 24386 tablet_bootstrap.cc:492] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.199903 24386 ts_tablet_manager.cc:1403] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 13:07:43.201314 24428 raft_consensus.cc:1275] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 8fdf2efb58be4c0c9cbc722e57a73975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.202836 24510 consensus_queue.cc:1048] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.203218 24386 raft_consensus.cc:359] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:43.204185 24386 raft_consensus.cc:740] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.204959 24386 consensus_queue.cc:260] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
W20260709 13:07:43.217178 23603 consensus_peers.cc:597] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:43.250684 23706 raft_consensus.cc:1275] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 8fdf2efb58be4c0c9cbc722e57a73975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.252872 24386 ts_tablet_manager.cc:1434] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.027s
I20260709 13:07:43.253851 24386 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.253746 24497 consensus_queue.cc:1048] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:43.273473 24386 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.274359 24386 tablet_bootstrap.cc:492] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.275010 24386 ts_tablet_manager.cc:1403] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.001s
I20260709 13:07:43.277377 24386 raft_consensus.cc:359] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.278224 24386 raft_consensus.cc:740] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.278872 24386 consensus_queue.cc:260] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
W20260709 13:07:43.279626 23677 consensus_peers.cc:597] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.280577 24386 ts_tablet_manager.cc:1434] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:07:43.281441 24386 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
W20260709 13:07:43.295821 23751 consensus_peers.cc:597] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.327898 24386 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.329010 24386 tablet_bootstrap.cc:492] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.329656 24386 ts_tablet_manager.cc:1403] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.027s
I20260709 13:07:43.332036 24386 raft_consensus.cc:359] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.332680 24386 raft_consensus.cc:740] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.333324 24386 consensus_queue.cc:260] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.335460 24386 ts_tablet_manager.cc:1434] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:43.336236 24386 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.338173 23637 raft_consensus.cc:1275] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.339879 24518 consensus_queue.cc:1048] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.353929 24431 raft_consensus.cc:1275] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 8fdf2efb58be4c0c9cbc722e57a73975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.364912 24497 consensus_queue.cc:1048] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:43.368201 23677 consensus_peers.cc:597] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:43.370103 23603 consensus_peers.cc:597] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.394299 23603 consensus_peers.cc:597] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:43.395404 23637 raft_consensus.cc:1275] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 8fdf2efb58be4c0c9cbc722e57a73975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.397985 23634 raft_consensus.cc:1275] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 8fdf2efb58be4c0c9cbc722e57a73975: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.399466 24497 consensus_queue.cc:1048] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.399734 24507 consensus_queue.cc:1048] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.409965 24431 raft_consensus.cc:1275] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.416232 24518 consensus_queue.cc:1048] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.419245 23637 raft_consensus.cc:1275] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.421824 24519 consensus_queue.cc:1048] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:43.442282 23706 raft_consensus.cc:1275] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:43.446431 24179 consensus_queue.cc:1048] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:43.450098 23751 consensus_peers.cc:597] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:43.459790 24386 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.461213 24386 tablet_bootstrap.cc:492] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
W20260709 13:07:43.465040 23751 consensus_peers.cc:597] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.465768 24386 ts_tablet_manager.cc:1403] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.130s	user 0.029s	sys 0.034s
I20260709 13:07:43.469090 24386 raft_consensus.cc:359] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.469857 24386 raft_consensus.cc:740] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.472151 24386 consensus_queue.cc:260] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.474200 24386 ts_tablet_manager.cc:1434] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:43.475054 24386 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.499821 24386 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.500752 24386 tablet_bootstrap.cc:492] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.501310 24386 ts_tablet_manager.cc:1403] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.000s
I20260709 13:07:43.503592 24386 raft_consensus.cc:359] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:43.504235 24386 raft_consensus.cc:740] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.505061 24386 consensus_queue.cc:260] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:43.506872 24386 ts_tablet_manager.cc:1434] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:43.508191 24386 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.527710 24386 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.528544 24386 tablet_bootstrap.cc:492] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.529098 24386 ts_tablet_manager.cc:1403] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:07:43.531014 24386 raft_consensus.cc:359] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.531853 24386 raft_consensus.cc:740] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.532555 24386 consensus_queue.cc:260] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.534308 24386 ts_tablet_manager.cc:1434] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:43.535593 24386 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.548352 24386 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.549257 24386 tablet_bootstrap.cc:492] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.549852 24386 ts_tablet_manager.cc:1403] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:07:43.551617 24386 raft_consensus.cc:359] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.552055 24386 raft_consensus.cc:740] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.553007 24386 consensus_queue.cc:260] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:43.554673 24386 ts_tablet_manager.cc:1434] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:43.556000 24386 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
W20260709 13:07:43.559363 23603 consensus_peers.cc:597] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.571575 24386 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.572523 24386 tablet_bootstrap.cc:492] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.573246 24386 ts_tablet_manager.cc:1403] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:07:43.575454 24386 raft_consensus.cc:359] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:43.576149 24386 raft_consensus.cc:740] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.577108 24386 consensus_queue.cc:260] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:43.578841 24386 ts_tablet_manager.cc:1434] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:07:43.579628 24386 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
W20260709 13:07:43.681291 23603 consensus_peers.cc:597] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.729877 24386 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.731618 24386 tablet_bootstrap.cc:492] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.733187 24386 ts_tablet_manager.cc:1403] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.012s
W20260709 13:07:43.740644 23751 consensus_peers.cc:597] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.775419 24386 raft_consensus.cc:359] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.777220 24386 raft_consensus.cc:740] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.778380 24386 consensus_queue.cc:260] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.802542 24386 ts_tablet_manager.cc:1434] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.069s	user 0.012s	sys 0.003s
W20260709 13:07:43.863222 23603 consensus_peers.cc:597] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.868151 24386 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:43.875438 24428 raft_consensus.cc:3060] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:43.891997 23751 consensus_peers.cc:597] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.892922 23751 consensus_peers.cc:597] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.953174 23751 consensus_peers.cc:597] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:43.955116 23603 consensus_peers.cc:597] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:43.961925 24428 raft_consensus.cc:3060] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.970268 24386 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:43.971700 24386 tablet_bootstrap.cc:492] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:43.972388 24386 ts_tablet_manager.cc:1403] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.005s
I20260709 13:07:43.975437 24386 raft_consensus.cc:359] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.976220 24386 raft_consensus.cc:740] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:43.976964 24386 consensus_queue.cc:260] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:43.979544 24386 ts_tablet_manager.cc:1434] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:07:43.980540 24386 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.028765 24386 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.029598 24386 tablet_bootstrap.cc:492] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.030273 24386 ts_tablet_manager.cc:1403] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.050s	user 0.025s	sys 0.020s
I20260709 13:07:44.035880 24386 raft_consensus.cc:359] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.036578 24386 raft_consensus.cc:740] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.037335 24386 consensus_queue.cc:260] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.039994 24386 ts_tablet_manager.cc:1434] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 13:07:44.040947 24386 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.055378 24386 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.056159 24386 tablet_bootstrap.cc:492] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.056711 24386 ts_tablet_manager.cc:1403] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:07:44.059214 24386 raft_consensus.cc:359] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.059856 24386 raft_consensus.cc:740] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.061251 24386 consensus_queue.cc:260] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.063624 24386 ts_tablet_manager.cc:1434] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:44.064703 24386 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.078235 24386 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.079210 24386 tablet_bootstrap.cc:492] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.079836 24386 ts_tablet_manager.cc:1403] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:07:44.082144 24386 raft_consensus.cc:359] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.082651 24386 raft_consensus.cc:740] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.083312 24386 consensus_queue.cc:260] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.085225 24386 ts_tablet_manager.cc:1434] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:44.086149 24386 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.100602 24386 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.101487 24386 tablet_bootstrap.cc:492] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.102058 24386 ts_tablet_manager.cc:1403] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:07:44.104534 24386 raft_consensus.cc:359] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.105224 24386 raft_consensus.cc:740] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.105808 24386 consensus_queue.cc:260] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.107921 24386 ts_tablet_manager.cc:1434] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:44.109457 24386 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.126261 24386 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.127218 24386 tablet_bootstrap.cc:492] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.127810 24386 ts_tablet_manager.cc:1403] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:07:44.129665 24386 raft_consensus.cc:359] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.130364 24386 raft_consensus.cc:740] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.131085 24386 consensus_queue.cc:260] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.133842 24386 ts_tablet_manager.cc:1434] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:44.136854 24386 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.190927 24386 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.192013 24386 tablet_bootstrap.cc:492] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.192639 24386 ts_tablet_manager.cc:1403] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.036s
I20260709 13:07:44.195173 24386 raft_consensus.cc:359] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.195866 24386 raft_consensus.cc:740] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.196527 24386 consensus_queue.cc:260] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.198544 24386 ts_tablet_manager.cc:1434] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:44.199386 24386 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.215197 24386 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.216158 24386 tablet_bootstrap.cc:492] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.216832 24386 ts_tablet_manager.cc:1403] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:07:44.219396 24386 raft_consensus.cc:359] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.220094 24386 raft_consensus.cc:740] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.220646 24386 consensus_queue.cc:260] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:44.222565 24386 ts_tablet_manager.cc:1434] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:44.223734 24386 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.237566 24386 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.238318 24386 tablet_bootstrap.cc:492] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.238956 24386 ts_tablet_manager.cc:1403] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.001s
I20260709 13:07:44.242203 24386 raft_consensus.cc:359] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.242913 24386 raft_consensus.cc:740] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.243645 24386 consensus_queue.cc:260] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.246066 24386 ts_tablet_manager.cc:1434] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 13:07:44.248241 24386 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.263053 24386 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.263959 24386 tablet_bootstrap.cc:492] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.264644 24386 ts_tablet_manager.cc:1403] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:07:44.267336 24386 raft_consensus.cc:359] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.268036 24386 raft_consensus.cc:740] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.268618 24386 consensus_queue.cc:260] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.270031 24386 ts_tablet_manager.cc:1434] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:44.271202 24386 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.285425 24386 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.286346 24386 tablet_bootstrap.cc:492] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.287038 24386 ts_tablet_manager.cc:1403] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:07:44.289136 24386 raft_consensus.cc:359] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.289651 24386 raft_consensus.cc:740] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.290164 24386 consensus_queue.cc:260] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.292007 24386 ts_tablet_manager.cc:1434] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:44.293115 24386 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.312011 24386 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.312891 24386 tablet_bootstrap.cc:492] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.313539 24386 ts_tablet_manager.cc:1403] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.021s	user 0.003s	sys 0.013s
I20260709 13:07:44.315958 24386 raft_consensus.cc:359] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.316634 24386 raft_consensus.cc:740] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.317250 24386 consensus_queue.cc:260] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:44.319193 24386 ts_tablet_manager.cc:1434] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.002s
I20260709 13:07:44.323486 24386 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.341106 24386 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.342088 24386 tablet_bootstrap.cc:492] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.342653 24386 ts_tablet_manager.cc:1403] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:07:44.345434 24386 raft_consensus.cc:359] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.346163 24386 raft_consensus.cc:740] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.346856 24386 consensus_queue.cc:260] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.348748 24386 ts_tablet_manager.cc:1434] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:44.350417 24386 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Bootstrap starting.
I20260709 13:07:44.390633 24386 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:44.391630 24386 tablet_bootstrap.cc:492] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Bootstrap complete.
I20260709 13:07:44.392442 24386 ts_tablet_manager.cc:1403] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.016s
I20260709 13:07:44.395377 24386 raft_consensus.cc:359] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.396073 24386 raft_consensus.cc:740] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Initialized, Role: FOLLOWER
I20260709 13:07:44.396724 24386 consensus_queue.cc:260] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:44.399482 24386 ts_tablet_manager.cc:1434] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:44.402010 24433 raft_consensus.cc:3060] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:44.402820 24428 raft_consensus.cc:3060] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:44.430774 24428 raft_consensus.cc:3060] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:44.615020 24433 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.063705 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.128968 23782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "037f0f88df364595893585d30b8a23e0"
dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
mode: GRACEFUL
new_leader_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:40366
I20260709 13:07:52.129614 23782 raft_consensus.cc:606] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Received request to transfer leadership to TS 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:52.141673 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "265102913f834db596bb95ebf8d031dd"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:52.142191 23634 raft_consensus.cc:606] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:52.144595 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:52.145052 23634 raft_consensus.cc:606] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:52.147338 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:52.147792 23634 raft_consensus.cc:606] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:52.149900 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:52.150424 23634 raft_consensus.cc:606] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:52.152937 23635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a43ac9d400274111ab086900b40199f0"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:52.153379 23635 raft_consensus.cc:606] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:52.159534 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:52.160923 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:52.370697 24592 raft_consensus.cc:993] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975: : Instructing follower 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:52.371388 24584 raft_consensus.cc:1081] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Signalling peer 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:52.373821 23711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "037f0f88df364595893585d30b8a23e0"
dest_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:41846
I20260709 13:07:52.374369 23711 raft_consensus.cc:493] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.374724 23711 raft_consensus.cc:3060] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.377359 24585 raft_consensus.cc:993] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.377969 24585 raft_consensus.cc:1081] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.383519 24433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "265102913f834db596bb95ebf8d031dd"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:52.384349 23711 raft_consensus.cc:515] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:52.384617 24433 raft_consensus.cc:493] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.385098 24433 raft_consensus.cc:3060] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.386619 23711 leader_election.cc:290] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:52.387125 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:52.387810 23635 raft_consensus.cc:3060] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.390911 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "037f0f88df364595893585d30b8a23e0" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:52.391496 23782 raft_consensus.cc:3055] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:52.392089 23782 raft_consensus.cc:740] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:52.392899 23782 consensus_queue.cc:260] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:52.394140 23782 raft_consensus.cc:3060] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.394567 24585 raft_consensus.cc:993] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:52.394274 23635 raft_consensus.cc:2468] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:52.403949 24585 raft_consensus.cc:1081] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:52.405017 23677 leader_election.cc:304] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:52.405418 24433 raft_consensus.cc:515] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:52.406044 24573 raft_consensus.cc:2804] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:52.406680 24573 raft_consensus.cc:697] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:52.406479 23711 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28"
dest_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:41850
I20260709 13:07:52.407469 23711 raft_consensus.cc:493] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.407887 23711 raft_consensus.cc:3060] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.407859 24573 consensus_queue.cc:237] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:52.400899 23782 raft_consensus.cc:2468] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:52.415594 24433 leader_election.cc:290] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:52.437384 23457 catalog_manager.cc:5697] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.441519 23784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:52.442345 23784 raft_consensus.cc:3060] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.444664 24588 raft_consensus.cc:993] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.445245 24588 raft_consensus.cc:1081] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.447569 24433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:52.448071 24433 raft_consensus.cc:493] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.448768 24433 raft_consensus.cc:3060] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.456929 24433 raft_consensus.cc:515] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:52.459051 24433 leader_election.cc:290] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:52.479275 23711 raft_consensus.cc:515] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:52.483171 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:52.484028 23635 raft_consensus.cc:3055] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:52.484439 23635 raft_consensus.cc:740] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:52.485255 23635 consensus_queue.cc:260] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:52.486963 23635 raft_consensus.cc:3060] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.498288 23635 raft_consensus.cc:2468] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:52.498957 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:52.499593 23677 leader_election.cc:304] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:52.499636 23707 raft_consensus.cc:3060] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.500224 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30353e6381ee498baaa0333b4b016c28" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:52.500818 23782 raft_consensus.cc:3060] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.469527 23784 raft_consensus.cc:2468] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.503352 24587 raft_consensus.cc:2804] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:52.503867 24587 raft_consensus.cc:697] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:52.498611 23711 leader_election.cc:290] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:52.504788 24380 leader_election.cc:304] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:52.507321 23781 raft_consensus.cc:1240] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Rejecting Update request from peer 5801d6e785774cafb5fd3d8bbc1caf29 for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:52.508711 23782 raft_consensus.cc:2468] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:52.511672 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62d63b259d0c43e8bfb2c9f89cfa8e86" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:52.512200 23634 raft_consensus.cc:3055] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:52.512475 23634 raft_consensus.cc:740] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:52.513121 24578 consensus_queue.cc:1059] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:52.513418 23634 consensus_queue.cc:260] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:52.514448 24578 raft_consensus.cc:3055] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:52.514828 24578 raft_consensus.cc:740] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:52.515362 23634 raft_consensus.cc:3060] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.515668 24578 consensus_queue.cc:260] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:52.517568 24578 raft_consensus.cc:3060] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.504822 24587 consensus_queue.cc:237] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:52.529098 23707 raft_consensus.cc:2468] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.530324 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "265102913f834db596bb95ebf8d031dd" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:52.530897 24381 leader_election.cc:304] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:52.534718 23634 raft_consensus.cc:2468] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.538641 24599 raft_consensus.cc:2804] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:52.547884 24602 raft_consensus.cc:2804] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:52.548525 23635 raft_consensus.cc:2468] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.553433 24602 raft_consensus.cc:697] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:52.555444 24602 consensus_queue.cc:237] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:52.558706 24599 raft_consensus.cc:697] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:52.560854 24599 consensus_queue.cc:237] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:52.575778 24585 raft_consensus.cc:993] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.576309 24578 raft_consensus.cc:1081] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.578310 24434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:52.579011 24434 raft_consensus.cc:493] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.578248 23458 catalog_manager.cc:5697] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.579421 23457 catalog_manager.cc:5697] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.579456 24434 raft_consensus.cc:3060] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.585672 24585 raft_consensus.cc:993] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.586198 24578 raft_consensus.cc:1081] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:52.589888 24434 raft_consensus.cc:515] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:52.594020 24434 leader_election.cc:290] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:52.596288 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:52.596958 23635 raft_consensus.cc:3055] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:52.597239 23635 raft_consensus.cc:740] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:52.598160 24433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a43ac9d400274111ab086900b40199f0"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:52.599438 24433 raft_consensus.cc:493] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.599818 24433 raft_consensus.cc:3060] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.597958 23635 consensus_queue.cc:260] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:52.603188 23635 raft_consensus.cc:3060] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.605410 23458 catalog_manager.cc:5697] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.598804 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e52cc6079649abb36ed7bc7bbacaca" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:52.607375 23782 raft_consensus.cc:3060] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.607450 24433 raft_consensus.cc:515] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:52.609826 24433 leader_election.cc:290] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:52.613900 23782 raft_consensus.cc:2468] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.615515 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ac9d400274111ab086900b40199f0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:52.616202 23781 raft_consensus.cc:3060] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.615540 24380 leader_election.cc:304] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:52.620954 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a43ac9d400274111ab086900b40199f0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:52.621534 23634 raft_consensus.cc:3055] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:52.621835 23634 raft_consensus.cc:740] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:52.623592 24599 raft_consensus.cc:2804] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:52.624135 24599 raft_consensus.cc:697] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:52.625063 24599 consensus_queue.cc:237] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:52.622502 23634 consensus_queue.cc:260] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:52.628144 23634 raft_consensus.cc:3060] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.634270 23781 raft_consensus.cc:2468] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.635440 24380 leader_election.cc:304] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:52.635535 23634 raft_consensus.cc:2468] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.636385 24602 raft_consensus.cc:2804] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:52.637095 24602 raft_consensus.cc:697] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:52.638072 24602 consensus_queue.cc:237] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:52.640897 23635 raft_consensus.cc:2468] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:52.649808 23458 catalog_manager.cc:5697] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.665443 23458 catalog_manager.cc:5697] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.828487 23635 raft_consensus.cc:1275] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:52.829663 24595 consensus_queue.cc:1048] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.843578 23781 raft_consensus.cc:1275] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:52.845811 24573 consensus_queue.cc:1048] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.009214 23634 raft_consensus.cc:1275] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.010637 24602 consensus_queue.cc:1048] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.017825 23634 raft_consensus.cc:1275] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.023142 23782 raft_consensus.cc:1275] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.031160 23707 raft_consensus.cc:1275] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.031126 24595 consensus_queue.cc:1048] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:53.035621 24603 consensus_queue.cc:1048] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:53.051443 24573 consensus_queue.cc:1048] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.067070 23781 raft_consensus.cc:1275] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.069144 24599 consensus_queue.cc:1048] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.097471 23635 raft_consensus.cc:1275] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.099327 24602 consensus_queue.cc:1048] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.116590 23634 raft_consensus.cc:1275] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.117890 24602 consensus_queue.cc:1048] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.127653 23782 raft_consensus.cc:1275] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.128978 24602 consensus_queue.cc:1048] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.166041 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:53.218720 23782 raft_consensus.cc:1275] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.220242 24602 consensus_queue.cc:1048] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.221357 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:53.230080 23634 raft_consensus.cc:1275] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.233698 24603 consensus_queue.cc:1048] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.274677 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:53.275251 23634 raft_consensus.cc:606] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:53.276407 24585 raft_consensus.cc:993] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.276938 24588 raft_consensus.cc:1081] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.277840 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:53.278468 23634 raft_consensus.cc:606] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:53.278491 24429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:53.279246 24429 raft_consensus.cc:493] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.279661 24429 raft_consensus.cc:3060] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.281165 23782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06"
dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:40366
I20260709 13:07:53.281721 23782 raft_consensus.cc:606] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:53.284402 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:53.284853 23634 raft_consensus.cc:606] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:53.287212 23635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:53.286933 24429 raft_consensus.cc:515] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:53.287712 23635 raft_consensus.cc:606] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:53.289505 24429 leader_election.cc:290] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:53.290067 23635 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:53.290252 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:53.290508 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b6e1ada0a04d7990b4fd562dd4cc7f" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:53.290648 23635 raft_consensus.cc:606] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:53.291150 23782 raft_consensus.cc:3060] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.291343 23634 raft_consensus.cc:3055] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:53.291764 23634 raft_consensus.cc:740] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:53.292632 23634 consensus_queue.cc:260] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:53.293586 23634 raft_consensus.cc:3060] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.295856 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:53.297639 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:53.297705 23782 raft_consensus.cc:2468] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:53.300477 24380 leader_election.cc:304] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:53.301291 24599 raft_consensus.cc:2804] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:53.301725 24599 raft_consensus.cc:697] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:53.302517 24599 consensus_queue.cc:237] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:53.302752 23634 raft_consensus.cc:2468] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:53.312664 23459 catalog_manager.cc:5697] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.481770 24634 raft_consensus.cc:993] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.482267 24588 raft_consensus.cc:1081] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.483894 24434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:53.484390 24434 raft_consensus.cc:493] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.484706 24434 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.490931 24434 raft_consensus.cc:515] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:53.492489 24434 leader_election.cc:290] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:53.493108 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:53.493513 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e719beac9bca41db843477aa2eabb1a0" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:53.493743 23781 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.494130 23635 raft_consensus.cc:3055] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:53.494469 23635 raft_consensus.cc:740] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:53.495190 23635 consensus_queue.cc:260] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:53.496248 23635 raft_consensus.cc:3060] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.499506 23781 raft_consensus.cc:2468] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:53.500519 24380 leader_election.cc:304] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:53.501355 24602 raft_consensus.cc:2804] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:53.501644 23635 raft_consensus.cc:2468] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:53.501878 24602 raft_consensus.cc:697] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:53.502810 24602 consensus_queue.cc:237] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:53.507791 24588 raft_consensus.cc:993] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.508380 24634 raft_consensus.cc:1081] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.509703 24434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:53.510201 24434 raft_consensus.cc:493] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.510535 24434 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.514020 23459 catalog_manager.cc:5697] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 2 to 3, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 3 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.515504 24634 raft_consensus.cc:993] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:53.516062 24585 raft_consensus.cc:1081] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:53.516363 24434 raft_consensus.cc:515] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:53.517917 24434 leader_election.cc:290] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:53.518738 23635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:53.519346 23635 raft_consensus.cc:3055] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:53.519316 23707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82de114cc0774d5d8ca8d4cd0d87972b" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:53.519857 23635 raft_consensus.cc:740] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:53.520082 23707 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.520654 23635 consensus_queue.cc:260] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:53.521659 23705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753"
dest_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:41850
I20260709 13:07:53.521793 23635 raft_consensus.cc:3060] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.522066 23705 raft_consensus.cc:493] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.522341 23705 raft_consensus.cc:3060] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.526855 23707 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:53.528385 24381 leader_election.cc:304] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:53.529512 24602 raft_consensus.cc:2804] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:53.529328 23705 raft_consensus.cc:515] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:53.530010 24602 raft_consensus.cc:697] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:53.531421 23705 leader_election.cc:290] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:53.531961 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:53.530874 24602 consensus_queue.cc:237] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:53.532541 23634 raft_consensus.cc:3055] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:53.532874 23634 raft_consensus.cc:740] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:53.533087 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4351d83f6f0478a9d56121d733ff753" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:53.533582 23634 consensus_queue.cc:260] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:53.534792 23634 raft_consensus.cc:3060] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.534035 23781 raft_consensus.cc:3060] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.541477 23634 raft_consensus.cc:2468] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:53.542882 23635 raft_consensus.cc:2468] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:53.546170 23677 leader_election.cc:304] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:53.547051 24626 raft_consensus.cc:993] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.547755 24626 raft_consensus.cc:1081] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.550318 24429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55636
I20260709 13:07:53.550825 24429 raft_consensus.cc:493] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.551084 24595 raft_consensus.cc:2804] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:53.551158 24429 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.551687 24595 raft_consensus.cc:697] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:53.552511 24595 consensus_queue.cc:237] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:53.553886 23781 raft_consensus.cc:2468] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:53.557642 24429 raft_consensus.cc:515] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:53.559814 24429 leader_election.cc:290] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:53.563436 23705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:53.564114 23705 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.567792 23459 catalog_manager.cc:5697] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 2 to 3, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 3 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.569582 23457 catalog_manager.cc:5697] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.570597 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a142d068a8e4383af2a8ec2986b9c06" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:53.572306 23705 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:53.595532 23781 raft_consensus.cc:3055] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:53.596189 23781 raft_consensus.cc:740] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:53.596275 24381 leader_election.cc:304] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:53.597240 24602 raft_consensus.cc:2804] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:53.596982 23781 consensus_queue.cc:260] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:53.597752 24602 raft_consensus.cc:697] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:53.598280 23781 raft_consensus.cc:3060] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:53.598630 24602 consensus_queue.cc:237] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:53.605530 23781 raft_consensus.cc:2468] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:53.610037 23459 catalog_manager.cc:5697] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 2 to 3, leader changed from 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 3 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.651466 24588 raft_consensus.cc:993] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.652017 24634 raft_consensus.cc:1081] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:53.653599 24434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:53.654166 24434 raft_consensus.cc:493] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:53.654538 24434 raft_consensus.cc:3060] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.661399 24434 raft_consensus.cc:515] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:53.663324 24434 leader_election.cc:290] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247)
I20260709 13:07:53.693886 23705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:53.701280 23705 raft_consensus.cc:3060] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.718067 23781 raft_consensus.cc:1275] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.722623 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ee2fe61752e4fd6a11c4e1dc2857051" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:53.722918 24628 consensus_queue.cc:1048] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:53.724246 23634 raft_consensus.cc:3055] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:53.724808 23634 raft_consensus.cc:740] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:53.728806 23705 raft_consensus.cc:2468] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:53.731760 24381 leader_election.cc:304] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:53.726382 23634 consensus_queue.cc:260] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:53.738844 23634 raft_consensus.cc:3060] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:53.739497 24628 raft_consensus.cc:2804] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:53.743644 24628 raft_consensus.cc:697] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:53.745251 24628 consensus_queue.cc:237] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } }
I20260709 13:07:53.754781 23634 raft_consensus.cc:2468] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:53.867537 23635 raft_consensus.cc:1275] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.869863 24599 consensus_queue.cc:1048] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:53.872448 23457 catalog_manager.cc:5697] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.908402 23635 raft_consensus.cc:1275] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:53.915288 24599 consensus_queue.cc:1048] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:53.941252 23781 raft_consensus.cc:1275] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:53.946774 24599 consensus_queue.cc:1048] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:53.954386 23638 raft_consensus.cc:1275] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:53.962126 24599 consensus_queue.cc:1048] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.003006 23711 raft_consensus.cc:1275] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:54.004942 24599 consensus_queue.cc:1048] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.047672 23781 raft_consensus.cc:1275] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:54.048996 24599 consensus_queue.cc:1048] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.059332 23707 raft_consensus.cc:1275] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:54.061295 24628 consensus_queue.cc:1048] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.066623 23781 raft_consensus.cc:1275] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.069840 24595 consensus_queue.cc:1048] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:54.082996 23638 raft_consensus.cc:1275] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.084980 24573 consensus_queue.cc:1048] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.149827 23705 raft_consensus.cc:1275] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.151005 24602 consensus_queue.cc:1048] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.160797 23638 raft_consensus.cc:1275] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.162470 24628 consensus_queue.cc:1048] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.299063 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:54.348526 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:54.387565 23782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142"
dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
mode: GRACEFUL
new_leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
 from {username='slave'} at 127.0.0.1:40366
I20260709 13:07:54.388442 23782 raft_consensus.cc:606] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Received request to transfer leadership to TS 5801d6e785774cafb5fd3d8bbc1caf29
I20260709 13:07:54.391551 23638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:54.392076 23638 raft_consensus.cc:606] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:54.398353 23638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:54.398919 23638 raft_consensus.cc:606] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:54.402076 23638 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:54.402648 23638 raft_consensus.cc:606] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:54.405743 23782 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "daafd10eea854105a7b5af409dcac409"
dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:40366
I20260709 13:07:54.406306 23782 raft_consensus.cc:606] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:54.409806 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:54.411469 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:54.480284 24626 raft_consensus.cc:993] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:54.481005 24584 raft_consensus.cc:1081] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:54.483337 24434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "daafd10eea854105a7b5af409dcac409"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55636
I20260709 13:07:54.483927 24434 raft_consensus.cc:493] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.484156 24434 raft_consensus.cc:3060] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.494733 24434 raft_consensus.cc:515] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:54.496483 24434 leader_election.cc:290] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:54.497007 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:54.497509 23711 raft_consensus.cc:3060] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.497927 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "daafd10eea854105a7b5af409dcac409" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:54.498507 23782 raft_consensus.cc:3055] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.498704 23782 raft_consensus.cc:740] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:54.499359 23782 consensus_queue.cc:260] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:54.500332 23782 raft_consensus.cc:3060] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.502635 23711 raft_consensus.cc:2468] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:54.503612 24381 leader_election.cc:304] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 2fa39659edab417ebd04cb981cf61549; no voters: 
I20260709 13:07:54.504357 24599 raft_consensus.cc:2804] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.504837 24599 raft_consensus.cc:697] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:54.505707 24599 consensus_queue.cc:237] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:54.506625 23782 raft_consensus.cc:2468] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:54.517160 23459 catalog_manager.cc:5697] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.678303 24584 raft_consensus.cc:993] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975: : Instructing follower 5801d6e785774cafb5fd3d8bbc1caf29 to start an election
I20260709 13:07:54.678815 24584 raft_consensus.cc:1081] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Signalling peer 5801d6e785774cafb5fd3d8bbc1caf29 to start an election
I20260709 13:07:54.680399 23634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
 from {username='slave'} at 127.0.0.1:49052
I20260709 13:07:54.680933 23634 raft_consensus.cc:493] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.681275 23634 raft_consensus.cc:3060] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.690099 23634 raft_consensus.cc:515] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:54.693025 23705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:54.693560 23705 raft_consensus.cc:3060] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.694072 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28355fbc03cd49a9aa2080b53afbd142" candidate_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:54.694649 23781 raft_consensus.cc:3055] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.694921 23781 raft_consensus.cc:740] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fdf2efb58be4c0c9cbc722e57a73975, State: Running, Role: LEADER
I20260709 13:07:54.695832 23781 consensus_queue.cc:260] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:54.697427 23781 raft_consensus.cc:3060] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.700513 23705 raft_consensus.cc:2468] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:54.702078 23603 leader_election.cc:304] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:54.693557 23634 leader_election.cc:290] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [CANDIDATE]: Term 2 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:54.702956 24634 raft_consensus.cc:2804] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.705240 24634 raft_consensus.cc:697] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Leader. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:54.707336 24634 consensus_queue.cc:237] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:54.714661 23781 raft_consensus.cc:2468] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5801d6e785774cafb5fd3d8bbc1caf29 in term 2.
I20260709 13:07:54.732132 23459 catalog_manager.cc:5697] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 reported cstate change: term changed from 1 to 2, leader changed from 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4) to 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.741357 24588 raft_consensus.cc:993] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:54.741760 24634 raft_consensus.cc:1081] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:54.743230 23705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1"
dest_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:41850
I20260709 13:07:54.743685 23705 raft_consensus.cc:493] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.743999 23705 raft_consensus.cc:3060] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.749238 23705 raft_consensus.cc:515] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:54.751067 23705 leader_election.cc:290] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:54.752447 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:54.753074 23781 raft_consensus.cc:3060] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.753311 23634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61dc47e97be24944ac16d6a564a62da1" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:54.753881 23634 raft_consensus.cc:3055] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.754196 23634 raft_consensus.cc:740] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:54.754966 23634 consensus_queue.cc:260] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:54.756186 23634 raft_consensus.cc:3060] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.760090 23781 raft_consensus.cc:2468] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:54.761360 23676 leader_election.cc:304] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:54.762015 24573 raft_consensus.cc:2804] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.762384 24573 raft_consensus.cc:697] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:54.762502 23634 raft_consensus.cc:2468] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:54.763151 24573 consensus_queue.cc:237] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:54.772056 23459 catalog_manager.cc:5697] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.840293 24588 raft_consensus.cc:993] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:54.840790 24634 raft_consensus.cc:1081] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:54.842214 24433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:54.842685 24433 raft_consensus.cc:493] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.842939 24433 raft_consensus.cc:3060] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.848018 24433 raft_consensus.cc:515] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:54.849756 24433 leader_election.cc:290] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:54.850642 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:54.850912 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce328dcc310474c82fd1fc598402f51" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:54.851317 23781 raft_consensus.cc:3060] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.851604 23638 raft_consensus.cc:3055] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:54.851918 23638 raft_consensus.cc:740] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:54.852696 23638 consensus_queue.cc:260] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:54.854696 23638 raft_consensus.cc:3060] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:54.857959 23781 raft_consensus.cc:2468] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:54.859130 24380 leader_election.cc:304] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:54.859944 24599 raft_consensus.cc:2804] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:54.860374 24599 raft_consensus.cc:697] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:54.861176 24599 consensus_queue.cc:237] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:54.861864 23638 raft_consensus.cc:2468] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:54.874580 23459 catalog_manager.cc:5697] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:54.905547 23781 raft_consensus.cc:1275] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.906620 24599 consensus_queue.cc:1048] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.920274 23705 raft_consensus.cc:1275] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:54.921766 24602 consensus_queue.cc:1048] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:54.923806 24588 raft_consensus.cc:993] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:54.925242 24588 raft_consensus.cc:1081] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:54.927204 24433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55620
I20260709 13:07:54.929411 24433 raft_consensus.cc:493] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.930557 24433 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:54.938475 24433 raft_consensus.cc:515] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:54.941383 23782 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:54.941928 23782 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:54.941998 24433 leader_election.cc:290] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Requested vote from peers 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419), 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595)
I20260709 13:07:54.942368 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fd318ba74c4199a62e26d48ff01f46" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:54.942970 23638 raft_consensus.cc:3055] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:54.943287 23638 raft_consensus.cc:740] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:54.943949 23638 consensus_queue.cc:260] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:54.944741 23638 raft_consensus.cc:3060] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:54.951514 23638 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:54.952718 24381 leader_election.cc:304] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 5801d6e785774cafb5fd3d8bbc1caf29; no voters: 
I20260709 13:07:54.955209 24602 raft_consensus.cc:2804] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:54.956647 24602 raft_consensus.cc:697] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:54.956905 23782 raft_consensus.cc:2468] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 3.
I20260709 13:07:54.958510 24602 consensus_queue.cc:237] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } }
I20260709 13:07:54.978442 23459 catalog_manager.cc:5697] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 2 to 3, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 3 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:55.215075 23782 raft_consensus.cc:1275] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.216331 24634 consensus_queue.cc:1048] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.235405 23782 raft_consensus.cc:1275] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.236878 24573 consensus_queue.cc:1048] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:55.239543 23638 raft_consensus.cc:1275] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.240379 23705 raft_consensus.cc:1275] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 5801d6e785774cafb5fd3d8bbc1caf29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.241894 24573 consensus_queue.cc:1048] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.244318 24588 consensus_queue.cc:1048] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.299450 23784 raft_consensus.cc:1275] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.300761 24602 consensus_queue.cc:1048] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.310386 23634 raft_consensus.cc:1275] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:55.311879 24602 consensus_queue.cc:1048] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.394961 23634 raft_consensus.cc:1275] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:55.396319 24602 consensus_queue.cc:1048] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.405496 23784 raft_consensus.cc:1275] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:55.406754 24670 consensus_queue.cc:1048] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:55.412391 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:55.465167 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:55.506232 23634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6"
dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
mode: GRACEFUL
new_leader_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:38532
I20260709 13:07:55.506764 23634 raft_consensus.cc:606] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Received request to transfer leadership to TS 2fa39659edab417ebd04cb981cf61549
I20260709 13:07:55.528040 23711 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1"
dest_uuid: "2fa39659edab417ebd04cb981cf61549"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:45560
I20260709 13:07:55.528641 23711 raft_consensus.cc:606] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:55.529825 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:55.531184 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:55.717411 24573 raft_consensus.cc:993] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:55.718209 24686 raft_consensus.cc:1081] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:55.720582 24434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55624
I20260709 13:07:55.721163 24434 raft_consensus.cc:493] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.721517 24434 raft_consensus.cc:3060] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.728330 24434 raft_consensus.cc:515] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:55.729727 24434 leader_election.cc:290] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:55.730471 23711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:55.731094 23711 raft_consensus.cc:3055] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.731176 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae1a0dfb08d64fbb85f81c33ab57e9e1" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:55.731442 23711 raft_consensus.cc:740] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:55.731907 23781 raft_consensus.cc:3060] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.732322 23711 consensus_queue.cc:260] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:55.733594 23711 raft_consensus.cc:3060] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.738128 23781 raft_consensus.cc:2468] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:55.739197 24380 leader_election.cc:304] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:55.742445 24670 raft_consensus.cc:2804] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.742923 24670 raft_consensus.cc:697] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:55.743858 24670 consensus_queue.cc:237] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:55.745965 23711 raft_consensus.cc:2468] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:55.756021 23457 catalog_manager.cc:5697] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 2fa39659edab417ebd04cb981cf61549 (127.13.181.3) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.838773 24675 raft_consensus.cc:993] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: : Instructing follower 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:55.839251 24588 raft_consensus.cc:1081] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Signalling peer 2fa39659edab417ebd04cb981cf61549 to start an election
I20260709 13:07:55.840549 23705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6"
dest_uuid: "2fa39659edab417ebd04cb981cf61549"
 from {username='slave'} at 127.0.0.1:41850
I20260709 13:07:55.840992 23705 raft_consensus.cc:493] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:55.841274 23705 raft_consensus.cc:3060] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.845924 23705 raft_consensus.cc:515] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:55.847523 23705 leader_election.cc:290] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Requested vote from peers 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:55.848376 23638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5801d6e785774cafb5fd3d8bbc1caf29"
I20260709 13:07:55.848421 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a9c72ca943445cbb12a3eaaa3989ef6" candidate_uuid: "2fa39659edab417ebd04cb981cf61549" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:55.849340 23781 raft_consensus.cc:3060] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.849331 23638 raft_consensus.cc:3055] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:55.849893 23638 raft_consensus.cc:740] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5801d6e785774cafb5fd3d8bbc1caf29, State: Running, Role: LEADER
I20260709 13:07:55.850665 23638 consensus_queue.cc:260] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:55.852012 23638 raft_consensus.cc:3060] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:55.856951 23781 raft_consensus.cc:2468] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:55.858353 23676 leader_election.cc:304] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fa39659edab417ebd04cb981cf61549, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:55.859345 24658 raft_consensus.cc:2804] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:55.859905 24658 raft_consensus.cc:697] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Becoming Leader. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:55.861304 24658 consensus_queue.cc:237] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } }
I20260709 13:07:55.863962 23638 raft_consensus.cc:2468] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fa39659edab417ebd04cb981cf61549 in term 2.
I20260709 13:07:55.872925 23457 catalog_manager.cc:5697] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 reported cstate change: term changed from 1 to 2, leader changed from 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2) to 2fa39659edab417ebd04cb981cf61549 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "2fa39659edab417ebd04cb981cf61549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:56.164476 23781 raft_consensus.cc:1275] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:56.165907 24602 consensus_queue.cc:1048] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:56.178050 23705 raft_consensus.cc:1275] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:56.179817 24602 consensus_queue.cc:1048] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.332744 23638 raft_consensus.cc:1275] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:56.334241 24658 consensus_queue.cc:1048] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5801d6e785774cafb5fd3d8bbc1caf29" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 35595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.342576 23781 raft_consensus.cc:1275] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 2fa39659edab417ebd04cb981cf61549: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:56.345609 24686 consensus_queue.cc:1048] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.532208 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:56.578038 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:56.616957 23705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3"
dest_uuid: "2fa39659edab417ebd04cb981cf61549"
mode: GRACEFUL
new_leader_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:45560
I20260709 13:07:56.617573 23705 raft_consensus.cc:606] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Received request to transfer leadership to TS 156aacba33d94250a5a0a6721246551e
I20260709 13:07:56.618904 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:56.620101 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:56.735074 24686 raft_consensus.cc:993] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549: : Instructing follower 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:56.735615 24658 raft_consensus.cc:1081] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Signalling peer 156aacba33d94250a5a0a6721246551e to start an election
I20260709 13:07:56.736975 24433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3"
dest_uuid: "156aacba33d94250a5a0a6721246551e"
 from {username='slave'} at 127.0.0.1:55624
I20260709 13:07:56.737442 24433 raft_consensus.cc:493] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:56.737696 24433 raft_consensus.cc:3060] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:56.744812 24433 raft_consensus.cc:515] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:56.746325 24433 leader_election.cc:290] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Requested vote from peers 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247), 8fdf2efb58be4c0c9cbc722e57a73975 (127.13.181.4:35419)
I20260709 13:07:56.746964 23705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fa39659edab417ebd04cb981cf61549"
I20260709 13:07:56.747390 23781 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43f58740da23409abe43f3768bfac6e3" candidate_uuid: "156aacba33d94250a5a0a6721246551e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fdf2efb58be4c0c9cbc722e57a73975"
I20260709 13:07:56.747674 23705 raft_consensus.cc:3055] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:56.747967 23781 raft_consensus.cc:3060] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:56.748085 23705 raft_consensus.cc:740] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fa39659edab417ebd04cb981cf61549, State: Running, Role: LEADER
I20260709 13:07:56.748936 23705 consensus_queue.cc:260] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:56.750332 23705 raft_consensus.cc:3060] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:56.754537 23781 raft_consensus.cc:2468] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:56.755613 24380 leader_election.cc:304] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 156aacba33d94250a5a0a6721246551e, 8fdf2efb58be4c0c9cbc722e57a73975; no voters: 
I20260709 13:07:56.756563 24670 raft_consensus.cc:2804] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:56.757146 24670 raft_consensus.cc:697] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Becoming Leader. State: Replica: 156aacba33d94250a5a0a6721246551e, State: Running, Role: LEADER
I20260709 13:07:56.756938 23705 raft_consensus.cc:2468] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 156aacba33d94250a5a0a6721246551e in term 2.
I20260709 13:07:56.758137 24670 consensus_queue.cc:237] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } }
I20260709 13:07:56.768824 23457 catalog_manager.cc:5697] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e reported cstate change: term changed from 1 to 2, leader changed from 2fa39659edab417ebd04cb981cf61549 (127.13.181.3) to 156aacba33d94250a5a0a6721246551e (127.13.181.1). New cstate: current_term: 2 leader_uuid: "156aacba33d94250a5a0a6721246551e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "156aacba33d94250a5a0a6721246551e" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 43543 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.190380 23781 raft_consensus.cc:1275] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:57.192025 24602 consensus_queue.cc:1048] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fdf2efb58be4c0c9cbc722e57a73975" member_type: VOTER last_known_addr { host: "127.13.181.4" port: 35419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:57.209405 23705 raft_consensus.cc:1275] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Refusing update from remote peer 156aacba33d94250a5a0a6721246551e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:57.213810 24703 consensus_queue.cc:1048] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fa39659edab417ebd04cb981cf61549" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 33247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:57.620896 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:57.658855 14036 tablet_server.cc:179] TabletServer@127.13.181.1:43543 shutting down...
W20260709 13:07:57.705878 23751 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 73 similar messages]
W20260709 13:07:57.714636 23751 consensus_peers.cc:597] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:57.721032 23751 consensus_peers.cc:597] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.721832 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:57.722909 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.724177 14036 raft_consensus.cc:2243] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.724764 14036 raft_consensus.cc:2272] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.727200 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.727908 14036 raft_consensus.cc:2243] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.728296 14036 raft_consensus.cc:2272] T 7353eea058f4496792494b7c5b54707b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.730621 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.731581 14036 raft_consensus.cc:2243] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.732738 14036 raft_consensus.cc:2272] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.735659 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.736282 14036 raft_consensus.cc:2243] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.736984 14036 raft_consensus.cc:2272] T e719beac9bca41db843477aa2eabb1a0 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.739001 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.739668 14036 raft_consensus.cc:2243] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.740419 14036 raft_consensus.cc:2272] T 56fd318ba74c4199a62e26d48ff01f46 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.742285 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.742899 14036 raft_consensus.cc:2243] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.743341 14036 raft_consensus.cc:2272] T bf53bc01d1484dbd95722162c9827f6d P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.745500 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.745972 14036 raft_consensus.cc:2243] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.746409 14036 raft_consensus.cc:2272] T 0bfaaac6cef24fd9837185a2710b1823 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.748798 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.749612 14036 raft_consensus.cc:2243] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.750200 14036 raft_consensus.cc:2272] T f0ef366a73c0412fa3f7e3966917d438 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:57.752166 23603 consensus_peers.cc:597] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.753332 14036 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:57.753011 23751 consensus_peers.cc:597] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.754272 14036 raft_consensus.cc:2243] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.754866 14036 raft_consensus.cc:2272] T 6a112ab003b24103ae2a7b922dc31f3d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.758047 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.758919 14036 raft_consensus.cc:2243] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.759470 14036 raft_consensus.cc:2272] T ec1ae450a6974af090cea14009c262d2 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:57.759588 23603 consensus_peers.cc:597] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:57.760569 23751 consensus_peers.cc:597] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.762445 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.763262 14036 raft_consensus.cc:2243] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.763777 14036 raft_consensus.cc:2272] T 6d840fb6d5bb459dadc6e033bf997f5e P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.765791 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.766386 14036 raft_consensus.cc:2243] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.766808 14036 raft_consensus.cc:2272] T ada29c39e396475e91dfcfdc5a412adc P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.768766 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.769455 14036 raft_consensus.cc:2243] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.769937 14036 raft_consensus.cc:2272] T dedb6c9f912b48b1aaac6a3b8947e308 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.772749 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.773628 14036 raft_consensus.cc:2243] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.774149 14036 raft_consensus.cc:2272] T 42d42bf20cfb4ca3a1c99680e76288b1 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.776855 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.777616 14036 raft_consensus.cc:2243] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.778098 14036 raft_consensus.cc:2272] T 883d3fdac6bf46478c2f6999beaa7fb0 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.781047 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.781591 14036 raft_consensus.cc:2243] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.782024 14036 raft_consensus.cc:2272] T ce9adf205be04005b843fa29a8aa6cbe P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.784183 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.784736 14036 raft_consensus.cc:2243] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.785120 14036 raft_consensus.cc:2272] T 6ecbdd1056594932b785458e6cd595c3 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.787143 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.787678 14036 raft_consensus.cc:2243] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.788071 14036 raft_consensus.cc:2272] T 982a36e8097b4dbfb315b9527072e1aa P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.790035 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.790566 14036 raft_consensus.cc:2243] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.790980 14036 raft_consensus.cc:2272] T 0870de63fd864cf8b6cd8448ac80634b P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.793916 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.794799 14036 raft_consensus.cc:2243] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.795413 14036 raft_consensus.cc:2272] T 4db0967cdcf34bd1a951b3e732ba51ae P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.798352 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.799233 14036 raft_consensus.cc:2243] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.800309 14036 raft_consensus.cc:2272] T 265102913f834db596bb95ebf8d031dd P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:57.803421 23603 consensus_peers.cc:597] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.803591 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.804390 14036 raft_consensus.cc:2243] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:57.803625 23751 consensus_peers.cc:597] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.804940 14036 raft_consensus.cc:2272] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.807629 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.808260 14036 raft_consensus.cc:2243] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.809001 14036 raft_consensus.cc:2272] T 82de114cc0774d5d8ca8d4cd0d87972b P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.811337 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.812014 14036 raft_consensus.cc:2243] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.812891 14036 raft_consensus.cc:2272] T 43f58740da23409abe43f3768bfac6e3 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.815423 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.816082 14036 raft_consensus.cc:2243] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.817018 14036 raft_consensus.cc:2272] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.819713 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.820407 14036 raft_consensus.cc:2243] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.821333 14036 raft_consensus.cc:2272] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.823406 14036 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:57.823796 23603 consensus_peers.cc:597] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.823945 14036 raft_consensus.cc:2243] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.824584 14036 raft_consensus.cc:2272] T ecbb921a20f742f58e9b8ebf7822cc87 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.826903 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.827589 14036 raft_consensus.cc:2243] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.828127 14036 raft_consensus.cc:2272] T b46b913ff5404592be0ac2df69ce2498 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.831050 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.831840 14036 raft_consensus.cc:2243] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.832331 14036 raft_consensus.cc:2272] T b4df4d5bfaa14060b865c3d19e9fa828 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.834923 14036 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:57.835402 23603 consensus_peers.cc:597] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.835752 14036 raft_consensus.cc:2243] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.836715 14036 raft_consensus.cc:2272] T a43ac9d400274111ab086900b40199f0 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.839560 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.840299 14036 raft_consensus.cc:2243] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.840751 14036 raft_consensus.cc:2272] T 0641dafd5a7041a0b0d2cfebe0b4306e P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.843552 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.844295 14036 raft_consensus.cc:2243] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.844830 14036 raft_consensus.cc:2272] T a1be00bf028b40acabfa2fcad430301d P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.847479 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.848367 14036 raft_consensus.cc:2243] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.848927 14036 raft_consensus.cc:2272] T 871dc3bda4c344b9bd080bf3fae3d085 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:57.849982 23751 consensus_peers.cc:597] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.851949 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.852862 14036 raft_consensus.cc:2243] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.853442 14036 raft_consensus.cc:2272] T 6641b8962e66467ba062e7c2b419d873 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:57.854063 23603 consensus_peers.cc:597] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.856408 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.857210 14036 raft_consensus.cc:2243] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.857698 14036 raft_consensus.cc:2272] T 2188519be6684f4b8f46b07846fba5ab P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.860414 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.861001 14036 raft_consensus.cc:2243] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.861492 14036 raft_consensus.cc:2272] T f331d8701aa747479e33e661ec648a30 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:57.863243 23677 consensus_peers.cc:597] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.864197 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.864809 14036 raft_consensus.cc:2243] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.865272 14036 raft_consensus.cc:2272] T 7e9732b9e0d94f8d9386a523a65e9519 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.867528 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.868023 14036 raft_consensus.cc:2243] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.868845 14036 raft_consensus.cc:2272] T 5a142d068a8e4383af2a8ec2986b9c06 P 156aacba33d94250a5a0a6721246551e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.870947 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.871512 14036 raft_consensus.cc:2243] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.872237 14036 raft_consensus.cc:2272] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.874161 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.874680 14036 raft_consensus.cc:2243] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.875399 14036 raft_consensus.cc:2272] T daafd10eea854105a7b5af409dcac409 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.877453 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.877948 14036 raft_consensus.cc:2243] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.878337 14036 raft_consensus.cc:2272] T 3e66f85de59d4ac4b676edfe803876b8 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.880936 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.881484 14036 raft_consensus.cc:2243] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.881889 14036 raft_consensus.cc:2272] T 7fe0677c45254e81bbad8dc085ffb64c P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.884146 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.884835 14036 raft_consensus.cc:2243] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:57.885318 14036 raft_consensus.cc:2272] T f090d4df44ad48388a56df9972462932 P 156aacba33d94250a5a0a6721246551e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.887749 14036 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:57.887676 23603 consensus_peers.cc:597] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.888567 14036 raft_consensus.cc:2243] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.889400 14036 raft_consensus.cc:2272] T 5ce328dcc310474c82fd1fc598402f51 P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:57.892378 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:57.893061 14036 raft_consensus.cc:2243] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:57.894053 14036 raft_consensus.cc:2272] T 70e52cc6079649abb36ed7bc7bbacaca P 156aacba33d94250a5a0a6721246551e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:57.896263 23603 consensus_peers.cc:597] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:57.931375 23677 consensus_peers.cc:597] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:57.952737 23677 consensus_peers.cc:597] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:57.956868 23677 consensus_peers.cc:597] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:57.978503 14036 tablet_server.cc:196] TabletServer@127.13.181.1:43543 shutdown complete.
W20260709 13:07:57.985952 23751 consensus_peers.cc:597] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:57.997691 23603 consensus_peers.cc:597] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.012869 23751 consensus_peers.cc:597] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.027753 23751 consensus_peers.cc:597] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.056892 23677 consensus_peers.cc:597] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.061822 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
W20260709 13:07:58.067433 23751 consensus_peers.cc:597] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.068017 23751 consensus_peers.cc:597] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.073621 23751 consensus_peers.cc:597] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.076689 23677 consensus_peers.cc:597] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.082017 23677 consensus_peers.cc:597] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.090893 23603 consensus_peers.cc:597] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.107219 23677 consensus_peers.cc:597] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.112260 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:58.113204 14036 tablet_replica.cc:333] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.113894 14036 raft_consensus.cc:2243] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.114370 14036 raft_consensus.cc:2272] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.116767 14036 tablet_replica.cc:333] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.117717 14036 raft_consensus.cc:2243] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.118352 14036 raft_consensus.cc:2272] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.120157 23677 consensus_peers.cc:597] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.121025 14036 tablet_replica.cc:333] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.121860 14036 raft_consensus.cc:2243] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.122408 14036 raft_consensus.cc:2272] T e719beac9bca41db843477aa2eabb1a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.125129 14036 tablet_replica.cc:333] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
W20260709 13:07:58.125809 23751 consensus_peers.cc:597] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.125945 14036 raft_consensus.cc:2243] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.126562 14036 raft_consensus.cc:2272] T 934afa29ceb24bb8a35260dfb5e22e6a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.128764 14036 tablet_replica.cc:333] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.129753 14036 raft_consensus.cc:2243] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.130811 14036 raft_consensus.cc:2272] T ada29c39e396475e91dfcfdc5a412adc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.133884 14036 tablet_replica.cc:333] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.134703 14036 raft_consensus.cc:2243] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:07:58.135572 23603 consensus_peers.cc:597] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.135788 14036 raft_consensus.cc:2272] T b4df4d5bfaa14060b865c3d19e9fa828 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.137744 23677 consensus_peers.cc:597] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 -> Peer 156aacba33d94250a5a0a6721246551e (127.13.181.1:43543): Couldn't send request to peer 156aacba33d94250a5a0a6721246551e. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:43543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.138586 14036 tablet_replica.cc:333] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.139282 14036 raft_consensus.cc:2243] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.139709 14036 raft_consensus.cc:2272] T 037f0f88df364595893585d30b8a23e0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.142207 14036 tablet_replica.cc:333] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.142995 14036 raft_consensus.cc:2243] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.143452 14036 raft_consensus.cc:2272] T 56fd318ba74c4199a62e26d48ff01f46 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.145273 14036 tablet_replica.cc:333] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.145830 14036 raft_consensus.cc:2243] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.146581 14036 raft_consensus.cc:2272] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.148620 14036 tablet_replica.cc:333] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.149250 14036 raft_consensus.cc:2243] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.149997 14036 raft_consensus.cc:2272] T 42d42bf20cfb4ca3a1c99680e76288b1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.152036 14036 tablet_replica.cc:333] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.152588 14036 raft_consensus.cc:2243] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.152983 14036 raft_consensus.cc:2272] T 30353e6381ee498baaa0333b4b016c28 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.154892 14036 tablet_replica.cc:333] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.155434 14036 raft_consensus.cc:2243] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.155862 14036 raft_consensus.cc:2272] T 82de114cc0774d5d8ca8d4cd0d87972b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.158383 14036 tablet_replica.cc:333] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.159173 14036 raft_consensus.cc:2243] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.159678 14036 raft_consensus.cc:2272] T 7353eea058f4496792494b7c5b54707b P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.162616 14036 tablet_replica.cc:333] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.163471 14036 raft_consensus.cc:2243] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.163949 14036 raft_consensus.cc:2272] T 61dc47e97be24944ac16d6a564a62da1 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.166491 14036 tablet_replica.cc:333] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.167361 14036 raft_consensus.cc:2243] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.167966 14036 raft_consensus.cc:2272] T a43ac9d400274111ab086900b40199f0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.170775 14036 tablet_replica.cc:333] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.171420 14036 raft_consensus.cc:2243] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.171877 14036 raft_consensus.cc:2272] T 202fa208bd5c4307aaa9589effb21dcd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.173883 14036 tablet_replica.cc:333] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.174427 14036 raft_consensus.cc:2243] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.175283 14036 raft_consensus.cc:2272] T 3e66f85de59d4ac4b676edfe803876b8 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.177291 14036 tablet_replica.cc:333] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.177798 14036 raft_consensus.cc:2243] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.178229 14036 raft_consensus.cc:2272] T 6641b8962e66467ba062e7c2b419d873 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.180300 14036 tablet_replica.cc:333] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.180858 14036 raft_consensus.cc:2243] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.181630 14036 raft_consensus.cc:2272] T 871dc3bda4c344b9bd080bf3fae3d085 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.183704 14036 tablet_replica.cc:333] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.184299 14036 raft_consensus.cc:2243] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.184767 14036 raft_consensus.cc:2272] T e4351d83f6f0478a9d56121d733ff753 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.186955 14036 tablet_replica.cc:333] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.187568 14036 raft_consensus.cc:2243] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:07:58.188306 23751 consensus_peers.cc:597] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.188362 14036 raft_consensus.cc:2272] T 0bfaaac6cef24fd9837185a2710b1823 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.190606 14036 tablet_replica.cc:333] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.191277 14036 raft_consensus.cc:2243] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.192013 14036 raft_consensus.cc:2272] T 3214eda030c94c39a590e4a7c3fb8ccc P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.193951 14036 tablet_replica.cc:333] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.194490 14036 raft_consensus.cc:2243] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.195259 14036 raft_consensus.cc:2272] T 85de537a84e841488dfe245e698eab3a P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.197229 14036 tablet_replica.cc:333] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.197779 14036 raft_consensus.cc:2243] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.198562 14036 raft_consensus.cc:2272] T bf53bc01d1484dbd95722162c9827f6d P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.200769 14036 tablet_replica.cc:333] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.201388 14036 raft_consensus.cc:2243] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.202299 14036 raft_consensus.cc:2272] T 6d840fb6d5bb459dadc6e033bf997f5e P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.204526 14036 tablet_replica.cc:333] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.204990 14036 raft_consensus.cc:2243] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.205349 14036 raft_consensus.cc:2272] T 36f60dc2cd934d1da48a665aad1c13d3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.207224 14036 tablet_replica.cc:333] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.207770 14036 raft_consensus.cc:2243] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.208174 14036 raft_consensus.cc:2272] T f331d8701aa747479e33e661ec648a30 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.210233 14036 tablet_replica.cc:333] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.210791 14036 raft_consensus.cc:2243] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.211249 14036 raft_consensus.cc:2272] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.212493 23751 consensus_peers.cc:597] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.213568 14036 tablet_replica.cc:333] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.214229 14036 raft_consensus.cc:2243] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.214658 14036 raft_consensus.cc:2272] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.217069 14036 tablet_replica.cc:333] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.217751 14036 raft_consensus.cc:2243] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.218214 14036 raft_consensus.cc:2272] T d6db2b37fa4a42eca168f8bcfda497a0 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.220878 14036 tablet_replica.cc:333] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.221570 14036 raft_consensus.cc:2243] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.222132 14036 raft_consensus.cc:2272] T 6ecbdd1056594932b785458e6cd595c3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.224660 14036 tablet_replica.cc:333] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.225526 14036 raft_consensus.cc:2243] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.226042 14036 raft_consensus.cc:2272] T 982a36e8097b4dbfb315b9527072e1aa P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.228626 14036 tablet_replica.cc:333] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.229327 14036 raft_consensus.cc:2243] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.230132 14036 raft_consensus.cc:2272] T 28355fbc03cd49a9aa2080b53afbd142 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.232730 14036 tablet_replica.cc:333] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.233342 14036 raft_consensus.cc:2243] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.233852 14036 raft_consensus.cc:2272] T 70e52cc6079649abb36ed7bc7bbacaca P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.235366 23677 consensus_peers.cc:597] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.236406 14036 tablet_replica.cc:333] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.237282 14036 raft_consensus.cc:2243] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.237769 14036 raft_consensus.cc:2272] T 5ce328dcc310474c82fd1fc598402f51 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.240171 14036 tablet_replica.cc:333] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.240662 14036 raft_consensus.cc:2243] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.241003 14036 raft_consensus.cc:2272] T 7fe0677c45254e81bbad8dc085ffb64c P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.242957 14036 tablet_replica.cc:333] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.243616 14036 raft_consensus.cc:2243] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.244541 14036 raft_consensus.cc:2272] T f090d4df44ad48388a56df9972462932 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.246913 14036 tablet_replica.cc:333] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.247596 14036 raft_consensus.cc:2243] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.248370 14036 raft_consensus.cc:2272] T 4db0967cdcf34bd1a951b3e732ba51ae P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.250252 14036 tablet_replica.cc:333] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.250763 14036 raft_consensus.cc:2243] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.251266 14036 raft_consensus.cc:2272] T 265102913f834db596bb95ebf8d031dd P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.253147 14036 tablet_replica.cc:333] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.253674 14036 raft_consensus.cc:2243] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.254390 14036 raft_consensus.cc:2272] T a6b9ad5291bf45a1978822097056ff57 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.256446 14036 tablet_replica.cc:333] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.256942 14036 raft_consensus.cc:2243] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.257416 14036 raft_consensus.cc:2272] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.259262 14036 tablet_replica.cc:333] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.259783 14036 raft_consensus.cc:2243] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.260262 14036 raft_consensus.cc:2272] T 9f4f5b98e071431492a1a258fddd2ef3 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.262879 14036 tablet_replica.cc:333] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.263465 14036 raft_consensus.cc:2243] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.263986 14036 raft_consensus.cc:2272] T ce9adf205be04005b843fa29a8aa6cbe P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.266486 14036 tablet_replica.cc:333] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29: stopping tablet replica
I20260709 13:07:58.267023 14036 raft_consensus.cc:2243] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.267606 14036 raft_consensus.cc:2272] T f0ef366a73c0412fa3f7e3966917d438 P 5801d6e785774cafb5fd3d8bbc1caf29 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.278074 23751 consensus_peers.cc:597] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.317535 23677 consensus_peers.cc:597] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.321343 23677 consensus_peers.cc:597] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.323807 23677 consensus_peers.cc:597] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.340296 23751 consensus_peers.cc:597] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.345221 23751 consensus_peers.cc:597] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.348161 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
W20260709 13:07:58.390033 23677 consensus_peers.cc:597] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.403515 23677 consensus_peers.cc:597] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.413158 23677 consensus_peers.cc:597] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.421128 23677 consensus_peers.cc:597] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.426149 23677 consensus_peers.cc:597] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.428674 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
I20260709 13:07:58.473273 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:58.474164 14036 tablet_replica.cc:333] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.474910 14036 raft_consensus.cc:2243] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.475512 14036 raft_consensus.cc:2272] T 62d63b259d0c43e8bfb2c9f89cfa8e86 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.477769 14036 tablet_replica.cc:333] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.478361 14036 raft_consensus.cc:2243] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.478833 14036 raft_consensus.cc:2272] T b4df4d5bfaa14060b865c3d19e9fa828 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.480898 14036 tablet_replica.cc:333] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.481500 14036 raft_consensus.cc:2243] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.482249 14036 raft_consensus.cc:2272] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.484323 23751 consensus_peers.cc:597] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.484383 14036 tablet_replica.cc:333] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.485138 14036 raft_consensus.cc:2243] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.485577 14036 raft_consensus.cc:2272] T 43f58740da23409abe43f3768bfac6e3 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.487601 14036 tablet_replica.cc:333] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.488269 14036 raft_consensus.cc:2243] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.488704 14036 raft_consensus.cc:2272] T 0870de63fd864cf8b6cd8448ac80634b P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.490623 14036 tablet_replica.cc:333] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.491235 14036 raft_consensus.cc:2243] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.491696 14036 raft_consensus.cc:2272] T 4db0967cdcf34bd1a951b3e732ba51ae P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.493822 14036 tablet_replica.cc:333] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.494624 14036 raft_consensus.cc:2243] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.495285 14036 raft_consensus.cc:2272] T e8de4fb2abe04956b7c4ecb7e8c66e15 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.498579 14036 tablet_replica.cc:333] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.499475 14036 raft_consensus.cc:2243] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.499971 14036 raft_consensus.cc:2272] T 28355fbc03cd49a9aa2080b53afbd142 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.502488 14036 tablet_replica.cc:333] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.503384 14036 raft_consensus.cc:2243] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.504521 14036 raft_consensus.cc:2272] T ada29c39e396475e91dfcfdc5a412adc P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.507978 14036 tablet_replica.cc:333] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
W20260709 13:07:58.507831 23751 consensus_peers.cc:597] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.508867 14036 raft_consensus.cc:2243] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.509413 14036 raft_consensus.cc:2272] T dedb6c9f912b48b1aaac6a3b8947e308 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.510820 23751 consensus_peers.cc:597] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.511580 14036 tablet_replica.cc:333] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.512317 14036 raft_consensus.cc:2243] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.513036 14036 raft_consensus.cc:2272] T 61dc47e97be24944ac16d6a564a62da1 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.514909 14036 tablet_replica.cc:333] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.515472 14036 raft_consensus.cc:2243] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.516304 14036 raft_consensus.cc:2272] T f0ef366a73c0412fa3f7e3966917d438 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.518770 14036 tablet_replica.cc:333] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.519399 14036 raft_consensus.cc:2243] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.519834 14036 raft_consensus.cc:2272] T 6a112ab003b24103ae2a7b922dc31f3d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.521734 14036 tablet_replica.cc:333] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.522269 14036 raft_consensus.cc:2243] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.522994 14036 raft_consensus.cc:2272] T 30353e6381ee498baaa0333b4b016c28 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.524770 14036 tablet_replica.cc:333] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.525322 14036 raft_consensus.cc:2243] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.525795 14036 raft_consensus.cc:2272] T 82de114cc0774d5d8ca8d4cd0d87972b P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.527639 14036 tablet_replica.cc:333] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.528223 14036 raft_consensus.cc:2243] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.528975 14036 raft_consensus.cc:2272] T 202fa208bd5c4307aaa9589effb21dcd P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.531558 14036 tablet_replica.cc:333] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.532339 14036 raft_consensus.cc:2243] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.532871 14036 raft_consensus.cc:2272] T daafd10eea854105a7b5af409dcac409 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.535461 14036 tablet_replica.cc:333] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.536273 14036 raft_consensus.cc:2243] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.536851 14036 raft_consensus.cc:2272] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.539204 14036 tablet_replica.cc:333] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.539709 14036 raft_consensus.cc:2243] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.540068 14036 raft_consensus.cc:2272] T 3e66f85de59d4ac4b676edfe803876b8 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.541803 14036 tablet_replica.cc:333] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.542281 14036 raft_consensus.cc:2243] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.542641 14036 raft_consensus.cc:2272] T ecbb921a20f742f58e9b8ebf7822cc87 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.544708 14036 tablet_replica.cc:333] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.545164 14036 raft_consensus.cc:2243] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.545872 14036 raft_consensus.cc:2272] T b46b913ff5404592be0ac2df69ce2498 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.547691 14036 tablet_replica.cc:333] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.548169 14036 raft_consensus.cc:2243] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.548516 14036 raft_consensus.cc:2272] T 4ee2fe61752e4fd6a11c4e1dc2857051 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.550220 14036 tablet_replica.cc:333] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.550725 14036 raft_consensus.cc:2243] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.551143 14036 raft_consensus.cc:2272] T 0bfaaac6cef24fd9837185a2710b1823 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.552986 14036 tablet_replica.cc:333] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.553463 14036 raft_consensus.cc:2243] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.553823 14036 raft_consensus.cc:2272] T 3214eda030c94c39a590e4a7c3fb8ccc P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.555747 14036 tablet_replica.cc:333] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.556226 14036 raft_consensus.cc:2243] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.556988 14036 raft_consensus.cc:2272] T 2188519be6684f4b8f46b07846fba5ab P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.559653 14036 tablet_replica.cc:333] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.560283 14036 raft_consensus.cc:2243] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.560832 14036 raft_consensus.cc:2272] T 0641dafd5a7041a0b0d2cfebe0b4306e P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.563318 14036 tablet_replica.cc:333] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.563817 14036 raft_consensus.cc:2243] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.570844 14036 raft_consensus.cc:2272] T 6641b8962e66467ba062e7c2b419d873 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.573760 14036 tablet_replica.cc:333] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.574594 14036 raft_consensus.cc:2243] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.575654 14036 raft_consensus.cc:2272] T e4351d83f6f0478a9d56121d733ff753 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.578428 14036 tablet_replica.cc:333] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.579259 14036 raft_consensus.cc:2243] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.579805 14036 raft_consensus.cc:2272] T a1be00bf028b40acabfa2fcad430301d P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.582445 14036 tablet_replica.cc:333] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.583253 14036 raft_consensus.cc:2243] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.584307 14036 raft_consensus.cc:2272] T f331d8701aa747479e33e661ec648a30 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.584645 23751 consensus_peers.cc:597] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 5801d6e785774cafb5fd3d8bbc1caf29 (127.13.181.2:35595): Couldn't send request to peer 5801d6e785774cafb5fd3d8bbc1caf29. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:35595: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.586436 14036 tablet_replica.cc:333] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.587150 14036 raft_consensus.cc:2243] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.587914 14036 raft_consensus.cc:2272] T 36f60dc2cd934d1da48a665aad1c13d3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.590266 14036 tablet_replica.cc:333] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
W20260709 13:07:58.590232 23751 consensus_peers.cc:597] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.591087 14036 raft_consensus.cc:2243] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.591529 14036 raft_consensus.cc:2272] T 85de537a84e841488dfe245e698eab3a P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.593353 14036 tablet_replica.cc:333] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.593889 14036 raft_consensus.cc:2243] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.594310 14036 raft_consensus.cc:2272] T bf53bc01d1484dbd95722162c9827f6d P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.596295 14036 tablet_replica.cc:333] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.596853 14036 raft_consensus.cc:2243] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.597635 14036 raft_consensus.cc:2272] T 037f0f88df364595893585d30b8a23e0 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.599507 14036 tablet_replica.cc:333] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.600034 14036 raft_consensus.cc:2243] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.600458 14036 raft_consensus.cc:2272] T 883d3fdac6bf46478c2f6999beaa7fb0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.602994 14036 tablet_replica.cc:333] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.603708 14036 raft_consensus.cc:2243] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.604173 14036 raft_consensus.cc:2272] T ec1ae450a6974af090cea14009c262d2 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.606739 14036 tablet_replica.cc:333] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.607308 14036 raft_consensus.cc:2243] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.607734 14036 raft_consensus.cc:2272] T a6b9ad5291bf45a1978822097056ff57 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.609771 14036 tablet_replica.cc:333] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.610425 14036 raft_consensus.cc:2243] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.611349 14036 raft_consensus.cc:2272] T 7fe0677c45254e81bbad8dc085ffb64c P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.614094 14036 tablet_replica.cc:333] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.614760 14036 raft_consensus.cc:2243] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.615316 14036 raft_consensus.cc:2272] T f090d4df44ad48388a56df9972462932 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.617384 14036 tablet_replica.cc:333] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.618000 14036 raft_consensus.cc:2243] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.618716 14036 raft_consensus.cc:2272] T 9f4f5b98e071431492a1a258fddd2ef3 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.620456 14036 tablet_replica.cc:333] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.620872 14036 raft_consensus.cc:2243] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.621218 14036 raft_consensus.cc:2272] T d6db2b37fa4a42eca168f8bcfda497a0 P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.623099 14036 tablet_replica.cc:333] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.623530 14036 raft_consensus.cc:2243] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.623889 14036 raft_consensus.cc:2272] T 934afa29ceb24bb8a35260dfb5e22e6a P 2fa39659edab417ebd04cb981cf61549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.625828 14036 tablet_replica.cc:333] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.626302 14036 raft_consensus.cc:2243] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.626641 14036 raft_consensus.cc:2272] T 5a142d068a8e4383af2a8ec2986b9c06 P 2fa39659edab417ebd04cb981cf61549 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.628373 14036 tablet_replica.cc:333] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549: stopping tablet replica
I20260709 13:07:58.628811 14036 raft_consensus.cc:2243] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.629485 14036 raft_consensus.cc:2272] T 7e9732b9e0d94f8d9386a523a65e9519 P 2fa39659edab417ebd04cb981cf61549 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:58.635623 23751 consensus_peers.cc:597] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.656644 23751 consensus_peers.cc:597] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.709398 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
W20260709 13:07:58.720450 23751 consensus_peers.cc:597] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.3:33247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.728193 23751 consensus_peers.cc:597] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.3:33247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.782819 14036 tablet_server.cc:179] TabletServer@127.13.181.4:0 shutting down...
W20260709 13:07:58.782876 23751 consensus_peers.cc:597] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.3:33247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:58.818862 23751 consensus_peers.cc:597] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 -> Peer 2fa39659edab417ebd04cb981cf61549 (127.13.181.3:33247): Couldn't send request to peer 2fa39659edab417ebd04cb981cf61549. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.3:33247: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:58.828236 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:58.828974 14036 tablet_replica.cc:333] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.829792 14036 raft_consensus.cc:2243] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.830336 14036 raft_consensus.cc:2272] T 9a9c72ca943445cbb12a3eaaa3989ef6 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.833045 14036 tablet_replica.cc:333] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.833745 14036 raft_consensus.cc:2243] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.834198 14036 raft_consensus.cc:2272] T 56fd318ba74c4199a62e26d48ff01f46 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.835997 14036 tablet_replica.cc:333] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.836527 14036 raft_consensus.cc:2243] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.836920 14036 raft_consensus.cc:2272] T 43f58740da23409abe43f3768bfac6e3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.838714 14036 tablet_replica.cc:333] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.839323 14036 raft_consensus.cc:2243] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.840076 14036 raft_consensus.cc:2272] T 0870de63fd864cf8b6cd8448ac80634b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.842128 14036 tablet_replica.cc:333] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.842691 14036 raft_consensus.cc:2243] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.843158 14036 raft_consensus.cc:2272] T e719beac9bca41db843477aa2eabb1a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.844901 14036 tablet_replica.cc:333] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.845453 14036 raft_consensus.cc:2243] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.845860 14036 raft_consensus.cc:2272] T 42d42bf20cfb4ca3a1c99680e76288b1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.847698 14036 tablet_replica.cc:333] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.848402 14036 raft_consensus.cc:2243] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.848922 14036 raft_consensus.cc:2272] T 30353e6381ee498baaa0333b4b016c28 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.851421 14036 tablet_replica.cc:333] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.852177 14036 raft_consensus.cc:2243] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.852588 14036 raft_consensus.cc:2272] T 85de537a84e841488dfe245e698eab3a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.854489 14036 tablet_replica.cc:333] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.854971 14036 raft_consensus.cc:2243] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.855739 14036 raft_consensus.cc:2272] T dedb6c9f912b48b1aaac6a3b8947e308 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.857578 14036 tablet_replica.cc:333] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.858049 14036 raft_consensus.cc:2243] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.859076 14036 raft_consensus.cc:2272] T ce9adf205be04005b843fa29a8aa6cbe P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.860905 14036 tablet_replica.cc:333] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.861372 14036 raft_consensus.cc:2243] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.862023 14036 raft_consensus.cc:2272] T 6a112ab003b24103ae2a7b922dc31f3d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.863996 14036 tablet_replica.cc:333] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.864478 14036 raft_consensus.cc:2243] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.865154 14036 raft_consensus.cc:2272] T 7353eea058f4496792494b7c5b54707b P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.867091 14036 tablet_replica.cc:333] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.867606 14036 raft_consensus.cc:2243] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.867959 14036 raft_consensus.cc:2272] T 61dc47e97be24944ac16d6a564a62da1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.869663 14036 tablet_replica.cc:333] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.870134 14036 raft_consensus.cc:2243] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.870501 14036 raft_consensus.cc:2272] T a43ac9d400274111ab086900b40199f0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.872372 14036 tablet_replica.cc:333] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.873029 14036 raft_consensus.cc:2243] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.873441 14036 raft_consensus.cc:2272] T 202fa208bd5c4307aaa9589effb21dcd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.875403 14036 tablet_replica.cc:333] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.875939 14036 raft_consensus.cc:2243] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.876364 14036 raft_consensus.cc:2272] T 6d840fb6d5bb459dadc6e033bf997f5e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.878216 14036 tablet_replica.cc:333] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.878749 14036 raft_consensus.cc:2243] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.879165 14036 raft_consensus.cc:2272] T daafd10eea854105a7b5af409dcac409 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.880885 14036 tablet_replica.cc:333] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.881433 14036 raft_consensus.cc:2243] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.881837 14036 raft_consensus.cc:2272] T ae1a0dfb08d64fbb85f81c33ab57e9e1 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.884181 14036 tablet_replica.cc:333] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.884912 14036 raft_consensus.cc:2243] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.885427 14036 raft_consensus.cc:2272] T 47b6e1ada0a04d7990b4fd562dd4cc7f P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.888608 14036 tablet_replica.cc:333] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.889453 14036 raft_consensus.cc:2243] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.890484 14036 raft_consensus.cc:2272] T ecbb921a20f742f58e9b8ebf7822cc87 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.893052 14036 tablet_replica.cc:333] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.893603 14036 raft_consensus.cc:2243] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.894032 14036 raft_consensus.cc:2272] T b46b913ff5404592be0ac2df69ce2498 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.895895 14036 tablet_replica.cc:333] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.896453 14036 raft_consensus.cc:2243] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.896869 14036 raft_consensus.cc:2272] T 36f60dc2cd934d1da48a665aad1c13d3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.898635 14036 tablet_replica.cc:333] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.899227 14036 raft_consensus.cc:2243] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.899643 14036 raft_consensus.cc:2272] T 037f0f88df364595893585d30b8a23e0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.901531 14036 tablet_replica.cc:333] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.902060 14036 raft_consensus.cc:2243] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.902819 14036 raft_consensus.cc:2272] T 883d3fdac6bf46478c2f6999beaa7fb0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.904832 14036 tablet_replica.cc:333] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.905359 14036 raft_consensus.cc:2243] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.905751 14036 raft_consensus.cc:2272] T 265102913f834db596bb95ebf8d031dd P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.908015 14036 tablet_replica.cc:333] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.908792 14036 raft_consensus.cc:2243] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.909579 14036 raft_consensus.cc:2272] T ec1ae450a6974af090cea14009c262d2 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.911875 14036 tablet_replica.cc:333] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.912400 14036 raft_consensus.cc:2243] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.912798 14036 raft_consensus.cc:2272] T a6b9ad5291bf45a1978822097056ff57 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.914644 14036 tablet_replica.cc:333] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.915210 14036 raft_consensus.cc:2243] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.915627 14036 raft_consensus.cc:2272] T 2188519be6684f4b8f46b07846fba5ab P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.917477 14036 tablet_replica.cc:333] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.917982 14036 raft_consensus.cc:2243] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.918728 14036 raft_consensus.cc:2272] T 0641dafd5a7041a0b0d2cfebe0b4306e P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.920650 14036 tablet_replica.cc:333] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.921172 14036 raft_consensus.cc:2243] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.921566 14036 raft_consensus.cc:2272] T 871dc3bda4c344b9bd080bf3fae3d085 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.923470 14036 tablet_replica.cc:333] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.924029 14036 raft_consensus.cc:2243] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.924772 14036 raft_consensus.cc:2272] T a1be00bf028b40acabfa2fcad430301d P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.927080 14036 tablet_replica.cc:333] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.927901 14036 raft_consensus.cc:2243] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.928426 14036 raft_consensus.cc:2272] T e4351d83f6f0478a9d56121d733ff753 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.930721 14036 tablet_replica.cc:333] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.931301 14036 raft_consensus.cc:2243] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.932032 14036 raft_consensus.cc:2272] T 934afa29ceb24bb8a35260dfb5e22e6a P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.933890 14036 tablet_replica.cc:333] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.934422 14036 raft_consensus.cc:2243] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.934844 14036 raft_consensus.cc:2272] T 5a142d068a8e4383af2a8ec2986b9c06 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.936623 14036 tablet_replica.cc:333] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.937119 14036 raft_consensus.cc:2243] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.937516 14036 raft_consensus.cc:2272] T 7e9732b9e0d94f8d9386a523a65e9519 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.939370 14036 tablet_replica.cc:333] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.939872 14036 raft_consensus.cc:2243] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.940263 14036 raft_consensus.cc:2272] T 3214eda030c94c39a590e4a7c3fb8ccc P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.941973 14036 tablet_replica.cc:333] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.942454 14036 raft_consensus.cc:2243] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.943214 14036 raft_consensus.cc:2272] T 6ecbdd1056594932b785458e6cd595c3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.944978 14036 tablet_replica.cc:333] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.945458 14036 raft_consensus.cc:2243] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.946153 14036 raft_consensus.cc:2272] T 982a36e8097b4dbfb315b9527072e1aa P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.948133 14036 tablet_replica.cc:333] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.948627 14036 raft_consensus.cc:2243] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.949364 14036 raft_consensus.cc:2272] T d6db2b37fa4a42eca168f8bcfda497a0 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.951397 14036 tablet_replica.cc:333] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.951922 14036 raft_consensus.cc:2243] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.952344 14036 raft_consensus.cc:2272] T 28355fbc03cd49a9aa2080b53afbd142 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.954324 14036 tablet_replica.cc:333] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.954824 14036 raft_consensus.cc:2243] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.955255 14036 raft_consensus.cc:2272] T 5ce328dcc310474c82fd1fc598402f51 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.957142 14036 tablet_replica.cc:333] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.957633 14036 raft_consensus.cc:2243] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.958055 14036 raft_consensus.cc:2272] T 70e52cc6079649abb36ed7bc7bbacaca P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.960094 14036 tablet_replica.cc:333] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.960590 14036 raft_consensus.cc:2243] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.961304 14036 raft_consensus.cc:2272] T 9208e7a4c72e41c9bd0a231c9f25ecbf P 8fdf2efb58be4c0c9cbc722e57a73975 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.963285 14036 tablet_replica.cc:333] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975: stopping tablet replica
I20260709 13:07:58.963814 14036 raft_consensus.cc:2243] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.964238 14036 raft_consensus.cc:2272] T 9f4f5b98e071431492a1a258fddd2ef3 P 8fdf2efb58be4c0c9cbc722e57a73975 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:59.034354 14036 tablet_server.cc:196] TabletServer@127.13.181.4:0 shutdown complete.
I20260709 13:07:59.094340 14036 master.cc:562] Master@127.13.181.62:37179 shutting down...
I20260709 13:07:59.120662 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:59.121286 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:59.121634 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 44c15f33e918460e830d0cbabdacfee8: stopping tablet replica
I20260709 13:07:59.144200 14036 master.cc:584] Master@127.13.181.62:37179 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (31391 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:07:59.235757 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:36785
I20260709 13:07:59.236960 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:59.242971 24727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.242982 24726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.243978 24729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:59.245714 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:59.246903 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:59.247215 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:59.247401 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602479247365 us; error 0 us; skew 500 ppm
I20260709 13:07:59.248004 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:59.250730 14036 webserver.cc:533] Webserver started at http://127.13.181.62:35573/ using document root <none> and password file <none>
I20260709 13:07:59.251315 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:59.251511 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:59.251809 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:59.252983 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "ccca871ef206437999949f8e7acfcced"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.257650 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:59.261310 24734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.262060 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:07:59.262369 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "ccca871ef206437999949f8e7acfcced"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.262688 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:59.273630 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:59.275090 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:59.316270 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:36785
I20260709 13:07:59.316391 24785 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:36785 every 8 connection(s)
I20260709 13:07:59.320391 24786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.332278 24786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced: Bootstrap starting.
I20260709 13:07:59.336992 24786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.341337 24786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced: No bootstrap required, opened a new log
I20260709 13:07:59.343786 24786 raft_consensus.cc:359] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccca871ef206437999949f8e7acfcced" member_type: VOTER }
I20260709 13:07:59.344215 24786 raft_consensus.cc:385] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.344411 24786 raft_consensus.cc:740] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccca871ef206437999949f8e7acfcced, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.344959 24786 consensus_queue.cc:260] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccca871ef206437999949f8e7acfcced" member_type: VOTER }
I20260709 13:07:59.345400 24786 raft_consensus.cc:399] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:59.345608 24786 raft_consensus.cc:493] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:59.345852 24786 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.350816 24786 raft_consensus.cc:515] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccca871ef206437999949f8e7acfcced" member_type: VOTER }
I20260709 13:07:59.351460 24786 leader_election.cc:304] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ccca871ef206437999949f8e7acfcced; no voters: 
I20260709 13:07:59.352757 24786 leader_election.cc:290] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:59.353199 24789 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.354614 24789 raft_consensus.cc:697] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 1 LEADER]: Becoming Leader. State: Replica: ccca871ef206437999949f8e7acfcced, State: Running, Role: LEADER
I20260709 13:07:59.355366 24789 consensus_queue.cc:237] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccca871ef206437999949f8e7acfcced" member_type: VOTER }
I20260709 13:07:59.355991 24786 sys_catalog.cc:565] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:59.360595 24791 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [sys.catalog]: SysCatalogTable state changed. Reason: New leader ccca871ef206437999949f8e7acfcced. Latest consensus state: current_term: 1 leader_uuid: "ccca871ef206437999949f8e7acfcced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccca871ef206437999949f8e7acfcced" member_type: VOTER } }
I20260709 13:07:59.361375 24791 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:59.361858 24790 sys_catalog.cc:455] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ccca871ef206437999949f8e7acfcced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ccca871ef206437999949f8e7acfcced" member_type: VOTER } }
I20260709 13:07:59.362341 24790 sys_catalog.cc:458] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:59.363585 24796 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:59.369136 24796 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:59.372378 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:59.379264 24796 catalog_manager.cc:1383] Generated new cluster ID: d2a87c5f0fbb4ce9aac87d4a922a3d3f
I20260709 13:07:59.379597 24796 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:59.402034 24796 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:59.403505 24796 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:59.415678 24796 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced: Generated new TSK 0
I20260709 13:07:59.416378 24796 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:59.442107 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:59.448757 24807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.449788 24808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.451913 24810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:59.452311 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:59.453284 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:59.453496 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:59.453641 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602479453630 us; error 0 us; skew 500 ppm
I20260709 13:07:59.454227 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:59.456579 14036 webserver.cc:533] Webserver started at http://127.13.181.1:41451/ using document root <none> and password file <none>
I20260709 13:07:59.457088 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:59.457278 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:59.457634 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:59.458703 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "b14018454e7243528a53097d861d9860"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.463109 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 13:07:59.466846 24815 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.467749 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:59.468078 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "b14018454e7243528a53097d861d9860"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.468390 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:59.495154 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:59.496563 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:59.498059 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:59.500420 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:59.500663 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.500913 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:59.501111 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.543124 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:45169
I20260709 13:07:59.543272 24877 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:45169 every 8 connection(s)
I20260709 13:07:59.548099 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:59.555073 24882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.556869 24883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.560117 24885 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:59.560204 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:59.561707 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:59.561905 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:59.562026 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602479562014 us; error 0 us; skew 500 ppm
I20260709 13:07:59.562471 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:59.564312 24878 heartbeater.cc:344] Connected to a master server at 127.13.181.62:36785
I20260709 13:07:59.564728 24878 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:59.565469 14036 webserver.cc:533] Webserver started at http://127.13.181.2:44359/ using document root <none> and password file <none>
I20260709 13:07:59.565555 24878 heartbeater.cc:507] Master 127.13.181.62:36785 requested a full tablet report, sending...
I20260709 13:07:59.566366 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:59.566624 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:59.566968 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:59.568090 24751 ts_manager.cc:194] Registered new tserver with Master: b14018454e7243528a53097d861d9860 (127.13.181.1:45169)
I20260709 13:07:59.568367 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "f14d8c46532144839fe9e550c5375bb3"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.570019 24751 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53302
I20260709 13:07:59.573427 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:59.576917 24890 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.577852 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:59.578210 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "f14d8c46532144839fe9e550c5375bb3"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.578547 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:59.597586 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:59.598930 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:59.600530 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:59.603096 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:59.603353 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.603628 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:59.603818 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.648603 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:38823
I20260709 13:07:59.648732 24952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:38823 every 8 connection(s)
I20260709 13:07:59.654042 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:59.662132 24956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.664810 24957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:59.666428 24959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:59.668198 14036 server_base.cc:1061] running on GCE node
I20260709 13:07:59.668277 24953 heartbeater.cc:344] Connected to a master server at 127.13.181.62:36785
I20260709 13:07:59.668972 24953 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:59.669687 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:59.669986 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:59.669817 24953 heartbeater.cc:507] Master 127.13.181.62:36785 requested a full tablet report, sending...
I20260709 13:07:59.670313 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602479670293 us; error 0 us; skew 500 ppm
I20260709 13:07:59.671085 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:59.672531 24751 ts_manager.cc:194] Registered new tserver with Master: f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:07:59.673703 14036 webserver.cc:533] Webserver started at http://127.13.181.3:43929/ using document root <none> and password file <none>
I20260709 13:07:59.674253 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:59.674199 24751 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53314
I20260709 13:07:59.674629 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:59.674929 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:59.676255 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "0112bd64596b458e919738d141c11382"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.681088 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:59.684950 24964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.686094 14036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:07:59.686451 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "0112bd64596b458e919738d141c11382"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:07:59.686861 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:59.708245 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:59.709502 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:59.710928 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:59.713140 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:59.713376 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.713619 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:59.713796 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.754779 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:39507
I20260709 13:07:59.754897 25026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:39507 every 8 connection(s)
I20260709 13:07:59.770926 25027 heartbeater.cc:344] Connected to a master server at 127.13.181.62:36785
I20260709 13:07:59.771431 25027 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:59.772243 25027 heartbeater.cc:507] Master 127.13.181.62:36785 requested a full tablet report, sending...
I20260709 13:07:59.774500 24751 ts_manager.cc:194] Registered new tserver with Master: 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:07:59.774691 14036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016742029s
I20260709 13:07:59.776428 24751 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53316
I20260709 13:07:59.803560 24751 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53330:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:59.806346 24751 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:59.887161 24917 tablet_service.cc:1511] Processing CreateTablet for tablet f32e4fada6c64110a15551377041605c (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:59.888109 24918 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8f6907aa1542b2814273621d732808 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:59.888666 24917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32e4fada6c64110a15551377041605c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.889520 24918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8f6907aa1542b2814273621d732808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.890800 24916 tablet_service.cc:1511] Processing CreateTablet for tablet 9e051e56692e4ce398071ae894476f9a (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:59.892210 24916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e051e56692e4ce398071ae894476f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.893913 24842 tablet_service.cc:1511] Processing CreateTablet for tablet f32e4fada6c64110a15551377041605c (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:59.894471 24915 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9ad39e7de1417295caf20d1c5b89a7 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:59.895383 24842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32e4fada6c64110a15551377041605c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.895797 24915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9ad39e7de1417295caf20d1c5b89a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.897850 24837 tablet_service.cc:1511] Processing CreateTablet for tablet cf849b56e308452db95708b906975984 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:59.898670 24992 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8f6907aa1542b2814273621d732808 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:59.899230 24837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf849b56e308452db95708b906975984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.900070 24992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8f6907aa1542b2814273621d732808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.900180 24843 tablet_service.cc:1511] Processing CreateTablet for tablet 9f8f6907aa1542b2814273621d732808 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:59.901669 24843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f8f6907aa1542b2814273621d732808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.904044 24836 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc40c1a2a6240c283e07226acf19348 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:59.904183 24990 tablet_service.cc:1511] Processing CreateTablet for tablet 9e051e56692e4ce398071ae894476f9a (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:59.905521 24990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e051e56692e4ce398071ae894476f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.905568 24836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc40c1a2a6240c283e07226acf19348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.907462 24989 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9ad39e7de1417295caf20d1c5b89a7 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:59.908316 24841 tablet_service.cc:1511] Processing CreateTablet for tablet 9e051e56692e4ce398071ae894476f9a (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:59.908864 24989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9ad39e7de1417295caf20d1c5b89a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.909829 24841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e051e56692e4ce398071ae894476f9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.912266 24988 tablet_service.cc:1511] Processing CreateTablet for tablet 0aaf959b79704b4dadaba6c9aa25b330 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:59.912364 24840 tablet_service.cc:1511] Processing CreateTablet for tablet 6e9ad39e7de1417295caf20d1c5b89a7 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:59.913697 24988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aaf959b79704b4dadaba6c9aa25b330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.913901 24840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e9ad39e7de1417295caf20d1c5b89a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.916347 24838 tablet_service.cc:1511] Processing CreateTablet for tablet fa3611d1df50451badca6d47011b47dc (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:59.916690 24991 tablet_service.cc:1511] Processing CreateTablet for tablet f32e4fada6c64110a15551377041605c (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:59.918056 24991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32e4fada6c64110a15551377041605c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.918809 24835 tablet_service.cc:1511] Processing CreateTablet for tablet 82f3cc7843bc4d03948aea53dbf7d3f7 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:59.920878 24986 tablet_service.cc:1511] Processing CreateTablet for tablet cf849b56e308452db95708b906975984 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:59.921259 24834 tablet_service.cc:1511] Processing CreateTablet for tablet a985475fd03e4c929036db80cdc99c21 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:59.922278 24986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf849b56e308452db95708b906975984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.916252 24987 tablet_service.cc:1511] Processing CreateTablet for tablet fa3611d1df50451badca6d47011b47dc (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:59.923473 24987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3611d1df50451badca6d47011b47dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.924037 24839 tablet_service.cc:1511] Processing CreateTablet for tablet 0aaf959b79704b4dadaba6c9aa25b330 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:59.924170 24984 tablet_service.cc:1511] Processing CreateTablet for tablet 82f3cc7843bc4d03948aea53dbf7d3f7 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:59.926159 24984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f3cc7843bc4d03948aea53dbf7d3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.925968 24983 tablet_service.cc:1511] Processing CreateTablet for tablet a985475fd03e4c929036db80cdc99c21 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:59.928165 24985 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc40c1a2a6240c283e07226acf19348 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:59.929500 24983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a985475fd03e4c929036db80cdc99c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.931404 24985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc40c1a2a6240c283e07226acf19348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.935284 24914 tablet_service.cc:1511] Processing CreateTablet for tablet 0aaf959b79704b4dadaba6c9aa25b330 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:59.936565 24910 tablet_service.cc:1511] Processing CreateTablet for tablet 82f3cc7843bc4d03948aea53dbf7d3f7 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:59.937950 24910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f3cc7843bc4d03948aea53dbf7d3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.940824 24909 tablet_service.cc:1511] Processing CreateTablet for tablet a985475fd03e4c929036db80cdc99c21 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:59.942655 24909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a985475fd03e4c929036db80cdc99c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.944468 24911 tablet_service.cc:1511] Processing CreateTablet for tablet 9fc40c1a2a6240c283e07226acf19348 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:59.945485 24912 tablet_service.cc:1511] Processing CreateTablet for tablet cf849b56e308452db95708b906975984 (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:59.945013 24913 tablet_service.cc:1511] Processing CreateTablet for tablet fa3611d1df50451badca6d47011b47dc (DEFAULT_TABLE table=test-workload [id=6c17c51f289d413ca5fc52e0cc4ca1ad]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:59.955438 24911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fc40c1a2a6240c283e07226acf19348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.957676 25043 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:07:59.958642 24914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aaf959b79704b4dadaba6c9aa25b330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.963557 24912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf849b56e308452db95708b906975984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.964318 24913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3611d1df50451badca6d47011b47dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.978971 24838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3611d1df50451badca6d47011b47dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.979934 24835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f3cc7843bc4d03948aea53dbf7d3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.982645 24834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a985475fd03e4c929036db80cdc99c21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.987474 24839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aaf959b79704b4dadaba6c9aa25b330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:00.110544 25043 tablet_bootstrap.cc:654] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.135351 25044 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.135370 25042 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.142796 25044 tablet_bootstrap.cc:654] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.148609 25042 tablet_bootstrap.cc:654] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.168766 25043 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.169273 25043 ts_tablet_manager.cc:1403] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.212s	user 0.017s	sys 0.000s
I20260709 13:08:00.172259 25043 raft_consensus.cc:359] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.173015 25043 raft_consensus.cc:385] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.173252 25044 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.173352 25043 raft_consensus.cc:740] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.173916 25044 ts_tablet_manager.cc:1403] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.016s
I20260709 13:08:00.174690 25043 consensus_queue.cc:260] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.176604 25044 raft_consensus.cc:359] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.177893 25044 raft_consensus.cc:385] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.178169 25044 raft_consensus.cc:740] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.179898 25043 ts_tablet_manager.cc:1434] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:00.180692 24878 heartbeater.cc:499] Master 127.13.181.62:36785 was elected leader, sending a full tablet report...
I20260709 13:08:00.181082 25043 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.178864 25044 consensus_queue.cc:260] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.188133 25043 tablet_bootstrap.cc:654] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.188838 25042 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.189381 25042 ts_tablet_manager.cc:1403] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.007s
I20260709 13:08:00.193007 25042 raft_consensus.cc:359] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.193979 25042 raft_consensus.cc:385] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.194355 25042 raft_consensus.cc:740] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.195854 25042 consensus_queue.cc:260] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.198709 24953 heartbeater.cc:499] Master 127.13.181.62:36785 was elected leader, sending a full tablet report...
I20260709 13:08:00.199434 25044 ts_tablet_manager.cc:1434] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.009s
I20260709 13:08:00.199879 25043 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.200436 25043 ts_tablet_manager.cc:1403] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 13:08:00.200763 25044 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.203440 25043 raft_consensus.cc:359] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.204393 25043 raft_consensus.cc:385] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.204779 25043 raft_consensus.cc:740] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.206764 25027 heartbeater.cc:499] Master 127.13.181.62:36785 was elected leader, sending a full tablet report...
I20260709 13:08:00.207880 25042 ts_tablet_manager.cc:1434] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:08:00.208932 25042 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.205842 25043 consensus_queue.cc:260] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.213406 25043 ts_tablet_manager.cc:1434] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:00.207894 25044 tablet_bootstrap.cc:654] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.214506 25043 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.219897 25042 tablet_bootstrap.cc:654] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.221936 25043 tablet_bootstrap.cc:654] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.235217 25044 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.236063 25044 ts_tablet_manager.cc:1403] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.006s
I20260709 13:08:00.239114 25044 raft_consensus.cc:359] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.239864 25044 raft_consensus.cc:385] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.240181 25044 raft_consensus.cc:740] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.241047 25044 consensus_queue.cc:260] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.244400 25044 ts_tablet_manager.cc:1434] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:00.245572 25044 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.251979 25044 tablet_bootstrap.cc:654] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.257814 25043 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.258330 25043 ts_tablet_manager.cc:1403] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.013s
I20260709 13:08:00.259092 25044 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
W20260709 13:08:00.259106 25028 tablet.cc:2406] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:00.259692 25044 ts_tablet_manager.cc:1403] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:08:00.261008 25043 raft_consensus.cc:359] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.261616 25043 raft_consensus.cc:385] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.261672 25042 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.261909 25043 raft_consensus.cc:740] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.262280 25042 ts_tablet_manager.cc:1403] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.019s
I20260709 13:08:00.262717 25043 consensus_queue.cc:260] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.262686 25044 raft_consensus.cc:359] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.263852 25044 raft_consensus.cc:385] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.264178 25044 raft_consensus.cc:740] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.265414 25043 ts_tablet_manager.cc:1434] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:00.265108 25044 consensus_queue.cc:260] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.265439 25042 raft_consensus.cc:359] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.266366 25042 raft_consensus.cc:385] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.266642 25043 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.266665 25042 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.267799 25042 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.270107 25044 ts_tablet_manager.cc:1434] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:00.270459 25042 ts_tablet_manager.cc:1434] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:00.271239 25044 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.271461 25042 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.277818 25042 tablet_bootstrap.cc:654] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.278292 25044 tablet_bootstrap.cc:654] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.285022 25043 tablet_bootstrap.cc:654] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.292371 25042 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.292788 25043 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.292887 25042 ts_tablet_manager.cc:1403] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 13:08:00.293223 25044 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.293407 25043 ts_tablet_manager.cc:1403] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:08:00.293744 25044 ts_tablet_manager.cc:1403] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:08:00.296586 25042 raft_consensus.cc:359] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.297273 25042 raft_consensus.cc:385] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.297549 25042 raft_consensus.cc:740] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.297704 25044 raft_consensus.cc:359] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.298488 25044 raft_consensus.cc:385] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.298254 25042 consensus_queue.cc:260] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.296859 25043 raft_consensus.cc:359] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.298834 25044 raft_consensus.cc:740] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.299218 25043 raft_consensus.cc:385] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.299538 25043 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.299822 25044 consensus_queue.cc:260] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.300805 25042 ts_tablet_manager.cc:1434] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:08:00.300364 25043 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.301842 25042 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.304068 25044 ts_tablet_manager.cc:1434] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:08:00.305145 25044 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.306655 25048 raft_consensus.cc:493] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.307205 25048 raft_consensus.cc:515] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.307651 25043 ts_tablet_manager.cc:1434] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:08:00.308856 25043 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.311663 25044 tablet_bootstrap.cc:654] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.312209 25048 leader_election.cc:290] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.315551 25043 tablet_bootstrap.cc:654] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.320322 25042 tablet_bootstrap.cc:654] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.324012 25044 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.324725 25044 ts_tablet_manager.cc:1403] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 13:08:00.330353 25044 raft_consensus.cc:359] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.331434 25044 raft_consensus.cc:385] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.331820 25044 raft_consensus.cc:740] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.333881 25044 consensus_queue.cc:260] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.335219 25043 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.335796 25043 ts_tablet_manager.cc:1403] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.012s
I20260709 13:08:00.336607 25044 ts_tablet_manager.cc:1434] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:08:00.337705 25044 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.338655 25043 raft_consensus.cc:359] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.339459 25043 raft_consensus.cc:385] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.339756 25043 raft_consensus.cc:740] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.340708 25043 consensus_queue.cc:260] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.344792 25044 tablet_bootstrap.cc:654] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.345666 25043 ts_tablet_manager.cc:1434] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:08:00.346832 25043 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.363855 25043 tablet_bootstrap.cc:654] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:00.368072 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:00.368510 24928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:00.369256 24928 raft_consensus.cc:2468] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14018454e7243528a53097d861d9860 in term 0.
I20260709 13:08:00.369360 25002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.370893 24818 leader_election.cc:304] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.371223 25044 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.371759 25048 raft_consensus.cc:2804] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.371845 25044 ts_tablet_manager.cc:1403] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.012s
I20260709 13:08:00.371929 25043 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.372318 25048 raft_consensus.cc:493] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.372830 25043 ts_tablet_manager.cc:1403] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 13:08:00.372856 25048 raft_consensus.cc:3060] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.373102 25042 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.375450 25042 ts_tablet_manager.cc:1403] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.074s	user 0.007s	sys 0.013s
I20260709 13:08:00.375236 25044 raft_consensus.cc:359] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.376179 25044 raft_consensus.cc:385] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.376555 25044 raft_consensus.cc:740] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.376413 25043 raft_consensus.cc:359] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.377518 25043 raft_consensus.cc:385] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.377898 25043 raft_consensus.cc:740] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.377648 25044 consensus_queue.cc:260] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.378749 25043 consensus_queue.cc:260] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
W20260709 13:08:00.379535 24818 leader_election.cc:343] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.378499 25042 raft_consensus.cc:359] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.380676 25042 raft_consensus.cc:385] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.381244 25042 raft_consensus.cc:740] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.380646 25048 raft_consensus.cc:515] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.382244 25044 ts_tablet_manager.cc:1434] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:00.383392 25044 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.384558 24928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:00.385182 24928 raft_consensus.cc:3060] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.389036 25043 ts_tablet_manager.cc:1434] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:08:00.390177 25044 tablet_bootstrap.cc:654] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.392724 25043 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.397127 24928 raft_consensus.cc:2468] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14018454e7243528a53097d861d9860 in term 1.
I20260709 13:08:00.399015 24818 leader_election.cc:304] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.400252 25065 raft_consensus.cc:2804] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.400431 25042 consensus_queue.cc:260] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.405503 25042 ts_tablet_manager.cc:1434] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:08:00.405642 25043 tablet_bootstrap.cc:654] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.407058 25048 leader_election.cc:290] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Requested vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.407147 25002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
W20260709 13:08:00.409344 24818 leader_election.cc:343] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.406692 25042 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.410933 25044 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.411700 25044 ts_tablet_manager.cc:1403] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.015s
I20260709 13:08:00.415793 25044 raft_consensus.cc:359] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.416615 25044 raft_consensus.cc:385] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.416996 25044 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.418184 25042 tablet_bootstrap.cc:654] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.417814 25044 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.419894 25065 raft_consensus.cc:697] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 LEADER]: Becoming Leader. State: Replica: b14018454e7243528a53097d861d9860, State: Running, Role: LEADER
I20260709 13:08:00.421782 25043 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.422501 25043 ts_tablet_manager.cc:1403] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.004s
I20260709 13:08:00.423084 25044 ts_tablet_manager.cc:1434] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:08:00.424145 25044 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.426338 25043 raft_consensus.cc:359] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.427337 25043 raft_consensus.cc:385] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.427702 25043 raft_consensus.cc:740] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.428597 25043 consensus_queue.cc:260] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.430840 25044 tablet_bootstrap.cc:654] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.432090 25043 ts_tablet_manager.cc:1434] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.009s
I20260709 13:08:00.433600 25043 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.420917 25065 consensus_queue.cc:237] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.442605 25043 tablet_bootstrap.cc:654] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.445973 25044 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.446427 25044 ts_tablet_manager.cc:1403] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 13:08:00.446739 25042 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.447543 25042 ts_tablet_manager.cc:1403] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.012s
I20260709 13:08:00.449013 25044 raft_consensus.cc:359] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.449769 25044 raft_consensus.cc:385] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.450145 25044 raft_consensus.cc:740] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.450093 25051 raft_consensus.cc:493] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.451104 25051 raft_consensus.cc:515] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.451287 25044 consensus_queue.cc:260] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.453471 25044 ts_tablet_manager.cc:1434] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:08:00.454556 25044 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.460039 25044 tablet_bootstrap.cc:654] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.470521 24751 catalog_manager.cc:5697] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 reported cstate change: term changed from 0 to 1, leader changed from <none> to b14018454e7243528a53097d861d9860 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "b14018454e7243528a53097d861d9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.473508 25049 raft_consensus.cc:493] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.474261 25049 raft_consensus.cc:515] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.480765 25043 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.481351 25043 ts_tablet_manager.cc:1403] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.024s
I20260709 13:08:00.483139 25049 leader_election.cc:290] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.487215 25051 leader_election.cc:290] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:00.498077 25044 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.498718 25044 ts_tablet_manager.cc:1403] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.014s
I20260709 13:08:00.486357 25043 raft_consensus.cc:359] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.499432 25043 raft_consensus.cc:385] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.499821 25043 raft_consensus.cc:740] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.500578 25043 consensus_queue.cc:260] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.501776 25042 raft_consensus.cc:359] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.502079 25044 raft_consensus.cc:359] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.502669 25043 ts_tablet_manager.cc:1434] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:08:00.502568 25042 raft_consensus.cc:385] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.510485 25042 raft_consensus.cc:740] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.511161 25043 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.511620 25042 consensus_queue.cc:260] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.514631 25042 ts_tablet_manager.cc:1434] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.004s
I20260709 13:08:00.502913 25044 raft_consensus.cc:385] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.515384 25044 raft_consensus.cc:740] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.516512 25044 consensus_queue.cc:260] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.518847 25044 ts_tablet_manager.cc:1434] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:08:00.519765 25044 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3: Bootstrap starting.
I20260709 13:08:00.521535 25043 tablet_bootstrap.cc:654] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.523988 25042 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.525547 25002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.526520 25002 raft_consensus.cc:2468] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.529331 24893 leader_election.cc:304] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.531585 25042 tablet_bootstrap.cc:654] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.535712 25044 tablet_bootstrap.cc:654] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.539273 25049 raft_consensus.cc:2804] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.539920 25049 raft_consensus.cc:493] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.540364 25049 raft_consensus.cc:3060] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.543586 25044 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3: No bootstrap required, opened a new log
I20260709 13:08:00.544049 25044 ts_tablet_manager.cc:1403] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 13:08:00.545900 25044 raft_consensus.cc:359] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.546396 25044 raft_consensus.cc:385] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.546609 25044 raft_consensus.cc:740] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.547233 25044 consensus_queue.cc:260] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.551421 25044 ts_tablet_manager.cc:1434] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:08:00.553686 25042 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.554374 25042 ts_tablet_manager.cc:1403] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.006s
I20260709 13:08:00.555588 25086 raft_consensus.cc:493] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.556121 25086 raft_consensus.cc:515] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.557878 25042 raft_consensus.cc:359] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.558780 25042 raft_consensus.cc:385] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.559090 25086 leader_election.cc:290] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.559403 25042 raft_consensus.cc:740] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.559832 25002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.560633 25002 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.560523 25042 consensus_queue.cc:260] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.561954 24893 leader_election.cc:304] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.563336 25042 ts_tablet_manager.cc:1434] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:00.564672 25042 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.558707 25049 raft_consensus.cc:515] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.572188 25042 tablet_bootstrap.cc:654] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.579295 25086 raft_consensus.cc:2804] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.583081 25067 raft_consensus.cc:493] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.583865 25067 raft_consensus.cc:515] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.584440 25049 leader_election.cc:290] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.585536 25042 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.586521 25067 leader_election.cc:290] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.582919 25065 raft_consensus.cc:493] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.587808 24853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.590726 24853 raft_consensus.cc:2468] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.590627 25065 raft_consensus.cc:515] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.582461 25086 raft_consensus.cc:493] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.587945 25002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.592904 25086 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.593119 25002 raft_consensus.cc:3060] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.588691 24852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.594105 25042 ts_tablet_manager.cc:1403] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.001s
I20260709 13:08:00.594219 24852 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.595723 24927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:00.596860 25051 raft_consensus.cc:493] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.597712 25042 raft_consensus.cc:359] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.598634 25042 raft_consensus.cc:385] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.588981 24928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:00.592867 25065 leader_election.cc:290] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.589346 25088 raft_consensus.cc:493] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.599522 24928 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14018454e7243528a53097d861d9860 in term 0.
I20260709 13:08:00.589648 24851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.597546 25051 raft_consensus.cc:515] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.601682 24818 leader_election.cc:304] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.602794 25065 raft_consensus.cc:2804] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.603209 25065 raft_consensus.cc:493] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.603644 25065 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.604148 25051 leader_election.cc:290] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:00.605093 24851 raft_consensus.cc:3060] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.609763 25086 raft_consensus.cc:515] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.611294 25065 raft_consensus.cc:515] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.613016 24852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.613655 24852 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.599023 25042 raft_consensus.cc:740] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.614917 25042 consensus_queue.cc:260] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.615787 24928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:00.616364 24928 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.617182 25042 ts_tablet_manager.cc:1434] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:08:00.618227 25042 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.618594 25049 raft_consensus.cc:493] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.623608 25049 raft_consensus.cc:515] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.625365 25042 tablet_bootstrap.cc:654] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.627147 25065 leader_election.cc:290] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Requested vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.630153 24853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9ad39e7de1417295caf20d1c5b89a7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.631098 24853 raft_consensus.cc:2468] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.632938 24892 leader_election.cc:304] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.599871 25088 raft_consensus.cc:515] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.635710 24927 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14018454e7243528a53097d861d9860 in term 0.
I20260709 13:08:00.622547 25051 raft_consensus.cc:493] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.640980 25049 leader_election.cc:290] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.641979 25049 raft_consensus.cc:2804] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.643239 25049 raft_consensus.cc:493] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.647874 25049 raft_consensus.cc:3060] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.640666 25051 raft_consensus.cc:515] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.656244 25051 leader_election.cc:290] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:00.656934 25001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.659647 25000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.672962 25002 raft_consensus.cc:2468] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:00.674897 25000 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14018454e7243528a53097d861d9860 in term 0.
I20260709 13:08:00.676400 25051 raft_consensus.cc:493] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.676502 24893 leader_election.cc:304] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.676990 25051 raft_consensus.cc:515] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.677654 24850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.679829 25051 leader_election.cc:290] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
W20260709 13:08:00.683812 24966 leader_election.cc:343] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.661867 25092 raft_consensus.cc:493] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.684489 24892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:45169, user_credentials={real_user=slave}} blocked reactor thread for 51739.6us
I20260709 13:08:00.685155 25092 raft_consensus.cc:515] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.646083 25088 leader_election.cc:290] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.664166 24998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9ad39e7de1417295caf20d1c5b89a7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.687100 24849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.666469 24997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.688061 24849 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.688272 24997 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.668530 25043 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.668478 25086 leader_election.cc:290] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.689675 25043 ts_tablet_manager.cc:1403] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.179s	user 0.051s	sys 0.092s
I20260709 13:08:00.690239 25086 raft_consensus.cc:2804] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.690963 25086 raft_consensus.cc:697] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:00.669859 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.691846 24996 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.693750 25043 raft_consensus.cc:359] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.670430 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.694761 25043 raft_consensus.cc:385] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.696065 25043 raft_consensus.cc:740] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.697013 25043 consensus_queue.cc:260] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.699872 25043 ts_tablet_manager.cc:1434] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:08:00.701198 25043 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:00.702219 24996 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:00.684131 25091 raft_consensus.cc:493] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.703927 25091 raft_consensus.cc:515] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.673121 24853 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.680413 24850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.711432 24850 raft_consensus.cc:2468] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 0.
I20260709 13:08:00.711544 25043 tablet_bootstrap.cc:654] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:00.682018 24818 leader_election.cc:343] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.713358 24818 leader_election.cc:304] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.713547 24966 leader_election.cc:304] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:00.714226 25065 raft_consensus.cc:2804] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.714646 25065 raft_consensus.cc:493] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.714986 25065 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.715540 24850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.715834 25089 raft_consensus.cc:2804] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.716202 24850 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 0.
I20260709 13:08:00.716312 25089 raft_consensus.cc:493] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:00.716580 24893 leader_election.cc:343] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.704756 25092 leader_election.cc:290] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
W20260709 13:08:00.717219 24818 leader_election.cc:343] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.717291 25092 raft_consensus.cc:493] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.717739 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.621526 24851 raft_consensus.cc:2468] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:00.717914 25092 raft_consensus.cc:515] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.720048 24926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:00.661482 24852 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:00.707170 24849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.721125 24849 raft_consensus.cc:2468] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.721081 24924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:00.672967 24928 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14018454e7243528a53097d861d9860 in term 1.
I20260709 13:08:00.721941 24924 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 0.
I20260709 13:08:00.722247 25065 raft_consensus.cc:515] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.722605 24926 raft_consensus.cc:2468] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 0.
I20260709 13:08:00.723515 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:00.723764 25091 leader_election.cc:290] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.724244 24925 raft_consensus.cc:2468] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 0.
I20260709 13:08:00.720335 24966 leader_election.cc:304] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:00.725381 25065 leader_election.cc:290] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Requested vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.725642 25051 raft_consensus.cc:2804] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.726187 25051 raft_consensus.cc:493] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.726310 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.726629 25051 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.726966 24999 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.707950 24892 leader_election.cc:304] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.709945 24927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:00.719868 25092 leader_election.cc:290] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.734900 24893 leader_election.cc:304] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.736112 25092 raft_consensus.cc:2804] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.734922 25051 raft_consensus.cc:515] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.736764 25092 raft_consensus.cc:697] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:00.737532 24997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.738509 25051 leader_election.cc:290] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:00.739113 24849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.739675 24849 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.736140 24967 leader_election.cc:304] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: b14018454e7243528a53097d861d9860
I20260709 13:08:00.741102 24997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:00.716755 25089 raft_consensus.cc:3060] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.741844 25051 raft_consensus.cc:2804] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.742806 24997 raft_consensus.cc:2468] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.744807 25051 raft_consensus.cc:493] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.705216 25086 consensus_queue.cc:237] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.746609 25093 raft_consensus.cc:2804] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.747253 25093 raft_consensus.cc:493] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.747684 25093 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.750098 24849 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 1.
I20260709 13:08:00.745752 25049 raft_consensus.cc:515] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.737648 24999 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14018454e7243528a53097d861d9860 in term 1.
I20260709 13:08:00.737617 25092 consensus_queue.cc:237] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.752002 24818 leader_election.cc:304] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:00.752473 25049 leader_election.cc:290] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.752816 25065 raft_consensus.cc:2804] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.741607 24967 leader_election.cc:304] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0112bd64596b458e919738d141c11382; no voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:00.753328 25065 raft_consensus.cc:697] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 LEADER]: Becoming Leader. State: Replica: b14018454e7243528a53097d861d9860, State: Running, Role: LEADER
I20260709 13:08:00.753621 24966 leader_election.cc:304] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:00.754263 25065 consensus_queue.cc:237] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.757586 25051 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:00.761212 24893 leader_election.cc:343] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.762161 24893 leader_election.cc:304] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
W20260709 13:08:00.760442 24892 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:45169, user_credentials={real_user=slave}} blocked reactor thread for 52580.7us
I20260709 13:08:00.766100 25049 raft_consensus.cc:2804] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.766470 25049 raft_consensus.cc:493] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.766863 25049 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.766918 24927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "b14018454e7243528a53097d861d9860" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:00.767373 24892 leader_election.cc:304] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:00.768625 24818 leader_election.cc:304] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 0112bd64596b458e919738d141c11382
I20260709 13:08:00.769400 24852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.769544 25067 raft_consensus.cc:2804] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.771189 25091 raft_consensus.cc:2804] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.771457 25067 raft_consensus.cc:697] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 LEADER]: Becoming Leader. State: Replica: b14018454e7243528a53097d861d9860, State: Running, Role: LEADER
I20260709 13:08:00.772540 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9ad39e7de1417295caf20d1c5b89a7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.772725 25067 consensus_queue.cc:237] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
W20260709 13:08:00.773918 24893 leader_election.cc:343] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.774360 25049 raft_consensus.cc:515] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.770896 24851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9ad39e7de1417295caf20d1c5b89a7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.787614 24851 raft_consensus.cc:3060] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.786777 25093 raft_consensus.cc:515] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.792035 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.792595 24927 raft_consensus.cc:2393] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b14018454e7243528a53097d861d9860 in current term 1: Already voted for candidate f14d8c46532144839fe9e550c5375bb3 in this term.
I20260709 13:08:00.793533 25049 leader_election.cc:290] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
W20260709 13:08:00.776263 24892 leader_election.cc:343] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.771627 25091 raft_consensus.cc:493] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.795095 25091 raft_consensus.cc:3060] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.798202 24852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
W20260709 13:08:00.803845 24892 leader_election.cc:343] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.804608 25097 raft_consensus.cc:2749] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.805621 25097 raft_consensus.cc:2804] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.806237 25097 raft_consensus.cc:697] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:00.807332 25097 consensus_queue.cc:237] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.809947 24849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:00.810983 24849 raft_consensus.cc:2468] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 0.
I20260709 13:08:00.814148 25043 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: No bootstrap required, opened a new log
I20260709 13:08:00.814916 25043 ts_tablet_manager.cc:1403] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.114s	user 0.015s	sys 0.001s
I20260709 13:08:00.817266 24851 raft_consensus.cc:2468] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:00.817076 25089 raft_consensus.cc:515] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.818439 24996 raft_consensus.cc:2393] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f14d8c46532144839fe9e550c5375bb3 in current term 1: Already voted for candidate 0112bd64596b458e919738d141c11382 in this term.
I20260709 13:08:00.818751 24892 leader_election.cc:304] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 0112bd64596b458e919738d141c11382
I20260709 13:08:00.814251 24852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.819890 25049 raft_consensus.cc:2804] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.820487 25049 raft_consensus.cc:697] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:00.818571 25043 raft_consensus.cc:359] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.821419 25043 raft_consensus.cc:385] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.821795 25043 raft_consensus.cc:740] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.821619 25049 consensus_queue.cc:237] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
W20260709 13:08:00.824247 24967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.2:38823, user_credentials={real_user=slave}} blocked reactor thread for 82728.4us
I20260709 13:08:00.826041 24927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:00.826740 24927 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.826653 25042 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.828189 25042 ts_tablet_manager.cc:1403] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.210s	user 0.054s	sys 0.072s
I20260709 13:08:00.827477 25043 consensus_queue.cc:260] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.830375 25043 ts_tablet_manager.cc:1434] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:00.834913 25093 leader_election.cc:290] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.834723 25042 raft_consensus.cc:359] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.835573 25042 raft_consensus.cc:385] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.835855 25042 raft_consensus.cc:740] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.836117 25051 raft_consensus.cc:515] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.838284 25089 leader_election.cc:290] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:00.837814 24751 catalog_manager.cc:5697] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.839120 25051 leader_election.cc:290] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:00.839056 25042 consensus_queue.cc:260] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.840333 24852 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.841051 24852 raft_consensus.cc:3060] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.841264 25042 ts_tablet_manager.cc:1434] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:00.842257 25042 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.842360 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:00.843300 24926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:00.844048 24926 raft_consensus.cc:2393] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0112bd64596b458e919738d141c11382 in current term 1: Already voted for candidate f14d8c46532144839fe9e550c5375bb3 in this term.
I20260709 13:08:00.839367 24999 raft_consensus.cc:2393] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f14d8c46532144839fe9e550c5375bb3 in current term 1: Already voted for candidate 0112bd64596b458e919738d141c11382 in this term.
I20260709 13:08:00.844547 24927 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 1.
I20260709 13:08:00.848127 24892 leader_election.cc:304] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 0112bd64596b458e919738d141c11382
I20260709 13:08:00.848495 25042 tablet_bootstrap.cc:654] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.848793 24893 leader_election.cc:304] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f14d8c46532144839fe9e550c5375bb3; no voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860
I20260709 13:08:00.849153 24852 raft_consensus.cc:2468] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 1.
I20260709 13:08:00.850031 25086 raft_consensus.cc:2804] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.850425 25086 raft_consensus.cc:493] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.850555 25093 raft_consensus.cc:2749] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.850780 25086 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.840646 24850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.852130 24966 leader_election.cc:304] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:00.852546 24850 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.853201 25051 raft_consensus.cc:2804] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.853709 25051 raft_consensus.cc:697] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:00.853842 25042 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:00.854385 25042 ts_tablet_manager.cc:1403] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:08:00.854663 25051 consensus_queue.cc:237] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.857506 25042 raft_consensus.cc:359] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.857966 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.858295 25042 raft_consensus.cc:385] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.858774 24999 raft_consensus.cc:2393] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f14d8c46532144839fe9e550c5375bb3 in current term 1: Already voted for candidate b14018454e7243528a53097d861d9860 in this term.
I20260709 13:08:00.858719 25042 raft_consensus.cc:740] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.859915 25042 consensus_queue.cc:260] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.860493 24850 raft_consensus.cc:2468] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 1.
I20260709 13:08:00.860612 24893 leader_election.cc:304] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f14d8c46532144839fe9e550c5375bb3; no voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860
I20260709 13:08:00.861594 25088 raft_consensus.cc:2749] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.862116 24966 leader_election.cc:304] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:00.862778 25042 ts_tablet_manager.cc:1434] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:08:00.862926 25089 raft_consensus.cc:2804] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.863593 25089 raft_consensus.cc:697] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:00.864359 25042 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382: Bootstrap starting.
I20260709 13:08:00.864425 25089 consensus_queue.cc:237] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.871793 25042 tablet_bootstrap.cc:654] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.875232 25091 raft_consensus.cc:515] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.877174 24925 raft_consensus.cc:2393] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0112bd64596b458e919738d141c11382 in current term 1: Already voted for candidate f14d8c46532144839fe9e550c5375bb3 in this term.
I20260709 13:08:00.878379 25091 leader_election.cc:290] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:00.882400 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:00.890388 24851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf849b56e308452db95708b906975984" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.891619 24851 raft_consensus.cc:2393] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f14d8c46532144839fe9e550c5375bb3 in current term 1: Already voted for candidate 0112bd64596b458e919738d141c11382 in this term.
I20260709 13:08:00.893396 24892 leader_election.cc:304] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f14d8c46532144839fe9e550c5375bb3; no voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860
I20260709 13:08:00.894554 25091 raft_consensus.cc:2749] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.898512 24750 catalog_manager.cc:5697] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 reported cstate change: term changed from 0 to 1, leader changed from <none> to b14018454e7243528a53097d861d9860 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "b14018454e7243528a53097d861d9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.917454 25067 consensus_queue.cc:1048] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.888648 25086 raft_consensus.cc:515] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:00.927541 24851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:00.928264 24851 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.944696 24750 catalog_manager.cc:5697] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 reported cstate change: term changed from 0 to 1, leader changed from <none> to b14018454e7243528a53097d861d9860 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "b14018454e7243528a53097d861d9860" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.977720 24751 catalog_manager.cc:5697] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.958999 24851 raft_consensus.cc:2468] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:01.002609 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:01.002493 24751 catalog_manager.cc:5697] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.003577 24892 leader_election.cc:304] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:01.004490 25086 leader_election.cc:290] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:01.004508 25091 raft_consensus.cc:2804] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:08:01.004841 24893 leader_election.cc:343] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0112bd64596b458e919738d141c11382 (127.13.181.3:39507): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:01.005416 25091 raft_consensus.cc:697] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:00.973760 25051 raft_consensus.cc:493] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.006222 25051 raft_consensus.cc:515] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:01.006532 25091 consensus_queue.cc:237] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:01.008550 25051 leader_election.cc:290] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), b14018454e7243528a53097d861d9860 (127.13.181.1:45169)
I20260709 13:08:01.009102 24999 raft_consensus.cc:3060] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:01.015280 25042 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382: No bootstrap required, opened a new log
I20260709 13:08:01.015869 25042 ts_tablet_manager.cc:1403] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382: Time spent bootstrapping tablet: real 0.152s	user 0.062s	sys 0.077s
I20260709 13:08:01.018323 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:01.017844 24748 catalog_manager.cc:5697] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.018491 25042 raft_consensus.cc:359] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:01.020804 24851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:01.022584 25042 raft_consensus.cc:385] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:01.023061 25042 raft_consensus.cc:740] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Initialized, Role: FOLLOWER
I20260709 13:08:01.023995 24966 leader_election.cc:304] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0112bd64596b458e919738d141c11382; no voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:01.026580 25089 raft_consensus.cc:2749] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:01.023876 25042 consensus_queue.cc:260] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:01.027070 25048 consensus_queue.cc:1048] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:01.028591 25042 ts_tablet_manager.cc:1434] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:08:01.031832 25097 raft_consensus.cc:493] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.032528 25097 raft_consensus.cc:515] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:01.035674 25097 leader_election.cc:290] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:01.035876 24851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:01.036736 24851 raft_consensus.cc:2393] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0112bd64596b458e919738d141c11382 in current term 1: Already voted for candidate f14d8c46532144839fe9e550c5375bb3 in this term.
I20260709 13:08:01.039427 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:01.041088 24967 leader_election.cc:304] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0112bd64596b458e919738d141c11382; no voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:01.042155 25097 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:01.043217 24750 catalog_manager.cc:5697] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.047984 25097 raft_consensus.cc:2749] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:01.056001 24750 catalog_manager.cc:5697] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.057390 24750 catalog_manager.cc:5697] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:01.063074 25097 raft_consensus.cc:493] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.063663 25097 raft_consensus.cc:515] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:01.066138 25097 leader_election.cc:290] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:01.066246 24851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9ad39e7de1417295caf20d1c5b89a7" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b14018454e7243528a53097d861d9860" is_pre_election: true
I20260709 13:08:01.067127 24851 raft_consensus.cc:2393] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0112bd64596b458e919738d141c11382 in current term 1: Already voted for candidate f14d8c46532144839fe9e550c5375bb3 in this term.
I20260709 13:08:01.067312 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e9ad39e7de1417295caf20d1c5b89a7" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:01.068922 24967 leader_election.cc:304] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0112bd64596b458e919738d141c11382; no voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:01.069641 25097 raft_consensus.cc:3060] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:01.075662 25097 raft_consensus.cc:2749] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:01.077376 14036 ts_manager.cc:295] Set tserver state for b14018454e7243528a53097d861d9860 to MAINTENANCE_MODE
I20260709 13:08:01.078234 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
I20260709 13:08:01.102761 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:01.103557 14036 tablet_replica.cc:333] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.104197 14036 raft_consensus.cc:2243] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.104635 14036 raft_consensus.cc:2272] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.106724 14036 tablet_replica.cc:333] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.107355 14036 raft_consensus.cc:2243] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.107730 14036 raft_consensus.cc:2272] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.109506 14036 tablet_replica.cc:333] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.110049 14036 raft_consensus.cc:2243] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.110433 14036 raft_consensus.cc:2272] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.112190 14036 tablet_replica.cc:333] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.112701 14036 raft_consensus.cc:2243] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.113066 14036 raft_consensus.cc:2272] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.114709 14036 tablet_replica.cc:333] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.115307 14036 raft_consensus.cc:2243] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.115703 14036 raft_consensus.cc:2272] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.117352 14036 tablet_replica.cc:333] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.117841 14036 raft_consensus.cc:2243] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:01.118420 14036 pending_rounds.cc:70] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Trying to abort 1 pending ops.
I20260709 13:08:01.118619 14036 pending_rounds.cc:77] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635761203146752 op_type: NO_OP noop_request { }
I20260709 13:08:01.118916 14036 raft_consensus.cc:2889] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:01.119268 14036 raft_consensus.cc:2272] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.121317 14036 tablet_replica.cc:333] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.121855 14036 raft_consensus.cc:2243] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.122241 14036 raft_consensus.cc:2272] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.123983 14036 tablet_replica.cc:333] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.124502 14036 raft_consensus.cc:2243] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:01.125082 14036 pending_rounds.cc:70] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Trying to abort 1 pending ops.
I20260709 13:08:01.125288 14036 pending_rounds.cc:77] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635761264373760 op_type: NO_OP noop_request { }
I20260709 13:08:01.125557 14036 raft_consensus.cc:2889] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:01.125828 14036 raft_consensus.cc:2272] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.127911 14036 tablet_replica.cc:333] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.128466 14036 raft_consensus.cc:2243] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:01.128835 14036 raft_consensus.cc:2272] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.130403 14036 tablet_replica.cc:333] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: stopping tablet replica
I20260709 13:08:01.130970 14036 raft_consensus.cc:2243] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:01.131850 14036 raft_consensus.cc:2272] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:01.161235 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
W20260709 13:08:01.202137 24892 consensus_peers.cc:597] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:01.265401 24966 consensus_peers.cc:597] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:01.313022 24966 consensus_peers.cc:597] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:01.334964 24966 consensus_peers.cc:597] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:01.338238 24892 consensus_peers.cc:597] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.343768 25097 raft_consensus.cc:493] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.344257 25097 raft_consensus.cc:515] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:01.345966 25097 leader_election.cc:290] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:01.347132 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:01.347920 24925 raft_consensus.cc:2393] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0112bd64596b458e919738d141c11382 in current term 1: Already voted for candidate b14018454e7243528a53097d861d9860 in this term.
I20260709 13:08:01.349324 25089 consensus_queue.cc:1048] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:01.349717 24966 leader_election.cc:336] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:01.350150 24966 leader_election.cc:304] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0112bd64596b458e919738d141c11382; no voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:01.351125 25089 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:01.355101 25086 consensus_queue.cc:1048] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:08:01.356981 24892 consensus_peers.cc:597] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.358843 25089 raft_consensus.cc:2749] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:01.363562 25086 consensus_queue.cc:1048] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:01.369448 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:01.375319 25049 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:01.388496 25089 consensus_queue.cc:1048] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:01.411638 24892 consensus_peers.cc:597] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:01.416666 25097 consensus_queue.cc:1048] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:01.441946 25086 consensus_queue.cc:1048] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:02.370492 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:02.491400 25049 raft_consensus.cc:493] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b14018454e7243528a53097d861d9860)
I20260709 13:08:02.491971 25049 raft_consensus.cc:515] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.493660 25049 leader_election.cc:290] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:02.495096 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
W20260709 13:08:02.497582 24892 leader_election.cc:336] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:02.497994 24892 leader_election.cc:304] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f14d8c46532144839fe9e550c5375bb3; no voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860
I20260709 13:08:02.498643 25049 raft_consensus.cc:2749] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:02.530398 25097 raft_consensus.cc:493] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b14018454e7243528a53097d861d9860)
I20260709 13:08:02.530989 25097 raft_consensus.cc:515] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.532799 25097 leader_election.cc:290] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), b14018454e7243528a53097d861d9860 (127.13.181.1:45169)
I20260709 13:08:02.533689 24927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3" is_pre_election: true
I20260709 13:08:02.534291 24927 raft_consensus.cc:2468] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 1.
I20260709 13:08:02.535418 24967 leader_election.cc:304] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:02.536315 25097 raft_consensus.cc:2804] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:02.536633 25097 raft_consensus.cc:493] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b14018454e7243528a53097d861d9860)
W20260709 13:08:02.536810 24966 leader_election.cc:336] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:02.537036 25097 raft_consensus.cc:3060] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.542356 25097 raft_consensus.cc:515] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.544163 25097 leader_election.cc:290] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Requested vote from peers f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823), b14018454e7243528a53097d861d9860 (127.13.181.1:45169)
I20260709 13:08:02.544780 24927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f8f6907aa1542b2814273621d732808" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:02.545403 24927 raft_consensus.cc:3060] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:02.548069 24966 leader_election.cc:336] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:02.550827 24927 raft_consensus.cc:2468] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 2.
I20260709 13:08:02.551923 24967 leader_election.cc:304] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: b14018454e7243528a53097d861d9860
I20260709 13:08:02.552640 25097 raft_consensus.cc:2804] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.553582 25097 raft_consensus.cc:697] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:02.554350 25097 consensus_queue.cc:237] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.561231 24750 catalog_manager.cc:5697] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 1 to 2, leader changed from b14018454e7243528a53097d861d9860 (127.13.181.1) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.597879 25049 raft_consensus.cc:493] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.598409 25049 raft_consensus.cc:515] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.600100 25049 leader_election.cc:290] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:02.601178 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:02.601765 24996 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:02.602685 24893 leader_election.cc:304] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:02.603390 25049 raft_consensus.cc:2804] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:02.603480 24892 leader_election.cc:336] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:02.603672 25049 raft_consensus.cc:493] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.604089 25049 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.608716 25049 raft_consensus.cc:515] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.610241 25049 leader_election.cc:290] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:02.611363 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:02.612002 24996 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:02.613962 24892 leader_election.cc:336] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:02.617369 24996 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 2.
I20260709 13:08:02.618407 24893 leader_election.cc:304] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: b14018454e7243528a53097d861d9860
I20260709 13:08:02.619095 25049 raft_consensus.cc:2804] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.620090 25049 raft_consensus.cc:697] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:02.620726 25049 consensus_queue.cc:237] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.628684 24750 catalog_manager.cc:5697] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 1 to 2, leader changed from b14018454e7243528a53097d861d9860 (127.13.181.1) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.633076 25049 raft_consensus.cc:493] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.633575 25049 raft_consensus.cc:515] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.636780 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382" is_pre_election: true
I20260709 13:08:02.637087 25049 leader_election.cc:290] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:02.637429 24996 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 1.
I20260709 13:08:02.638787 24893 leader_election.cc:304] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:02.639533 25049 raft_consensus.cc:2804] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:08:02.639735 24892 leader_election.cc:336] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:02.639860 25049 raft_consensus.cc:493] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.640405 25049 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.645449 25049 raft_consensus.cc:515] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.647193 25049 leader_election.cc:290] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:02.648223 24996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:02.648852 24996 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:02.650935 24892 leader_election.cc:336] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111)
I20260709 13:08:02.654433 24996 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 2.
I20260709 13:08:02.655572 24893 leader_election.cc:304] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: b14018454e7243528a53097d861d9860
I20260709 13:08:02.656263 25049 raft_consensus.cc:2804] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.656697 25049 raft_consensus.cc:697] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:02.657536 25049 consensus_queue.cc:237] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:02.664443 24750 catalog_manager.cc:5697] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 1 to 2, leader changed from b14018454e7243528a53097d861d9860 (127.13.181.1) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:02.759212 24966 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111) [suppressed 121 similar messages]
W20260709 13:08:03.044174 24892 consensus_peers.cc:597] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:03.053954 24966 consensus_peers.cc:597] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.159871 24927 raft_consensus.cc:1275] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.161247 25097 consensus_queue.cc:1048] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:03.186329 24996 raft_consensus.cc:1275] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:08:03.186874 24892 consensus_peers.cc:597] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:03.187692 25049 consensus_queue.cc:1048] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:03.205288 24996 raft_consensus.cc:1275] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:03.206772 25143 consensus_queue.cc:1048] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:03.371613 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:08:03.733757 24966 consensus_peers.cc:597] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:03.832396 24966 consensus_peers.cc:597] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:03.847681 24892 consensus_peers.cc:597] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:03.853127 24966 consensus_peers.cc:597] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:03.922354 24892 consensus_peers.cc:597] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:04.011251 24892 consensus_peers.cc:597] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:04.308641 24892 consensus_peers.cc:597] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:04.372807 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:08:05.353945 24966 consensus_peers.cc:597] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.373839 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:08:05.442220 24892 consensus_peers.cc:597] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:05.634274 24892 consensus_peers.cc:597] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:06.082799 24966 consensus_peers.cc:597] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:06.181149 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:06.190196 25152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:06.191509 25153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:06.193269 25155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:06.193897 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:06.195849 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:06.196044 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:06.196195 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602486196184 us; error 0 us; skew 500 ppm
I20260709 13:08:06.196702 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:06.199407 14036 webserver.cc:533] Webserver started at http://127.13.181.1:41451/ using document root <none> and password file <none>
I20260709 13:08:06.199925 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:06.200078 14036 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:08:06.204178 14036 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:08:06.208279 25160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:06.209242 14036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:08:06.209635 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "b14018454e7243528a53097d861d9860"
format_stamp: "Formatted at 2026-07-09 13:07:59 on dist-test-slave-28ks"
I20260709 13:08:06.210167 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:06.232685 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:06.234014 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:06.235723 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:06.239622 25167 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:08:06.245179 24892 consensus_peers.cc:597] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:06.265524 24966 consensus_peers.cc:597] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:06.278194 24966 consensus_peers.cc:597] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:06.303838 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:08:06.304169 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.066s	user 0.003s	sys 0.000s
I20260709 13:08:06.304425 14036 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:08:06.309998 25167 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.327301 25167 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:08:06.328310 25167 tablet_bootstrap.cc:492] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.328964 25167 ts_tablet_manager.cc:1403] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:08:06.332046 25167 raft_consensus.cc:359] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.333262 25167 raft_consensus.cc:740] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.334071 25167 consensus_queue.cc:260] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.337014 25167 ts_tablet_manager.cc:1434] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:08:06.337921 25167 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.352808 25167 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.353696 25167 tablet_bootstrap.cc:492] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.354386 25167 ts_tablet_manager.cc:1403] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:08:06.357218 25167 raft_consensus.cc:359] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.357906 25167 raft_consensus.cc:740] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.358762 25167 consensus_queue.cc:260] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.360921 25167 ts_tablet_manager.cc:1434] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:06.361716 25167 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.367542 14036 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:08:06.367890 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.063s	user 0.060s	sys 0.004s
W20260709 13:08:06.374986 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:06.376927 25167 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.377938 25167 tablet_bootstrap.cc:492] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.378758 25167 ts_tablet_manager.cc:1403] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:08:06.382745 25167 raft_consensus.cc:359] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.383750 25167 raft_consensus.cc:740] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.384785 25167 consensus_queue.cc:260] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.387638 25167 ts_tablet_manager.cc:1434] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:06.388713 25167 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.406031 25167 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.406755 25167 tablet_bootstrap.cc:492] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.407361 25167 ts_tablet_manager.cc:1403] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:08:06.409193 25167 raft_consensus.cc:359] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.409706 25167 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.410317 25167 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.411839 25167 ts_tablet_manager.cc:1434] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:08:06.412636 25167 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.423578 25167 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.424263 25167 tablet_bootstrap.cc:492] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.424786 25167 ts_tablet_manager.cc:1403] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 13:08:06.426774 25167 raft_consensus.cc:359] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.427357 25167 raft_consensus.cc:740] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.427997 25167 consensus_queue.cc:260] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.430050 25167 ts_tablet_manager.cc:1434] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:08:06.430886 25167 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.435192 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:45169
I20260709 13:08:06.435321 25229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:45169 every 8 connection(s)
I20260709 13:08:06.442272 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:06.443094 25167 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.444080 25167 tablet_bootstrap.cc:492] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.444811 25167 ts_tablet_manager.cc:1403] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 13:08:06.447507 25167 raft_consensus.cc:359] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.448221 25167 raft_consensus.cc:740] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.448979 25167 consensus_queue.cc:260] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.450847 25167 ts_tablet_manager.cc:1434] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:06.451709 25167 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.482714 25167 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.483875 25167 tablet_bootstrap.cc:492] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.484570 25167 ts_tablet_manager.cc:1403] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.003s
I20260709 13:08:06.487622 25230 heartbeater.cc:344] Connected to a master server at 127.13.181.62:36785
I20260709 13:08:06.487406 25167 raft_consensus.cc:359] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.487967 25204 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.488116 25167 raft_consensus.cc:740] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.488103 25230 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:06.489077 25167 consensus_queue.cc:260] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.489730 25230 heartbeater.cc:507] Master 127.13.181.62:36785 requested a full tablet report, sending...
I20260709 13:08:06.491403 25167 ts_tablet_manager.cc:1434] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:06.492266 25167 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.492520 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:06.493309 24925 raft_consensus.cc:606] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:06.496034 25204 pending_rounds.cc:85] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Aborting all ops after (but not including) 0
I20260709 13:08:06.496362 25204 pending_rounds.cc:107] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:08:06.496428 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:06.496737 25204 raft_consensus.cc:2889] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.497104 24925 raft_consensus.cc:606] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:06.498840 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:06.499465 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:06.500274 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:06.513489 25167 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.514851 25167 tablet_bootstrap.cc:492] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.515434 25167 ts_tablet_manager.cc:1403] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:08:06.516288 24748 ts_manager.cc:194] Re-registered known tserver with Master: b14018454e7243528a53097d861d9860 (127.13.181.1:45169)
I20260709 13:08:06.517647 25167 raft_consensus.cc:359] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.518281 25167 raft_consensus.cc:740] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.518992 25167 consensus_queue.cc:260] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.521238 25167 ts_tablet_manager.cc:1434] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:06.521925 25167 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.531543 25143 raft_consensus.cc:993] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:06.531720 24748 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55528
I20260709 13:08:06.532279 25151 raft_consensus.cc:1081] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:06.534248 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:06.534358 25167 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:08:06.534796 24999 raft_consensus.cc:493] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.535284 24999 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.535317 25230 heartbeater.cc:499] Master 127.13.181.62:36785 was elected leader, sending a full tablet report...
I20260709 13:08:06.535513 25167 tablet_bootstrap.cc:492] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.536437 25167 ts_tablet_manager.cc:1403] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:08:06.539172 25167 raft_consensus.cc:359] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.540015 25167 raft_consensus.cc:740] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.540756 25167 consensus_queue.cc:260] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.542868 25167 ts_tablet_manager.cc:1434] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:08:06.543666 25167 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Bootstrap starting.
I20260709 13:08:06.544224 24999 raft_consensus.cc:515] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.547775 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:06.548478 24925 raft_consensus.cc:3055] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:06.548815 24925 raft_consensus.cc:740] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:06.549676 24925 consensus_queue.cc:260] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.550933 24925 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.558420 25204 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.559190 24999 leader_election.cc:290] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:06.561034 25167 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:06.562031 24925 raft_consensus.cc:2468] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 2.
I20260709 13:08:06.562137 25167 tablet_bootstrap.cc:492] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Bootstrap complete.
I20260709 13:08:06.562995 25167 ts_tablet_manager.cc:1403] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:08:06.563668 24967 leader_election.cc:304] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:06.564757 25150 raft_consensus.cc:2804] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:06.565382 25150 raft_consensus.cc:697] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:06.566747 25150 consensus_queue.cc:237] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.568404 25167 raft_consensus.cc:359] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.569109 25167 raft_consensus.cc:740] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14018454e7243528a53097d861d9860, State: Initialized, Role: FOLLOWER
I20260709 13:08:06.569319 25204 pending_rounds.cc:85] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Aborting all ops after (but not including) 0
I20260709 13:08:06.569692 25204 pending_rounds.cc:107] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:08:06.569972 25204 raft_consensus.cc:2889] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.569904 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:06.569855 25167 consensus_queue.cc:260] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.570854 25203 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.585129 25143 raft_consensus.cc:993] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:06.585865 25143 raft_consensus.cc:1081] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:06.588593 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:06.589377 24999 raft_consensus.cc:493] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.589838 24999 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.590926 25203 raft_consensus.cc:2468] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 2.
I20260709 13:08:06.595237 25167 ts_tablet_manager.cc:1434] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860: Time spent starting tablet: real 0.032s	user 0.019s	sys 0.012s
I20260709 13:08:06.597723 24999 raft_consensus.cc:515] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.601019 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:06.601588 24925 raft_consensus.cc:3055] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:06.601881 24925 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:06.602613 24925 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.603669 24925 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.601040 24748 catalog_manager.cc:5697] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 1 to 2, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.607178 24999 leader_election.cc:290] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:06.608192 25204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:06.608872 25204 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.613904 24925 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 2.
I20260709 13:08:06.615846 24967 leader_election.cc:304] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:06.616734 25204 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 2.
I20260709 13:08:06.617245 25150 raft_consensus.cc:2804] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:06.617854 25150 raft_consensus.cc:697] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:06.618830 25150 consensus_queue.cc:237] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:06.635084 24750 catalog_manager.cc:5697] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 1 to 2, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.828562 25203 raft_consensus.cc:3060] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.968152 25203 raft_consensus.cc:1275] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:06.969430 25150 consensus_queue.cc:1048] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:06.981314 24925 raft_consensus.cc:1275] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:06.983134 25260 consensus_queue.cc:1048] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:07.066118 25203 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.067461 25260 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:07.077510 24925 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:07.080358 25146 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:08:07.376099 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:07.513031 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.521662 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:07.522290 24925 raft_consensus.cc:606] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:07.534286 24999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21"
dest_uuid: "0112bd64596b458e919738d141c11382"
mode: GRACEFUL
new_leader_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:08:07.534776 24999 raft_consensus.cc:606] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Received request to transfer leadership to TS f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:07.537320 24999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "0112bd64596b458e919738d141c11382"
mode: GRACEFUL
new_leader_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:08:07.537815 24999 raft_consensus.cc:606] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Received request to transfer leadership to TS f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:07.538949 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:07.539474 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:07.540066 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.651427 25146 raft_consensus.cc:993] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: : Instructing follower f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:07.652015 25260 raft_consensus.cc:1081] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Signalling peer f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:07.653891 24925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:48428
I20260709 13:08:07.654384 24925 raft_consensus.cc:493] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.654703 24925 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.660018 24925 raft_consensus.cc:515] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:07.662577 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:07.663089 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:07.663283 25203 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.662366 24925 leader_election.cc:290] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 3 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:07.663669 24999 raft_consensus.cc:3055] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.664179 24999 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:07.664951 24999 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:07.665796 24999 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.669260 25203 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 3.
I20260709 13:08:07.670404 24892 leader_election.cc:304] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:07.671240 25151 raft_consensus.cc:2804] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:07.671412 24999 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 3.
I20260709 13:08:07.671788 25151 raft_consensus.cc:697] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:07.673228 25151 consensus_queue.cc:237] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:07.680680 24750 catalog_manager.cc:5697] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 2 to 3, leader changed from 0112bd64596b458e919738d141c11382 (127.13.181.3) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 3 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.990981 25146 raft_consensus.cc:993] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382: : Instructing follower f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:07.991552 25260 raft_consensus.cc:1081] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Signalling peer f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:07.993140 24925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:48428
I20260709 13:08:07.993724 24925 raft_consensus.cc:493] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.994031 24925 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.000294 24925 raft_consensus.cc:515] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.001956 24925 leader_election.cc:290] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:08.002780 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:08.003007 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:08.003489 25203 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.003588 24999 raft_consensus.cc:3055] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.004010 24999 raft_consensus.cc:740] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:08.004890 24999 consensus_queue.cc:260] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.006208 24999 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.010823 25203 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 2.
I20260709 13:08:08.012188 24892 leader_election.cc:304] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:08.012980 25151 raft_consensus.cc:2804] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:08.013396 25151 raft_consensus.cc:697] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:08.013550 24999 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 2.
I20260709 13:08:08.014350 25151 consensus_queue.cc:237] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.021011 24750 catalog_manager.cc:5697] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 1 to 2, leader changed from 0112bd64596b458e919738d141c11382 (127.13.181.3) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:08.091204 25143 raft_consensus.cc:993] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:08.091704 25151 raft_consensus.cc:1081] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:08.093175 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:08.093636 24999 raft_consensus.cc:493] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.093930 24999 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.099912 24999 raft_consensus.cc:515] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.101522 24999 leader_election.cc:290] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:08.102238 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:08.102587 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:08.102849 25203 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.103210 24925 raft_consensus.cc:3055] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.103524 24925 raft_consensus.cc:740] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:08.104276 24925 consensus_queue.cc:260] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.105250 24925 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.108024 25203 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:08.109570 24966 leader_election.cc:304] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:08.110464 25260 raft_consensus.cc:2804] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:08.110945 25260 raft_consensus.cc:697] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:08.111069 24925 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:08.112016 25260 consensus_queue.cc:237] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.119519 24750 catalog_manager.cc:5697] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 2 to 3, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.181928 24999 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.183100 25151 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.194357 25203 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:08.196774 25151 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:08.377183 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:08.501856 24925 raft_consensus.cc:1275] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:08.503365 25260 consensus_queue.cc:1048] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.513037 25203 raft_consensus.cc:1275] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:08.514494 25260 consensus_queue.cc:1048] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.523299 24999 raft_consensus.cc:1275] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:08.524528 25151 consensus_queue.cc:1048] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.535645 25203 raft_consensus.cc:1275] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:08.537041 25151 consensus_queue.cc:1048] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.546452 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:08.556353 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:08.556828 24925 raft_consensus.cc:606] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:08.559113 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:08.559535 24925 raft_consensus.cc:606] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:08.561829 24999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc"
dest_uuid: "0112bd64596b458e919738d141c11382"
mode: GRACEFUL
new_leader_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:08:08.562328 24999 raft_consensus.cc:606] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Received request to transfer leadership to TS f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:08.563571 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:08.564173 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:08.564860 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:08.662899 25143 raft_consensus.cc:993] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:08.663445 25151 raft_consensus.cc:1081] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:08.664989 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:08.665432 24999 raft_consensus.cc:493] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.665702 24999 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:08.670543 24999 raft_consensus.cc:515] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.672097 24999 leader_election.cc:290] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 4 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:08.672971 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:08.673121 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:08.673722 25203 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:08.673753 24925 raft_consensus.cc:3055] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:08.674226 24925 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:08.675098 24925 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.676383 24925 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:08.682261 25203 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 4.
I20260709 13:08:08.683481 24925 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 4.
I20260709 13:08:08.683614 24966 leader_election.cc:304] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:08.684520 25260 raft_consensus.cc:2804] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:08.684995 25260 raft_consensus.cc:697] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:08.685742 25260 consensus_queue.cc:237] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.692660 24750 catalog_manager.cc:5697] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 3 to 4, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 4 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.838500 25284 raft_consensus.cc:993] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: : Instructing follower f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:08.838951 25284 raft_consensus.cc:1081] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Signalling peer f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:08.840478 24925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:48428
I20260709 13:08:08.841012 24925 raft_consensus.cc:493] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.841315 24925 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.846220 24925 raft_consensus.cc:515] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.847812 24925 leader_election.cc:290] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:08.848630 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:08.848824 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:08.849272 25203 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.849367 24999 raft_consensus.cc:3055] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.849771 24999 raft_consensus.cc:740] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:08.850638 24999 consensus_queue.cc:260] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.852013 24999 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.856549 25203 raft_consensus.cc:2468] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 2.
I20260709 13:08:08.857932 24892 leader_election.cc:304] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:08.858454 24999 raft_consensus.cc:2468] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 2.
I20260709 13:08:08.858673 25151 raft_consensus.cc:2804] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:08.859189 25151 raft_consensus.cc:697] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:08.860217 25151 consensus_queue.cc:237] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:08.867638 24750 catalog_manager.cc:5697] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 1 to 2, leader changed from 0112bd64596b458e919738d141c11382 (127.13.181.3) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.057753 25143 raft_consensus.cc:993] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:09.058221 25292 raft_consensus.cc:1081] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:09.059809 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:09.060226 24999 raft_consensus.cc:493] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:09.060447 24999 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.065248 24999 raft_consensus.cc:515] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.066732 24999 leader_election.cc:290] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:09.067780 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:09.067821 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a985475fd03e4c929036db80cdc99c21" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:09.068385 25203 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.068553 24925 raft_consensus.cc:3055] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:09.068984 24925 raft_consensus.cc:740] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:09.069674 24925 consensus_queue.cc:260] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.070628 24925 raft_consensus.cc:3060] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.073683 25203 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:09.074764 24966 leader_election.cc:304] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:09.075531 25284 raft_consensus.cc:2804] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.075572 24925 raft_consensus.cc:2468] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:09.076086 25284 raft_consensus.cc:697] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:09.077193 25284 consensus_queue.cc:237] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.084324 24750 catalog_manager.cc:5697] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 2 to 3, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.172776 24925 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 4 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:09.173893 25284 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:09.184418 25203 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 4 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:09.186296 25284 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:09.294716 25203 raft_consensus.cc:1275] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:09.296046 25292 consensus_queue.cc:1048] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.305805 24999 raft_consensus.cc:1275] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:09.307336 25299 consensus_queue.cc:1048] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:08:09.378217 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:09.572028 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:09.579669 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:09.580219 24925 raft_consensus.cc:606] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:09.582872 24999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348"
dest_uuid: "0112bd64596b458e919738d141c11382"
mode: GRACEFUL
new_leader_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:08:09.583314 24999 raft_consensus.cc:606] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Received request to transfer leadership to TS f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:09.585786 24999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "0112bd64596b458e919738d141c11382"
mode: GRACEFUL
new_leader_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:08:09.586220 24999 raft_consensus.cc:606] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 LEADER]: Received request to transfer leadership to TS f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:09.587306 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:09.587920 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:09.588550 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:09.593461 24925 raft_consensus.cc:1275] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:09.594970 25284 consensus_queue.cc:1048] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:09.604691 25203 raft_consensus.cc:1275] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:09.606235 25302 consensus_queue.cc:1048] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:09.657631 25299 raft_consensus.cc:993] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:09.658126 25292 raft_consensus.cc:1081] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:09.659762 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:09.660281 24999 raft_consensus.cc:493] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:09.660514 24999 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.664795 24999 raft_consensus.cc:515] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.666188 24999 leader_election.cc:290] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:09.667122 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:09.667258 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f3cc7843bc4d03948aea53dbf7d3f7" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:09.668008 24925 raft_consensus.cc:3055] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:09.668008 25203 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.668681 24925 raft_consensus.cc:740] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:09.669610 24925 consensus_queue.cc:260] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.670907 24925 raft_consensus.cc:3060] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.675679 25203 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:09.676901 24966 leader_election.cc:304] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:09.677680 25302 raft_consensus.cc:2804] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.677942 24925 raft_consensus.cc:2468] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:09.678103 25302 raft_consensus.cc:697] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:09.679404 25302 consensus_queue.cc:237] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.686185 24748 catalog_manager.cc:5697] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 2 to 3, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.764629 25302 raft_consensus.cc:993] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: : Instructing follower f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:09.765453 25293 raft_consensus.cc:1081] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 LEADER]: Signalling peer f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:09.766860 24925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32e4fada6c64110a15551377041605c"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:48428
I20260709 13:08:09.767373 24925 raft_consensus.cc:493] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:09.767665 24925 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.771929 24925 raft_consensus.cc:515] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.773253 24925 leader_election.cc:290] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 5 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:09.774140 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:09.774277 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32e4fada6c64110a15551377041605c" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:09.774911 24999 raft_consensus.cc:3055] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:09.774926 25203 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.775285 24999 raft_consensus.cc:740] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:09.776099 24999 consensus_queue.cc:260] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.776929 24999 raft_consensus.cc:3060] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:09.780141 25203 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 5.
I20260709 13:08:09.781518 24892 leader_election.cc:304] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:09.781574 24999 raft_consensus.cc:2468] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 5.
I20260709 13:08:09.782363 25292 raft_consensus.cc:2804] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:09.782898 25292 raft_consensus.cc:697] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 5 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:09.783803 25292 consensus_queue.cc:237] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.790076 24748 catalog_manager.cc:5697] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 4 to 5, leader changed from 0112bd64596b458e919738d141c11382 (127.13.181.3) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 5 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:09.878053 25302 raft_consensus.cc:993] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382: : Instructing follower f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:09.878546 25293 raft_consensus.cc:1081] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Signalling peer f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:09.880007 24925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:48428
I20260709 13:08:09.880556 24925 raft_consensus.cc:493] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:09.880793 24925 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.885331 24925 raft_consensus.cc:515] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.886670 24925 leader_election.cc:290] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 3 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:09.887673 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:09.888214 24999 raft_consensus.cc:3055] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:09.888134 25203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fc40c1a2a6240c283e07226acf19348" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:09.888695 24999 raft_consensus.cc:740] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:09.888887 25203 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.889482 24999 consensus_queue.cc:260] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.890363 24999 raft_consensus.cc:3060] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.893536 25203 raft_consensus.cc:2468] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 3.
I20260709 13:08:09.894589 24892 leader_election.cc:304] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:09.894713 24999 raft_consensus.cc:2468] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 3.
I20260709 13:08:09.895295 25292 raft_consensus.cc:2804] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.895781 25292 raft_consensus.cc:697] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 3 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:09.896504 25292 consensus_queue.cc:237] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:09.902813 24748 catalog_manager.cc:5697] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 2 to 3, leader changed from 0112bd64596b458e919738d141c11382 (127.13.181.3) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 3 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:10.060905 24925 raft_consensus.cc:1275] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:10.061950 25293 consensus_queue.cc:1048] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:10.071563 25203 raft_consensus.cc:1275] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:10.072989 25302 consensus_queue.cc:1048] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:10.175091 25203 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 5 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:10.176397 25292 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:10.184278 24999 raft_consensus.cc:1275] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 5 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:08:10.186951 25292 consensus_queue.cc:1048] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:10.311739 25204 raft_consensus.cc:1275] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:10.313205 25292 consensus_queue.cc:1048] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:10.323563 24999 raft_consensus.cc:1275] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:10.325193 25311 consensus_queue.cc:1048] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:10.379338 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:10.596844 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:10.606783 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:10.607419 24925 raft_consensus.cc:606] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:10.609978 24999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a"
dest_uuid: "0112bd64596b458e919738d141c11382"
mode: GRACEFUL
new_leader_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:44164
I20260709 13:08:10.610404 24999 raft_consensus.cc:606] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Received request to transfer leadership to TS f14d8c46532144839fe9e550c5375bb3
I20260709 13:08:10.612838 24925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
mode: GRACEFUL
new_leader_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:36938
I20260709 13:08:10.613377 24925 raft_consensus.cc:606] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Received request to transfer leadership to TS 0112bd64596b458e919738d141c11382
I20260709 13:08:10.614333 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:10.614863 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:10.615479 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:10.935822 25311 raft_consensus.cc:993] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:10.936352 25143 raft_consensus.cc:1081] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:10.937937 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:10.938385 24999 raft_consensus.cc:493] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.938652 24999 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.942902 24999 raft_consensus.cc:515] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:10.944290 24999 leader_election.cc:290] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:10.945289 25204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:10.945376 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3611d1df50451badca6d47011b47dc" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:10.945914 25204 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.945947 24925 raft_consensus.cc:3055] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:10.946645 24925 raft_consensus.cc:740] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:10.947314 24925 consensus_queue.cc:260] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:10.948195 24925 raft_consensus.cc:3060] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.951201 25204 raft_consensus.cc:2468] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:10.952337 24966 leader_election.cc:304] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:10.952934 24925 raft_consensus.cc:2468] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 3.
I20260709 13:08:10.953011 25260 raft_consensus.cc:2804] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:10.953559 25260 raft_consensus.cc:697] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:10.954334 25260 consensus_queue.cc:237] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:10.960820 24750 catalog_manager.cc:5697] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 2 to 3, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.035181 25284 raft_consensus.cc:993] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382: : Instructing follower f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:11.035655 25284 raft_consensus.cc:1081] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Signalling peer f14d8c46532144839fe9e550c5375bb3 to start an election
I20260709 13:08:11.037068 24925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a"
dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
 from {username='slave'} at 127.0.0.1:48428
I20260709 13:08:11.037506 24925 raft_consensus.cc:493] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.037739 24925 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.042058 24925 raft_consensus.cc:515] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:11.043676 24925 leader_election.cc:290] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 4 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), 0112bd64596b458e919738d141c11382 (127.13.181.3:39507)
I20260709 13:08:11.044553 25204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:11.044716 24999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e051e56692e4ce398071ae894476f9a" candidate_uuid: "f14d8c46532144839fe9e550c5375bb3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0112bd64596b458e919738d141c11382"
I20260709 13:08:11.045306 25204 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.045365 24999 raft_consensus.cc:3055] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:11.045792 24999 raft_consensus.cc:740] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:11.046545 24999 consensus_queue.cc:260] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:11.047713 24999 raft_consensus.cc:3060] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.052197 25204 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 4.
I20260709 13:08:11.053501 24892 leader_election.cc:304] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14018454e7243528a53097d861d9860, f14d8c46532144839fe9e550c5375bb3; no voters: 
I20260709 13:08:11.053782 24999 raft_consensus.cc:2468] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f14d8c46532144839fe9e550c5375bb3 in term 4.
I20260709 13:08:11.054224 25311 raft_consensus.cc:2804] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:11.054746 25311 raft_consensus.cc:697] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 4 LEADER]: Becoming Leader. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:11.055588 25311 consensus_queue.cc:237] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:11.062662 24750 catalog_manager.cc:5697] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 reported cstate change: term changed from 3 to 4, leader changed from 0112bd64596b458e919738d141c11382 (127.13.181.3) to f14d8c46532144839fe9e550c5375bb3 (127.13.181.2). New cstate: current_term: 4 leader_uuid: "f14d8c46532144839fe9e550c5375bb3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:11.124426 25143 raft_consensus.cc:993] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3: : Instructing follower 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:11.124956 25143 raft_consensus.cc:1081] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Signalling peer 0112bd64596b458e919738d141c11382 to start an election
I20260709 13:08:11.126453 24999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330"
dest_uuid: "0112bd64596b458e919738d141c11382"
 from {username='slave'} at 127.0.0.1:46376
I20260709 13:08:11.126914 24999 raft_consensus.cc:493] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:11.127177 24999 raft_consensus.cc:3060] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.131845 24999 raft_consensus.cc:515] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:11.133324 24999 leader_election.cc:290] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Requested vote from peers b14018454e7243528a53097d861d9860 (127.13.181.1:45169), f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823)
I20260709 13:08:11.134418 25204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b14018454e7243528a53097d861d9860"
I20260709 13:08:11.134567 24925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0aaf959b79704b4dadaba6c9aa25b330" candidate_uuid: "0112bd64596b458e919738d141c11382" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f14d8c46532144839fe9e550c5375bb3"
I20260709 13:08:11.134984 25204 raft_consensus.cc:3060] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.135169 24925 raft_consensus.cc:3055] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:11.135567 24925 raft_consensus.cc:740] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f14d8c46532144839fe9e550c5375bb3, State: Running, Role: LEADER
I20260709 13:08:11.136282 24925 consensus_queue.cc:260] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:11.137192 24925 raft_consensus.cc:3060] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.141382 25204 raft_consensus.cc:2468] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 2.
I20260709 13:08:11.142441 24966 leader_election.cc:304] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0112bd64596b458e919738d141c11382, b14018454e7243528a53097d861d9860; no voters: 
I20260709 13:08:11.142760 24925 raft_consensus.cc:2468] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0112bd64596b458e919738d141c11382 in term 2.
I20260709 13:08:11.143404 25284 raft_consensus.cc:2804] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:11.143941 25284 raft_consensus.cc:697] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Becoming Leader. State: Replica: 0112bd64596b458e919738d141c11382, State: Running, Role: LEADER
I20260709 13:08:11.145010 25284 consensus_queue.cc:237] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } }
I20260709 13:08:11.152789 24750 catalog_manager.cc:5697] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 reported cstate change: term changed from 1 to 2, leader changed from f14d8c46532144839fe9e550c5375bb3 (127.13.181.2) to 0112bd64596b458e919738d141c11382 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "0112bd64596b458e919738d141c11382" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:11.380522 24799 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:08:11.411234 24925 raft_consensus.cc:1275] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:11.412503 25284 consensus_queue.cc:1048] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.422282 25204 raft_consensus.cc:1275] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:11.423888 25284 consensus_queue.cc:1048] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.497645 24999 raft_consensus.cc:1275] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 4 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:11.498920 25143 consensus_queue.cc:1048] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0112bd64596b458e919738d141c11382" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 39507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.501435 25204 raft_consensus.cc:1275] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 4 FOLLOWER]: Refusing update from remote peer f14d8c46532144839fe9e550c5375bb3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:11.502768 25311 consensus_queue.cc:1048] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:11.590301 24925 raft_consensus.cc:1275] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.591578 25324 consensus_queue.cc:1048] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f14d8c46532144839fe9e550c5375bb3" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.600637 25204 raft_consensus.cc:1275] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Refusing update from remote peer 0112bd64596b458e919738d141c11382: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:11.602118 25324 consensus_queue.cc:1048] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b14018454e7243528a53097d861d9860" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:11.622341 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:11.661363 14036 tablet_server.cc:179] TabletServer@127.13.181.1:45169 shutting down...
I20260709 13:08:11.681269 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.681874 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.682415 14036 raft_consensus.cc:2243] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.682878 14036 raft_consensus.cc:2272] T 9f8f6907aa1542b2814273621d732808 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.685344 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.685904 14036 raft_consensus.cc:2243] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.686342 14036 raft_consensus.cc:2272] T a985475fd03e4c929036db80cdc99c21 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.688127 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.688694 14036 raft_consensus.cc:2243] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.689293 14036 raft_consensus.cc:2272] T f32e4fada6c64110a15551377041605c P b14018454e7243528a53097d861d9860 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.691226 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.691745 14036 raft_consensus.cc:2243] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.692183 14036 raft_consensus.cc:2272] T 9e051e56692e4ce398071ae894476f9a P b14018454e7243528a53097d861d9860 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.694407 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.694941 14036 raft_consensus.cc:2243] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.695446 14036 raft_consensus.cc:2272] T 6e9ad39e7de1417295caf20d1c5b89a7 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.697168 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.697659 14036 raft_consensus.cc:2243] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.698052 14036 raft_consensus.cc:2272] T cf849b56e308452db95708b906975984 P b14018454e7243528a53097d861d9860 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.699802 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.700443 14036 raft_consensus.cc:2243] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.700831 14036 raft_consensus.cc:2272] T fa3611d1df50451badca6d47011b47dc P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.703471 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.703989 14036 raft_consensus.cc:2243] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.704388 14036 raft_consensus.cc:2272] T 0aaf959b79704b4dadaba6c9aa25b330 P b14018454e7243528a53097d861d9860 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.706423 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.706915 14036 raft_consensus.cc:2243] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.707398 14036 raft_consensus.cc:2272] T 9fc40c1a2a6240c283e07226acf19348 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.709051 14036 tablet_replica.cc:333] stopping tablet replica
I20260709 13:08:11.709491 14036 raft_consensus.cc:2243] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.709877 14036 raft_consensus.cc:2272] T 82f3cc7843bc4d03948aea53dbf7d3f7 P b14018454e7243528a53097d861d9860 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.738066 14036 tablet_server.cc:196] TabletServer@127.13.181.1:45169 shutdown complete.
W20260709 13:08:11.751222 24892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111) [suppressed 74 similar messages]
W20260709 13:08:11.754426 24892 consensus_peers.cc:597] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.758085 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
W20260709 13:08:11.773092 24967 consensus_peers.cc:597] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 -> Peer f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823): Couldn't send request to peer f14d8c46532144839fe9e550c5375bb3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.788055 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.789009 14036 tablet_replica.cc:333] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.789871 14036 raft_consensus.cc:2243] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.790354 14036 raft_consensus.cc:2272] T a985475fd03e4c929036db80cdc99c21 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.793138 14036 tablet_replica.cc:333] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.793725 14036 raft_consensus.cc:2243] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.794487 14036 raft_consensus.cc:2272] T f32e4fada6c64110a15551377041605c P f14d8c46532144839fe9e550c5375bb3 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.796644 14036 tablet_replica.cc:333] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.797183 14036 raft_consensus.cc:2243] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.797603 14036 raft_consensus.cc:2272] T 82f3cc7843bc4d03948aea53dbf7d3f7 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.799606 14036 tablet_replica.cc:333] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.800105 14036 raft_consensus.cc:2243] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.800596 14036 raft_consensus.cc:2272] T 9f8f6907aa1542b2814273621d732808 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.802539 14036 tablet_replica.cc:333] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.803122 14036 raft_consensus.cc:2243] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.803851 14036 raft_consensus.cc:2272] T 9e051e56692e4ce398071ae894476f9a P f14d8c46532144839fe9e550c5375bb3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.806689 14036 tablet_replica.cc:333] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.807307 14036 raft_consensus.cc:2243] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.808285 14036 raft_consensus.cc:2272] T 6e9ad39e7de1417295caf20d1c5b89a7 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.810278 14036 tablet_replica.cc:333] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.810793 14036 raft_consensus.cc:2243] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.811558 14036 raft_consensus.cc:2272] T 9fc40c1a2a6240c283e07226acf19348 P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.813500 14036 tablet_replica.cc:333] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.814162 14036 raft_consensus.cc:2243] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.814611 14036 raft_consensus.cc:2272] T 0aaf959b79704b4dadaba6c9aa25b330 P f14d8c46532144839fe9e550c5375bb3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.817118 14036 tablet_replica.cc:333] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.817660 14036 raft_consensus.cc:2243] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.818099 14036 raft_consensus.cc:2272] T cf849b56e308452db95708b906975984 P f14d8c46532144839fe9e550c5375bb3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.820164 14036 tablet_replica.cc:333] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3: stopping tablet replica
I20260709 13:08:11.820662 14036 raft_consensus.cc:2243] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.821069 14036 raft_consensus.cc:2272] T fa3611d1df50451badca6d47011b47dc P f14d8c46532144839fe9e550c5375bb3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:11.831925 24966 consensus_peers.cc:597] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.846076 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
W20260709 13:08:11.855916 24967 consensus_peers.cc:597] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 -> Peer f14d8c46532144839fe9e550c5375bb3 (127.13.181.2:38823): Couldn't send request to peer f14d8c46532144839fe9e550c5375bb3. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:38823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.870678 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
W20260709 13:08:11.898072 24966 consensus_peers.cc:597] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 -> Peer b14018454e7243528a53097d861d9860 (127.13.181.1:45169): Couldn't send request to peer b14018454e7243528a53097d861d9860. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:45169: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.900998 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.901773 14036 tablet_replica.cc:333] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.902395 14036 raft_consensus.cc:2243] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.902851 14036 raft_consensus.cc:2272] T 9e051e56692e4ce398071ae894476f9a P 0112bd64596b458e919738d141c11382 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.905229 14036 tablet_replica.cc:333] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.905781 14036 raft_consensus.cc:2243] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.906224 14036 raft_consensus.cc:2272] T 6e9ad39e7de1417295caf20d1c5b89a7 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.908264 14036 tablet_replica.cc:333] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.908771 14036 raft_consensus.cc:2243] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.909531 14036 raft_consensus.cc:2272] T 9f8f6907aa1542b2814273621d732808 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.911751 14036 tablet_replica.cc:333] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.912294 14036 raft_consensus.cc:2243] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.912951 14036 raft_consensus.cc:2272] T 82f3cc7843bc4d03948aea53dbf7d3f7 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.915627 14036 tablet_replica.cc:333] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.916172 14036 raft_consensus.cc:2243] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.916922 14036 raft_consensus.cc:2272] T a985475fd03e4c929036db80cdc99c21 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.918915 14036 tablet_replica.cc:333] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.919469 14036 raft_consensus.cc:2243] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.919890 14036 raft_consensus.cc:2272] T f32e4fada6c64110a15551377041605c P 0112bd64596b458e919738d141c11382 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.922041 14036 tablet_replica.cc:333] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.922588 14036 raft_consensus.cc:2243] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.922993 14036 raft_consensus.cc:2272] T 9fc40c1a2a6240c283e07226acf19348 P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.925083 14036 tablet_replica.cc:333] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.925606 14036 raft_consensus.cc:2243] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.926390 14036 raft_consensus.cc:2272] T 0aaf959b79704b4dadaba6c9aa25b330 P 0112bd64596b458e919738d141c11382 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.929039 14036 tablet_replica.cc:333] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.929575 14036 raft_consensus.cc:2243] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.930408 14036 raft_consensus.cc:2272] T cf849b56e308452db95708b906975984 P 0112bd64596b458e919738d141c11382 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.932569 14036 tablet_replica.cc:333] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382: stopping tablet replica
I20260709 13:08:11.933079 14036 raft_consensus.cc:2243] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.933797 14036 raft_consensus.cc:2272] T fa3611d1df50451badca6d47011b47dc P 0112bd64596b458e919738d141c11382 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.965518 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
I20260709 13:08:11.988466 14036 master.cc:562] Master@127.13.181.62:36785 shutting down...
I20260709 13:08:12.012662 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:12.013175 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:12.013453 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P ccca871ef206437999949f8e7acfcced: stopping tablet replica
I20260709 13:08:12.034135 14036 master.cc:584] Master@127.13.181.62:36785 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12845 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:08:12.080866 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:40761
I20260709 13:08:12.082037 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.088203 25340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.089772 25341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.089857 25343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.090795 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:12.092028 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:12.092206 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.092417 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602492092404 us; error 0 us; skew 500 ppm
I20260709 13:08:12.093005 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.095808 14036 webserver.cc:533] Webserver started at http://127.13.181.62:38451/ using document root <none> and password file <none>
I20260709 13:08:12.096306 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.096499 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.096782 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.097848 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "bf6aefa7ca76417ba0716e809ccee84d"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.102245 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:12.106175 25348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.106842 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:12.107172 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "bf6aefa7ca76417ba0716e809ccee84d"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.107417 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.119359 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.120568 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.160772 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:40761
I20260709 13:08:12.160918 25399 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:40761 every 8 connection(s)
I20260709 13:08:12.164798 25400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.175002 25400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d: Bootstrap starting.
I20260709 13:08:12.179852 25400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.183990 25400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d: No bootstrap required, opened a new log
I20260709 13:08:12.186125 25400 raft_consensus.cc:359] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6aefa7ca76417ba0716e809ccee84d" member_type: VOTER }
I20260709 13:08:12.186519 25400 raft_consensus.cc:385] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.186697 25400 raft_consensus.cc:740] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf6aefa7ca76417ba0716e809ccee84d, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.187274 25400 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6aefa7ca76417ba0716e809ccee84d" member_type: VOTER }
I20260709 13:08:12.187734 25400 raft_consensus.cc:399] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:12.187925 25400 raft_consensus.cc:493] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:12.188136 25400 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.192915 25400 raft_consensus.cc:515] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6aefa7ca76417ba0716e809ccee84d" member_type: VOTER }
I20260709 13:08:12.193383 25400 leader_election.cc:304] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf6aefa7ca76417ba0716e809ccee84d; no voters: 
I20260709 13:08:12.194880 25400 leader_election.cc:290] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:12.195434 25403 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.196832 25403 raft_consensus.cc:697] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 1 LEADER]: Becoming Leader. State: Replica: bf6aefa7ca76417ba0716e809ccee84d, State: Running, Role: LEADER
I20260709 13:08:12.197559 25403 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6aefa7ca76417ba0716e809ccee84d" member_type: VOTER }
I20260709 13:08:12.197854 25400 sys_catalog.cc:565] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:12.201972 25405 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf6aefa7ca76417ba0716e809ccee84d. Latest consensus state: current_term: 1 leader_uuid: "bf6aefa7ca76417ba0716e809ccee84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6aefa7ca76417ba0716e809ccee84d" member_type: VOTER } }
I20260709 13:08:12.202033 25404 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf6aefa7ca76417ba0716e809ccee84d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf6aefa7ca76417ba0716e809ccee84d" member_type: VOTER } }
I20260709 13:08:12.202764 25405 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:12.202823 25404 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:12.209507 25410 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:12.214346 25410 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:12.215499 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:12.223150 25410 catalog_manager.cc:1383] Generated new cluster ID: 8dde96b927d9461aa4adad718ef45173
I20260709 13:08:12.223446 25410 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:12.245725 25410 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:12.247125 25410 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:12.261178 25410 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d: Generated new TSK 0
I20260709 13:08:12.261965 25410 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:12.282442 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.288498 25421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.289958 25422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.291427 25424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.291479 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:12.292531 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:12.292744 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.292922 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602492292886 us; error 0 us; skew 500 ppm
I20260709 13:08:12.293479 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.295971 14036 webserver.cc:533] Webserver started at http://127.13.181.1:35999/ using document root <none> and password file <none>
I20260709 13:08:12.296442 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.296638 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.296911 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.297971 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "96e3d0953fda421887be406721c39a02"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.302496 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:08:12.305933 25429 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.306770 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:12.307119 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "96e3d0953fda421887be406721c39a02"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.307397 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.329061 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.330279 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.331795 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:12.334015 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:12.334187 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.334472 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:12.334631 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.377991 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:35437
I20260709 13:08:12.378083 25491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:35437 every 8 connection(s)
I20260709 13:08:12.383316 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.391709 25496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.394496 25497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.396258 25499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.398464 25492 heartbeater.cc:344] Connected to a master server at 127.13.181.62:40761
I20260709 13:08:12.398682 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:12.399133 25492 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:12.399891 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:08:12.399912 25492 heartbeater.cc:507] Master 127.13.181.62:40761 requested a full tablet report, sending...
W20260709 13:08:12.400240 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.400593 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602492400575 us; error 0 us; skew 500 ppm
I20260709 13:08:12.401280 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.402544 25365 ts_manager.cc:194] Registered new tserver with Master: 96e3d0953fda421887be406721c39a02 (127.13.181.1:35437)
I20260709 13:08:12.404145 14036 webserver.cc:533] Webserver started at http://127.13.181.2:44599/ using document root <none> and password file <none>
I20260709 13:08:12.404726 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.404747 25365 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49336
I20260709 13:08:12.405030 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.405416 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.406682 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "5c9456bf1747480d840be9799faff2e7"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.411783 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:08:12.415463 25504 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.416388 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 13:08:12.416653 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "5c9456bf1747480d840be9799faff2e7"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.416899 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.429584 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.430727 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.432212 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:12.434381 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:12.434587 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.434841 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:12.435007 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.478070 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:33657
I20260709 13:08:12.478183 25566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:33657 every 8 connection(s)
I20260709 13:08:12.483173 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:12.490185 25570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:12.492189 25571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.496753 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:12.496768 25567 heartbeater.cc:344] Connected to a master server at 127.13.181.62:40761
W20260709 13:08:12.496944 25573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:12.497653 25567 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:12.498442 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:08:12.498594 25567 heartbeater.cc:507] Master 127.13.181.62:40761 requested a full tablet report, sending...
W20260709 13:08:12.498818 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:12.499120 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602492499099 us; error 0 us; skew 500 ppm
I20260709 13:08:12.499842 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:12.501170 25365 ts_manager.cc:194] Registered new tserver with Master: 5c9456bf1747480d840be9799faff2e7 (127.13.181.2:33657)
I20260709 13:08:12.502738 14036 webserver.cc:533] Webserver started at http://127.13.181.3:46439/ using document root <none> and password file <none>
I20260709 13:08:12.503189 25365 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49350
I20260709 13:08:12.503436 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:12.503756 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:12.504081 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:12.505725 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "f37be05692904810ac8f2b79a788940c"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.510691 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:08:12.515780 25578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.516701 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:08:12.517217 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "f37be05692904810ac8f2b79a788940c"
format_stamp: "Formatted at 2026-07-09 13:08:12 on dist-test-slave-28ks"
I20260709 13:08:12.517508 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.543517 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.544737 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.546209 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:12.548457 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:12.548676 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.548954 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:12.549117 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.591219 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:45119
I20260709 13:08:12.591308 25640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:45119 every 8 connection(s)
I20260709 13:08:12.606098 25641 heartbeater.cc:344] Connected to a master server at 127.13.181.62:40761
I20260709 13:08:12.606655 25641 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:12.607467 25641 heartbeater.cc:507] Master 127.13.181.62:40761 requested a full tablet report, sending...
I20260709 13:08:12.609807 25365 ts_manager.cc:194] Registered new tserver with Master: f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:12.610344 14036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015923603s
I20260709 13:08:12.611701 25365 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49358
I20260709 13:08:12.637924 25365 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49368:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:12.640322 25365 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:12.686851 25457 tablet_service.cc:1511] Processing CreateTablet for tablet cf77405cfad14574a02b6fb1197beee9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb31cb548d4c433fab28919bdd453d4b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:08:12.687146 25456 tablet_service.cc:1511] Processing CreateTablet for tablet 01e0be4829c24450b0e71f82caeef950 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb31cb548d4c433fab28919bdd453d4b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:08:12.688467 25457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf77405cfad14574a02b6fb1197beee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.691689 25456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e0be4829c24450b0e71f82caeef950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.696579 25606 tablet_service.cc:1511] Processing CreateTablet for tablet cf77405cfad14574a02b6fb1197beee9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb31cb548d4c433fab28919bdd453d4b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:08:12.698168 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf77405cfad14574a02b6fb1197beee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.700323 25605 tablet_service.cc:1511] Processing CreateTablet for tablet 01e0be4829c24450b0e71f82caeef950 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb31cb548d4c433fab28919bdd453d4b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:08:12.701936 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e0be4829c24450b0e71f82caeef950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.701694 25532 tablet_service.cc:1511] Processing CreateTablet for tablet cf77405cfad14574a02b6fb1197beee9 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb31cb548d4c433fab28919bdd453d4b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:08:12.704231 25531 tablet_service.cc:1511] Processing CreateTablet for tablet 01e0be4829c24450b0e71f82caeef950 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fb31cb548d4c433fab28919bdd453d4b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:08:12.705912 25532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf77405cfad14574a02b6fb1197beee9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.708623 25531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01e0be4829c24450b0e71f82caeef950. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.731743 25656 tablet_bootstrap.cc:492] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02: Bootstrap starting.
I20260709 13:08:12.732973 25657 tablet_bootstrap.cc:492] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c: Bootstrap starting.
I20260709 13:08:12.739336 25658 tablet_bootstrap.cc:492] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7: Bootstrap starting.
I20260709 13:08:12.739791 25656 tablet_bootstrap.cc:654] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.740561 25657 tablet_bootstrap.cc:654] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.745832 25656 tablet_bootstrap.cc:492] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02: No bootstrap required, opened a new log
I20260709 13:08:12.746390 25656 ts_tablet_manager.cc:1403] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:08:12.747543 25658 tablet_bootstrap.cc:654] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.748083 25657 tablet_bootstrap.cc:492] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c: No bootstrap required, opened a new log
I20260709 13:08:12.748597 25657 ts_tablet_manager.cc:1403] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:08:12.749513 25656 raft_consensus.cc:359] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.750281 25656 raft_consensus.cc:385] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.750588 25656 raft_consensus.cc:740] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e3d0953fda421887be406721c39a02, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.751403 25656 consensus_queue.cc:260] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.751621 25657 raft_consensus.cc:359] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.752331 25657 raft_consensus.cc:385] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.752585 25658 tablet_bootstrap.cc:492] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7: No bootstrap required, opened a new log
I20260709 13:08:12.752681 25657 raft_consensus.cc:740] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f37be05692904810ac8f2b79a788940c, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.753353 25658 ts_tablet_manager.cc:1403] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:08:12.754175 25492 heartbeater.cc:499] Master 127.13.181.62:40761 was elected leader, sending a full tablet report...
I20260709 13:08:12.753804 25657 consensus_queue.cc:260] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.754387 25656 ts_tablet_manager.cc:1434] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:12.755550 25656 tablet_bootstrap.cc:492] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02: Bootstrap starting.
I20260709 13:08:12.756632 25658 raft_consensus.cc:359] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.757402 25658 raft_consensus.cc:385] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.757694 25658 raft_consensus.cc:740] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9456bf1747480d840be9799faff2e7, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.758589 25658 consensus_queue.cc:260] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.763420 25657 ts_tablet_manager.cc:1434] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.008s
I20260709 13:08:12.764626 25656 tablet_bootstrap.cc:654] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.766184 25567 heartbeater.cc:499] Master 127.13.181.62:40761 was elected leader, sending a full tablet report...
I20260709 13:08:12.766315 25658 ts_tablet_manager.cc:1434] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:08:12.767482 25658 tablet_bootstrap.cc:492] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7: Bootstrap starting.
I20260709 13:08:12.771008 25641 heartbeater.cc:499] Master 127.13.181.62:40761 was elected leader, sending a full tablet report...
I20260709 13:08:12.772877 25656 tablet_bootstrap.cc:492] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02: No bootstrap required, opened a new log
I20260709 13:08:12.773720 25656 ts_tablet_manager.cc:1403] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:08:12.773875 25657 tablet_bootstrap.cc:492] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c: Bootstrap starting.
I20260709 13:08:12.776410 25658 tablet_bootstrap.cc:654] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.780787 25657 tablet_bootstrap.cc:654] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.782445 25656 raft_consensus.cc:359] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.783566 25656 raft_consensus.cc:385] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.783957 25656 raft_consensus.cc:740] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e3d0953fda421887be406721c39a02, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.785109 25656 consensus_queue.cc:260] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.788326 25656 ts_tablet_manager.cc:1434] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:08:12.792304 25658 tablet_bootstrap.cc:492] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7: No bootstrap required, opened a new log
I20260709 13:08:12.792961 25658 ts_tablet_manager.cc:1403] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.009s
I20260709 13:08:12.793213 25657 tablet_bootstrap.cc:492] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c: No bootstrap required, opened a new log
I20260709 13:08:12.793680 25662 raft_consensus.cc:493] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.793812 25657 ts_tablet_manager.cc:1403] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:08:12.794222 25662 raft_consensus.cc:515] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.796587 25658 raft_consensus.cc:359] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.797483 25658 raft_consensus.cc:385] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.797935 25658 raft_consensus.cc:740] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9456bf1747480d840be9799faff2e7, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.797500 25657 raft_consensus.cc:359] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.798444 25657 raft_consensus.cc:385] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.798769 25657 raft_consensus.cc:740] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f37be05692904810ac8f2b79a788940c, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.799580 25662 leader_election.cc:290] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9456bf1747480d840be9799faff2e7 (127.13.181.2:33657), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:12.799868 25657 consensus_queue.cc:260] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.802359 25657 ts_tablet_manager.cc:1434] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:08:12.798938 25658 consensus_queue.cc:260] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.806442 25658 ts_tablet_manager.cc:1434] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 13:08:12.818816 25542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf77405cfad14574a02b6fb1197beee9" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9456bf1747480d840be9799faff2e7" is_pre_election: true
I20260709 13:08:12.819767 25542 raft_consensus.cc:2468] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 0.
I20260709 13:08:12.821476 25430 leader_election.cc:304] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9456bf1747480d840be9799faff2e7, 96e3d0953fda421887be406721c39a02; no voters: 
I20260709 13:08:12.822417 25662 raft_consensus.cc:2804] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.822788 25662 raft_consensus.cc:493] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.823168 25662 raft_consensus.cc:3060] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.826767 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf77405cfad14574a02b6fb1197beee9" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c" is_pre_election: true
I20260709 13:08:12.827534 25616 raft_consensus.cc:2468] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 0.
I20260709 13:08:12.829587 25662 raft_consensus.cc:515] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.831326 25662 leader_election.cc:290] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 election: Requested vote from peers 5c9456bf1747480d840be9799faff2e7 (127.13.181.2:33657), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:12.832060 25542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf77405cfad14574a02b6fb1197beee9" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9456bf1747480d840be9799faff2e7"
I20260709 13:08:12.832291 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf77405cfad14574a02b6fb1197beee9" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c"
I20260709 13:08:12.832598 25542 raft_consensus.cc:3060] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.832867 25616 raft_consensus.cc:3060] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.838167 25616 raft_consensus.cc:2468] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 1.
I20260709 13:08:12.838362 25542 raft_consensus.cc:2468] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 1.
I20260709 13:08:12.839350 25432 leader_election.cc:304] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96e3d0953fda421887be406721c39a02, f37be05692904810ac8f2b79a788940c; no voters: 
I20260709 13:08:12.840129 25662 raft_consensus.cc:2804] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.841104 25662 raft_consensus.cc:697] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 1 LEADER]: Becoming Leader. State: Replica: 96e3d0953fda421887be406721c39a02, State: Running, Role: LEADER
I20260709 13:08:12.841821 25662 consensus_queue.cc:237] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:12.849566 25363 catalog_manager.cc:5697] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96e3d0953fda421887be406721c39a02 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "96e3d0953fda421887be406721c39a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.053779 25664 raft_consensus.cc:493] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.054313 25664 raft_consensus.cc:515] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.056421 25664 leader_election.cc:290] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e3d0953fda421887be406721c39a02 (127.13.181.1:35437), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:13.066694 25467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e0be4829c24450b0e71f82caeef950" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e3d0953fda421887be406721c39a02" is_pre_election: true
I20260709 13:08:13.067188 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e0be4829c24450b0e71f82caeef950" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c" is_pre_election: true
I20260709 13:08:13.067466 25467 raft_consensus.cc:2468] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 0.
I20260709 13:08:13.067827 25616 raft_consensus.cc:2468] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 0.
I20260709 13:08:13.068742 25505 leader_election.cc:304] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9456bf1747480d840be9799faff2e7, 96e3d0953fda421887be406721c39a02; no voters: 
I20260709 13:08:13.069478 25664 raft_consensus.cc:2804] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.069835 25664 raft_consensus.cc:493] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.070063 25664 raft_consensus.cc:3060] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.075210 25664 raft_consensus.cc:515] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.076788 25664 leader_election.cc:290] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 election: Requested vote from peers 96e3d0953fda421887be406721c39a02 (127.13.181.1:35437), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:13.077736 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e0be4829c24450b0e71f82caeef950" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c"
I20260709 13:08:13.077703 25467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01e0be4829c24450b0e71f82caeef950" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e3d0953fda421887be406721c39a02"
I20260709 13:08:13.078595 25616 raft_consensus.cc:3060] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.078617 25467 raft_consensus.cc:3060] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.085940 25616 raft_consensus.cc:2468] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 1.
I20260709 13:08:13.085940 25467 raft_consensus.cc:2468] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 1.
I20260709 13:08:13.087550 25507 leader_election.cc:304] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9456bf1747480d840be9799faff2e7, f37be05692904810ac8f2b79a788940c; no voters: 
I20260709 13:08:13.088279 25664 raft_consensus.cc:2804] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.089195 25664 raft_consensus.cc:697] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 1 LEADER]: Becoming Leader. State: Replica: 5c9456bf1747480d840be9799faff2e7, State: Running, Role: LEADER
I20260709 13:08:13.089975 25664 consensus_queue.cc:237] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.097436 25363 catalog_manager.cc:5697] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c9456bf1747480d840be9799faff2e7 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5c9456bf1747480d840be9799faff2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.177896 25363 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49376:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:13.179926 25363 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:13.202306 25456 tablet_service.cc:1511] Processing CreateTablet for tablet b8c86fc13c404a50847b31805d95f531 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6a8882fa5af248bea732686ed47fde12]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:08:13.203613 25456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c86fc13c404a50847b31805d95f531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:13.203331 25532 tablet_service.cc:1511] Processing CreateTablet for tablet b8c86fc13c404a50847b31805d95f531 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6a8882fa5af248bea732686ed47fde12]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:08:13.204828 25532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c86fc13c404a50847b31805d95f531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:13.205716 25605 tablet_service.cc:1511] Processing CreateTablet for tablet b8c86fc13c404a50847b31805d95f531 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6a8882fa5af248bea732686ed47fde12]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:08:13.206951 25605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c86fc13c404a50847b31805d95f531. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:13.209342 25413 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:13.211107 25531 tablet_service.cc:1511] Processing CreateTablet for tablet e3bbda975d514d63b98b2e3235136797 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6a8882fa5af248bea732686ed47fde12]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:08:13.211316 25606 tablet_service.cc:1511] Processing CreateTablet for tablet e3bbda975d514d63b98b2e3235136797 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6a8882fa5af248bea732686ed47fde12]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:08:13.212414 25531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bbda975d514d63b98b2e3235136797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:13.211119 25457 tablet_service.cc:1511] Processing CreateTablet for tablet e3bbda975d514d63b98b2e3235136797 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=6a8882fa5af248bea732686ed47fde12]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:08:13.213773 25457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bbda975d514d63b98b2e3235136797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:13.212414 25606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3bbda975d514d63b98b2e3235136797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:13.223435 25658 tablet_bootstrap.cc:492] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7: Bootstrap starting.
I20260709 13:08:13.229696 25658 tablet_bootstrap.cc:654] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.234830 25657 tablet_bootstrap.cc:492] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: Bootstrap starting.
I20260709 13:08:13.238368 25658 tablet_bootstrap.cc:492] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7: No bootstrap required, opened a new log
I20260709 13:08:13.239008 25658 ts_tablet_manager.cc:1403] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:08:13.242025 25657 tablet_bootstrap.cc:654] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.242065 25658 raft_consensus.cc:359] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.243009 25658 raft_consensus.cc:385] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.243352 25658 raft_consensus.cc:740] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9456bf1747480d840be9799faff2e7, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.244222 25658 consensus_queue.cc:260] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.244773 25656 tablet_bootstrap.cc:492] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02: Bootstrap starting.
I20260709 13:08:13.246685 25658 ts_tablet_manager.cc:1434] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:08:13.249312 25658 tablet_bootstrap.cc:492] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7: Bootstrap starting.
I20260709 13:08:13.252220 25656 tablet_bootstrap.cc:654] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.252391 25657 tablet_bootstrap.cc:492] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: No bootstrap required, opened a new log
I20260709 13:08:13.253031 25657 ts_tablet_manager.cc:1403] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 13:08:13.256007 25658 tablet_bootstrap.cc:654] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.256210 25657 raft_consensus.cc:359] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.257079 25657 raft_consensus.cc:385] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.257469 25657 raft_consensus.cc:740] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f37be05692904810ac8f2b79a788940c, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.258239 25657 consensus_queue.cc:260] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.263620 25657 ts_tablet_manager.cc:1434] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:08:13.265035 25657 tablet_bootstrap.cc:492] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c: Bootstrap starting.
I20260709 13:08:13.266076 25656 tablet_bootstrap.cc:492] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02: No bootstrap required, opened a new log
I20260709 13:08:13.266616 25656 ts_tablet_manager.cc:1403] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:08:13.267313 25658 tablet_bootstrap.cc:492] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7: No bootstrap required, opened a new log
I20260709 13:08:13.267853 25658 ts_tablet_manager.cc:1403] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:08:13.269658 25656 raft_consensus.cc:359] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.270475 25656 raft_consensus.cc:385] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.270769 25656 raft_consensus.cc:740] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e3d0953fda421887be406721c39a02, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.270793 25658 raft_consensus.cc:359] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.271602 25657 tablet_bootstrap.cc:654] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.271811 25658 raft_consensus.cc:385] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.272153 25658 raft_consensus.cc:740] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9456bf1747480d840be9799faff2e7, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.272238 25656 consensus_queue.cc:260] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.273052 25658 consensus_queue.cc:260] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.276712 25656 ts_tablet_manager.cc:1434] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:13.277849 25656 tablet_bootstrap.cc:492] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02: Bootstrap starting.
I20260709 13:08:13.284430 25656 tablet_bootstrap.cc:654] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.284996 25658 ts_tablet_manager.cc:1434] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:08:13.295766 25656 tablet_bootstrap.cc:492] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02: No bootstrap required, opened a new log
I20260709 13:08:13.296334 25656 ts_tablet_manager.cc:1403] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.013s
I20260709 13:08:13.296639 25657 tablet_bootstrap.cc:492] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c: No bootstrap required, opened a new log
I20260709 13:08:13.297202 25657 ts_tablet_manager.cc:1403] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.012s
I20260709 13:08:13.299240 25656 raft_consensus.cc:359] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.299872 25656 raft_consensus.cc:385] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.300271 25656 raft_consensus.cc:740] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96e3d0953fda421887be406721c39a02, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.299925 25657 raft_consensus.cc:359] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.300748 25657 raft_consensus.cc:385] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.301026 25657 raft_consensus.cc:740] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f37be05692904810ac8f2b79a788940c, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.300981 25656 consensus_queue.cc:260] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.301867 25657 consensus_queue.cc:260] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.303076 25656 ts_tablet_manager.cc:1434] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:08:13.303782 25657 ts_tablet_manager.cc:1434] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:13.344535 25669 consensus_queue.cc:1048] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.356949 25689 consensus_queue.cc:1048] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.420089 25664 raft_consensus.cc:493] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.420579 25664 raft_consensus.cc:515] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.422259 25664 leader_election.cc:290] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96e3d0953fda421887be406721c39a02 (127.13.181.1:35437), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:13.423054 25467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e3d0953fda421887be406721c39a02" is_pre_election: true
I20260709 13:08:13.423266 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c" is_pre_election: true
I20260709 13:08:13.423756 25467 raft_consensus.cc:2468] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 0.
I20260709 13:08:13.423872 25616 raft_consensus.cc:2468] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 0.
I20260709 13:08:13.424899 25505 leader_election.cc:304] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9456bf1747480d840be9799faff2e7, 96e3d0953fda421887be406721c39a02; no voters: 
I20260709 13:08:13.425563 25664 raft_consensus.cc:2804] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.425971 25664 raft_consensus.cc:493] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.426316 25664 raft_consensus.cc:3060] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.434376 25664 raft_consensus.cc:515] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.436426 25664 leader_election.cc:290] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 election: Requested vote from peers 96e3d0953fda421887be406721c39a02 (127.13.181.1:35437), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:13.437398 25467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96e3d0953fda421887be406721c39a02"
I20260709 13:08:13.437389 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797" candidate_uuid: "5c9456bf1747480d840be9799faff2e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c"
I20260709 13:08:13.438223 25467 raft_consensus.cc:3060] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.438261 25616 raft_consensus.cc:3060] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.445119 25467 raft_consensus.cc:2468] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 1.
I20260709 13:08:13.445119 25616 raft_consensus.cc:2468] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c9456bf1747480d840be9799faff2e7 in term 1.
I20260709 13:08:13.446364 25507 leader_election.cc:304] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9456bf1747480d840be9799faff2e7, f37be05692904810ac8f2b79a788940c; no voters: 
I20260709 13:08:13.447152 25664 raft_consensus.cc:2804] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.447626 25664 raft_consensus.cc:697] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 LEADER]: Becoming Leader. State: Replica: 5c9456bf1747480d840be9799faff2e7, State: Running, Role: LEADER
I20260709 13:08:13.448422 25664 consensus_queue.cc:237] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.455698 25363 catalog_manager.cc:5697] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c9456bf1747480d840be9799faff2e7 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "5c9456bf1747480d840be9799faff2e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.517100 25689 raft_consensus.cc:493] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.517627 25689 raft_consensus.cc:515] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.519559 25689 leader_election.cc:290] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c9456bf1747480d840be9799faff2e7 (127.13.181.2:33657), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:13.520555 25542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9456bf1747480d840be9799faff2e7" is_pre_election: true
I20260709 13:08:13.520633 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c" is_pre_election: true
I20260709 13:08:13.521166 25542 raft_consensus.cc:2468] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 0.
I20260709 13:08:13.521313 25616 raft_consensus.cc:2468] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 0.
I20260709 13:08:13.522158 25430 leader_election.cc:304] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9456bf1747480d840be9799faff2e7, 96e3d0953fda421887be406721c39a02; no voters: 
I20260709 13:08:13.522962 25689 raft_consensus.cc:2804] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.523300 25689 raft_consensus.cc:493] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.523607 25689 raft_consensus.cc:3060] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.528573 25689 raft_consensus.cc:515] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.530031 25689 leader_election.cc:290] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 election: Requested vote from peers 5c9456bf1747480d840be9799faff2e7 (127.13.181.2:33657), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:13.531150 25542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9456bf1747480d840be9799faff2e7"
I20260709 13:08:13.531237 25616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f37be05692904810ac8f2b79a788940c"
I20260709 13:08:13.532088 25542 raft_consensus.cc:3060] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.532171 25616 raft_consensus.cc:3060] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.533571 25664 consensus_queue.cc:1048] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.538962 25616 raft_consensus.cc:2468] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 1.
I20260709 13:08:13.539372 25542 raft_consensus.cc:2468] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 1.
I20260709 13:08:13.540124 25432 leader_election.cc:304] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96e3d0953fda421887be406721c39a02, f37be05692904810ac8f2b79a788940c; no voters: 
I20260709 13:08:13.541169 25689 raft_consensus.cc:2804] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.541676 25689 raft_consensus.cc:697] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 LEADER]: Becoming Leader. State: Replica: 96e3d0953fda421887be406721c39a02, State: Running, Role: LEADER
I20260709 13:08:13.542546 25689 consensus_queue.cc:237] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:13.547264 25673 consensus_queue.cc:1048] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:13.553462 25364 catalog_manager.cc:5697] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96e3d0953fda421887be406721c39a02 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "96e3d0953fda421887be406721c39a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.651371 25542 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797"
dest_uuid: "5c9456bf1747480d840be9799faff2e7"
mode: GRACEFUL
new_leader_uuid: "96e3d0953fda421887be406721c39a02"
 from {username='slave'} at 127.0.0.1:42426
I20260709 13:08:13.651904 25542 raft_consensus.cc:606] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 LEADER]: Received request to transfer leadership to TS 96e3d0953fda421887be406721c39a02
I20260709 13:08:14.037604 25664 consensus_queue.cc:1048] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:14.039314 25701 consensus_queue.cc:1048] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:14.049618 25673 raft_consensus.cc:993] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7: : Instructing follower 96e3d0953fda421887be406721c39a02 to start an election
I20260709 13:08:14.050540 25701 raft_consensus.cc:1081] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 LEADER]: Signalling peer 96e3d0953fda421887be406721c39a02 to start an election
I20260709 13:08:14.053413 25466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797"
dest_uuid: "96e3d0953fda421887be406721c39a02"
 from {username='slave'} at 127.0.0.1:43090
I20260709 13:08:14.055150 25466 raft_consensus.cc:493] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.055626 25466 raft_consensus.cc:3060] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.074735 25466 raft_consensus.cc:515] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:14.078531 25542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c9456bf1747480d840be9799faff2e7"
I20260709 13:08:14.078922 25466 leader_election.cc:290] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 2 election: Requested vote from peers 5c9456bf1747480d840be9799faff2e7 (127.13.181.2:33657), f37be05692904810ac8f2b79a788940c (127.13.181.3:45119)
I20260709 13:08:14.079305 25542 raft_consensus.cc:3055] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.079761 25542 raft_consensus.cc:740] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5c9456bf1747480d840be9799faff2e7, State: Running, Role: LEADER
I20260709 13:08:14.080433 25615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3bbda975d514d63b98b2e3235136797" candidate_uuid: "96e3d0953fda421887be406721c39a02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f37be05692904810ac8f2b79a788940c"
I20260709 13:08:14.081132 25615 raft_consensus.cc:3060] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.080816 25542 consensus_queue.cc:260] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:14.082374 25542 raft_consensus.cc:3060] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.091281 25615 raft_consensus.cc:2468] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 2.
I20260709 13:08:14.092653 25700 consensus_queue.cc:1048] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:14.092916 25542 raft_consensus.cc:2468] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96e3d0953fda421887be406721c39a02 in term 2.
I20260709 13:08:14.092772 25432 leader_election.cc:304] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96e3d0953fda421887be406721c39a02, f37be05692904810ac8f2b79a788940c; no voters: 
I20260709 13:08:14.094380 25669 raft_consensus.cc:2804] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.094954 25669 raft_consensus.cc:697] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 2 LEADER]: Becoming Leader. State: Replica: 96e3d0953fda421887be406721c39a02, State: Running, Role: LEADER
I20260709 13:08:14.096318 25669 consensus_queue.cc:237] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:14.107208 25362 catalog_manager.cc:5697] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 reported cstate change: term changed from 1 to 2, leader changed from 5c9456bf1747480d840be9799faff2e7 (127.13.181.2) to 96e3d0953fda421887be406721c39a02 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "96e3d0953fda421887be406721c39a02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.108857 25700 consensus_queue.cc:1048] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:14.134244 14036 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:08:14.136376 14036 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:08:14.136801 14036 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:08:14.154445 25466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531"
dest_uuid: "96e3d0953fda421887be406721c39a02"
mode: GRACEFUL
new_leader_uuid: "f37be05692904810ac8f2b79a788940c"
 from {username='slave'} at 127.0.0.1:43796
I20260709 13:08:14.155053 25466 raft_consensus.cc:606] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 LEADER]: Received request to transfer leadership to TS f37be05692904810ac8f2b79a788940c
I20260709 13:08:14.156381 14036 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:08:14.546679 25616 raft_consensus.cc:1275] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 2 FOLLOWER]: Refusing update from remote peer 96e3d0953fda421887be406721c39a02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.548372 25669 consensus_queue.cc:1048] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.560139 25542 raft_consensus.cc:1275] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 2 FOLLOWER]: Refusing update from remote peer 96e3d0953fda421887be406721c39a02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.561842 25669 consensus_queue.cc:1048] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.680181 25689 raft_consensus.cc:993] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02: : Instructing follower f37be05692904810ac8f2b79a788940c to start an election
I20260709 13:08:14.680670 25669 raft_consensus.cc:1081] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 LEADER]: Signalling peer f37be05692904810ac8f2b79a788940c to start an election
I20260709 13:08:14.682170 25616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531"
dest_uuid: "f37be05692904810ac8f2b79a788940c"
 from {username='slave'} at 127.0.0.1:52362
I20260709 13:08:14.682749 25616 raft_consensus.cc:493] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.683144 25616 raft_consensus.cc:3060] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.689818 25616 raft_consensus.cc:515] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:14.692023 25616 leader_election.cc:290] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [CANDIDATE]: Term 2 election: Requested vote from peers 96e3d0953fda421887be406721c39a02 (127.13.181.1:35437), 5c9456bf1747480d840be9799faff2e7 (127.13.181.2:33657)
I20260709 13:08:14.707535 25466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531" candidate_uuid: "f37be05692904810ac8f2b79a788940c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "96e3d0953fda421887be406721c39a02"
I20260709 13:08:14.708349 25466 raft_consensus.cc:3055] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.708791 25466 raft_consensus.cc:740] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 96e3d0953fda421887be406721c39a02, State: Running, Role: LEADER
I20260709 13:08:14.709623 25542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8c86fc13c404a50847b31805d95f531" candidate_uuid: "f37be05692904810ac8f2b79a788940c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5c9456bf1747480d840be9799faff2e7"
I20260709 13:08:14.710286 25542 raft_consensus.cc:3060] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.709856 25466 consensus_queue.cc:260] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:14.711395 25466 raft_consensus.cc:3060] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.719518 25542 raft_consensus.cc:2468] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f37be05692904810ac8f2b79a788940c in term 2.
I20260709 13:08:14.719995 25466 raft_consensus.cc:2468] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f37be05692904810ac8f2b79a788940c in term 2.
I20260709 13:08:14.721133 25579 leader_election.cc:304] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9456bf1747480d840be9799faff2e7, f37be05692904810ac8f2b79a788940c; no voters: 
I20260709 13:08:14.721843 25663 raft_consensus.cc:2804] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.723239 25663 raft_consensus.cc:697] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 2 LEADER]: Becoming Leader. State: Replica: f37be05692904810ac8f2b79a788940c, State: Running, Role: LEADER
I20260709 13:08:14.724252 25663 consensus_queue.cc:237] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } }
I20260709 13:08:14.730743 25363 catalog_manager.cc:5697] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c reported cstate change: term changed from 1 to 2, leader changed from 96e3d0953fda421887be406721c39a02 (127.13.181.1) to f37be05692904810ac8f2b79a788940c (127.13.181.3). New cstate: current_term: 2 leader_uuid: "f37be05692904810ac8f2b79a788940c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96e3d0953fda421887be406721c39a02" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 35437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c9456bf1747480d840be9799faff2e7" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 33657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f37be05692904810ac8f2b79a788940c" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:14.773463 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
I20260709 13:08:14.799299 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:14.800303 14036 tablet_replica.cc:333] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02: stopping tablet replica
I20260709 13:08:14.801108 14036 raft_consensus.cc:2243] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.801540 14036 raft_consensus.cc:2272] T b8c86fc13c404a50847b31805d95f531 P 96e3d0953fda421887be406721c39a02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.804394 14036 tablet_replica.cc:333] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02: stopping tablet replica
I20260709 13:08:14.804975 14036 raft_consensus.cc:2243] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:14.805805 14036 raft_consensus.cc:2272] T cf77405cfad14574a02b6fb1197beee9 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.808164 14036 tablet_replica.cc:333] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02: stopping tablet replica
I20260709 13:08:14.808912 14036 raft_consensus.cc:2243] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:14.809706 14036 raft_consensus.cc:2272] T e3bbda975d514d63b98b2e3235136797 P 96e3d0953fda421887be406721c39a02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.812484 14036 tablet_replica.cc:333] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02: stopping tablet replica
I20260709 13:08:14.813015 14036 raft_consensus.cc:2243] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.813454 14036 raft_consensus.cc:2272] T 01e0be4829c24450b0e71f82caeef950 P 96e3d0953fda421887be406721c39a02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.830302 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
W20260709 13:08:14.846428 25505 consensus_peers.cc:597] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 -> Peer 96e3d0953fda421887be406721c39a02 (127.13.181.1:35437): Couldn't send request to peer 96e3d0953fda421887be406721c39a02. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:35437: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.851975 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
I20260709 13:08:14.879371 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:14.880167 14036 tablet_replica.cc:333] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7: stopping tablet replica
I20260709 13:08:14.880919 14036 raft_consensus.cc:2243] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.881343 14036 raft_consensus.cc:2272] T b8c86fc13c404a50847b31805d95f531 P 5c9456bf1747480d840be9799faff2e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.884282 14036 tablet_replica.cc:333] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7: stopping tablet replica
I20260709 13:08:14.884820 14036 raft_consensus.cc:2243] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.885195 14036 raft_consensus.cc:2272] T e3bbda975d514d63b98b2e3235136797 P 5c9456bf1747480d840be9799faff2e7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.888077 14036 tablet_replica.cc:333] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7: stopping tablet replica
I20260709 13:08:14.888626 14036 raft_consensus.cc:2243] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:14.889477 14036 raft_consensus.cc:2272] T 01e0be4829c24450b0e71f82caeef950 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.892284 14036 tablet_replica.cc:333] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7: stopping tablet replica
I20260709 13:08:14.892835 14036 raft_consensus.cc:2243] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.893304 14036 raft_consensus.cc:2272] T cf77405cfad14574a02b6fb1197beee9 P 5c9456bf1747480d840be9799faff2e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.918342 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
I20260709 13:08:14.934490 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
I20260709 13:08:14.956303 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:14.957135 14036 tablet_replica.cc:333] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: stopping tablet replica
I20260709 13:08:14.957836 14036 raft_consensus.cc:2243] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:14.958499 14036 pending_rounds.cc:70] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: Trying to abort 1 pending ops.
I20260709 13:08:14.958724 14036 pending_rounds.cc:77] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635818397765632 op_type: NO_OP noop_request { }
I20260709 13:08:14.959074 14036 raft_consensus.cc:2889] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:14.959406 14036 raft_consensus.cc:2272] T b8c86fc13c404a50847b31805d95f531 P f37be05692904810ac8f2b79a788940c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.962133 14036 tablet_replica.cc:333] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c: stopping tablet replica
I20260709 13:08:14.962693 14036 raft_consensus.cc:2243] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.963317 14036 raft_consensus.cc:2272] T cf77405cfad14574a02b6fb1197beee9 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.965674 14036 tablet_replica.cc:333] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c: stopping tablet replica
I20260709 13:08:14.966218 14036 raft_consensus.cc:2243] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.966686 14036 raft_consensus.cc:2272] T e3bbda975d514d63b98b2e3235136797 P f37be05692904810ac8f2b79a788940c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.969740 14036 tablet_replica.cc:333] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c: stopping tablet replica
I20260709 13:08:14.970227 14036 raft_consensus.cc:2243] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:14.970700 14036 raft_consensus.cc:2272] T 01e0be4829c24450b0e71f82caeef950 P f37be05692904810ac8f2b79a788940c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:14.998616 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
I20260709 13:08:15.015753 14036 master.cc:562] Master@127.13.181.62:40761 shutting down...
I20260709 13:08:15.037639 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:15.038229 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:15.038657 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P bf6aefa7ca76417ba0716e809ccee84d: stopping tablet replica
I20260709 13:08:15.058305 14036 master.cc:584] Master@127.13.181.62:40761 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3016 ms)
[----------] 6 tests from LeaderRebalancerTest (330888 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:08:15.097540 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:37499
I20260709 13:08:15.098728 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:15.104816 25724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.106597 25725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:15.106861 14036 server_base.cc:1061] running on GCE node
W20260709 13:08:15.107071 25727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:15.108129 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:15.108361 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:15.108532 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602495108516 us; error 0 us; skew 500 ppm
I20260709 13:08:15.109067 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:15.111773 14036 webserver.cc:533] Webserver started at http://127.13.181.62:34133/ using document root <none> and password file <none>
I20260709 13:08:15.112390 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:15.112639 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:15.112977 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:15.114269 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "5346a95ae6ee41f28eec3f6921a16b3d"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.119277 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 13:08:15.122749 25732 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.123570 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:08:15.123880 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "5346a95ae6ee41f28eec3f6921a16b3d"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.124167 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:15.143879 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:15.145169 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:15.184855 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:37499
I20260709 13:08:15.184945 25783 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:37499 every 8 connection(s)
I20260709 13:08:15.188864 25784 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.200503 25784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d: Bootstrap starting.
I20260709 13:08:15.206029 25784 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:15.210378 25784 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d: No bootstrap required, opened a new log
I20260709 13:08:15.212612 25784 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" member_type: VOTER }
I20260709 13:08:15.213013 25784 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:15.213218 25784 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5346a95ae6ee41f28eec3f6921a16b3d, State: Initialized, Role: FOLLOWER
I20260709 13:08:15.213887 25784 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" member_type: VOTER }
I20260709 13:08:15.214339 25784 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:15.214569 25784 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:15.214800 25784 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:15.219851 25784 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" member_type: VOTER }
I20260709 13:08:15.220358 25784 leader_election.cc:304] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5346a95ae6ee41f28eec3f6921a16b3d; no voters: 
I20260709 13:08:15.221504 25784 leader_election.cc:290] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:15.221871 25787 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:15.223204 25787 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 1 LEADER]: Becoming Leader. State: Replica: 5346a95ae6ee41f28eec3f6921a16b3d, State: Running, Role: LEADER
I20260709 13:08:15.223881 25787 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" member_type: VOTER }
I20260709 13:08:15.224498 25784 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:15.226866 25789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5346a95ae6ee41f28eec3f6921a16b3d. Latest consensus state: current_term: 1 leader_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" member_type: VOTER } }
I20260709 13:08:15.226837 25788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5346a95ae6ee41f28eec3f6921a16b3d" member_type: VOTER } }
I20260709 13:08:15.227661 25789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:15.227768 25788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:15.231751 25792 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:15.236661 25792 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:15.239930 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:15.245362 25792 catalog_manager.cc:1383] Generated new cluster ID: 5d5eeb8d2b654616b44c9823e9e6206a
I20260709 13:08:15.245647 25792 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:15.259729 25792 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:15.261057 25792 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:15.276340 25792 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d: Generated new TSK 0
I20260709 13:08:15.277025 25792 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:15.307184 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:15.313622 25805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.314459 25806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.316861 25808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:15.317028 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:15.318017 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:15.318198 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:15.318316 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602495318306 us; error 0 us; skew 500 ppm
I20260709 13:08:15.318918 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:15.321381 14036 webserver.cc:533] Webserver started at http://127.13.181.1:37899/ using document root <none> and password file <none>
I20260709 13:08:15.321885 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:15.322038 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:15.322259 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:15.323448 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.328011 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:08:15.331430 25813 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.332192 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:15.332553 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.332858 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:15.345460 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:15.346762 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:15.348327 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:15.350698 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:15.350950 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.351282 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:15.351496 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.395641 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:36857
I20260709 13:08:15.395746 25875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:36857 every 8 connection(s)
I20260709 13:08:15.400856 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:15.409230 25880 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.409555 25881 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.413280 25883 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:15.413947 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:15.414543 25876 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37499
I20260709 13:08:15.415066 25876 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:15.415235 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:15.415570 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:15.415789 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602495415769 us; error 0 us; skew 500 ppm
I20260709 13:08:15.416077 25876 heartbeater.cc:507] Master 127.13.181.62:37499 requested a full tablet report, sending...
I20260709 13:08:15.416721 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:15.418861 25749 ts_manager.cc:194] Registered new tserver with Master: 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857)
I20260709 13:08:15.419672 14036 webserver.cc:533] Webserver started at http://127.13.181.2:41903/ using document root <none> and password file <none>
I20260709 13:08:15.420207 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:15.420449 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:15.420739 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:15.421175 25749 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56224
I20260709 13:08:15.422351 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "adca8255c5db4b8d985905e1b4763a11"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.428591 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:08:15.434643 25888 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.435693 14036 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:08:15.436040 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "adca8255c5db4b8d985905e1b4763a11"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.436371 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:15.450322 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:15.451540 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:15.452986 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:15.455220 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:15.455485 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.455729 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:15.455901 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.497359 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:38127
I20260709 13:08:15.497450 25950 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:38127 every 8 connection(s)
I20260709 13:08:15.502218 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:15.509600 25954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.511714 25955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:15.513157 25958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:15.513818 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:15.514825 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:08:15.515089 25951 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37499
W20260709 13:08:15.515149 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:15.515702 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602495515683 us; error 0 us; skew 500 ppm
I20260709 13:08:15.515723 25951 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:15.516359 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:15.516682 25951 heartbeater.cc:507] Master 127.13.181.62:37499 requested a full tablet report, sending...
I20260709 13:08:15.519117 25749 ts_manager.cc:194] Registered new tserver with Master: adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:15.519459 14036 webserver.cc:533] Webserver started at http://127.13.181.3:40741/ using document root <none> and password file <none>
I20260709 13:08:15.519996 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:15.520212 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:15.520479 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:15.520876 25749 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56230
I20260709 13:08:15.521782 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.526551 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:08:15.530218 25962 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.531344 14036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:08:15.531684 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
format_stamp: "Formatted at 2026-07-09 13:08:15 on dist-test-slave-28ks"
I20260709 13:08:15.532028 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:15.551170 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:15.552435 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:15.553987 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:15.556387 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:15.556643 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.556914 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:15.557114 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:15.601361 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:42055
I20260709 13:08:15.601461 26024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:42055 every 8 connection(s)
I20260709 13:08:15.616567 26025 heartbeater.cc:344] Connected to a master server at 127.13.181.62:37499
I20260709 13:08:15.616926 26025 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:15.617590 26025 heartbeater.cc:507] Master 127.13.181.62:37499 requested a full tablet report, sending...
I20260709 13:08:15.619582 25749 ts_manager.cc:194] Registered new tserver with Master: 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:15.620114 14036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015067669s
I20260709 13:08:15.621008 25749 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56236
I20260709 13:08:15.647535 25749 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56250:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:15.650835 25749 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:15.721846 25841 tablet_service.cc:1511] Processing CreateTablet for tablet e3c37150c1894e7da642b8af48bbe27e (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:15.723426 25841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c37150c1894e7da642b8af48bbe27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.727212 25987 tablet_service.cc:1511] Processing CreateTablet for tablet b3df05b17d4241999f34a272680d44cb (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:15.728111 25840 tablet_service.cc:1511] Processing CreateTablet for tablet 267814db287341c595a273268b614c45 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:15.728986 25987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3df05b17d4241999f34a272680d44cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.728698 25915 tablet_service.cc:1511] Processing CreateTablet for tablet 267814db287341c595a273268b614c45 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:15.729765 25840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267814db287341c595a273268b614c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.730376 25915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267814db287341c595a273268b614c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.730311 25988 tablet_service.cc:1511] Processing CreateTablet for tablet 813bc21ce0d040f8b611f5503dca8c80 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:15.731156 25916 tablet_service.cc:1511] Processing CreateTablet for tablet e3c37150c1894e7da642b8af48bbe27e (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:15.732561 25988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813bc21ce0d040f8b611f5503dca8c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.732362 25839 tablet_service.cc:1511] Processing CreateTablet for tablet 813bc21ce0d040f8b611f5503dca8c80 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:15.733024 25916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c37150c1894e7da642b8af48bbe27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.726899 25990 tablet_service.cc:1511] Processing CreateTablet for tablet e3c37150c1894e7da642b8af48bbe27e (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:15.733716 25839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813bc21ce0d040f8b611f5503dca8c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.734270 25990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3c37150c1894e7da642b8af48bbe27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.728214 25989 tablet_service.cc:1511] Processing CreateTablet for tablet 267814db287341c595a273268b614c45 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:15.736536 25989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 267814db287341c595a273268b614c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.768594 25914 tablet_service.cc:1511] Processing CreateTablet for tablet 813bc21ce0d040f8b611f5503dca8c80 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:15.771195 25914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813bc21ce0d040f8b611f5503dca8c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.771735 25838 tablet_service.cc:1511] Processing CreateTablet for tablet b3df05b17d4241999f34a272680d44cb (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:15.773193 25838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3df05b17d4241999f34a272680d44cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.783558 25913 tablet_service.cc:1511] Processing CreateTablet for tablet b3df05b17d4241999f34a272680d44cb (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:15.785164 25913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3df05b17d4241999f34a272680d44cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.792152 25837 tablet_service.cc:1511] Processing CreateTablet for tablet 2812843fcd4547a3a9438614a27c8f48 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:15.793649 25837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2812843fcd4547a3a9438614a27c8f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.798566 25912 tablet_service.cc:1511] Processing CreateTablet for tablet 2812843fcd4547a3a9438614a27c8f48 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:15.800071 25912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2812843fcd4547a3a9438614a27c8f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.818670 25986 tablet_service.cc:1511] Processing CreateTablet for tablet 2812843fcd4547a3a9438614a27c8f48 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:15.820158 25986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2812843fcd4547a3a9438614a27c8f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.827234 25836 tablet_service.cc:1511] Processing CreateTablet for tablet a20d74ab418f4845b250ba7e9358087a (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:15.828758 25836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d74ab418f4845b250ba7e9358087a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.829907 25911 tablet_service.cc:1511] Processing CreateTablet for tablet a20d74ab418f4845b250ba7e9358087a (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:15.833184 25911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d74ab418f4845b250ba7e9358087a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.841894 25987 tablet_service.cc:1511] Processing CreateTablet for tablet a20d74ab418f4845b250ba7e9358087a (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:15.843992 25987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a20d74ab418f4845b250ba7e9358087a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.849386 25839 tablet_service.cc:1511] Processing CreateTablet for tablet 637d9b67922945ccb252127e696ad2cf (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:15.850733 25839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637d9b67922945ccb252127e696ad2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.853441 25910 tablet_service.cc:1511] Processing CreateTablet for tablet 637d9b67922945ccb252127e696ad2cf (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:15.854866 25910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637d9b67922945ccb252127e696ad2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.886936 25841 tablet_service.cc:1511] Processing CreateTablet for tablet 30636af4b95945a7968f5e116600b4d7 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:15.888641 25841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30636af4b95945a7968f5e116600b4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.900359 26041 tablet_bootstrap.cc:492] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:15.902503 25987 tablet_service.cc:1511] Processing CreateTablet for tablet 637d9b67922945ccb252127e696ad2cf (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:15.904166 25987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637d9b67922945ccb252127e696ad2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.904047 26040 tablet_bootstrap.cc:492] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:15.912328 25841 tablet_service.cc:1511] Processing CreateTablet for tablet 9538861166364b80b5975791dd4e1eb5 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:15.909816 25910 tablet_service.cc:1511] Processing CreateTablet for tablet 30636af4b95945a7968f5e116600b4d7 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:15.916030 25913 tablet_service.cc:1511] Processing CreateTablet for tablet 9538861166364b80b5975791dd4e1eb5 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:15.916847 25986 tablet_service.cc:1511] Processing CreateTablet for tablet 9538861166364b80b5975791dd4e1eb5 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:15.918146 25986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9538861166364b80b5975791dd4e1eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.919595 26041 tablet_bootstrap.cc:654] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:15.920518 25910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30636af4b95945a7968f5e116600b4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.921319 25841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9538861166364b80b5975791dd4e1eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.931149 26040 tablet_bootstrap.cc:654] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:15.931740 26042 tablet_bootstrap.cc:492] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:15.931953 25989 tablet_service.cc:1511] Processing CreateTablet for tablet 30636af4b95945a7968f5e116600b4d7 (DEFAULT_TABLE table=test-workload [id=2d58c892a8904486826c76da81be3139]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:15.935114 25989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30636af4b95945a7968f5e116600b4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.936281 25913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9538861166364b80b5975791dd4e1eb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:15.950177 26042 tablet_bootstrap.cc:654] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:15.936501 26041 tablet_bootstrap.cc:492] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:15.951192 26041 ts_tablet_manager.cc:1403] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.006s
I20260709 13:08:15.954751 26041 raft_consensus.cc:359] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:15.955960 26041 raft_consensus.cc:385] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:15.956429 26041 raft_consensus.cc:740] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:15.963946 26041 consensus_queue.cc:260] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:15.966886 26042 tablet_bootstrap.cc:492] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:15.967578 26042 ts_tablet_manager.cc:1403] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.004s
I20260709 13:08:15.970679 26042 raft_consensus.cc:359] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:15.971660 26042 raft_consensus.cc:385] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:15.971918 25876 heartbeater.cc:499] Master 127.13.181.62:37499 was elected leader, sending a full tablet report...
I20260709 13:08:15.973189 26041 ts_tablet_manager.cc:1434] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.005s
I20260709 13:08:15.974309 26041 tablet_bootstrap.cc:492] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:15.971984 26042 raft_consensus.cc:740] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:15.977445 26040 tablet_bootstrap.cc:492] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:15.976918 26042 consensus_queue.cc:260] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:15.978166 26040 ts_tablet_manager.cc:1403] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.075s	user 0.024s	sys 0.004s
I20260709 13:08:15.981480 26040 raft_consensus.cc:359] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:15.982295 26040 raft_consensus.cc:385] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:15.982635 26040 raft_consensus.cc:740] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:15.983381 26040 consensus_queue.cc:260] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:15.984227 26041 tablet_bootstrap.cc:654] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:15.989761 25951 heartbeater.cc:499] Master 127.13.181.62:37499 was elected leader, sending a full tablet report...
I20260709 13:08:15.990088 26042 ts_tablet_manager.cc:1434] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.011s
I20260709 13:08:15.991387 26042 tablet_bootstrap.cc:492] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:15.998296 26042 tablet_bootstrap.cc:654] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.003245 26040 ts_tablet_manager.cc:1434] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.015s
I20260709 13:08:16.003521 26025 heartbeater.cc:499] Master 127.13.181.62:37499 was elected leader, sending a full tablet report...
I20260709 13:08:16.004494 26040 tablet_bootstrap.cc:492] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:16.012346 26040 tablet_bootstrap.cc:654] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.021907 26041 tablet_bootstrap.cc:492] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.022761 26041 ts_tablet_manager.cc:1403] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 13:08:16.032817 26041 raft_consensus.cc:359] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.035233 26041 raft_consensus.cc:385] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.035606 26041 raft_consensus.cc:740] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.037015 26041 consensus_queue.cc:260] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.037489 26042 tablet_bootstrap.cc:492] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.038156 26042 ts_tablet_manager.cc:1403] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.022s
I20260709 13:08:16.038882 26040 tablet_bootstrap.cc:492] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.039505 26040 ts_tablet_manager.cc:1403] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.017s
I20260709 13:08:16.039901 26041 ts_tablet_manager.cc:1434] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:08:16.041172 26042 raft_consensus.cc:359] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.041966 26042 raft_consensus.cc:385] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.042290 26042 raft_consensus.cc:740] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.042388 26040 raft_consensus.cc:359] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.043355 26040 raft_consensus.cc:385] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.043133 26042 consensus_queue.cc:260] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.043761 26040 raft_consensus.cc:740] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.043192 26041 tablet_bootstrap.cc:492] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:16.044658 26040 consensus_queue.cc:260] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.046950 26040 ts_tablet_manager.cc:1434] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:08:16.047242 26042 ts_tablet_manager.cc:1434] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:16.048061 26040 tablet_bootstrap.cc:492] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:16.048307 26042 tablet_bootstrap.cc:492] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:16.052392 26041 tablet_bootstrap.cc:654] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.055433 26040 tablet_bootstrap.cc:654] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.055830 26042 tablet_bootstrap.cc:654] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.072899 26041 tablet_bootstrap.cc:492] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.072953 26042 tablet_bootstrap.cc:492] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.073443 26041 ts_tablet_manager.cc:1403] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.003s
I20260709 13:08:16.073563 26042 ts_tablet_manager.cc:1403] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 13:08:16.073787 26040 tablet_bootstrap.cc:492] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.074278 26040 ts_tablet_manager.cc:1403] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:08:16.076028 26041 raft_consensus.cc:359] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.076646 26041 raft_consensus.cc:385] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.076941 26041 raft_consensus.cc:740] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.076709 26042 raft_consensus.cc:359] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.077550 26042 raft_consensus.cc:385] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.077070 26040 raft_consensus.cc:359] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.077627 26041 consensus_queue.cc:260] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.077927 26042 raft_consensus.cc:740] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.078037 26040 raft_consensus.cc:385] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.078563 26040 raft_consensus.cc:740] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.078914 26042 consensus_queue.cc:260] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.079375 26040 consensus_queue.cc:260] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.080174 26041 ts_tablet_manager.cc:1434] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:16.081219 26041 tablet_bootstrap.cc:492] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:16.081274 26042 ts_tablet_manager.cc:1434] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:08:16.081887 26040 ts_tablet_manager.cc:1434] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:16.082469 26042 tablet_bootstrap.cc:492] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:16.082918 26040 tablet_bootstrap.cc:492] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:16.089993 26042 tablet_bootstrap.cc:654] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.091492 26041 tablet_bootstrap.cc:654] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.091674 26040 tablet_bootstrap.cc:654] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.098109 26048 raft_consensus.cc:493] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.098850 26048 raft_consensus.cc:515] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.107059 26041 tablet_bootstrap.cc:492] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.107630 26041 ts_tablet_manager.cc:1403] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.008s
I20260709 13:08:16.110611 26041 raft_consensus.cc:359] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.111490 26041 raft_consensus.cc:385] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.111814 26041 raft_consensus.cc:740] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.112695 26041 consensus_queue.cc:260] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.115288 26041 ts_tablet_manager.cc:1434] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:08:16.116334 26041 tablet_bootstrap.cc:492] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:16.120134 26048 leader_election.cc:290] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.122562 26041 tablet_bootstrap.cc:654] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.127682 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.128736 25851 raft_consensus.cc:2468] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:16.131969 25964 leader_election.cc:304] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:16.133435 26048 raft_consensus.cc:2804] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.133971 26048 raft_consensus.cc:493] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.134588 26048 raft_consensus.cc:3060] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.147866 26042 tablet_bootstrap.cc:492] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.148573 26042 ts_tablet_manager.cc:1403] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.037s
I20260709 13:08:16.150031 26040 tablet_bootstrap.cc:492] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.150586 26040 ts_tablet_manager.cc:1403] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.005s
I20260709 13:08:16.151432 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.152146 25926 raft_consensus.cc:2468] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:16.152885 26042 raft_consensus.cc:359] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.153743 26042 raft_consensus.cc:385] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.154114 26042 raft_consensus.cc:740] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.148717 26041 tablet_bootstrap.cc:492] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.153416 26040 raft_consensus.cc:359] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.154871 26060 raft_consensus.cc:493] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.155092 26040 raft_consensus.cc:385] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.155663 26040 raft_consensus.cc:740] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.155161 26042 consensus_queue.cc:260] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.155776 26060 raft_consensus.cc:515] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.156602 26040 consensus_queue.cc:260] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.158156 26060 leader_election.cc:290] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.154884 26041 ts_tablet_manager.cc:1403] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.017s
I20260709 13:08:16.158952 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.159651 25851 raft_consensus.cc:2468] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:16.161024 25964 leader_election.cc:304] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:16.161881 26041 raft_consensus.cc:359] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.162449 26042 ts_tablet_manager.cc:1434] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:16.162667 26041 raft_consensus.cc:385] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.163043 26041 raft_consensus.cc:740] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.163822 26042 tablet_bootstrap.cc:492] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:16.163789 26041 consensus_queue.cc:260] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.166298 26041 ts_tablet_manager.cc:1434] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:16.171573 26042 tablet_bootstrap.cc:654] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.172870 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.173628 26040 ts_tablet_manager.cc:1434] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.023s	user 0.015s	sys 0.007s
I20260709 13:08:16.172760 26061 raft_consensus.cc:2804] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.174654 26040 tablet_bootstrap.cc:492] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
W20260709 13:08:16.174695 25966 leader_election.cc:343] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.175338 26061 raft_consensus.cc:493] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.175834 26061 raft_consensus.cc:3060] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.177433 26048 raft_consensus.cc:515] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.179807 26048 leader_election.cc:290] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.180478 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:16.180895 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:16.181104 25851 raft_consensus.cc:3060] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.181560 25926 raft_consensus.cc:3060] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.184669 26040 tablet_bootstrap.cc:654] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.189371 25851 raft_consensus.cc:2468] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:16.190251 25926 raft_consensus.cc:2468] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:16.181031 26041 tablet_bootstrap.cc:492] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:16.190819 25964 leader_election.cc:304] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:16.191777 26048 raft_consensus.cc:2804] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.203431 26041 tablet_bootstrap.cc:654] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.204030 26048 raft_consensus.cc:697] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:16.205057 26048 consensus_queue.cc:237] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.207309 26042 tablet_bootstrap.cc:492] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.207911 26042 ts_tablet_manager.cc:1403] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 13:08:16.210958 26042 raft_consensus.cc:359] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.211773 26042 raft_consensus.cc:385] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.211575 26061 raft_consensus.cc:515] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.212177 26042 raft_consensus.cc:740] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.213963 26061 leader_election.cc:290] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.214854 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:16.215498 25851 raft_consensus.cc:3060] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.215473 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:16.219419 26041 tablet_bootstrap.cc:492] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.213385 26042 consensus_queue.cc:260] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.220198 25926 raft_consensus.cc:3060] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.220728 26040 tablet_bootstrap.cc:492] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.221238 26040 ts_tablet_manager.cc:1403] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.013s
I20260709 13:08:16.224714 26040 raft_consensus.cc:359] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.219959 26041 ts_tablet_manager.cc:1403] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.009s
I20260709 13:08:16.225965 26040 raft_consensus.cc:385] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.226730 26040 raft_consensus.cc:740] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.227682 26040 consensus_queue.cc:260] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.228713 26042 ts_tablet_manager.cc:1434] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:08:16.230319 26046 raft_consensus.cc:493] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.230496 26041 raft_consensus.cc:359] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.228591 25851 raft_consensus.cc:2468] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:16.233043 26046 raft_consensus.cc:515] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.231921 25747 catalog_manager.cc:5697] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.234180 25964 leader_election.cc:304] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
W20260709 13:08:16.234953 25797 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:16.231329 25926 raft_consensus.cc:2468] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:16.233184 26041 raft_consensus.cc:385] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.240589 26047 raft_consensus.cc:493] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.241282 26047 raft_consensus.cc:515] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.245934 26061 raft_consensus.cc:493] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.240224 26041 raft_consensus.cc:740] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.246536 26061 raft_consensus.cc:515] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.248898 26040 ts_tablet_manager.cc:1434] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:08:16.249469 26047 leader_election.cc:290] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.249552 26061 leader_election.cc:290] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.239488 26046 leader_election.cc:290] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.252306 26042 tablet_bootstrap.cc:492] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:16.250808 26048 raft_consensus.cc:2804] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.268244 26041 consensus_queue.cc:260] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.268364 26047 raft_consensus.cc:493] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.277467 26040 tablet_bootstrap.cc:492] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:16.278353 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.279069 25925 raft_consensus.cc:2468] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:16.277361 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.275430 26047 raft_consensus.cc:515] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:16.281062 25966 leader_election.cc:304] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.281291 25851 raft_consensus.cc:2468] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:16.281967 26061 raft_consensus.cc:2804] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.282347 26061 raft_consensus.cc:493] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.282704 26061 raft_consensus.cc:3060] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.273988 26048 raft_consensus.cc:697] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:16.290059 26047 leader_election.cc:290] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.289387 26046 raft_consensus.cc:493] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.303572 26046 raft_consensus.cc:515] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:16.304562 26041 ts_tablet_manager.cc:1434] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
I20260709 13:08:16.304477 26048 consensus_queue.cc:237] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.305943 26041 tablet_bootstrap.cc:492] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:16.306236 26046 leader_election.cc:290] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.308872 26061 raft_consensus.cc:515] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.315130 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.317094 25926 raft_consensus.cc:2468] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:16.317314 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.318078 25925 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:16.327677 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.328158 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.317303 26042 tablet_bootstrap.cc:654] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.328444 25851 raft_consensus.cc:2468] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:16.328917 25850 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:16.330298 25890 leader_election.cc:304] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.328356 26061 leader_election.cc:290] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.331678 26047 raft_consensus.cc:2804] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.331888 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:16.332605 25850 raft_consensus.cc:3060] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.332823 25817 leader_election.cc:304] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.333845 26046 raft_consensus.cc:2804] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.334208 26046 raft_consensus.cc:493] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.334579 26046 raft_consensus.cc:3060] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.332875 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.337229 26000 raft_consensus.cc:2393] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adca8255c5db4b8d985905e1b4763a11 in current term 1: Already voted for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in this term.
I20260709 13:08:16.332113 26047 raft_consensus.cc:493] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.338135 26047 raft_consensus.cc:3060] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.338536 26040 tablet_bootstrap.cc:654] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.339095 26041 tablet_bootstrap.cc:654] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.341589 25999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.341871 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.342900 25999 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:16.344970 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.345692 25998 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:16.346756 25890 leader_election.cc:304] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.342857 25850 raft_consensus.cc:2468] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:16.347342 25817 leader_election.cc:304] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.356763 26076 raft_consensus.cc:2804] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.357115 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:16.357549 26076 raft_consensus.cc:493] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.358110 26076 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:16.355410 25814 leader_election.cc:343] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.370937 26078 raft_consensus.cc:2804] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.371459 26078 raft_consensus.cc:493] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.371745 26041 tablet_bootstrap.cc:492] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.367137 26046 raft_consensus.cc:515] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.371794 26078 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.371604 25964 leader_election.cc:304] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:16.373540 26048 raft_consensus.cc:2804] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.373993 26048 raft_consensus.cc:697] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:16.374627 26046 leader_election.cc:290] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.375283 26046 raft_consensus.cc:493] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.374841 26048 consensus_queue.cc:237] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.375712 26046 raft_consensus.cc:515] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.377671 26046 leader_election.cc:290] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.377897 26076 raft_consensus.cc:515] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:16.385155 26040 tablet_bootstrap.cc:492] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.385775 26041 ts_tablet_manager.cc:1403] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.080s	user 0.015s	sys 0.005s
I20260709 13:08:16.388077 26040 ts_tablet_manager.cc:1403] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.111s	user 0.004s	sys 0.028s
I20260709 13:08:16.374846 26047 raft_consensus.cc:515] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.391813 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:16.393167 26047 leader_election.cc:290] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.393994 25925 raft_consensus.cc:2393] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in current term 1: Already voted for candidate adca8255c5db4b8d985905e1b4763a11 in this term.
I20260709 13:08:16.393766 26040 raft_consensus.cc:359] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.394518 26040 raft_consensus.cc:385] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.394814 26040 raft_consensus.cc:740] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.395653 26040 consensus_queue.cc:260] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.397244 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267814db287341c595a273268b614c45" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.397886 26040 ts_tablet_manager.cc:1434] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:08:16.397847 26041 raft_consensus.cc:359] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.398121 26000 raft_consensus.cc:2468] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:16.398723 26041 raft_consensus.cc:385] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.399158 26040 tablet_bootstrap.cc:492] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:16.402892 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:16.403009 26041 raft_consensus.cc:740] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
W20260709 13:08:16.400097 25814 leader_election.cc:343] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.401084 26078 raft_consensus.cc:515] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:16.402202 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:16.404072 26041 consensus_queue.cc:260] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.407246 25925 raft_consensus.cc:3060] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.407955 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267814db287341c595a273268b614c45" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.408804 26078 leader_election.cc:290] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.409070 25814 leader_election.cc:304] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
W20260709 13:08:16.410099 25817 leader_election.cc:343] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.410009 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:16.410987 25926 raft_consensus.cc:2393] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e7ac3d587f541c2b05b6541fbe0a504 in current term 1: Already voted for candidate adca8255c5db4b8d985905e1b4763a11 in this term.
I20260709 13:08:16.413136 26041 ts_tablet_manager.cc:1434] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 13:08:16.414283 26041 tablet_bootstrap.cc:492] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:16.414419 26040 tablet_bootstrap.cc:654] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.415472 25925 raft_consensus.cc:2468] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:16.418550 26076 leader_election.cc:290] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.418463 25817 leader_election.cc:304] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 30b7e0e4c8eb42a19bd1d057b5fb8760
I20260709 13:08:16.419595 26079 raft_consensus.cc:2804] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.420096 26079 raft_consensus.cc:697] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:16.420599 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:16.421242 26000 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.420956 26079 consensus_queue.cc:237] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.423273 26078 raft_consensus.cc:2804] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.423704 26078 raft_consensus.cc:493] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.424067 26078 raft_consensus.cc:3060] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.426544 26041 tablet_bootstrap.cc:654] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.429826 26042 tablet_bootstrap.cc:492] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.431216 26042 ts_tablet_manager.cc:1403] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.184s	user 0.022s	sys 0.013s
I20260709 13:08:16.431414 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:16.432575 25850 raft_consensus.cc:2393] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adca8255c5db4b8d985905e1b4763a11 in current term 1: Already voted for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in this term.
I20260709 13:08:16.431824 25746 catalog_manager.cc:5697] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.433862 25746 catalog_manager.cc:5697] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.434341 26042 raft_consensus.cc:359] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.435194 26042 raft_consensus.cc:385] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.435521 26042 raft_consensus.cc:740] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.436303 26042 consensus_queue.cc:260] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.438601 26042 ts_tablet_manager.cc:1434] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:08:16.440047 26042 tablet_bootstrap.cc:492] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:16.442680 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:16.443683 25850 raft_consensus.cc:2393] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adca8255c5db4b8d985905e1b4763a11 in current term 1: Already voted for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in this term.
I20260709 13:08:16.444242 26048 raft_consensus.cc:493] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.445307 26078 raft_consensus.cc:515] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.445719 26048 raft_consensus.cc:515] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.447990 26048 leader_election.cc:290] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.448511 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267814db287341c595a273268b614c45" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:16.449107 25925 raft_consensus.cc:3060] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.451936 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d74ab418f4845b250ba7e9358087a" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
W20260709 13:08:16.453207 25964 leader_election.cc:343] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.455480 25890 leader_election.cc:304] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adca8255c5db4b8d985905e1b4763a11; no voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:16.456141 25748 catalog_manager.cc:5697] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.459254 26076 raft_consensus.cc:2749] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:16.460274 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d74ab418f4845b250ba7e9358087a" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.461493 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
W20260709 13:08:16.463856 25966 leader_election.cc:343] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.464358 25966 leader_election.cc:304] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760; no voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:16.465816 26048 raft_consensus.cc:2749] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:16.472319 26042 tablet_bootstrap.cc:654] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.473989 26078 leader_election.cc:290] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.475003 25925 raft_consensus.cc:2468] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:16.473502 25814 leader_election.cc:304] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:16.476754 25817 leader_election.cc:304] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.477833 26079 raft_consensus.cc:2749] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:16.478525 26079 raft_consensus.cc:2804] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.478333 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "267814db287341c595a273268b614c45" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:16.479388 25998 raft_consensus.cc:3060] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.480358 26079 raft_consensus.cc:697] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:16.484052 26079 consensus_queue.cc:237] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.489516 26000 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:16.491313 25889 leader_election.cc:304] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:16.492110 25998 raft_consensus.cc:2468] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:16.492583 26076 raft_consensus.cc:2804] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.493076 26076 raft_consensus.cc:697] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:16.493722 26040 tablet_bootstrap.cc:492] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.494267 26040 ts_tablet_manager.cc:1403] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.095s	user 0.024s	sys 0.015s
I20260709 13:08:16.493877 26076 consensus_queue.cc:237] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:16.496639 26042 tablet_bootstrap.cc:492] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.497313 26042 ts_tablet_manager.cc:1403] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.007s
I20260709 13:08:16.497610 26040 raft_consensus.cc:359] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.491287 26041 tablet_bootstrap.cc:492] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.498405 26040 raft_consensus.cc:385] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.498751 26040 raft_consensus.cc:740] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.499728 26040 consensus_queue.cc:260] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.500242 26042 raft_consensus.cc:359] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.501019 26042 raft_consensus.cc:385] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.501297 26042 raft_consensus.cc:740] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.502377 26040 ts_tablet_manager.cc:1434] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:08:16.502138 26042 consensus_queue.cc:260] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.503412 26040 tablet_bootstrap.cc:492] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:16.504892 26042 ts_tablet_manager.cc:1434] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:16.504606 25748 catalog_manager.cc:5697] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 0 to 1, leader changed from <none> to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.505937 26042 tablet_bootstrap.cc:492] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:16.498787 26041 ts_tablet_manager.cc:1403] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.085s	user 0.017s	sys 0.008s
I20260709 13:08:16.509001 26041 raft_consensus.cc:359] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.509634 26041 raft_consensus.cc:385] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.509896 26041 raft_consensus.cc:740] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.512573 26040 tablet_bootstrap.cc:654] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.513002 26042 tablet_bootstrap.cc:654] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.517946 25746 catalog_manager.cc:5697] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.521476 26041 consensus_queue.cc:260] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.527243 26042 tablet_bootstrap.cc:492] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.527829 26042 ts_tablet_manager.cc:1403] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.008s
I20260709 13:08:16.530511 26042 raft_consensus.cc:359] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.531243 26042 raft_consensus.cc:385] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.531554 26042 raft_consensus.cc:740] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.531898 26041 ts_tablet_manager.cc:1434] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:08:16.532413 26042 consensus_queue.cc:260] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.534677 26042 ts_tablet_manager.cc:1434] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:16.535652 26042 tablet_bootstrap.cc:492] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:16.536401 26041 tablet_bootstrap.cc:492] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:16.541942 26042 tablet_bootstrap.cc:654] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.542640 26079 raft_consensus.cc:493] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.543210 26079 raft_consensus.cc:515] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.543948 26041 tablet_bootstrap.cc:654] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.544792 26040 tablet_bootstrap.cc:492] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.545310 26040 ts_tablet_manager.cc:1403] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.008s
I20260709 13:08:16.545411 26079 leader_election.cc:290] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.546537 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.546983 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.547708 25925 raft_consensus.cc:2468] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
W20260709 13:08:16.548094 25814 leader_election.cc:343] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.549355 25817 leader_election.cc:304] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 30b7e0e4c8eb42a19bd1d057b5fb8760
I20260709 13:08:16.550325 26040 raft_consensus.cc:359] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.550879 26040 raft_consensus.cc:385] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.551151 26040 raft_consensus.cc:740] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.551013 26079 raft_consensus.cc:2804] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.551815 26079 raft_consensus.cc:493] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.552042 26040 consensus_queue.cc:260] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.552304 26079 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.557268 26040 ts_tablet_manager.cc:1434] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:08:16.558255 26040 tablet_bootstrap.cc:492] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:16.565129 26079 raft_consensus.cc:515] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.568305 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:16.568895 25925 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.572139 26040 tablet_bootstrap.cc:654] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.577454 26041 tablet_bootstrap.cc:492] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:16.577975 26041 ts_tablet_manager.cc:1403] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.011s
I20260709 13:08:16.578184 26042 tablet_bootstrap.cc:492] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:16.578343 25925 raft_consensus.cc:2468] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:16.578734 26042 ts_tablet_manager.cc:1403] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.012s
I20260709 13:08:16.580911 26041 raft_consensus.cc:359] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.581316 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:16.581730 26041 raft_consensus.cc:385] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.582104 26041 raft_consensus.cc:740] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.583060 26042 raft_consensus.cc:359] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.582945 26041 consensus_queue.cc:260] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.583014 25817 leader_election.cc:304] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.584700 26078 raft_consensus.cc:2804] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.583822 26042 raft_consensus.cc:385] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.585130 26078 raft_consensus.cc:697] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:16.585327 26042 raft_consensus.cc:740] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.586024 26078 consensus_queue.cc:237] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.586165 26042 consensus_queue.cc:260] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.588148 26041 ts_tablet_manager.cc:1434] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:08:16.588403 26042 ts_tablet_manager.cc:1434] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:16.590180 26040 tablet_bootstrap.cc:492] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:16.590660 26040 ts_tablet_manager.cc:1403] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.008s
W20260709 13:08:16.590979 25814 leader_election.cc:343] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:16.592545 26079 leader_election.cc:290] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.593928 26040 raft_consensus.cc:359] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.595003 26040 raft_consensus.cc:385] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.595425 26040 raft_consensus.cc:740] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.596266 26040 consensus_queue.cc:260] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.598600 26040 ts_tablet_manager.cc:1434] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:08:16.604270 25748 catalog_manager.cc:5697] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.616544 26048 raft_consensus.cc:493] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.617063 26048 raft_consensus.cc:515] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.618850 26048 leader_election.cc:290] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.619690 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.619865 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.620548 25925 raft_consensus.cc:2393] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in current term 1: Already voted for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in this term.
I20260709 13:08:16.621470 25966 leader_election.cc:304] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760; no voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:16.622107 26048 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.627384 26048 raft_consensus.cc:2749] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:16.651541 26048 consensus_queue.cc:1048] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.652784 26061 consensus_queue.cc:1048] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.675668 26076 raft_consensus.cc:493] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.676209 26076 raft_consensus.cc:515] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.678726 26076 leader_election.cc:290] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.679414 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.680183 25998 raft_consensus.cc:2468] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:16.680382 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.681062 25850 raft_consensus.cc:2468] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:16.681185 25889 leader_election.cc:304] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.682097 26076 raft_consensus.cc:2804] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.682353 26076 raft_consensus.cc:493] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.682569 26076 raft_consensus.cc:3060] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.687302 26076 raft_consensus.cc:515] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.688860 26076 leader_election.cc:290] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.689779 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:16.689962 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:16.690471 25850 raft_consensus.cc:3060] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.690622 25998 raft_consensus.cc:3060] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.695839 25998 raft_consensus.cc:2468] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:16.696131 25850 raft_consensus.cc:2468] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:16.696965 25889 leader_election.cc:304] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.697786 26076 raft_consensus.cc:2804] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.698287 26076 raft_consensus.cc:697] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:16.699144 26076 consensus_queue.cc:237] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.699508 26048 consensus_queue.cc:1048] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.711659 26061 consensus_queue.cc:1048] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.712330 25748 catalog_manager.cc:5697] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 0 to 1, leader changed from <none> to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.850039 26076 raft_consensus.cc:493] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.850685 26076 raft_consensus.cc:515] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.852790 26076 leader_election.cc:290] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.853629 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d74ab418f4845b250ba7e9358087a" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.854059 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d74ab418f4845b250ba7e9358087a" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:16.854405 25851 raft_consensus.cc:2468] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:16.854842 25998 raft_consensus.cc:2468] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:16.855522 25890 leader_election.cc:304] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.856470 26076 raft_consensus.cc:2804] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:16.856794 26076 raft_consensus.cc:493] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.857075 26076 raft_consensus.cc:3060] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.863356 26076 raft_consensus.cc:515] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.864312 26061 consensus_queue.cc:1048] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.865470 26076 leader_election.cc:290] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:16.866740 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d74ab418f4845b250ba7e9358087a" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:16.867376 25998 raft_consensus.cc:3060] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.867776 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a20d74ab418f4845b250ba7e9358087a" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:16.868525 25850 raft_consensus.cc:3060] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.876361 25998 raft_consensus.cc:2468] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:16.878178 25889 leader_election.cc:304] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:16.878456 26061 consensus_queue.cc:1048] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.882109 25850 raft_consensus.cc:2468] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:16.882493 26078 consensus_queue.cc:1048] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:16.886623 26047 raft_consensus.cc:2804] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:16.887347 26047 raft_consensus.cc:697] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:16.888716 26047 consensus_queue.cc:237] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.892779 26061 raft_consensus.cc:493] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.893603 26061 raft_consensus.cc:515] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:16.896449 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:16.896785 26061 leader_election.cc:290] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:16.900115 26046 consensus_queue.cc:1048] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.903714 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:16.904789 25925 raft_consensus.cc:2393] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in current term 1: Already voted for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in this term.
I20260709 13:08:16.908965 25966 leader_election.cc:304] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760; no voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:16.911914 26061 raft_consensus.cc:3060] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:16.919394 26061 raft_consensus.cc:2749] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:16.925590 25746 catalog_manager.cc:5697] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 0 to 1, leader changed from <none> to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.941596 26078 consensus_queue.cc:1048] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:16.952965 26078 consensus_queue.cc:1048] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.009708 26078 consensus_queue.cc:1048] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.022020 26078 consensus_queue.cc:1048] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.067404 26047 consensus_queue.cc:1048] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.078680 26076 consensus_queue.cc:1048] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.209539 25925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
mode: GRACEFUL
new_leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:34172
I20260709 13:08:17.210069 25925 raft_consensus.cc:606] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Received request to transfer leadership to TS 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:17.226714 25998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
mode: GRACEFUL
new_leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:54772
I20260709 13:08:17.226714 26076 consensus_queue.cc:1048] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:17.227514 25998 raft_consensus.cc:606] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Received request to transfer leadership to TS 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:17.234858 25998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
mode: GRACEFUL
new_leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:54772
I20260709 13:08:17.235528 25998 raft_consensus.cc:606] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Received request to transfer leadership to TS 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:17.243014 26047 consensus_queue.cc:1048] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.245409 25998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
mode: GRACEFUL
new_leader_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:54772
I20260709 13:08:17.246305 25998 raft_consensus.cc:606] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Received request to transfer leadership to TS adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:17.268903 25851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:47922
I20260709 13:08:17.269441 25851 raft_consensus.cc:606] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Received request to transfer leadership to TS adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:17.274991 25851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:47922
I20260709 13:08:17.275663 25851 raft_consensus.cc:606] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Received request to transfer leadership to TS adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:17.280669 25925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
mode: GRACEFUL
new_leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:34172
I20260709 13:08:17.281196 25925 raft_consensus.cc:606] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Received request to transfer leadership to TS 30b7e0e4c8eb42a19bd1d057b5fb8760
I20260709 13:08:17.289057 26060 raft_consensus.cc:993] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: : Instructing follower 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:17.289165 26063 raft_consensus.cc:993] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760: : Instructing follower 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:17.289582 26048 raft_consensus.cc:1081] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Signalling peer 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:17.289824 26060 raft_consensus.cc:1081] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Signalling peer 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:17.291311 25850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:47914
I20260709 13:08:17.291586 25851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:47914
I20260709 13:08:17.291859 25850 raft_consensus.cc:493] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.292191 25851 raft_consensus.cc:493] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.292369 25850 raft_consensus.cc:3060] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.292613 25851 raft_consensus.cc:3060] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.297562 25851 raft_consensus.cc:515] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.297660 25850 raft_consensus.cc:515] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.299530 25850 leader_election.cc:290] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:17.299490 25851 leader_election.cc:290] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:17.300776 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:17.300678 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:17.301486 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "813bc21ce0d040f8b611f5503dca8c80" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:17.301927 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3df05b17d4241999f34a272680d44cb" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:17.301436 26000 raft_consensus.cc:3055] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.301465 25926 raft_consensus.cc:3060] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.302675 25925 raft_consensus.cc:3060] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.302640 26000 raft_consensus.cc:740] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:17.302314 25998 raft_consensus.cc:3055] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.303332 25998 raft_consensus.cc:740] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:17.303778 26000 consensus_queue.cc:260] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.304122 25998 consensus_queue.cc:260] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.305150 26000 raft_consensus.cc:3060] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.305460 25998 raft_consensus.cc:3060] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.309759 25926 raft_consensus.cc:2468] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:17.310153 25925 raft_consensus.cc:2468] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:17.312803 26000 raft_consensus.cc:2468] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:17.312260 25998 raft_consensus.cc:2468] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:17.311314 25817 leader_election.cc:304] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:17.315073 25814 leader_election.cc:304] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:17.315305 26078 raft_consensus.cc:2804] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.315868 26078 raft_consensus.cc:697] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:17.315927 26079 raft_consensus.cc:2804] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.316764 26079 raft_consensus.cc:697] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:17.316828 26078 consensus_queue.cc:237] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.317669 26079 consensus_queue.cc:237] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.325752 25748 catalog_manager.cc:5697] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 1 to 2, leader changed from 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3) to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.327263 25748 catalog_manager.cc:5697] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 1 to 2, leader changed from 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3) to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.353274 26078 raft_consensus.cc:993] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:17.353832 26079 raft_consensus.cc:1081] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Signalling peer adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:17.355415 25925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:34162
I20260709 13:08:17.355899 25925 raft_consensus.cc:493] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.356196 25925 raft_consensus.cc:3060] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.361071 25925 raft_consensus.cc:515] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.362808 25925 leader_election.cc:290] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:17.363791 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:17.363890 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637d9b67922945ccb252127e696ad2cf" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:17.364497 25851 raft_consensus.cc:3055] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.364519 25998 raft_consensus.cc:3060] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.364977 25851 raft_consensus.cc:740] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:17.365789 25851 consensus_queue.cc:260] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.366829 25851 raft_consensus.cc:3060] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.369997 25998 raft_consensus.cc:2468] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:17.371275 25889 leader_election.cc:304] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:17.372226 26047 raft_consensus.cc:2804] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.372721 26047 raft_consensus.cc:697] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:17.372836 25851 raft_consensus.cc:2468] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:17.373631 26047 consensus_queue.cc:237] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.381145 25748 catalog_manager.cc:5697] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 1 to 2, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.447968 26078 raft_consensus.cc:993] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:17.448487 26078 raft_consensus.cc:1081] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Signalling peer adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:17.450169 25925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:34162
I20260709 13:08:17.450747 25925 raft_consensus.cc:493] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.451157 25925 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.452587 26047 consensus_queue.cc:1048] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.457788 25925 raft_consensus.cc:515] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.460388 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:17.460979 25851 raft_consensus.cc:3055] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.461305 25851 raft_consensus.cc:740] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:17.462093 25851 consensus_queue.cc:260] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.463220 25851 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.463908 25925 leader_election.cc:290] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:17.468087 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:17.470791 25851 raft_consensus.cc:2468] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:17.471457 26047 consensus_queue.cc:1048] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:17.471998 25890 leader_election.cc:304] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:17.473081 26105 raft_consensus.cc:2804] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.468792 25998 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.473803 26105 raft_consensus.cc:697] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:17.474751 26105 consensus_queue.cc:237] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.481766 25998 raft_consensus.cc:2468] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:17.484812 25748 catalog_manager.cc:5697] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 1 to 2, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.494488 26063 raft_consensus.cc:993] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760: : Instructing follower adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:17.495015 26060 raft_consensus.cc:1081] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Signalling peer adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:17.497323 25925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:34160
I20260709 13:08:17.497886 25925 raft_consensus.cc:493] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.498224 25925 raft_consensus.cc:3060] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.503312 25925 raft_consensus.cc:515] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.504968 25925 leader_election.cc:290] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:17.505851 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:17.506078 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2812843fcd4547a3a9438614a27c8f48" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:17.506482 25851 raft_consensus.cc:3060] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.506696 25998 raft_consensus.cc:3055] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.507081 25998 raft_consensus.cc:740] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:17.507750 25998 consensus_queue.cc:260] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.508692 25998 raft_consensus.cc:3060] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.516860 25851 raft_consensus.cc:2468] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:17.518086 25890 leader_election.cc:304] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:17.518560 25998 raft_consensus.cc:2468] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:17.518958 26047 raft_consensus.cc:2804] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.519580 26047 raft_consensus.cc:697] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:17.520323 26047 consensus_queue.cc:237] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.527231 25746 catalog_manager.cc:5697] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 1 to 2, leader changed from 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3) to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.663578 26105 raft_consensus.cc:993] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11: : Instructing follower 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:17.664191 26047 raft_consensus.cc:1081] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Signalling peer 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:17.665771 25851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:47918
I20260709 13:08:17.666262 25851 raft_consensus.cc:493] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.666596 25851 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.671703 25851 raft_consensus.cc:515] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:17.673241 25851 leader_election.cc:290] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Requested vote from peers 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:17.674165 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:17.674494 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:17.674755 25998 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.675101 25925 raft_consensus.cc:3055] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.675494 25925 raft_consensus.cc:740] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:17.676182 25925 consensus_queue.cc:260] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:17.677111 25925 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.680429 25998 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:17.681583 25814 leader_election.cc:304] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:17.681831 25925 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:17.682331 26078 raft_consensus.cc:2804] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.682806 26078 raft_consensus.cc:697] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:17.683569 26078 consensus_queue.cc:237] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:17.690124 25746 catalog_manager.cc:5697] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 1 to 2, leader changed from adca8255c5db4b8d985905e1b4763a11 (127.13.181.2) to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.748879 26105 raft_consensus.cc:993] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11: : Instructing follower 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:17.749387 26047 raft_consensus.cc:1081] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Signalling peer 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:17.750953 25998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54768
I20260709 13:08:17.751502 25998 raft_consensus.cc:493] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.751893 25998 raft_consensus.cc:3060] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.757215 25998 raft_consensus.cc:515] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.758970 25998 leader_election.cc:290] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:17.759718 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:17.760006 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9538861166364b80b5975791dd4e1eb5" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:17.760370 25851 raft_consensus.cc:3060] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.760633 25925 raft_consensus.cc:3055] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.761010 25925 raft_consensus.cc:740] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:17.761785 25925 consensus_queue.cc:260] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.763142 25925 raft_consensus.cc:3060] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.763716 25998 raft_consensus.cc:1275] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.765189 26078 consensus_queue.cc:1048] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.766928 25851 raft_consensus.cc:2468] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 2.
I20260709 13:08:17.768225 25964 leader_election.cc:304] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:17.769373 26060 raft_consensus.cc:2804] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.770059 26060 raft_consensus.cc:697] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:17.770619 25925 raft_consensus.cc:2468] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 2.
I20260709 13:08:17.771219 26060 consensus_queue.cc:237] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:17.777240 25925 raft_consensus.cc:1275] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.778815 26079 consensus_queue.cc:1048] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.787555 25747 catalog_manager.cc:5697] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 1 to 2, leader changed from adca8255c5db4b8d985905e1b4763a11 (127.13.181.2) to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.796909 25925 raft_consensus.cc:1275] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.798599 26046 consensus_queue.cc:1048] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.809589 25998 raft_consensus.cc:1275] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.811506 26046 consensus_queue.cc:1048] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.855549 25998 raft_consensus.cc:1275] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.856668 26047 consensus_queue.cc:1048] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.865155 25851 raft_consensus.cc:1275] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.868556 26076 consensus_queue.cc:1048] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.964596 25998 raft_consensus.cc:1275] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.966099 26076 consensus_queue.cc:1048] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:17.974200 25851 raft_consensus.cc:1275] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:17.975721 26047 consensus_queue.cc:1048] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.008625 25851 raft_consensus.cc:1275] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.010037 26047 consensus_queue.cc:1048] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.013980 25998 raft_consensus.cc:1275] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.015568 26047 consensus_queue.cc:1048] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.082504 25925 raft_consensus.cc:1275] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.083849 26046 consensus_queue.cc:1048] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.093602 25998 raft_consensus.cc:1275] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.094914 26046 consensus_queue.cc:1048] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.316821 25851 raft_consensus.cc:1275] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.318212 26060 consensus_queue.cc:1048] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.328975 25925 raft_consensus.cc:1275] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.343443 26060 consensus_queue.cc:1048] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.310362 25746 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56252:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:20.312558 25746 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:20.364928 25841 tablet_service.cc:1511] Processing CreateTablet for tablet cee0d2d57b3f4777b6d6f7d3814d3c6d (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:20.365542 25913 tablet_service.cc:1511] Processing CreateTablet for tablet cee0d2d57b3f4777b6d6f7d3814d3c6d (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:20.366217 25841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee0d2d57b3f4777b6d6f7d3814d3c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.366815 25913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee0d2d57b3f4777b6d6f7d3814d3c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.367877 25989 tablet_service.cc:1511] Processing CreateTablet for tablet cee0d2d57b3f4777b6d6f7d3814d3c6d (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:20.369102 25989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cee0d2d57b3f4777b6d6f7d3814d3c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.372586 25836 tablet_service.cc:1511] Processing CreateTablet for tablet 39983baa41d549c98a89454b8f09676f (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:20.373977 25836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39983baa41d549c98a89454b8f09676f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.376521 25910 tablet_service.cc:1511] Processing CreateTablet for tablet 39983baa41d549c98a89454b8f09676f (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:20.377840 25910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39983baa41d549c98a89454b8f09676f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.378423 25987 tablet_service.cc:1511] Processing CreateTablet for tablet 39983baa41d549c98a89454b8f09676f (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:20.380044 25987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39983baa41d549c98a89454b8f09676f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.383411 25840 tablet_service.cc:1511] Processing CreateTablet for tablet 9c89b3847b164bf785b1993781a3dc80 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:20.385253 25840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c89b3847b164bf785b1993781a3dc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.391072 25911 tablet_service.cc:1511] Processing CreateTablet for tablet 9c89b3847b164bf785b1993781a3dc80 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:20.392410 25911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c89b3847b164bf785b1993781a3dc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.395538 25986 tablet_service.cc:1511] Processing CreateTablet for tablet 9c89b3847b164bf785b1993781a3dc80 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:20.396862 25986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c89b3847b164bf785b1993781a3dc80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.397763 25837 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca08b2eb0484172a2f621cc121f07d9 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:20.399020 25837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca08b2eb0484172a2f621cc121f07d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.418560 25915 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca08b2eb0484172a2f621cc121f07d9 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:20.420009 25915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca08b2eb0484172a2f621cc121f07d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.422940 25990 tablet_service.cc:1511] Processing CreateTablet for tablet 1ca08b2eb0484172a2f621cc121f07d9 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:20.425514 25990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ca08b2eb0484172a2f621cc121f07d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.427910 25916 tablet_service.cc:1511] Processing CreateTablet for tablet a9653a2aff9f4f94a3febefb27bcfd99 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:20.429198 25916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9653a2aff9f4f94a3febefb27bcfd99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.428969 25988 tablet_service.cc:1511] Processing CreateTablet for tablet a9653a2aff9f4f94a3febefb27bcfd99 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:20.430287 25988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9653a2aff9f4f94a3febefb27bcfd99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.431180 25838 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7fcaae59cc450d80b16672fd143d79 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:20.432463 25838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7fcaae59cc450d80b16672fd143d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.433264 25912 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7fcaae59cc450d80b16672fd143d79 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:20.434552 25912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7fcaae59cc450d80b16672fd143d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.439303 25839 tablet_service.cc:1511] Processing CreateTablet for tablet a9653a2aff9f4f94a3febefb27bcfd99 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:20.440653 25839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9653a2aff9f4f94a3febefb27bcfd99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.451649 25985 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7fcaae59cc450d80b16672fd143d79 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:20.453127 25985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7fcaae59cc450d80b16672fd143d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.454599 25837 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9c339904d04c9e81f95a74ca2c28d3 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:20.467141 25914 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9c339904d04c9e81f95a74ca2c28d3 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:20.468564 25914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9c339904d04c9e81f95a74ca2c28d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.472735 26150 tablet_bootstrap.cc:492] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:20.474511 25841 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5e76c4c4694445863acc532f0d6584 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:20.479221 25913 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5e76c4c4694445863acc532f0d6584 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:20.481249 25837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9c339904d04c9e81f95a74ca2c28d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.503465 25841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5e76c4c4694445863acc532f0d6584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.503502 25913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5e76c4c4694445863acc532f0d6584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.484692 25988 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5e76c4c4694445863acc532f0d6584 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:20.511837 25988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5e76c4c4694445863acc532f0d6584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.489718 25835 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9859da43a240fc8865bd1292ebcab8 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:20.515616 25835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9859da43a240fc8865bd1292ebcab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.516245 26148 tablet_bootstrap.cc:492] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.489969 25989 tablet_service.cc:1511] Processing CreateTablet for tablet 2b9c339904d04c9e81f95a74ca2c28d3 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:20.520675 25989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b9c339904d04c9e81f95a74ca2c28d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.525344 26148 tablet_bootstrap.cc:654] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.493613 25986 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9859da43a240fc8865bd1292ebcab8 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:20.492455 25911 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9859da43a240fc8865bd1292ebcab8 (DEFAULT_TABLE table=soft_deleted_table [id=a07d9181e71b42aa957a28addc865168]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:20.526759 25986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9859da43a240fc8865bd1292ebcab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.526806 25911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9859da43a240fc8865bd1292ebcab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:20.549117 26150 tablet_bootstrap.cc:654] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.566255 26151 tablet_bootstrap.cc:492] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:20.569028 26148 tablet_bootstrap.cc:492] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.569674 26148 ts_tablet_manager.cc:1403] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.030s
I20260709 13:08:20.572836 26148 raft_consensus.cc:359] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.573590 26148 raft_consensus.cc:385] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.573933 26148 raft_consensus.cc:740] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.574867 26148 consensus_queue.cc:260] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.577306 26148 ts_tablet_manager.cc:1434] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:08:20.578557 26148 tablet_bootstrap.cc:492] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.583333 26151 tablet_bootstrap.cc:654] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.585821 26148 tablet_bootstrap.cc:654] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.586223 26150 tablet_bootstrap.cc:492] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:20.586874 26150 ts_tablet_manager.cc:1403] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.114s	user 0.008s	sys 0.005s
I20260709 13:08:20.594539 26150 raft_consensus.cc:359] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.595714 26150 raft_consensus.cc:385] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.596131 26150 raft_consensus.cc:740] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.597185 26150 consensus_queue.cc:260] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.599936 26148 tablet_bootstrap.cc:492] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.600112 26151 tablet_bootstrap.cc:492] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:20.600189 26150 ts_tablet_manager.cc:1434] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:08:20.600569 26148 ts_tablet_manager.cc:1403] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.003s
I20260709 13:08:20.600943 26151 ts_tablet_manager.cc:1403] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.007s
I20260709 13:08:20.601748 26150 tablet_bootstrap.cc:492] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:20.603813 26148 raft_consensus.cc:359] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.604537 26148 raft_consensus.cc:385] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.604852 26148 raft_consensus.cc:740] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.605571 26148 consensus_queue.cc:260] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.607550 26151 raft_consensus.cc:359] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.608471 26151 raft_consensus.cc:385] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.608795 26151 raft_consensus.cc:740] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.609597 26151 consensus_queue.cc:260] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.612048 26151 ts_tablet_manager.cc:1434] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:20.613154 26151 tablet_bootstrap.cc:492] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:20.620239 26151 tablet_bootstrap.cc:654] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.632118 26150 tablet_bootstrap.cc:654] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.638849 26148 ts_tablet_manager.cc:1434] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.038s	user 0.029s	sys 0.007s
I20260709 13:08:20.640056 26148 tablet_bootstrap.cc:492] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.640743 26151 tablet_bootstrap.cc:492] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:20.641350 26151 ts_tablet_manager.cc:1403] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.012s
I20260709 13:08:20.641606 26150 tablet_bootstrap.cc:492] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:20.642196 26150 ts_tablet_manager.cc:1403] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 13:08:20.643241 26156 raft_consensus.cc:493] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.643836 26156 raft_consensus.cc:515] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.644600 26151 raft_consensus.cc:359] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.645401 26151 raft_consensus.cc:385] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.645735 26151 raft_consensus.cc:740] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.646862 26148 tablet_bootstrap.cc:654] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.647114 26151 consensus_queue.cc:260] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.649365 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:20.649571 26151 ts_tablet_manager.cc:1434] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:20.650151 25851 raft_consensus.cc:2468] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:20.650846 26151 tablet_bootstrap.cc:492] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:20.652173 25964 leader_election.cc:304] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:20.646917 26156 leader_election.cc:290] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:20.654212 26150 raft_consensus.cc:359] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.654830 26156 raft_consensus.cc:2804] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.654994 26150 raft_consensus.cc:385] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.655346 26156 raft_consensus.cc:493] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.655369 26150 raft_consensus.cc:740] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.655843 26156 raft_consensus.cc:3060] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.656332 26150 consensus_queue.cc:260] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.658686 26148 tablet_bootstrap.cc:492] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.659267 26148 ts_tablet_manager.cc:1403] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 13:08:20.662391 26148 raft_consensus.cc:359] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.662744 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:20.663327 26148 raft_consensus.cc:385] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.663669 26148 raft_consensus.cc:740] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.663759 25926 raft_consensus.cc:2468] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:20.664491 26148 consensus_queue.cc:260] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.666993 26148 ts_tablet_manager.cc:1434] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:08:20.667938 26148 tablet_bootstrap.cc:492] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.675482 26148 tablet_bootstrap.cc:654] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.675959 26156 raft_consensus.cc:515] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.678110 26156 leader_election.cc:290] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:20.679535 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:20.680450 25925 raft_consensus.cc:3060] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.687361 26148 tablet_bootstrap.cc:492] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.688128 26148 ts_tablet_manager.cc:1403] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 13:08:20.691989 26148 raft_consensus.cc:359] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.692951 26148 raft_consensus.cc:385] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.693327 26148 raft_consensus.cc:740] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.694249 26148 consensus_queue.cc:260] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.696265 25925 raft_consensus.cc:2468] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:20.697490 26148 ts_tablet_manager.cc:1434] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:20.697657 25966 leader_election.cc:304] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
W20260709 13:08:20.699404 25964 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.181.1:36857, user_credentials={real_user=slave}} blocked reactor thread for 47368.2us
I20260709 13:08:20.662937 26151 tablet_bootstrap.cc:654] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.701663 26150 ts_tablet_manager.cc:1434] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.059s	user 0.014s	sys 0.018s
I20260709 13:08:20.702508 26148 tablet_bootstrap.cc:492] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.703790 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:20.704365 25851 raft_consensus.cc:3060] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.705591 26150 tablet_bootstrap.cc:492] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:20.710038 26148 tablet_bootstrap.cc:654] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.713116 26150 tablet_bootstrap.cc:654] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.699913 26160 raft_consensus.cc:2804] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.714725 26160 raft_consensus.cc:697] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:20.716531 26160 consensus_queue.cc:237] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.718389 25851 raft_consensus.cc:2468] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:20.724681 26151 tablet_bootstrap.cc:492] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:20.725694 26151 ts_tablet_manager.cc:1403] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.004s
I20260709 13:08:20.739795 26151 raft_consensus.cc:359] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.741186 25745 catalog_manager.cc:5697] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.742219 26151 raft_consensus.cc:385] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.742764 26151 raft_consensus.cc:740] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.743808 26151 consensus_queue.cc:260] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.744534 26150 tablet_bootstrap.cc:492] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:20.744796 26148 tablet_bootstrap.cc:492] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.745086 26150 ts_tablet_manager.cc:1403] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.013s
I20260709 13:08:20.745350 26148 ts_tablet_manager.cc:1403] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.027s
I20260709 13:08:20.748313 26150 raft_consensus.cc:359] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.749075 26148 raft_consensus.cc:359] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.749531 26151 ts_tablet_manager.cc:1434] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:08:20.749826 26148 raft_consensus.cc:385] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.750177 26148 raft_consensus.cc:740] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.750885 26151 tablet_bootstrap.cc:492] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:20.749110 26150 raft_consensus.cc:385] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.751468 26150 raft_consensus.cc:740] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.752228 26150 consensus_queue.cc:260] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.752511 26148 consensus_queue.cc:260] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.754587 26150 ts_tablet_manager.cc:1434] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:20.755163 26148 ts_tablet_manager.cc:1434] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:08:20.756214 26150 tablet_bootstrap.cc:492] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:20.761492 26151 tablet_bootstrap.cc:654] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.757136 26148 tablet_bootstrap.cc:492] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.764945 26150 tablet_bootstrap.cc:654] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.774427 26148 tablet_bootstrap.cc:654] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.782763 26148 tablet_bootstrap.cc:492] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.782783 26151 tablet_bootstrap.cc:492] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:20.782900 26150 tablet_bootstrap.cc:492] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:20.783695 26151 ts_tablet_manager.cc:1403] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.019s
I20260709 13:08:20.783689 26148 ts_tablet_manager.cc:1403] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 13:08:20.783926 26150 ts_tablet_manager.cc:1403] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.013s
I20260709 13:08:20.787158 26151 raft_consensus.cc:359] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.787266 26148 raft_consensus.cc:359] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.788153 26151 raft_consensus.cc:385] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.787901 26150 raft_consensus.cc:359] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.788269 26148 raft_consensus.cc:385] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.788590 26151 raft_consensus.cc:740] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.788735 26150 raft_consensus.cc:385] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.788811 26148 raft_consensus.cc:740] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.789136 26150 raft_consensus.cc:740] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.789474 26151 consensus_queue.cc:260] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.789858 26148 consensus_queue.cc:260] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.790206 26150 consensus_queue.cc:260] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.792730 26148 ts_tablet_manager.cc:1434] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:20.792935 26150 ts_tablet_manager.cc:1434] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:08:20.793928 26148 tablet_bootstrap.cc:492] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.794005 26150 tablet_bootstrap.cc:492] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:20.795744 26151 ts_tablet_manager.cc:1434] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:08:20.801297 26150 tablet_bootstrap.cc:654] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.803341 26148 tablet_bootstrap.cc:654] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.808275 26151 tablet_bootstrap.cc:492] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:20.817096 26151 tablet_bootstrap.cc:654] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.817636 26150 tablet_bootstrap.cc:492] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:20.818192 26150 ts_tablet_manager.cc:1403] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.024s	user 0.000s	sys 0.017s
I20260709 13:08:20.821803 26161 raft_consensus.cc:493] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.822357 26161 raft_consensus.cc:515] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.824424 26148 tablet_bootstrap.cc:492] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.824625 26161 leader_election.cc:290] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:20.825145 26148 ts_tablet_manager.cc:1403] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.011s
I20260709 13:08:20.821501 26150 raft_consensus.cc:359] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.826014 26150 raft_consensus.cc:385] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.826159 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:20.826522 26150 raft_consensus.cc:740] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.827648 26150 consensus_queue.cc:260] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.828702 26148 raft_consensus.cc:359] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.829468 26148 raft_consensus.cc:385] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.829721 26148 raft_consensus.cc:740] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
W20260709 13:08:20.828153 25817 leader_election.cc:343] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.829706 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:20.830760 26148 consensus_queue.cc:260] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.832244 26000 raft_consensus.cc:2468] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:20.832909 26150 ts_tablet_manager.cc:1434] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:08:20.833145 26148 ts_tablet_manager.cc:1434] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:20.834210 26148 tablet_bootstrap.cc:492] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.834565 26150 tablet_bootstrap.cc:492] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:20.839908 25814 leader_election.cc:304] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:20.841023 26148 tablet_bootstrap.cc:654] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.841508 26161 raft_consensus.cc:2804] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.842099 26161 raft_consensus.cc:493] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.842555 26161 raft_consensus.cc:3060] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.843894 26150 tablet_bootstrap.cc:654] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.855199 26160 raft_consensus.cc:493] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.856060 26160 raft_consensus.cc:515] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.858886 26105 raft_consensus.cc:493] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.859575 26105 raft_consensus.cc:515] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.861902 26105 leader_election.cc:290] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:20.862113 26160 leader_election.cc:290] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:20.863915 26150 tablet_bootstrap.cc:492] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:20.864655 26150 ts_tablet_manager.cc:1403] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.002s
I20260709 13:08:20.865706 26148 tablet_bootstrap.cc:492] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:20.865512 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:20.866492 26148 ts_tablet_manager.cc:1403] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.008s
I20260709 13:08:20.866791 25925 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:20.868446 26150 raft_consensus.cc:359] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.868603 25966 leader_election.cc:304] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:20.869311 26150 raft_consensus.cc:385] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.869354 26148 raft_consensus.cc:359] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.869887 26150 raft_consensus.cc:740] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.864362 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:20.870162 26148 raft_consensus.cc:385] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.870572 26148 raft_consensus.cc:740] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.870776 25850 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 0.
I20260709 13:08:20.871048 26150 consensus_queue.cc:260] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.871330 26148 consensus_queue.cc:260] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.872328 26156 raft_consensus.cc:2804] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.872725 26156 raft_consensus.cc:493] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.872527 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:20.873238 26156 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.873626 25851 raft_consensus.cc:2468] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:20.873917 26150 ts_tablet_manager.cc:1434] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:20.875195 26150 tablet_bootstrap.cc:492] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:20.875495 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:20.876282 26000 raft_consensus.cc:2468] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:20.877784 25889 leader_election.cc:304] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:20.878602 26105 raft_consensus.cc:2804] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.878968 26105 raft_consensus.cc:493] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.879338 26105 raft_consensus.cc:3060] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.885221 26150 tablet_bootstrap.cc:654] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.890053 26156 raft_consensus.cc:515] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.896157 26148 ts_tablet_manager.cc:1434] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.004s
I20260709 13:08:20.897605 26148 tablet_bootstrap.cc:492] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Bootstrap starting.
I20260709 13:08:20.893443 26105 raft_consensus.cc:515] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.900032 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:20.901033 25851 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.902271 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:20.903177 25850 raft_consensus.cc:3060] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.911849 26105 leader_election.cc:290] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:20.913743 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:20.917200 26000 raft_consensus.cc:3060] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.913767 26156 leader_election.cc:290] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:20.916393 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:20.920094 25925 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.929455 26105 raft_consensus.cc:493] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.930267 26105 raft_consensus.cc:515] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.935263 25849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:20.936350 25849 raft_consensus.cc:2468] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:20.938064 25890 leader_election.cc:304] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:20.939905 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:20.940678 25998 raft_consensus.cc:2468] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:20.947468 26105 leader_election.cc:290] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:20.947484 26170 raft_consensus.cc:2804] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:20.948776 26170 raft_consensus.cc:493] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.949213 26170 raft_consensus.cc:3060] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.954190 26156 raft_consensus.cc:493] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.936486 25850 raft_consensus.cc:2468] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:20.889832 26161 raft_consensus.cc:515] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.954540 26000 raft_consensus.cc:2468] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:20.965523 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:20.965909 26148 tablet_bootstrap.cc:654] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:20.966163 25998 raft_consensus.cc:3060] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:20.954761 26156 raft_consensus.cc:515] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.967783 26151 tablet_bootstrap.cc:492] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:20.968317 26151 ts_tablet_manager.cc:1403] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.160s	user 0.053s	sys 0.077s
I20260709 13:08:20.968797 26156 leader_election.cc:290] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:20.958702 25925 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:20.972289 26151 raft_consensus.cc:359] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.972997 26151 raft_consensus.cc:385] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:20.973271 26151 raft_consensus.cc:740] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:20.973925 26151 consensus_queue.cc:260] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.976157 26151 ts_tablet_manager.cc:1434] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:20.976805 25998 raft_consensus.cc:2468] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:20.961905 25890 leader_election.cc:304] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:20.977617 26151 tablet_bootstrap.cc:492] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:20.978318 26177 raft_consensus.cc:2804] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.979447 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:20.963446 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:20.980975 25966 leader_election.cc:304] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:20.964620 25851 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 1.
I20260709 13:08:20.984674 26156 raft_consensus.cc:2804] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.985232 26156 raft_consensus.cc:697] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:20.986061 26156 consensus_queue.cc:237] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.955539 26150 tablet_bootstrap.cc:492] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
W20260709 13:08:20.987654 25817 leader_election.cc:343] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:20.988091 26150 ts_tablet_manager.cc:1403] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.052s
I20260709 13:08:20.990851 25814 leader_election.cc:304] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:20.991767 26046 raft_consensus.cc:2804] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:20.976822 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:20.992261 26046 raft_consensus.cc:697] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:20.959457 26170 raft_consensus.cc:515] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.993181 26046 consensus_queue.cc:237] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:20.978809 26177 raft_consensus.cc:697] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:20.995456 26170 leader_election.cc:290] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:20.964120 26161 leader_election.cc:290] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:20.995965 26177 consensus_queue.cc:237] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.004719 26151 tablet_bootstrap.cc:654] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.007097 26149 raft_consensus.cc:493] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.007705 26149 raft_consensus.cc:515] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.008489 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.009083 25998 raft_consensus.cc:3060] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.010015 26149 leader_election.cc:290] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.012223 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:21.013008 25926 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:21.014379 25817 leader_election.cc:304] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
W20260709 13:08:21.015937 25964 leader_election.cc:343] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.016582 26150 raft_consensus.cc:359] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.017990 26150 raft_consensus.cc:385] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.018222 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:21.019201 26161 raft_consensus.cc:2804] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.022544 26150 raft_consensus.cc:740] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.022716 26000 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:21.023598 26161 raft_consensus.cc:493] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.026069 26161 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.026783 26150 consensus_queue.cc:260] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.030143 26150 ts_tablet_manager.cc:1434] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.000s
I20260709 13:08:21.031524 26150 tablet_bootstrap.cc:492] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:21.021836 25998 raft_consensus.cc:2468] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:21.034991 26161 raft_consensus.cc:515] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.035192 25889 leader_election.cc:304] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.025151 26148 tablet_bootstrap.cc:492] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760: No bootstrap required, opened a new log
I20260709 13:08:21.036813 26148 ts_tablet_manager.cc:1403] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent bootstrapping tablet: real 0.140s	user 0.023s	sys 0.003s
I20260709 13:08:21.037146 25748 catalog_manager.cc:5697] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:21.025321 25890 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.1:36857, user_credentials={real_user=slave}} blocked reactor thread for 46315.3us
I20260709 13:08:21.040293 26105 raft_consensus.cc:2804] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.040874 26105 raft_consensus.cc:697] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.041270 26161 leader_election.cc:290] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.041474 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:21.041117 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.042101 25850 raft_consensus.cc:3060] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.042167 25998 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:21.042785 25966 leader_election.cc:343] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:21.043308 25966 leader_election.cc:304] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760; no voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:21.043982 26156 raft_consensus.cc:2749] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.037868 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.046681 25926 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.041774 26105 consensus_queue.cc:237] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.033308 25745 catalog_manager.cc:5697] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 0 to 1, leader changed from <none> to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.053468 25850 raft_consensus.cc:2468] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:21.022591 25746 catalog_manager.cc:5697] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 0 to 1, leader changed from <none> to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.047293 26148 raft_consensus.cc:359] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.059242 26148 raft_consensus.cc:385] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.059623 26148 raft_consensus.cc:740] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.060477 26148 consensus_queue.cc:260] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.063784 25998 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:21.063902 25926 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:21.066555 25817 leader_election.cc:304] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.067780 26161 raft_consensus.cc:2804] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.068284 26161 raft_consensus.cc:697] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.069100 26161 consensus_queue.cc:237] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.070240 26148 ts_tablet_manager.cc:1434] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:08:21.072650 26150 tablet_bootstrap.cc:654] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.074833 26151 tablet_bootstrap.cc:492] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:21.075484 26151 ts_tablet_manager.cc:1403] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.031s
I20260709 13:08:21.078322 26151 raft_consensus.cc:359] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.079057 26151 raft_consensus.cc:385] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.079398 26151 raft_consensus.cc:740] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.080125 26151 consensus_queue.cc:260] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.082103 26151 ts_tablet_manager.cc:1434] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:21.090603 26151 tablet_bootstrap.cc:492] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:21.090513 25745 catalog_manager.cc:5697] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 0 to 1, leader changed from <none> to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.109648 26151 tablet_bootstrap.cc:654] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.117980 26151 tablet_bootstrap.cc:492] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:21.118078 26150 tablet_bootstrap.cc:492] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:21.118512 26151 ts_tablet_manager.cc:1403] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:08:21.118629 26150 ts_tablet_manager.cc:1403] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.024s
I20260709 13:08:21.119973 25746 catalog_manager.cc:5697] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.121016 26151 raft_consensus.cc:359] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.121694 26151 raft_consensus.cc:385] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.121507 26150 raft_consensus.cc:359] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.122025 26151 raft_consensus.cc:740] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.122242 26150 raft_consensus.cc:385] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.122605 26150 raft_consensus.cc:740] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.122833 26151 consensus_queue.cc:260] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.123302 26150 consensus_queue.cc:260] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.125288 26151 ts_tablet_manager.cc:1434] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:21.125684 26150 ts_tablet_manager.cc:1434] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:08:21.126602 26151 tablet_bootstrap.cc:492] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:21.127362 26150 tablet_bootstrap.cc:492] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: Bootstrap starting.
I20260709 13:08:21.133199 26151 tablet_bootstrap.cc:654] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.137310 26150 tablet_bootstrap.cc:654] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.138731 26151 tablet_bootstrap.cc:492] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:21.139216 26151 ts_tablet_manager.cc:1403] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 13:08:21.141633 26151 raft_consensus.cc:359] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.142151 26151 raft_consensus.cc:385] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.142375 26151 raft_consensus.cc:740] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.142853 26151 consensus_queue.cc:260] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.144100 26156 consensus_queue.cc:1048] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.146705 26151 ts_tablet_manager.cc:1434] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:21.147720 26151 tablet_bootstrap.cc:492] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: Bootstrap starting.
I20260709 13:08:21.151209 26150 tablet_bootstrap.cc:492] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: No bootstrap required, opened a new log
I20260709 13:08:21.151755 26150 ts_tablet_manager.cc:1403] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260709 13:08:21.152794 26151 tablet_bootstrap.cc:654] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:21.155278 26150 raft_consensus.cc:359] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.156076 26150 raft_consensus.cc:385] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.156327 26150 raft_consensus.cc:740] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.157634 26150 consensus_queue.cc:260] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.165097 26150 ts_tablet_manager.cc:1434] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:08:21.169723 26151 tablet_bootstrap.cc:492] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: No bootstrap required, opened a new log
I20260709 13:08:21.170348 26151 ts_tablet_manager.cc:1403] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.007s
I20260709 13:08:21.173393 26151 raft_consensus.cc:359] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.174165 26151 raft_consensus.cc:385] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:21.174531 26156 consensus_queue.cc:1048] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.174533 26151 raft_consensus.cc:740] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Initialized, Role: FOLLOWER
I20260709 13:08:21.176596 26151 consensus_queue.cc:260] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.178813 26151 ts_tablet_manager.cc:1434] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:08:21.183501 26105 raft_consensus.cc:493] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.184151 26105 raft_consensus.cc:515] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.189958 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:21.190860 25851 raft_consensus.cc:2468] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:21.193518 25890 leader_election.cc:304] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.194654 26179 raft_consensus.cc:2804] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.195079 26179 raft_consensus.cc:493] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.195444 26179 raft_consensus.cc:3060] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.196841 26105 leader_election.cc:290] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.199819 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:21.200660 25998 raft_consensus.cc:2468] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:21.203742 26179 raft_consensus.cc:515] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.206194 26179 leader_election.cc:290] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.206494 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:21.206736 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.206990 25850 raft_consensus.cc:3060] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.207366 25998 raft_consensus.cc:3060] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.211932 25998 raft_consensus.cc:2468] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:21.212152 25850 raft_consensus.cc:2468] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 1.
I20260709 13:08:21.213001 25889 leader_election.cc:304] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.213999 26105 raft_consensus.cc:2804] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.214488 26105 raft_consensus.cc:697] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.215342 26105 consensus_queue.cc:237] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.222581 25748 catalog_manager.cc:5697] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 0 to 1, leader changed from <none> to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 1 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:21.301630 25797 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:21.346868 26161 raft_consensus.cc:493] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.347512 26161 raft_consensus.cc:515] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.348258 26149 raft_consensus.cc:493] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.348690 26149 raft_consensus.cc:515] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.349246 26161 leader_election.cc:290] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.349911 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:21.350311 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:21.350014 26105 raft_consensus.cc:493] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.350585 26149 leader_election.cc:290] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.350983 26105 raft_consensus.cc:515] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.350955 25998 raft_consensus.cc:2468] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:21.351568 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11" is_pre_election: true
I20260709 13:08:21.352097 25999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:21.352378 25926 raft_consensus.cc:2468] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:21.352451 25925 raft_consensus.cc:2468] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:21.352828 25999 raft_consensus.cc:2468] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 0.
I20260709 13:08:21.353492 26105 leader_election.cc:290] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.353904 25814 leader_election.cc:304] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:21.354228 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:21.354854 25850 raft_consensus.cc:2468] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:21.355206 26149 raft_consensus.cc:2804] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.355460 25999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:21.356038 25817 leader_election.cc:304] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.355615 26149 raft_consensus.cc:493] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.356213 25890 leader_election.cc:304] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.356169 25999 raft_consensus.cc:2468] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 0.
I20260709 13:08:21.356775 26149 raft_consensus.cc:3060] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.356917 26161 raft_consensus.cc:2804] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.357271 26105 raft_consensus.cc:2804] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:21.357441 26161 raft_consensus.cc:493] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.357735 26105 raft_consensus.cc:493] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.357950 26161 raft_consensus.cc:3060] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.358191 26105 raft_consensus.cc:3060] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.363178 26161 raft_consensus.cc:515] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.364918 26161 leader_election.cc:290] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.364734 26149 raft_consensus.cc:515] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.365275 26105 raft_consensus.cc:515] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.366184 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.366184 25999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.367049 25926 raft_consensus.cc:2393] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9e7ac3d587f541c2b05b6541fbe0a504 in current term 1: Already voted for candidate adca8255c5db4b8d985905e1b4763a11 in this term.
I20260709 13:08:21.367398 26105 leader_election.cc:290] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.367873 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.366956 26149 leader_election.cc:290] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.368788 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.367920 25999 raft_consensus.cc:3060] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.368507 25925 raft_consensus.cc:3060] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.368520 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:21.370147 25850 raft_consensus.cc:2393] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate adca8255c5db4b8d985905e1b4763a11 in current term 1: Already voted for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in this term.
I20260709 13:08:21.370507 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.370122 25998 raft_consensus.cc:3060] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.372138 25889 leader_election.cc:304] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adca8255c5db4b8d985905e1b4763a11; no voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:21.373539 26105 raft_consensus.cc:2749] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.375932 25925 raft_consensus.cc:2468] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:21.376135 25999 raft_consensus.cc:2468] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:21.377002 25817 leader_election.cc:304] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.377239 25814 leader_election.cc:304] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:21.377763 26149 raft_consensus.cc:2804] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.378193 26161 raft_consensus.cc:2804] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:21.378194 25998 raft_consensus.cc:2468] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 1.
I20260709 13:08:21.378226 26149 raft_consensus.cc:697] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.379380 26161 raft_consensus.cc:697] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.379801 26149 consensus_queue.cc:237] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.380209 26161 consensus_queue.cc:237] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.388760 25748 catalog_manager.cc:5697] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.400092 25748 catalog_manager.cc:5697] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 1 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.415186 26105 consensus_queue.cc:1048] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.425874 26170 consensus_queue.cc:1048] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.495656 26161 consensus_queue.cc:1048] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.506475 26161 consensus_queue.cc:1048] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.508939 26170 raft_consensus.cc:493] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.509545 26170 raft_consensus.cc:515] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.514094 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" is_pre_election: true
I20260709 13:08:21.517663 26170 leader_election.cc:290] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.522786 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" is_pre_election: true
I20260709 13:08:21.523531 25998 raft_consensus.cc:2393] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate adca8255c5db4b8d985905e1b4763a11 in current term 1: Already voted for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in this term.
I20260709 13:08:21.524957 25889 leader_election.cc:304] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adca8255c5db4b8d985905e1b4763a11; no voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:21.525763 26170 raft_consensus.cc:3060] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:21.529340 25998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
mode: GRACEFUL
new_leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:54772
I20260709 13:08:21.529983 25998 raft_consensus.cc:606] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Received request to transfer leadership to TS 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:21.532418 26170 raft_consensus.cc:2749] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:21.535703 25998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39983baa41d549c98a89454b8f09676f"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
mode: GRACEFUL
new_leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:54772
I20260709 13:08:21.536294 25998 raft_consensus.cc:606] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Received request to transfer leadership to TS 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:21.541671 25925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
mode: GRACEFUL
new_leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:34172
I20260709 13:08:21.542098 25925 raft_consensus.cc:606] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Received request to transfer leadership to TS 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:21.546857 25925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
mode: GRACEFUL
new_leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:34172
I20260709 13:08:21.547315 25925 raft_consensus.cc:606] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Received request to transfer leadership to TS 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:21.551772 25850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:47922
I20260709 13:08:21.552292 25850 raft_consensus.cc:606] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Received request to transfer leadership to TS adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:21.557726 25850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:47922
I20260709 13:08:21.558279 25850 raft_consensus.cc:606] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Received request to transfer leadership to TS adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:21.563354 26170 consensus_queue.cc:1048] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.564174 25850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:47922
I20260709 13:08:21.564828 25850 raft_consensus.cc:606] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Received request to transfer leadership to TS adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:21.571489 25851 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:47922
I20260709 13:08:21.572100 25851 raft_consensus.cc:606] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Received request to transfer leadership to TS adca8255c5db4b8d985905e1b4763a11
I20260709 13:08:21.576359 26161 consensus_queue.cc:1048] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.577180 26105 consensus_queue.cc:1048] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.580013 26161 consensus_queue.cc:1048] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.590389 26160 consensus_queue.cc:1048] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:21.593063 25925 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
mode: GRACEFUL
new_leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:34172
I20260709 13:08:21.593694 25925 raft_consensus.cc:606] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Received request to transfer leadership to TS 30b7e0e4c8eb42a19bd1d057b5fb8760
I20260709 13:08:21.594619 26156 raft_consensus.cc:993] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: : Instructing follower 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.603431 26208 raft_consensus.cc:1081] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Signalling peer 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.608150 25850 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:47914
I20260709 13:08:21.608780 25850 raft_consensus.cc:493] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.609198 25850 raft_consensus.cc:3060] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.612172 26161 raft_consensus.cc:993] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:21.612700 26161 raft_consensus.cc:1081] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Signalling peer adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:21.614974 25924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:34162
I20260709 13:08:21.616142 25924 raft_consensus.cc:493] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.616685 25924 raft_consensus.cc:3060] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.624410 26207 consensus_queue.cc:1048] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.627298 26105 raft_consensus.cc:993] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: : Instructing follower 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.627791 26177 raft_consensus.cc:1081] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Signalling peer 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.629693 25851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:47918
I20260709 13:08:21.630295 25851 raft_consensus.cc:493] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.630627 25851 raft_consensus.cc:3060] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.637399 25924 raft_consensus.cc:515] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.637995 25851 raft_consensus.cc:515] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.640628 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.641220 25925 raft_consensus.cc:3055] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.641505 25925 raft_consensus.cc:740] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.642618 25925 consensus_queue.cc:260] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.644553 25851 leader_election.cc:290] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.645442 25850 raft_consensus.cc:515] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.647948 25924 leader_election.cc:290] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.649243 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c89b3847b164bf785b1993781a3dc80" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.643721 25925 raft_consensus.cc:3060] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.652717 25998 raft_consensus.cc:3060] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.653307 25999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.653926 25999 raft_consensus.cc:3060] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.657763 26177 consensus_queue.cc:1048] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.659565 25925 raft_consensus.cc:2468] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.660553 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5e76c4c4694445863acc532f0d6584" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:21.661147 25851 raft_consensus.cc:3055] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.661433 25851 raft_consensus.cc:740] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.662293 25851 consensus_queue.cc:260] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.663319 25851 raft_consensus.cc:3060] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.666747 25998 raft_consensus.cc:2468] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.667699 26134 raft_consensus.cc:993] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: : Instructing follower 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.666785 25850 leader_election.cc:290] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.668304 26156 raft_consensus.cc:1081] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Signalling peer 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.669289 25817 leader_election.cc:304] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.671106 26149 raft_consensus.cc:2804] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.670980 25849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39983baa41d549c98a89454b8f09676f"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:47914
I20260709 13:08:21.671718 26149 raft_consensus.cc:697] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.672691 25849 raft_consensus.cc:493] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.672590 26149 consensus_queue.cc:237] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.673233 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.673118 25849 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.673851 25998 raft_consensus.cc:3055] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.674150 25998 raft_consensus.cc:740] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:21.674952 25998 consensus_queue.cc:260] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.676163 25851 raft_consensus.cc:2468] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:21.676272 25998 raft_consensus.cc:3060] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.676827 26177 raft_consensus.cc:993] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: : Instructing follower 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:21.677290 26177 raft_consensus.cc:1081] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Signalling peer 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:21.677717 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cee0d2d57b3f4777b6d6f7d3814d3c6d" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.678263 25925 raft_consensus.cc:3060] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.681178 26000 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54768
I20260709 13:08:21.681838 26000 raft_consensus.cc:493] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.682209 26000 raft_consensus.cc:3060] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.684849 25925 raft_consensus.cc:2468] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.686982 25999 raft_consensus.cc:2468] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:21.687526 25998 raft_consensus.cc:2468] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.688508 25817 leader_election.cc:304] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.688685 25889 leader_election.cc:304] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.689267 26161 raft_consensus.cc:2804] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.689596 26177 raft_consensus.cc:2804] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.689754 26161 raft_consensus.cc:697] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.690169 26177 raft_consensus.cc:697] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.690755 26161 consensus_queue.cc:237] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.691112 26177 consensus_queue.cc:237] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.692050 26000 raft_consensus.cc:515] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.693151 25997 raft_consensus.cc:1240] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Rejecting Update request from peer adca8255c5db4b8d985905e1b4763a11 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:21.697285 26000 leader_election.cc:290] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:21.700801 26170 consensus_queue.cc:1048] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.704264 25925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.704841 26170 consensus_queue.cc:1059] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.703034 25849 raft_consensus.cc:515] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.706930 25925 raft_consensus.cc:3055] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.708225 25925 raft_consensus.cc:740] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.709882 25850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859da43a240fc8865bd1292ebcab8" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:21.710840 25849 leader_election.cc:290] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.711526 25924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.712101 25924 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.712481 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.713073 26000 raft_consensus.cc:3055] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.713376 26000 raft_consensus.cc:740] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:21.713882 25925 consensus_queue.cc:260] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.714145 26000 consensus_queue.cc:260] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.715059 25925 raft_consensus.cc:3060] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.715423 26000 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.720536 25746 catalog_manager.cc:5697] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 1 to 2, leader changed from adca8255c5db4b8d985905e1b4763a11 (127.13.181.2) to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.721702 25924 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.723713 26000 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.724614 25817 leader_election.cc:304] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.722697 25925 raft_consensus.cc:2468] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 2.
I20260709 13:08:21.724002 25748 catalog_manager.cc:5697] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 1 to 2, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:21.728709 26170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:08:21.729609 26149 raft_consensus.cc:2804] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.729705 25966 leader_election.cc:304] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 9e7ac3d587f541c2b05b6541fbe0a504
I20260709 13:08:21.730129 26149 raft_consensus.cc:697] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.730746 26207 raft_consensus.cc:2804] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.731292 26207 raft_consensus.cc:697] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:21.731063 26149 consensus_queue.cc:237] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.732126 26207 consensus_queue.cc:237] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.741847 25745 catalog_manager.cc:5697] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 1 to 2, leader changed from adca8255c5db4b8d985905e1b4763a11 (127.13.181.2) to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.750489 25746 catalog_manager.cc:5697] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 1 to 2, leader changed from 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3) to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.751870 25746 catalog_manager.cc:5697] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 1 to 2, leader changed from 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3) to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.831686 26161 consensus_queue.cc:1048] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.833340 26177 raft_consensus.cc:993] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: : Instructing follower 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.833967 26170 raft_consensus.cc:1081] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Signalling peer 9e7ac3d587f541c2b05b6541fbe0a504 to start an election
I20260709 13:08:21.835569 25851 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
 from {username='slave'} at 127.0.0.1:47918
I20260709 13:08:21.836020 25851 raft_consensus.cc:493] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.836350 25851 raft_consensus.cc:3060] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.838985 26149 raft_consensus.cc:993] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:21.839497 26149 raft_consensus.cc:1081] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Signalling peer adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:21.841106 25924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:34162
I20260709 13:08:21.841665 25924 raft_consensus.cc:493] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.842036 25924 raft_consensus.cc:3060] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.845603 26046 consensus_queue.cc:1048] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.853679 25851 raft_consensus.cc:515] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.855443 25851 leader_election.cc:290] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Requested vote from peers adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.856197 25926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:21.856812 25926 raft_consensus.cc:3055] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.856943 26000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ca08b2eb0484172a2f621cc121f07d9" candidate_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.857648 26000 raft_consensus.cc:3060] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.857159 25926 raft_consensus.cc:740] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.858997 25924 raft_consensus.cc:515] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.859714 25926 consensus_queue.cc:260] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.860689 25925 raft_consensus.cc:1240] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Rejecting Update request from peer 9e7ac3d587f541c2b05b6541fbe0a504 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:21.860925 25926 raft_consensus.cc:3060] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.863468 25924 leader_election.cc:290] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.864972 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.865586 25998 raft_consensus.cc:3060] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.868050 26046 consensus_queue.cc:1059] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.868899 26149 raft_consensus.cc:3055] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.869280 26149 raft_consensus.cc:740] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.869463 25926 raft_consensus.cc:2468] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.870153 26149 consensus_queue.cc:260] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.871394 26000 raft_consensus.cc:2468] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e7ac3d587f541c2b05b6541fbe0a504 in term 2.
I20260709 13:08:21.871654 26149 raft_consensus.cc:3060] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.868114 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b9c339904d04c9e81f95a74ca2c28d3" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:21.872634 25817 leader_election.cc:304] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e7ac3d587f541c2b05b6541fbe0a504, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.873353 26046 raft_consensus.cc:2804] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.873798 26046 raft_consensus.cc:697] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Leader. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.874572 26046 consensus_queue.cc:237] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.877872 25998 raft_consensus.cc:2468] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:21.879314 25889 leader_election.cc:304] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.880199 26170 raft_consensus.cc:2804] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.880647 26170 raft_consensus.cc:697] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.881443 26170 consensus_queue.cc:237] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.882730 25745 catalog_manager.cc:5697] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 reported cstate change: term changed from 1 to 2, leader changed from adca8255c5db4b8d985905e1b4763a11 (127.13.181.2) to 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1). New cstate: current_term: 2 leader_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.885576 25851 raft_consensus.cc:2468] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:21.888188 26046 consensus_queue.cc:1048] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.891431 25746 catalog_manager.cc:5697] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 1 to 2, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:21.902653 26046 consensus_queue.cc:1048] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:21.911440 26149 raft_consensus.cc:993] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:21.911940 26046 raft_consensus.cc:1081] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Signalling peer adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:21.913415 25926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:34162
I20260709 13:08:21.913901 25926 raft_consensus.cc:493] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.914212 25926 raft_consensus.cc:3060] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.919126 25926 raft_consensus.cc:515] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.921301 25926 leader_election.cc:290] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:21.921789 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:21.921897 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7fcaae59cc450d80b16672fd143d79" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:21.922483 25851 raft_consensus.cc:3055] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:21.922864 25851 raft_consensus.cc:740] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:21.922611 25998 raft_consensus.cc:3060] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.923682 25851 consensus_queue.cc:260] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.924899 25851 raft_consensus.cc:3060] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:21.929968 25998 raft_consensus.cc:2468] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:21.931377 25851 raft_consensus.cc:2468] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:21.931329 25889 leader_election.cc:304] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:21.932417 26170 raft_consensus.cc:2804] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:21.932924 26170 raft_consensus.cc:697] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:21.933692 26170 consensus_queue.cc:237] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:21.940289 25745 catalog_manager.cc:5697] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 1 to 2, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.054052 26161 raft_consensus.cc:993] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:22.054572 26046 raft_consensus.cc:1081] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Signalling peer adca8255c5db4b8d985905e1b4763a11 to start an election
I20260709 13:08:22.056139 25926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
 from {username='slave'} at 127.0.0.1:34162
I20260709 13:08:22.056701 25926 raft_consensus.cc:493] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.057068 25926 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.062281 25926 raft_consensus.cc:515] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:22.064392 25926 leader_election.cc:290] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3:42055)
I20260709 13:08:22.064961 25851 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:22.065368 25998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "adca8255c5db4b8d985905e1b4763a11" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
I20260709 13:08:22.065639 25851 raft_consensus.cc:3055] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:22.066022 25851 raft_consensus.cc:740] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:22.066069 25998 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.066871 25851 consensus_queue.cc:260] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:22.068019 25851 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.072677 25998 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:22.074004 25889 leader_election.cc:304] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:22.074294 25851 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adca8255c5db4b8d985905e1b4763a11 in term 2.
I20260709 13:08:22.074834 26170 raft_consensus.cc:2804] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:22.075347 26170 raft_consensus.cc:697] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Leader. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:22.075632 25998 raft_consensus.cc:1275] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.076159 26170 consensus_queue.cc:237] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:22.077061 26046 consensus_queue.cc:1048] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.085405 25926 raft_consensus.cc:1275] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.085115 25745 catalog_manager.cc:5697] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 reported cstate change: term changed from 1 to 2, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to adca8255c5db4b8d985905e1b4763a11 (127.13.181.2). New cstate: current_term: 2 leader_uuid: "adca8255c5db4b8d985905e1b4763a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.087191 26149 consensus_queue.cc:1048] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.119918 25926 raft_consensus.cc:1275] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.121274 26161 consensus_queue.cc:1048] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.123078 25926 raft_consensus.cc:1275] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.124853 26207 consensus_queue.cc:1048] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.132380 25998 raft_consensus.cc:1275] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.135653 26161 consensus_queue.cc:1048] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.136632 25851 raft_consensus.cc:3060] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.145236 25851 raft_consensus.cc:1275] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.147415 25926 raft_consensus.cc:1275] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.147372 26156 consensus_queue.cc:1048] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.149174 26161 consensus_queue.cc:1048] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.152592 25849 raft_consensus.cc:1275] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.154531 26170 consensus_queue.cc:1048] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.162207 25998 raft_consensus.cc:1275] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.165759 26161 consensus_queue.cc:1048] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.169878 25998 raft_consensus.cc:1275] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.171285 26177 consensus_queue.cc:1048] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.287935 25926 raft_consensus.cc:1275] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.289289 26161 consensus_queue.cc:1048] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.290486 25851 raft_consensus.cc:1275] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.291924 26177 consensus_queue.cc:1048] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.297284 26000 raft_consensus.cc:1275] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer 9e7ac3d587f541c2b05b6541fbe0a504: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.299134 26161 consensus_queue.cc:1048] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.303864 25998 raft_consensus.cc:1275] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.305567 26177 consensus_queue.cc:1048] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.339999 26000 raft_consensus.cc:1275] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.341373 26177 consensus_queue.cc:1048] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.350726 25851 raft_consensus.cc:1275] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.352133 26179 consensus_queue.cc:1048] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.608647 25851 raft_consensus.cc:1275] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.610165 26179 consensus_queue.cc:1048] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.620151 26000 raft_consensus.cc:1275] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Refusing update from remote peer adca8255c5db4b8d985905e1b4763a11: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.622418 26170 consensus_queue.cc:1048] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:24.598260 25746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56252:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:08:24.629590 25746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56252:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:08:24.694733 14036 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:08:24.829042 26241 log.cc:927] Time spent T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: Append to log took a long time: real 0.052s	user 0.000s	sys 0.004s
I20260709 13:08:24.894433 26260 tablet.cc:1724] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:24.896174 26263 tablet.cc:1724] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:24.906551 26246 log.cc:927] Time spent T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:08:24.957093 26262 tablet.cc:1724] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:24.964366 26254 log.cc:927] Time spent T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: Append to log took a long time: real 0.114s	user 0.002s	sys 0.003s
I20260709 13:08:24.969642 26270 tablet.cc:1724] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:24.970652 26251 log.cc:927] Time spent T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:08:24.983846 25952 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:5d7fcaae59cc450d80b16672fd143d79)
W20260709 13:08:24.993144 25952 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:5d7fcaae59cc450d80b16672fd143d79)
W20260709 13:08:25.008438 25952 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:5d7fcaae59cc450d80b16672fd143d79)
W20260709 13:08:25.055961 26265 log.cc:927] Time spent T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
I20260709 13:08:25.063638 25847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39983baa41d549c98a89454b8f09676f"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54298
I20260709 13:08:25.064600 25847 raft_consensus.cc:606] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Received request to transfer leadership to TS 30b7e0e4c8eb42a19bd1d057b5fb8760
W20260709 13:08:25.067623 26252 log.cc:927] Time spent T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:08:25.065348 26268 tablet.cc:1724] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:25.130240 25814 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:42055, user_credentials={real_user=slave}} blocked reactor thread for 82392.2us
I20260709 13:08:25.159368 26284 raft_consensus.cc:993] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.159914 26284 raft_consensus.cc:1081] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Signalling peer 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.192457 26278 tablet.cc:1724] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.209519 26280 tablet.cc:1724] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.209650 26287 tablet.cc:1724] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.221976 26285 tablet.cc:1724] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.225517 26279 tablet.cc:1724] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.233704 26272 tablet.cc:1724] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.236339 26289 tablet.cc:1724] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.245100 26263 tablet.cc:1724] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.254379 25923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
mode: GRACEFUL
new_leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:44442
I20260709 13:08:25.253983 26270 tablet.cc:1724] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.255138 25923 raft_consensus.cc:606] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Received request to transfer leadership to TS 30b7e0e4c8eb42a19bd1d057b5fb8760
I20260709 13:08:25.256888 14036 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:08:25.257511 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.261053 26285 tablet.cc:1724] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.263885 26260 tablet.cc:1724] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.270537 26287 tablet.cc:1724] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.283987 26285 tablet.cc:1724] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.287504 26262 tablet.cc:1724] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.298236 25999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39983baa41d549c98a89454b8f09676f"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54756
I20260709 13:08:25.299022 25999 raft_consensus.cc:493] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.299613 25999 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.318421 25924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7"
dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
mode: GRACEFUL
new_leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:44442
I20260709 13:08:25.321220 25924 raft_consensus.cc:606] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Received request to transfer leadership to TS 30b7e0e4c8eb42a19bd1d057b5fb8760
I20260709 13:08:25.322448 26278 tablet.cc:1724] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.323660 26287 tablet.cc:1724] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.328938 25849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e"
dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
mode: GRACEFUL
new_leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54298
I20260709 13:08:25.332788 25849 raft_consensus.cc:606] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Received request to transfer leadership to TS 30b7e0e4c8eb42a19bd1d057b5fb8760
I20260709 13:08:25.329457 26289 tablet.cc:1724] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.336028 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:25.335711 25999 raft_consensus.cc:515] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.336715 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:25.338215 25999 leader_election.cc:290] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:25.339397 25923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:25.340147 25923 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.341665 26285 tablet.cc:1724] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.344606 26279 tablet.cc:1724] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.351291 26262 tablet.cc:1724] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.355418 26268 tablet.cc:1724] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.362542 26179 raft_consensus.cc:993] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: : Instructing follower 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.371119 26179 raft_consensus.cc:1081] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Signalling peer 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.364979 25849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39983baa41d549c98a89454b8f09676f" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:25.365118 26260 tablet.cc:1724] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:25.372326 25849 raft_consensus.cc:3055] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.372715 25849 raft_consensus.cc:740] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:25.373682 25849 consensus_queue.cc:260] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.375389 25849 raft_consensus.cc:3060] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.380908 25996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54768
I20260709 13:08:25.381580 25996 raft_consensus.cc:493] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.381953 25996 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.390255 25996 raft_consensus.cc:515] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.393041 25996 leader_election.cc:290] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:25.394055 25924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:25.397099 25924 raft_consensus.cc:3055] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.397428 25924 raft_consensus.cc:740] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:25.398330 25924 consensus_queue.cc:260] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.395393 25847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9653a2aff9f4f94a3febefb27bcfd99" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:25.400782 25847 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.403546 25924 raft_consensus.cc:3060] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.408121 25849 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.410611 25964 leader_election.cc:304] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:25.411692 26207 raft_consensus.cc:2804] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.412137 26207 raft_consensus.cc:697] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:25.413100 26207 consensus_queue.cc:237] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.416467 25847 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.418287 25964 leader_election.cc:304] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:25.419389 26259 raft_consensus.cc:2804] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.419905 26259 raft_consensus.cc:697] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:25.420778 26259 consensus_queue.cc:237] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.423825 25924 raft_consensus.cc:2468] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.423882 25923 raft_consensus.cc:2468] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.448657 25745 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d: soft_deleted_table [id=a07d9181e71b42aa957a28addc865168] alter complete (version 1)
I20260709 13:08:25.460160 25748 catalog_manager.cc:5697] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 2 to 3, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.461760 25748 catalog_manager.cc:5697] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 2 to 3, leader changed from adca8255c5db4b8d985905e1b4763a11 (127.13.181.2) to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.703994 26179 raft_consensus.cc:993] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11: : Instructing follower 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.704519 26170 raft_consensus.cc:1081] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Signalling peer 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.705848 25996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54768
I20260709 13:08:25.706270 25996 raft_consensus.cc:493] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.706534 25996 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.711488 25996 raft_consensus.cc:515] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.712972 25996 leader_election.cc:290] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:25.713979 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:25.714020 25923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30636af4b95945a7968f5e116600b4d7" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:25.714682 25846 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.714773 25923 raft_consensus.cc:3055] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.715284 25923 raft_consensus.cc:740] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adca8255c5db4b8d985905e1b4763a11, State: Running, Role: LEADER
I20260709 13:08:25.716001 25923 consensus_queue.cc:260] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.717607 25923 raft_consensus.cc:3060] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.722029 25846 raft_consensus.cc:2468] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.723327 25964 leader_election.cc:304] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, 9e7ac3d587f541c2b05b6541fbe0a504; no voters: 
I20260709 13:08:25.723855 25923 raft_consensus.cc:2468] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.724066 26259 raft_consensus.cc:2804] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.724606 26259 raft_consensus.cc:697] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:25.725384 26259 consensus_queue.cc:237] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } }
I20260709 13:08:25.737385 25748 catalog_manager.cc:5697] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 2 to 3, leader changed from adca8255c5db4b8d985905e1b4763a11 (127.13.181.2) to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.740610 26236 raft_consensus.cc:993] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504: : Instructing follower 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.741222 26290 raft_consensus.cc:1081] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Signalling peer 30b7e0e4c8eb42a19bd1d057b5fb8760 to start an election
I20260709 13:08:25.742643 25996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e"
dest_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760"
 from {username='slave'} at 127.0.0.1:54756
I20260709 13:08:25.743163 25996 raft_consensus.cc:493] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:25.743474 25996 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.750512 25996 raft_consensus.cc:515] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:25.752447 25996 leader_election.cc:290] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Requested vote from peers 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857), adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127)
I20260709 13:08:25.753165 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9e7ac3d587f541c2b05b6541fbe0a504"
I20260709 13:08:25.753873 25846 raft_consensus.cc:3055] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.753803 25923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3c37150c1894e7da642b8af48bbe27e" candidate_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adca8255c5db4b8d985905e1b4763a11"
I20260709 13:08:25.754335 25846 raft_consensus.cc:740] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9e7ac3d587f541c2b05b6541fbe0a504, State: Running, Role: LEADER
I20260709 13:08:25.754545 25923 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.755302 25846 consensus_queue.cc:260] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:25.756278 25846 raft_consensus.cc:3060] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.759739 25923 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.761089 25966 leader_election.cc:304] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b7e0e4c8eb42a19bd1d057b5fb8760, adca8255c5db4b8d985905e1b4763a11; no voters: 
I20260709 13:08:25.761230 25846 raft_consensus.cc:2468] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b7e0e4c8eb42a19bd1d057b5fb8760 in term 3.
I20260709 13:08:25.761862 26259 raft_consensus.cc:2804] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.762305 26259 raft_consensus.cc:697] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Becoming Leader. State: Replica: 30b7e0e4c8eb42a19bd1d057b5fb8760, State: Running, Role: LEADER
I20260709 13:08:25.763119 26259 consensus_queue.cc:237] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } }
I20260709 13:08:25.770780 25748 catalog_manager.cc:5697] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 reported cstate change: term changed from 2 to 3, leader changed from 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1) to 30b7e0e4c8eb42a19bd1d057b5fb8760 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b7e0e4c8eb42a19bd1d057b5fb8760" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 42055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:25.801157 25924 raft_consensus.cc:1275] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:25.802506 26259 consensus_queue.cc:1048] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:25.810415 25846 raft_consensus.cc:1275] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:25.812368 26207 consensus_queue.cc:1048] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:25.829517 25924 raft_consensus.cc:1275] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:25.830953 26207 consensus_queue.cc:1048] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:25.840243 25846 raft_consensus.cc:1275] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:08:25.842147 26261 consensus_queue.cc:1048] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:26.158294 25924 raft_consensus.cc:1275] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.159585 26259 consensus_queue.cc:1048] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.168342 25846 raft_consensus.cc:1275] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.169792 26207 consensus_queue.cc:1048] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.172833 25924 raft_consensus.cc:1275] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.174796 26259 consensus_queue.cc:1048] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "adca8255c5db4b8d985905e1b4763a11" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 38127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:26.189153 25846 raft_consensus.cc:1275] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Refusing update from remote peer 30b7e0e4c8eb42a19bd1d057b5fb8760: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:26.190558 26207 consensus_queue.cc:1048] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e7ac3d587f541c2b05b6541fbe0a504" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:26.395867 14036 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:08:26.400677 14036 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:08:26.401085 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:26.405917 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:08:26.406282 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.435334 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
I20260709 13:08:27.470032 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:27.471014 14036 tablet_replica.cc:333] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.472312 14036 raft_consensus.cc:2243] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.473014 14036 raft_consensus.cc:2272] T 2b9c339904d04c9e81f95a74ca2c28d3 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.476106 14036 tablet_replica.cc:333] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.477054 14036 raft_consensus.cc:2243] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.477689 14036 raft_consensus.cc:2272] T 5d7fcaae59cc450d80b16672fd143d79 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:27.478078 25964 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 13:08:27.480651 14036 tablet_replica.cc:333] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
W20260709 13:08:27.481603 25964 consensus_peers.cc:597] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 -> Peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Couldn't send request to peer 9e7ac3d587f541c2b05b6541fbe0a504. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.481766 14036 raft_consensus.cc:2243] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.482492 14036 raft_consensus.cc:2272] T 5d9859da43a240fc8865bd1292ebcab8 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.485371 14036 tablet_replica.cc:333] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.485982 14036 raft_consensus.cc:2243] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.486502 14036 raft_consensus.cc:2272] T 7b5e76c4c4694445863acc532f0d6584 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.488693 14036 tablet_replica.cc:333] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.489568 14036 raft_consensus.cc:2243] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.490397 14036 raft_consensus.cc:2272] T 2812843fcd4547a3a9438614a27c8f48 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.492921 14036 tablet_replica.cc:333] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.494024 14036 raft_consensus.cc:2243] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.495236 14036 raft_consensus.cc:2272] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.497848 14036 tablet_replica.cc:333] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.498513 14036 raft_consensus.cc:2243] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.499064 14036 raft_consensus.cc:2272] T 39983baa41d549c98a89454b8f09676f P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.501724 14036 tablet_replica.cc:333] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.502645 14036 raft_consensus.cc:2243] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.503585 14036 raft_consensus.cc:2272] T 1ca08b2eb0484172a2f621cc121f07d9 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.506314 14036 tablet_replica.cc:333] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.507143 14036 raft_consensus.cc:2243] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.507826 14036 raft_consensus.cc:2272] T 30636af4b95945a7968f5e116600b4d7 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.510655 14036 tablet_replica.cc:333] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.511483 14036 raft_consensus.cc:2243] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.512604 14036 raft_consensus.cc:2272] T 267814db287341c595a273268b614c45 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.515687 14036 tablet_replica.cc:333] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.516563 14036 raft_consensus.cc:2243] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.517278 14036 raft_consensus.cc:2272] T 9538861166364b80b5975791dd4e1eb5 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.519768 14036 tablet_replica.cc:333] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.520292 14036 raft_consensus.cc:2243] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.521031 14036 raft_consensus.cc:2272] T 637d9b67922945ccb252127e696ad2cf P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.524618 14036 tablet_replica.cc:333] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.525549 14036 raft_consensus.cc:2243] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:27.526320 25964 consensus_peers.cc:597] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 -> Peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Couldn't send request to peer 9e7ac3d587f541c2b05b6541fbe0a504. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.526396 14036 raft_consensus.cc:2272] T a9653a2aff9f4f94a3febefb27bcfd99 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.529685 14036 tablet_replica.cc:333] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.530311 14036 raft_consensus.cc:2243] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.530844 14036 raft_consensus.cc:2272] T a20d74ab418f4845b250ba7e9358087a P 9e7ac3d587f541c2b05b6541fbe0a504 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:27.533051 25890 consensus_peers.cc:597] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 -> Peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Couldn't send request to peer 9e7ac3d587f541c2b05b6541fbe0a504. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.534025 14036 tablet_replica.cc:333] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.534694 14036 raft_consensus.cc:2243] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.535235 14036 raft_consensus.cc:2272] T e3c37150c1894e7da642b8af48bbe27e P 9e7ac3d587f541c2b05b6541fbe0a504 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.537725 14036 tablet_replica.cc:333] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.538488 14036 raft_consensus.cc:2243] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.539417 14036 raft_consensus.cc:2272] T 9c89b3847b164bf785b1993781a3dc80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.541518 14036 tablet_replica.cc:333] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.542196 14036 raft_consensus.cc:2243] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.543414 14036 raft_consensus.cc:2272] T b3df05b17d4241999f34a272680d44cb P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.546435 14036 tablet_replica.cc:333] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504: stopping tablet replica
I20260709 13:08:27.546931 14036 raft_consensus.cc:2243] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.547770 14036 raft_consensus.cc:2272] T 813bc21ce0d040f8b611f5503dca8c80 P 9e7ac3d587f541c2b05b6541fbe0a504 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.592178 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
W20260709 13:08:27.592779 25964 consensus_peers.cc:597] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 -> Peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Couldn't send request to peer 9e7ac3d587f541c2b05b6541fbe0a504. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.597446 25890 consensus_peers.cc:597] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 -> Peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Couldn't send request to peer 9e7ac3d587f541c2b05b6541fbe0a504. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.630606 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
I20260709 13:08:27.661789 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:27.662734 14036 tablet_replica.cc:333] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.663950 14036 raft_consensus.cc:2243] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.664944 14036 raft_consensus.cc:2272] T 7b5e76c4c4694445863acc532f0d6584 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.667338 14036 tablet_replica.cc:333] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.667946 14036 raft_consensus.cc:2243] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.668408 14036 raft_consensus.cc:2272] T 5d9859da43a240fc8865bd1292ebcab8 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.670377 14036 tablet_replica.cc:333] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.670954 14036 raft_consensus.cc:2243] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.671730 14036 raft_consensus.cc:2272] T 5d7fcaae59cc450d80b16672fd143d79 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.673734 14036 tablet_replica.cc:333] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.674307 14036 raft_consensus.cc:2243] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.675194 14036 raft_consensus.cc:2272] T 2b9c339904d04c9e81f95a74ca2c28d3 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.677176 14036 tablet_replica.cc:333] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.677757 14036 raft_consensus.cc:2243] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.678572 14036 raft_consensus.cc:2272] T 2812843fcd4547a3a9438614a27c8f48 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.680759 14036 tablet_replica.cc:333] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.681316 14036 raft_consensus.cc:2243] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.681767 14036 raft_consensus.cc:2272] T cee0d2d57b3f4777b6d6f7d3814d3c6d P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.683802 14036 tablet_replica.cc:333] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.684350 14036 raft_consensus.cc:2243] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.684798 14036 raft_consensus.cc:2272] T 39983baa41d549c98a89454b8f09676f P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.686669 14036 tablet_replica.cc:333] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.687322 14036 raft_consensus.cc:2243] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.687769 14036 raft_consensus.cc:2272] T 1ca08b2eb0484172a2f621cc121f07d9 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.689616 14036 tablet_replica.cc:333] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.690176 14036 raft_consensus.cc:2243] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.690589 14036 raft_consensus.cc:2272] T 30636af4b95945a7968f5e116600b4d7 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.692862 14036 tablet_replica.cc:333] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.693387 14036 raft_consensus.cc:2243] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.693825 14036 raft_consensus.cc:2272] T 267814db287341c595a273268b614c45 P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.695881 14036 tablet_replica.cc:333] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.696388 14036 raft_consensus.cc:2243] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.696800 14036 raft_consensus.cc:2272] T 813bc21ce0d040f8b611f5503dca8c80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.698844 14036 tablet_replica.cc:333] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.699469 14036 raft_consensus.cc:2243] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.699877 14036 raft_consensus.cc:2272] T a9653a2aff9f4f94a3febefb27bcfd99 P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.701787 14036 tablet_replica.cc:333] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.702353 14036 raft_consensus.cc:2243] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.703318 14036 raft_consensus.cc:2272] T a20d74ab418f4845b250ba7e9358087a P adca8255c5db4b8d985905e1b4763a11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.706066 14036 tablet_replica.cc:333] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.706895 14036 raft_consensus.cc:2243] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.707468 14036 raft_consensus.cc:2272] T e3c37150c1894e7da642b8af48bbe27e P adca8255c5db4b8d985905e1b4763a11 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:27.707795 25966 consensus_peers.cc:597] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 -> Peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Couldn't send request to peer adca8255c5db4b8d985905e1b4763a11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.710237 14036 tablet_replica.cc:333] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
W20260709 13:08:27.710688 25964 consensus_peers.cc:597] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 -> Peer 9e7ac3d587f541c2b05b6541fbe0a504 (127.13.181.1:36857): Couldn't send request to peer 9e7ac3d587f541c2b05b6541fbe0a504. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36857: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.710925 14036 raft_consensus.cc:2243] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.711532 14036 raft_consensus.cc:2272] T 9c89b3847b164bf785b1993781a3dc80 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.713476 14036 tablet_replica.cc:333] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.714120 14036 raft_consensus.cc:2243] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.714646 14036 raft_consensus.cc:2272] T b3df05b17d4241999f34a272680d44cb P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.717307 14036 tablet_replica.cc:333] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.717885 14036 raft_consensus.cc:2243] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:27.718227 25966 consensus_peers.cc:597] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 -> Peer adca8255c5db4b8d985905e1b4763a11 (127.13.181.2:38127): Couldn't send request to peer adca8255c5db4b8d985905e1b4763a11. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.718379 14036 raft_consensus.cc:2272] T 9538861166364b80b5975791dd4e1eb5 P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.720711 14036 tablet_replica.cc:333] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11: stopping tablet replica
I20260709 13:08:27.721235 14036 raft_consensus.cc:2243] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.722105 14036 raft_consensus.cc:2272] T 637d9b67922945ccb252127e696ad2cf P adca8255c5db4b8d985905e1b4763a11 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.762848 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
I20260709 13:08:27.796356 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
I20260709 13:08:27.826152 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:27.826960 14036 tablet_replica.cc:333] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.828058 14036 raft_consensus.cc:2243] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.828714 14036 raft_consensus.cc:2272] T 2b9c339904d04c9e81f95a74ca2c28d3 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.830736 14036 tablet_replica.cc:333] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.831384 14036 raft_consensus.cc:2243] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.832136 14036 raft_consensus.cc:2272] T 5d9859da43a240fc8865bd1292ebcab8 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.834308 14036 tablet_replica.cc:333] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.834852 14036 raft_consensus.cc:2243] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.835359 14036 raft_consensus.cc:2272] T 7b5e76c4c4694445863acc532f0d6584 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.837194 14036 tablet_replica.cc:333] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.837704 14036 raft_consensus.cc:2243] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.838068 14036 raft_consensus.cc:2272] T 5d7fcaae59cc450d80b16672fd143d79 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.840015 14036 tablet_replica.cc:333] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.840531 14036 raft_consensus.cc:2243] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.840914 14036 raft_consensus.cc:2272] T 1ca08b2eb0484172a2f621cc121f07d9 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.842715 14036 tablet_replica.cc:333] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.843286 14036 raft_consensus.cc:2243] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.843973 14036 raft_consensus.cc:2272] T 39983baa41d549c98a89454b8f09676f P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.845779 14036 tablet_replica.cc:333] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.846221 14036 raft_consensus.cc:2243] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.846638 14036 raft_consensus.cc:2272] T 2812843fcd4547a3a9438614a27c8f48 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.848655 14036 tablet_replica.cc:333] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.849166 14036 raft_consensus.cc:2243] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.849562 14036 raft_consensus.cc:2272] T cee0d2d57b3f4777b6d6f7d3814d3c6d P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.851470 14036 tablet_replica.cc:333] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.851977 14036 raft_consensus.cc:2243] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.852690 14036 raft_consensus.cc:2272] T 30636af4b95945a7968f5e116600b4d7 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.854632 14036 tablet_replica.cc:333] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.855213 14036 raft_consensus.cc:2243] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.855767 14036 raft_consensus.cc:2272] T a20d74ab418f4845b250ba7e9358087a P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.858518 14036 tablet_replica.cc:333] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.859395 14036 raft_consensus.cc:2243] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.860109 14036 raft_consensus.cc:2272] T a9653a2aff9f4f94a3febefb27bcfd99 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.862094 14036 tablet_replica.cc:333] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.862653 14036 raft_consensus.cc:2243] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.863161 14036 raft_consensus.cc:2272] T 637d9b67922945ccb252127e696ad2cf P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.865139 14036 tablet_replica.cc:333] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.865680 14036 raft_consensus.cc:2243] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.866503 14036 raft_consensus.cc:2272] T 9538861166364b80b5975791dd4e1eb5 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.868695 14036 tablet_replica.cc:333] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.869234 14036 raft_consensus.cc:2243] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.869652 14036 raft_consensus.cc:2272] T 267814db287341c595a273268b614c45 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.871659 14036 tablet_replica.cc:333] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.872200 14036 raft_consensus.cc:2243] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.872924 14036 raft_consensus.cc:2272] T e3c37150c1894e7da642b8af48bbe27e P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.874902 14036 tablet_replica.cc:333] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.875463 14036 raft_consensus.cc:2243] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.875847 14036 raft_consensus.cc:2272] T 9c89b3847b164bf785b1993781a3dc80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.877693 14036 tablet_replica.cc:333] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.878122 14036 raft_consensus.cc:2243] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.878502 14036 raft_consensus.cc:2272] T b3df05b17d4241999f34a272680d44cb P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.880573 14036 tablet_replica.cc:333] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760: stopping tablet replica
I20260709 13:08:27.880976 14036 raft_consensus.cc:2243] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:27.881369 14036 raft_consensus.cc:2272] T 813bc21ce0d040f8b611f5503dca8c80 P 30b7e0e4c8eb42a19bd1d057b5fb8760 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.920733 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
I20260709 13:08:27.955971 14036 master.cc:562] Master@127.13.181.62:37499 shutting down...
I20260709 13:08:27.979974 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:27.980554 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:27.981056 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5346a95ae6ee41f28eec3f6921a16b3d: stopping tablet replica
I20260709 13:08:28.002280 14036 master.cc:584] Master@127.13.181.62:37499 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12958 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:08:28.056358 14036 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.181.62:35903
I20260709 13:08:28.057487 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:28.063848 26309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:28.064254 26312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:28.064384 26310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.065168 14036 server_base.cc:1061] running on GCE node
I20260709 13:08:28.065984 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:28.066159 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:28.066274 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602508066264 us; error 0 us; skew 500 ppm
I20260709 13:08:28.066720 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:28.069222 14036 webserver.cc:533] Webserver started at http://127.13.181.62:46105/ using document root <none> and password file <none>
I20260709 13:08:28.069638 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:28.069796 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:28.070001 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:28.071079 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/master-0-root/instance:
uuid: "fe2b18e926e94d2da2e9e91f28fde9af"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.075472 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:08:28.078758 26317 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.079581 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:28.079890 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/master-0-root
uuid: "fe2b18e926e94d2da2e9e91f28fde9af"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.080171 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:28.099958 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:28.101220 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:28.140678 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.62:35903
I20260709 13:08:28.140817 26368 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.62:35903 every 8 connection(s)
I20260709 13:08:28.144814 26369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.156227 26369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af: Bootstrap starting.
I20260709 13:08:28.161232 26369 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.165792 26369 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af: No bootstrap required, opened a new log
I20260709 13:08:28.168339 26369 raft_consensus.cc:359] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" member_type: VOTER }
I20260709 13:08:28.168781 26369 raft_consensus.cc:385] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.169039 26369 raft_consensus.cc:740] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2b18e926e94d2da2e9e91f28fde9af, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.169685 26369 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" member_type: VOTER }
I20260709 13:08:28.170181 26369 raft_consensus.cc:399] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:28.170439 26369 raft_consensus.cc:493] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:28.170742 26369 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:28.176007 26369 raft_consensus.cc:515] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" member_type: VOTER }
I20260709 13:08:28.176597 26369 leader_election.cc:304] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe2b18e926e94d2da2e9e91f28fde9af; no voters: 
I20260709 13:08:28.177824 26369 leader_election.cc:290] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:28.178166 26372 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:28.179597 26372 raft_consensus.cc:697] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 1 LEADER]: Becoming Leader. State: Replica: fe2b18e926e94d2da2e9e91f28fde9af, State: Running, Role: LEADER
I20260709 13:08:28.180276 26372 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" member_type: VOTER }
I20260709 13:08:28.181078 26369 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:28.185086 26373 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" member_type: VOTER } }
I20260709 13:08:28.185310 26374 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe2b18e926e94d2da2e9e91f28fde9af. Latest consensus state: current_term: 1 leader_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe2b18e926e94d2da2e9e91f28fde9af" member_type: VOTER } }
I20260709 13:08:28.186180 26374 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:28.187225 26373 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:28.188755 26378 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:28.194002 26378 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:28.199275 14036 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:28.203541 26378 catalog_manager.cc:1383] Generated new cluster ID: 51b4b1c35f2c4286b9ac823f75339977
I20260709 13:08:28.203800 26378 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:28.224524 26378 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:28.225821 26378 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:28.240592 26378 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af: Generated new TSK 0
I20260709 13:08:28.241257 26378 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:28.266888 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:28.273072 26390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:28.274112 26391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.276738 14036 server_base.cc:1061] running on GCE node
W20260709 13:08:28.276687 26393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.277979 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:28.278163 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:28.278280 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602508278268 us; error 0 us; skew 500 ppm
I20260709 13:08:28.278723 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:28.280946 14036 webserver.cc:533] Webserver started at http://127.13.181.1:44997/ using document root <none> and password file <none>
I20260709 13:08:28.281497 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:28.281657 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:28.281869 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:28.283133 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-0-root/instance:
uuid: "348bd127f30f46e1a84a78b57b66f77a"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.287523 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:08:28.290737 26398 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.291648 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:08:28.291986 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-0-root
uuid: "348bd127f30f46e1a84a78b57b66f77a"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.292316 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:28.314139 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:28.315518 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:28.317137 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:28.319608 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:28.319811 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.320145 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:28.320349 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.361620 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.1:36961
I20260709 13:08:28.361740 26460 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.1:36961 every 8 connection(s)
I20260709 13:08:28.366781 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:28.373890 26465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:28.374892 26466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.377362 14036 server_base.cc:1061] running on GCE node
W20260709 13:08:28.377935 26468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.378996 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:28.379292 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:28.379531 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602508379513 us; error 0 us; skew 500 ppm
I20260709 13:08:28.379608 26461 heartbeater.cc:344] Connected to a master server at 127.13.181.62:35903
I20260709 13:08:28.380079 26461 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:28.380242 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:28.380807 26461 heartbeater.cc:507] Master 127.13.181.62:35903 requested a full tablet report, sending...
I20260709 13:08:28.383157 14036 webserver.cc:533] Webserver started at http://127.13.181.2:45769/ using document root <none> and password file <none>
I20260709 13:08:28.383288 26334 ts_manager.cc:194] Registered new tserver with Master: 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961)
I20260709 13:08:28.383762 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:28.384039 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:28.384337 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:28.385231 26334 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56856
I20260709 13:08:28.385489 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-1-root/instance:
uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.390354 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:08:28.394074 26473 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.394889 14036 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:28.395380 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-1-root
uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.395706 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:28.416288 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:28.417503 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:28.418953 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:28.421270 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:28.421512 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.421729 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:28.421866 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.462126 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.2:32995
I20260709 13:08:28.462421 26535 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.2:32995 every 8 connection(s)
I20260709 13:08:28.467406 14036 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:28.474607 26539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:28.475948 26540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.478708 14036 server_base.cc:1061] running on GCE node
W20260709 13:08:28.479390 26542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:28.479974 26536 heartbeater.cc:344] Connected to a master server at 127.13.181.62:35903
I20260709 13:08:28.480422 26536 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:28.480577 14036 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:28.480886 14036 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:28.481092 14036 hybrid_clock.cc:648] HybridClock initialized: now 1783602508481075 us; error 0 us; skew 500 ppm
I20260709 13:08:28.481458 26536 heartbeater.cc:507] Master 127.13.181.62:35903 requested a full tablet report, sending...
I20260709 13:08:28.481989 14036 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:28.484017 26334 ts_manager.cc:194] Registered new tserver with Master: f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:28.484961 14036 webserver.cc:533] Webserver started at http://127.13.181.3:36831/ using document root <none> and password file <none>
I20260709 13:08:28.485633 14036 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:28.485867 14036 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:28.485867 26334 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56870
I20260709 13:08:28.486274 14036 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:28.487864 14036 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-2-root/instance:
uuid: "0e26deddd9324b8b929a6eb224280097"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.492534 14036 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:28.496225 26547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.497048 14036 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:08:28.497377 14036 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-2-root
uuid: "0e26deddd9324b8b929a6eb224280097"
format_stamp: "Formatted at 2026-07-09 13:08:28 on dist-test-slave-28ks"
I20260709 13:08:28.497674 14036 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskCWtdNm/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602164044135-14036-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:28.523370 14036 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:28.524567 14036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:28.526243 14036 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:28.528553 14036 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:28.528780 14036 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.529036 14036 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:28.529219 14036 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:28.569808 14036 rpc_server.cc:307] RPC server started. Bound to: 127.13.181.3:34557
I20260709 13:08:28.569913 26609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.181.3:34557 every 8 connection(s)
I20260709 13:08:28.584049 26610 heartbeater.cc:344] Connected to a master server at 127.13.181.62:35903
I20260709 13:08:28.584514 26610 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:28.585265 26610 heartbeater.cc:507] Master 127.13.181.62:35903 requested a full tablet report, sending...
I20260709 13:08:28.587352 26334 ts_manager.cc:194] Registered new tserver with Master: 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:28.587879 14036 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014672121s
I20260709 13:08:28.588757 26334 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56876
I20260709 13:08:28.614305 26334 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56882:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:28.617050 26334 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:28.703707 26573 tablet_service.cc:1511] Processing CreateTablet for tablet ddbebc16af5545ef990c3a43641f114e (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:28.704020 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 729b05ee1c6649edb015253fb12fe4c4 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:28.705281 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbebc16af5545ef990c3a43641f114e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.705808 26574 tablet_service.cc:1511] Processing CreateTablet for tablet c0b63f8428fe4dce9b42560ca36d3b14 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:28.706386 26425 tablet_service.cc:1511] Processing CreateTablet for tablet c0b63f8428fe4dce9b42560ca36d3b14 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:28.707567 26424 tablet_service.cc:1511] Processing CreateTablet for tablet ddbebc16af5545ef990c3a43641f114e (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:28.709075 26572 tablet_service.cc:1511] Processing CreateTablet for tablet f6beef3502914b20bf0d7f6b89903b93 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:28.710474 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b63f8428fe4dce9b42560ca36d3b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.710239 26423 tablet_service.cc:1511] Processing CreateTablet for tablet f6beef3502914b20bf0d7f6b89903b93 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:28.711875 26500 tablet_service.cc:1511] Processing CreateTablet for tablet c0b63f8428fe4dce9b42560ca36d3b14 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:28.712298 26498 tablet_service.cc:1511] Processing CreateTablet for tablet f6beef3502914b20bf0d7f6b89903b93 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:28.712653 26422 tablet_service.cc:1511] Processing CreateTablet for tablet a56c20a706174c9d8477f6c80037f3be (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:28.713248 26500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b63f8428fe4dce9b42560ca36d3b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.708016 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0b63f8428fe4dce9b42560ca36d3b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.714035 26426 tablet_service.cc:1511] Processing CreateTablet for tablet 729b05ee1c6649edb015253fb12fe4c4 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:28.715309 26426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729b05ee1c6649edb015253fb12fe4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.715772 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729b05ee1c6649edb015253fb12fe4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.716266 26499 tablet_service.cc:1511] Processing CreateTablet for tablet ddbebc16af5545ef990c3a43641f114e (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:28.717589 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbebc16af5545ef990c3a43641f114e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.718487 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6beef3502914b20bf0d7f6b89903b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.719412 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6beef3502914b20bf0d7f6b89903b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.719405 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56c20a706174c9d8477f6c80037f3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.710130 26501 tablet_service.cc:1511] Processing CreateTablet for tablet 729b05ee1c6649edb015253fb12fe4c4 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:28.720753 26423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6beef3502914b20bf0d7f6b89903b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.721210 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 729b05ee1c6649edb015253fb12fe4c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.721971 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddbebc16af5545ef990c3a43641f114e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.766331 26497 tablet_service.cc:1511] Processing CreateTablet for tablet a56c20a706174c9d8477f6c80037f3be (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:28.767632 26571 tablet_service.cc:1511] Processing CreateTablet for tablet a56c20a706174c9d8477f6c80037f3be (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:28.768780 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56c20a706174c9d8477f6c80037f3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.770124 26421 tablet_service.cc:1511] Processing CreateTablet for tablet 75a5a607b33444d481012ba72e9fb7f2 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:28.770614 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a56c20a706174c9d8477f6c80037f3be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.771548 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a5a607b33444d481012ba72e9fb7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.778527 26626 tablet_bootstrap.cc:492] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:28.785233 26626 tablet_bootstrap.cc:654] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.796548 26627 tablet_bootstrap.cc:492] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:28.809549 26575 tablet_service.cc:1511] Processing CreateTablet for tablet 75a5a607b33444d481012ba72e9fb7f2 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:28.811504 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a5a607b33444d481012ba72e9fb7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.812552 26625 tablet_bootstrap.cc:492] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:28.816888 26426 tablet_service.cc:1511] Processing CreateTablet for tablet b9762e66cc4a4bf386558b9e67c5979c (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:28.818296 26426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9762e66cc4a4bf386558b9e67c5979c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.820703 26498 tablet_service.cc:1511] Processing CreateTablet for tablet b9762e66cc4a4bf386558b9e67c5979c (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:28.822063 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9762e66cc4a4bf386558b9e67c5979c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.831198 26627 tablet_bootstrap.cc:654] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.839383 26423 tablet_service.cc:1511] Processing CreateTablet for tablet ed916284f33f4976bcf48282267ebb51 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:28.840802 26625 tablet_bootstrap.cc:654] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.841297 26423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed916284f33f4976bcf48282267ebb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.836999 26575 tablet_service.cc:1511] Processing CreateTablet for tablet b9762e66cc4a4bf386558b9e67c5979c (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:28.847697 26497 tablet_service.cc:1511] Processing CreateTablet for tablet 75a5a607b33444d481012ba72e9fb7f2 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:28.849073 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75a5a607b33444d481012ba72e9fb7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.849399 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9762e66cc4a4bf386558b9e67c5979c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.858131 26626 tablet_bootstrap.cc:492] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:28.858718 26626 ts_tablet_manager.cc:1403] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.033s
I20260709 13:08:28.860445 26501 tablet_service.cc:1511] Processing CreateTablet for tablet ed916284f33f4976bcf48282267ebb51 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:28.862049 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed916284f33f4976bcf48282267ebb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.863757 26627 tablet_bootstrap.cc:492] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:28.864624 26627 ts_tablet_manager.cc:1403] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.010s
I20260709 13:08:28.862056 26626 raft_consensus.cc:359] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.867439 26626 raft_consensus.cc:385] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.867853 26626 raft_consensus.cc:740] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.869097 26627 raft_consensus.cc:359] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:28.869872 26627 raft_consensus.cc:385] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.870162 26627 raft_consensus.cc:740] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.870409 26626 consensus_queue.cc:260] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.871495 26571 tablet_service.cc:1511] Processing CreateTablet for tablet ed916284f33f4976bcf48282267ebb51 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:28.877015 26627 consensus_queue.cc:260] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:28.879498 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed916284f33f4976bcf48282267ebb51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.880553 26610 heartbeater.cc:499] Master 127.13.181.62:35903 was elected leader, sending a full tablet report...
I20260709 13:08:28.877902 26421 tablet_service.cc:1511] Processing CreateTablet for tablet ab16e189770a4778b4a878cb2edd6a89 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:28.881800 26625 tablet_bootstrap.cc:492] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:28.882304 26625 ts_tablet_manager.cc:1403] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.000s
I20260709 13:08:28.882694 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16e189770a4778b4a878cb2edd6a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.885326 26625 raft_consensus.cc:359] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.886113 26625 raft_consensus.cc:385] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.886397 26625 raft_consensus.cc:740] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.887355 26625 consensus_queue.cc:260] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.888945 26498 tablet_service.cc:1511] Processing CreateTablet for tablet ab16e189770a4778b4a878cb2edd6a89 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:28.890873 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16e189770a4778b4a878cb2edd6a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.881618 26626 ts_tablet_manager.cc:1434] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.006s
I20260709 13:08:28.892181 26626 tablet_bootstrap.cc:492] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:28.899010 26626 tablet_bootstrap.cc:654] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.901643 26572 tablet_service.cc:1511] Processing CreateTablet for tablet ab16e189770a4778b4a878cb2edd6a89 (DEFAULT_TABLE table=test-workload [id=0260042c491d4ea1b3e31076377c930a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:28.902243 26625 ts_tablet_manager.cc:1434] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:08:28.903187 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab16e189770a4778b4a878cb2edd6a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.909375 26536 heartbeater.cc:499] Master 127.13.181.62:35903 was elected leader, sending a full tablet report...
I20260709 13:08:28.914448 26625 tablet_bootstrap.cc:492] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:28.915863 26626 tablet_bootstrap.cc:492] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:28.916011 26627 ts_tablet_manager.cc:1434] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.006s
I20260709 13:08:28.916479 26461 heartbeater.cc:499] Master 127.13.181.62:35903 was elected leader, sending a full tablet report...
I20260709 13:08:28.916466 26626 ts_tablet_manager.cc:1403] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:08:28.920190 26626 raft_consensus.cc:359] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.920900 26626 raft_consensus.cc:385] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.921207 26626 raft_consensus.cc:740] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.922214 26626 consensus_queue.cc:260] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.924724 26626 ts_tablet_manager.cc:1434] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:28.925727 26626 tablet_bootstrap.cc:492] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:28.928987 26625 tablet_bootstrap.cc:654] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.930891 26627 tablet_bootstrap.cc:492] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:28.932428 26626 tablet_bootstrap.cc:654] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.935115 26625 tablet_bootstrap.cc:492] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:28.935794 26625 ts_tablet_manager.cc:1403] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.004s
I20260709 13:08:28.937121 26627 tablet_bootstrap.cc:654] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.939697 26625 raft_consensus.cc:359] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.940807 26625 raft_consensus.cc:385] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.941197 26625 raft_consensus.cc:740] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.942525 26625 consensus_queue.cc:260] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.945858 26625 ts_tablet_manager.cc:1434] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:28.947244 26625 tablet_bootstrap.cc:492] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:28.956881 26625 tablet_bootstrap.cc:654] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.961284 26626 tablet_bootstrap.cc:492] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:28.961968 26626 ts_tablet_manager.cc:1403] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.010s
I20260709 13:08:28.966809 26626 raft_consensus.cc:359] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.967446 26626 raft_consensus.cc:385] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.967651 26626 raft_consensus.cc:740] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.968259 26626 consensus_queue.cc:260] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.968993 26625 tablet_bootstrap.cc:492] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:28.969724 26625 ts_tablet_manager.cc:1403] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:08:28.970269 26626 ts_tablet_manager.cc:1434] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:28.971431 26626 tablet_bootstrap.cc:492] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:28.973634 26625 raft_consensus.cc:359] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.974892 26625 raft_consensus.cc:385] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.975479 26625 raft_consensus.cc:740] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.976682 26625 consensus_queue.cc:260] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.977917 26626 tablet_bootstrap.cc:654] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.979835 26625 ts_tablet_manager.cc:1434] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:08:28.981251 26625 tablet_bootstrap.cc:492] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:28.985453 26626 tablet_bootstrap.cc:492] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:28.986024 26626 ts_tablet_manager.cc:1403] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:08:28.988075 26625 tablet_bootstrap.cc:654] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:28.988982 26626 raft_consensus.cc:359] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:28.989660 26626 raft_consensus.cc:385] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.989916 26626 raft_consensus.cc:740] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.990682 26626 consensus_queue.cc:260] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:28.993664 26627 tablet_bootstrap.cc:492] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:28.994046 26625 tablet_bootstrap.cc:492] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:28.994704 26627 ts_tablet_manager.cc:1403] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.008s
I20260709 13:08:28.994763 26625 ts_tablet_manager.cc:1403] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 13:08:28.995700 26626 ts_tablet_manager.cc:1434] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:28.996747 26626 tablet_bootstrap.cc:492] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:28.998000 26625 raft_consensus.cc:359] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.998759 26625 raft_consensus.cc:385] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:28.999058 26625 raft_consensus.cc:740] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:28.998961 26627 raft_consensus.cc:359] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:28.999836 26627 raft_consensus.cc:385] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.000138 26627 raft_consensus.cc:740] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.000070 26625 consensus_queue.cc:260] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.001734 26627 consensus_queue.cc:260] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.003944 26626 tablet_bootstrap.cc:654] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.004650 26625 ts_tablet_manager.cc:1434] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:29.005774 26625 tablet_bootstrap.cc:492] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:29.010144 26626 tablet_bootstrap.cc:492] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:29.010712 26626 ts_tablet_manager.cc:1403] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:08:29.012395 26625 tablet_bootstrap.cc:654] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.013012 26627 ts_tablet_manager.cc:1434] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:08:29.013653 26626 raft_consensus.cc:359] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.014434 26626 raft_consensus.cc:385] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.014742 26626 raft_consensus.cc:740] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.015846 26626 consensus_queue.cc:260] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.017416 26633 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.018103 26633 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.019120 26627 tablet_bootstrap.cc:492] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:29.020562 26626 ts_tablet_manager.cc:1434] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:08:29.021653 26626 tablet_bootstrap.cc:492] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:29.033222 26633 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.036027 26627 tablet_bootstrap.cc:654] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.039248 26626 tablet_bootstrap.cc:654] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.042371 26625 tablet_bootstrap.cc:492] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:29.043046 26625 ts_tablet_manager.cc:1403] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.023s
I20260709 13:08:29.043951 26631 raft_consensus.cc:493] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.044473 26631 raft_consensus.cc:515] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.046015 26625 raft_consensus.cc:359] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:29.046762 26625 raft_consensus.cc:385] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.047086 26625 raft_consensus.cc:740] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.047806 26625 consensus_queue.cc:260] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:29.050076 26625 ts_tablet_manager.cc:1434] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:29.053043 26625 tablet_bootstrap.cc:492] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:29.052937 26631 leader_election.cc:290] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.061801 26625 tablet_bootstrap.cc:654] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.092648 26631 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.093549 26631 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.097193 26631 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.144632 26633 raft_consensus.cc:493] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.145345 26626 tablet_bootstrap.cc:492] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:29.145244 26633 raft_consensus.cc:515] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.146184 26626 ts_tablet_manager.cc:1403] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.125s	user 0.043s	sys 0.063s
I20260709 13:08:29.146615 26625 tablet_bootstrap.cc:492] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:29.147193 26625 ts_tablet_manager.cc:1403] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.094s	user 0.032s	sys 0.053s
I20260709 13:08:29.146970 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.148147 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:29.148873 26585 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:29.149533 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.150066 26626 raft_consensus.cc:359] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.150444 26625 raft_consensus.cc:359] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.151075 26626 raft_consensus.cc:385] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.151271 26625 raft_consensus.cc:385] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.154763 26627 tablet_bootstrap.cc:492] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:29.151726 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.153606 26633 leader_election.cc:290] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.152331 26477 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
W20260709 13:08:29.152495 26548 leader_election.cc:343] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.158888 26627 ts_tablet_manager.cc:1403] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.140s	user 0.052s	sys 0.057s
W20260709 13:08:29.160199 26548 leader_election.cc:343] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.152241 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.161530 26510 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:29.162304 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
W20260709 13:08:29.160272 26550 leader_election.cc:343] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.163094 26585 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:29.163226 26550 leader_election.cc:304] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097; no voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:29.164113 26633 raft_consensus.cc:2804] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.164559 26633 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.164779 26631 raft_consensus.cc:2749] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.151806 26625 raft_consensus.cc:740] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.151767 26626 raft_consensus.cc:740] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.165578 26477 leader_election.cc:304] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.165879 26625 consensus_queue.cc:260] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.166616 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.165014 26550 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:29.164988 26633 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.168246 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.169366 26631 raft_consensus.cc:2804] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.169903 26631 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.170360 26631 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.170531 26650 raft_consensus.cc:493] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.171849 26650 raft_consensus.cc:515] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.175151 26650 leader_election.cc:290] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.163132 26627 raft_consensus.cc:359] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
W20260709 13:08:29.177879 26474 leader_election.cc:343] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.178243 26627 raft_consensus.cc:385] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.176738 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.179484 26435 raft_consensus.cc:2468] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:29.179386 26626 consensus_queue.cc:260] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.178840 26627 raft_consensus.cc:740] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.181023 26650 raft_consensus.cc:2804] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.181663 26474 leader_election.cc:304] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.178202 26633 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.196375 26650 raft_consensus.cc:493] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.190068 26631 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.183991 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
W20260709 13:08:29.194598 26382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:29.181704 26627 consensus_queue.cc:260] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.196945 26650 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.198206 26585 raft_consensus.cc:2468] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:29.203801 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:29.204635 26584 raft_consensus.cc:2393] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f3cc3405985542cc9b5bbfde63eb7cff in current term 1: Already voted for candidate 0e26deddd9324b8b929a6eb224280097 in this term.
I20260709 13:08:29.198414 26651 raft_consensus.cc:2804] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.199322 26436 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:29.199534 26625 ts_tablet_manager.cc:1434] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.052s	user 0.019s	sys 0.020s
I20260709 13:08:29.207321 26625 tablet_bootstrap.cc:492] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:29.200897 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:29.211346 26510 raft_consensus.cc:2393] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0e26deddd9324b8b929a6eb224280097 in current term 1: Already voted for candidate f3cc3405985542cc9b5bbfde63eb7cff in this term.
I20260709 13:08:29.212781 26651 raft_consensus.cc:493] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.212518 26650 raft_consensus.cc:515] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.213208 26651 raft_consensus.cc:3060] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.215900 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.216012 26650 leader_election.cc:290] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.216117 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:29.216523 26436 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.216900 26584 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.220321 26625 tablet_bootstrap.cc:654] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.224607 26436 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:29.225683 26584 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:29.226034 26474 leader_election.cc:304] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.201074 26627 ts_tablet_manager.cc:1434] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:08:29.201846 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.227279 26650 raft_consensus.cc:2804] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.227867 26627 tablet_bootstrap.cc:492] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
W20260709 13:08:29.229161 26548 leader_election.cc:343] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.229717 26548 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097; no voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:29.198855 26633 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.230595 26653 raft_consensus.cc:2749] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.200980 26631 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.231316 26632 raft_consensus.cc:493] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.225714 26625 tablet_bootstrap.cc:492] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:29.234421 26625 ts_tablet_manager.cc:1403] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:08:29.233883 26632 raft_consensus.cc:515] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:29.235911 26627 tablet_bootstrap.cc:654] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.202818 26626 ts_tablet_manager.cc:1434] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.007s
I20260709 13:08:29.237986 26625 raft_consensus.cc:359] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.238857 26625 raft_consensus.cc:385] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.239246 26625 raft_consensus.cc:740] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.240231 26625 consensus_queue.cc:260] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.238879 26626 tablet_bootstrap.cc:492] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:29.242857 26625 ts_tablet_manager.cc:1434] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:29.244136 26627 tablet_bootstrap.cc:492] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:29.244148 26625 tablet_bootstrap.cc:492] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:29.244894 26627 ts_tablet_manager.cc:1403] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:08:29.248512 26627 raft_consensus.cc:359] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.249370 26627 raft_consensus.cc:385] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.249694 26627 raft_consensus.cc:740] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.227897 26650 raft_consensus.cc:697] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:29.202535 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.250629 26627 consensus_queue.cc:260] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
W20260709 13:08:29.251495 26474 leader_election.cc:343] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.252087 26474 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cc3405985542cc9b5bbfde63eb7cff; no voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:29.252140 26650 consensus_queue.cc:237] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.253333 26633 raft_consensus.cc:2749] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.253741 26625 tablet_bootstrap.cc:654] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.257865 26632 leader_election.cc:290] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.261264 26627 ts_tablet_manager.cc:1434] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:08:29.262535 26627 tablet_bootstrap.cc:492] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:29.267665 26625 tablet_bootstrap.cc:492] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:29.268235 26625 ts_tablet_manager.cc:1403] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:08:29.269801 26626 tablet_bootstrap.cc:654] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.267681 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729b05ee1c6649edb015253fb12fe4c4" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:29.271397 26584 raft_consensus.cc:2468] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:29.272764 26402 leader_election.cc:304] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:29.273574 26632 raft_consensus.cc:2804] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.273941 26632 raft_consensus.cc:493] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.274271 26632 raft_consensus.cc:3060] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.274132 26625 raft_consensus.cc:359] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.274904 26625 raft_consensus.cc:385] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.275249 26625 raft_consensus.cc:740] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.276021 26625 consensus_queue.cc:260] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.278056 26625 ts_tablet_manager.cc:1434] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:29.279017 26625 tablet_bootstrap.cc:492] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:29.278537 26332 catalog_manager.cc:5697] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.280366 26631 raft_consensus.cc:493] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.280857 26631 raft_consensus.cc:515] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.270888 26627 tablet_bootstrap.cc:654] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.283591 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.284307 26434 raft_consensus.cc:2468] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:29.233872 26651 raft_consensus.cc:515] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.285653 26548 leader_election.cc:304] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:29.282831 26632 raft_consensus.cc:515] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:29.293061 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729b05ee1c6649edb015253fb12fe4c4" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.293785 26510 raft_consensus.cc:2468] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:29.294124 26632 leader_election.cc:290] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Requested vote from peers 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.294660 26653 raft_consensus.cc:2804] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.295002 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.290359 26627 tablet_bootstrap.cc:492] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:29.295733 26434 raft_consensus.cc:3060] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.295897 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729b05ee1c6649edb015253fb12fe4c4" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:29.295156 26653 raft_consensus.cc:493] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.296483 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.296514 26584 raft_consensus.cc:3060] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.295938 26627 ts_tablet_manager.cc:1403] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.005s
I20260709 13:08:29.297663 26631 leader_election.cc:290] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.297261 26510 raft_consensus.cc:2468] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:29.296682 26653 raft_consensus.cc:3060] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.291707 26625 tablet_bootstrap.cc:654] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.300608 26627 raft_consensus.cc:359] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.301396 26627 raft_consensus.cc:385] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.301705 26627 raft_consensus.cc:740] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.302420 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "729b05ee1c6649edb015253fb12fe4c4" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:29.302515 26627 consensus_queue.cc:260] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.303225 26510 raft_consensus.cc:3060] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.304925 26627 ts_tablet_manager.cc:1434] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:08:29.306584 26434 raft_consensus.cc:2468] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:29.308252 26627 tablet_bootstrap.cc:492] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:29.310788 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:29.308688 26626 tablet_bootstrap.cc:492] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:29.310724 26474 leader_election.cc:304] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.311491 26585 raft_consensus.cc:3060] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.312203 26650 raft_consensus.cc:2804] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.311637 26510 raft_consensus.cc:2468] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:29.313004 26650 raft_consensus.cc:697] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:29.314325 26650 consensus_queue.cc:237] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.315415 26401 leader_election.cc:304] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.318480 26632 raft_consensus.cc:2804] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.319216 26627 tablet_bootstrap.cc:654] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.319866 26626 ts_tablet_manager.cc:1403] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.002s
I20260709 13:08:29.321434 26585 raft_consensus.cc:2468] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:29.309461 26651 leader_election.cc:290] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.319252 26632 raft_consensus.cc:697] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:29.323866 26626 raft_consensus.cc:359] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.324065 26632 consensus_queue.cc:237] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } }
I20260709 13:08:29.327466 26584 raft_consensus.cc:2468] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:29.333810 26653 raft_consensus.cc:515] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.329807 26626 raft_consensus.cc:385] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.337558 26626 raft_consensus.cc:740] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.344211 26627 tablet_bootstrap.cc:492] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:29.344614 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.344815 26625 tablet_bootstrap.cc:492] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:29.344830 26627 ts_tablet_manager.cc:1403] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.002s
I20260709 13:08:29.345283 26434 raft_consensus.cc:3060] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.345628 26625 ts_tablet_manager.cc:1403] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.014s
I20260709 13:08:29.348366 26627 raft_consensus.cc:359] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.348575 26625 raft_consensus.cc:359] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.349112 26627 raft_consensus.cc:385] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.349361 26625 raft_consensus.cc:385] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.349472 26627 raft_consensus.cc:740] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.349800 26625 raft_consensus.cc:740] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.350379 26627 consensus_queue.cc:260] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.350597 26625 consensus_queue.cc:260] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.352794 26625 ts_tablet_manager.cc:1434] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:29.353021 26627 ts_tablet_manager.cc:1434] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:08:29.354152 26627 tablet_bootstrap.cc:492] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:29.354257 26434 raft_consensus.cc:2468] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:29.355396 26548 leader_election.cc:304] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:29.356518 26631 raft_consensus.cc:2804] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.361697 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:29.363204 26510 raft_consensus.cc:3060] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.363116 26626 consensus_queue.cc:260] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.369980 26627 tablet_bootstrap.cc:654] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.370177 26650 raft_consensus.cc:493] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.370774 26650 raft_consensus.cc:515] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.373749 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.373723 26333 catalog_manager.cc:5697] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 0 to 1, leader changed from <none> to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 1 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:29.375659 26474 leader_election.cc:343] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.380577 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:29.380981 26510 raft_consensus.cc:2468] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
W20260709 13:08:29.384202 26477 leader_election.cc:343] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:29.384323 26631 raft_consensus.cc:697] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:29.387140 26477 leader_election.cc:304] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cc3405985542cc9b5bbfde63eb7cff; no voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:29.388135 26651 raft_consensus.cc:2749] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.387766 26631 consensus_queue.cc:237] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.388831 26332 catalog_manager.cc:5697] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.383327 26653 leader_election.cc:290] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.391160 26650 leader_election.cc:290] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.401767 26626 ts_tablet_manager.cc:1434] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 13:08:29.402024 26632 raft_consensus.cc:493] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.402510 26632 raft_consensus.cc:515] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.402956 26626 tablet_bootstrap.cc:492] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:29.404650 26632 leader_election.cc:290] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.407241 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:29.407919 26584 raft_consensus.cc:2468] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:29.409242 26402 leader_election.cc:304] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:29.410162 26632 raft_consensus.cc:2804] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.410578 26632 raft_consensus.cc:493] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.410984 26632 raft_consensus.cc:3060] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.411266 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.411937 26510 raft_consensus.cc:2468] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:29.416541 26626 tablet_bootstrap.cc:654] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.418191 26627 tablet_bootstrap.cc:492] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:29.417371 26334 catalog_manager.cc:5697] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.419314 26627 ts_tablet_manager.cc:1403] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.065s	user 0.021s	sys 0.031s
I20260709 13:08:29.419106 26632 raft_consensus.cc:515] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.422176 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:29.423386 26510 raft_consensus.cc:3060] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.424201 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:29.424774 26584 raft_consensus.cc:3060] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.422513 26627 raft_consensus.cc:359] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.430513 26627 raft_consensus.cc:385] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.430863 26627 raft_consensus.cc:740] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.431704 26627 consensus_queue.cc:260] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.433983 26627 ts_tablet_manager.cc:1434] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:08:29.435199 26627 tablet_bootstrap.cc:492] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:29.437536 26584 raft_consensus.cc:2468] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:29.439357 26402 leader_election.cc:304] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:29.437605 26626 tablet_bootstrap.cc:492] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:29.440240 26510 raft_consensus.cc:2468] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:29.440289 26657 raft_consensus.cc:2804] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.442389 26657 raft_consensus.cc:697] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:29.443315 26657 consensus_queue.cc:237] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.443987 26627 tablet_bootstrap.cc:654] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.447105 26626 ts_tablet_manager.cc:1403] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.003s
I20260709 13:08:29.448870 26627 tablet_bootstrap.cc:492] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:29.449415 26627 ts_tablet_manager.cc:1403] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:08:29.450186 26626 raft_consensus.cc:359] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.451210 26626 raft_consensus.cc:385] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.451548 26626 raft_consensus.cc:740] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.452440 26627 raft_consensus.cc:359] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.453178 26627 raft_consensus.cc:385] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.453482 26627 raft_consensus.cc:740] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.453408 26626 consensus_queue.cc:260] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.454569 26627 consensus_queue.cc:260] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.456602 26626 ts_tablet_manager.cc:1434] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:29.456930 26627 ts_tablet_manager.cc:1434] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:29.457950 26626 tablet_bootstrap.cc:492] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:29.457993 26627 tablet_bootstrap.cc:492] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:29.452440 26632 leader_election.cc:290] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.462731 26631 raft_consensus.cc:493] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.463279 26631 raft_consensus.cc:515] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.464053 26626 tablet_bootstrap.cc:654] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.464840 26627 tablet_bootstrap.cc:654] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:29.467630 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16e189770a4778b4a878cb2edd6a89" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.468571 26510 raft_consensus.cc:2468] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:29.471192 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16e189770a4778b4a878cb2edd6a89" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.472127 26434 raft_consensus.cc:2468] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:29.475462 26334 catalog_manager.cc:5697] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 0 to 1, leader changed from <none> to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 1 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.478869 26550 leader_election.cc:304] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.479866 26653 raft_consensus.cc:2804] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.480065 26627 tablet_bootstrap.cc:492] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:29.480245 26653 raft_consensus.cc:493] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.480563 26627 ts_tablet_manager.cc:1403] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.002s
I20260709 13:08:29.480594 26653 raft_consensus.cc:3060] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.483577 26627 raft_consensus.cc:359] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.484272 26627 raft_consensus.cc:385] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.484566 26627 raft_consensus.cc:740] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.485220 26627 consensus_queue.cc:260] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.485618 26631 leader_election.cc:290] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.487324 26627 ts_tablet_manager.cc:1434] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:29.490255 26653 raft_consensus.cc:515] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.493749 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16e189770a4778b4a878cb2edd6a89" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.494498 26434 raft_consensus.cc:3060] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.495743 26653 leader_election.cc:290] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.498452 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab16e189770a4778b4a878cb2edd6a89" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:29.499399 26626 tablet_bootstrap.cc:492] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:29.499979 26626 ts_tablet_manager.cc:1403] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.008s
I20260709 13:08:29.502597 26626 raft_consensus.cc:359] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.499279 26510 raft_consensus.cc:3060] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.504496 26657 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.505035 26657 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.507932 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.508447 26434 raft_consensus.cc:2468] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:29.508759 26511 raft_consensus.cc:2393] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348bd127f30f46e1a84a78b57b66f77a in current term 1: Already voted for candidate f3cc3405985542cc9b5bbfde63eb7cff in this term.
I20260709 13:08:29.509215 26510 raft_consensus.cc:2468] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:29.509358 26657 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.509963 26626 raft_consensus.cc:385] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:29.509807 26548 leader_election.cc:304] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:29.510360 26626 raft_consensus.cc:740] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:29.510802 26653 raft_consensus.cc:2804] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.511299 26653 raft_consensus.cc:697] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:29.511005 26626 consensus_queue.cc:260] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.511835 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:29.512629 26584 raft_consensus.cc:2393] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 348bd127f30f46e1a84a78b57b66f77a in current term 1: Already voted for candidate 0e26deddd9324b8b929a6eb224280097 in this term.
I20260709 13:08:29.512178 26653 consensus_queue.cc:237] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.512979 26626 ts_tablet_manager.cc:1434] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:08:29.514010 26402 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a; no voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:29.514139 26631 raft_consensus.cc:493] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.514834 26657 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.514709 26631 raft_consensus.cc:515] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.517303 26631 leader_election.cc:290] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.518540 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:29.519317 26510 raft_consensus.cc:2468] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:29.519310 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.520326 26434 raft_consensus.cc:2468] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:29.520653 26550 leader_election.cc:304] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.521612 26631 raft_consensus.cc:2804] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.522019 26631 raft_consensus.cc:493] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.522286 26657 raft_consensus.cc:2749] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:29.522432 26631 raft_consensus.cc:3060] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.529714 26631 raft_consensus.cc:515] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.529289 26334 catalog_manager.cc:5697] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.532255 26631 leader_election.cc:290] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:29.532810 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:29.533326 26510 raft_consensus.cc:3060] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.533514 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.534088 26434 raft_consensus.cc:3060] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.539460 26510 raft_consensus.cc:2468] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:29.540488 26550 leader_election.cc:304] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.540877 26434 raft_consensus.cc:2468] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:29.541467 26631 raft_consensus.cc:2804] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.542218 26631 raft_consensus.cc:697] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:29.543002 26631 consensus_queue.cc:237] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.550285 26334 catalog_manager.cc:5697] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:29.634343 26650 raft_consensus.cc:493] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.635000 26650 raft_consensus.cc:515] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.636786 26650 leader_election.cc:290] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.637732 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:29.637822 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:29.638453 26434 raft_consensus.cc:2468] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:29.638566 26584 raft_consensus.cc:2468] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:29.639633 26474 leader_election.cc:304] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.640643 26650 raft_consensus.cc:2804] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:29.641012 26650 raft_consensus.cc:493] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:29.641367 26650 raft_consensus.cc:3060] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.648953 26650 raft_consensus.cc:515] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.650624 26650 leader_election.cc:290] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:29.651373 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:29.651590 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:29.651965 26434 raft_consensus.cc:3060] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.652205 26584 raft_consensus.cc:3060] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:29.656898 26434 raft_consensus.cc:2468] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:29.657470 26584 raft_consensus.cc:2468] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:29.657984 26474 leader_election.cc:304] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:29.658869 26650 raft_consensus.cc:2804] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:29.659328 26650 raft_consensus.cc:697] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:29.659965 26650 consensus_queue.cc:237] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:29.667356 26334 catalog_manager.cc:5697] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:29.676818 26650 consensus_queue.cc:1048] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.688409 26650 consensus_queue.cc:1048] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.795284 26657 consensus_queue.cc:1048] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.805461 26632 consensus_queue.cc:1048] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.823884 26632 consensus_queue.cc:1048] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.834738 26657 consensus_queue.cc:1048] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:29.856878 26631 consensus_queue.cc:1048] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.869932 26631 consensus_queue.cc:1048] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.900355 26651 consensus_queue.cc:1048] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:29.909962 26650 consensus_queue.cc:1048] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.020328 26631 consensus_queue.cc:1048] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.030606 26631 consensus_queue.cc:1048] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.031545 26671 consensus_queue.cc:1048] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:30.040458 26671 consensus_queue.cc:1048] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.058673 26650 consensus_queue.cc:1048] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:30.073590 26633 consensus_queue.cc:1048] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:08:30.201179 26382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:30.865228 26633 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.865959 26633 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:30.867789 26633 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:30.868713 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:30.869050 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:30.869459 26436 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:30.869738 26585 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:30.870657 26474 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:30.871412 26633 raft_consensus.cc:2804] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.871713 26633 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.871974 26633 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.877235 26633 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:30.879244 26633 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:30.879827 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:30.880419 26436 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.880638 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:30.881916 26585 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.886317 26436 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:30.887467 26474 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:30.888199 26633 raft_consensus.cc:2804] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:30.888614 26633 raft_consensus.cc:697] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:30.889508 26585 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:30.889423 26633 consensus_queue.cc:237] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:30.897485 26333 catalog_manager.cc:5697] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 0 to 2, leader changed from <none> to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.302940 26436 raft_consensus.cc:1275] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:31.304311 26633 consensus_queue.cc:1048] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.317255 26585 raft_consensus.cc:1275] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:08:31.318785 26633 consensus_queue.cc:1048] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:31.424453 26510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
mode: GRACEFUL
new_leader_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:43372
I20260709 13:08:31.425056 26510 raft_consensus.cc:606] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Received request to transfer leadership to TS 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:31.432003 26510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
mode: GRACEFUL
new_leader_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:43372
I20260709 13:08:31.432615 26510 raft_consensus.cc:606] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Received request to transfer leadership to TS 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:31.435931 26709 raft_consensus.cc:993] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff: : Instructing follower 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:31.436404 26650 raft_consensus.cc:1081] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Signalling peer 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:31.438004 26436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:48420
I20260709 13:08:31.438627 26436 raft_consensus.cc:493] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.438934 26436 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.440006 26510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
mode: GRACEFUL
new_leader_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:43372
I20260709 13:08:31.440647 26510 raft_consensus.cc:606] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Received request to transfer leadership to TS 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:31.445361 26436 raft_consensus.cc:515] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.447419 26436 leader_election.cc:290] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:31.448170 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:31.448844 26510 raft_consensus.cc:3055] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.449113 26510 raft_consensus.cc:740] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:31.449873 26510 consensus_queue.cc:260] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.450834 26510 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.455938 26510 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:31.457037 26401 leader_election.cc:304] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:31.457198 26585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:31.457834 26585 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.457942 26675 raft_consensus.cc:2804] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.459347 26675 raft_consensus.cc:697] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:31.460212 26675 consensus_queue.cc:237] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.465939 26585 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:31.466024 26584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be"
dest_uuid: "0e26deddd9324b8b929a6eb224280097"
mode: GRACEFUL
new_leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:56282
I20260709 13:08:31.466784 26584 raft_consensus.cc:606] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Received request to transfer leadership to TS f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:31.469659 26332 catalog_manager.cc:5697] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 1 to 2, leader changed from f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2) to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 2 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.481021 26671 raft_consensus.cc:993] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097: : Instructing follower f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:31.481503 26670 raft_consensus.cc:1081] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Signalling peer f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:31.483266 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:43352
I20260709 13:08:31.483762 26510 raft_consensus.cc:493] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.484053 26510 raft_consensus.cc:3060] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.487596 26436 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
mode: GRACEFUL
new_leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:48444
I20260709 13:08:31.488353 26436 raft_consensus.cc:606] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Received request to transfer leadership to TS f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:31.490151 26510 raft_consensus.cc:515] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.492882 26510 leader_election.cc:290] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:31.492997 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:31.493767 26436 raft_consensus.cc:3060] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.494195 26585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51"
dest_uuid: "0e26deddd9324b8b929a6eb224280097"
mode: GRACEFUL
new_leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:56282
I20260709 13:08:31.494865 26585 raft_consensus.cc:606] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Received request to transfer leadership to TS f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:31.498073 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a56c20a706174c9d8477f6c80037f3be" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:31.498769 26584 raft_consensus.cc:3055] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.499104 26584 raft_consensus.cc:740] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:31.499933 26584 consensus_queue.cc:260] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.500841 26436 raft_consensus.cc:2468] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:31.501312 26584 raft_consensus.cc:3060] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.502507 26474 leader_election.cc:304] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:31.503322 26650 raft_consensus.cc:2804] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.503809 26650 raft_consensus.cc:697] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:31.504590 26650 consensus_queue.cc:237] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.508832 26584 raft_consensus.cc:2468] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:31.512624 26332 catalog_manager.cc:5697] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 1 to 2, leader changed from 0e26deddd9324b8b929a6eb224280097 (127.13.181.3) to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.590943 26716 raft_consensus.cc:993] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a: : Instructing follower f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:31.591421 26675 raft_consensus.cc:1081] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Signalling peer f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:31.592990 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:43362
I20260709 13:08:31.593492 26510 raft_consensus.cc:493] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.593743 26510 raft_consensus.cc:3060] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.598889 26510 raft_consensus.cc:515] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.600621 26510 leader_election.cc:290] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:31.601328 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:31.601667 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9762e66cc4a4bf386558b9e67c5979c" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:31.601940 26436 raft_consensus.cc:3055] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.602276 26584 raft_consensus.cc:3060] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.602332 26436 raft_consensus.cc:740] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:31.603215 26436 consensus_queue.cc:260] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.604130 26436 raft_consensus.cc:3060] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.607307 26584 raft_consensus.cc:2468] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:31.608321 26477 leader_election.cc:304] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:31.609086 26650 raft_consensus.cc:2804] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.609134 26436 raft_consensus.cc:2468] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:31.609515 26650 raft_consensus.cc:697] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:31.610369 26650 consensus_queue.cc:237] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.617311 26332 catalog_manager.cc:5697] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 1 to 2, leader changed from 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1) to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.702061 26633 raft_consensus.cc:993] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff: : Instructing follower 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:31.702507 26650 raft_consensus.cc:1081] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Signalling peer 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:31.703985 26436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:48420
I20260709 13:08:31.704483 26436 raft_consensus.cc:493] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.704788 26436 raft_consensus.cc:3060] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.709645 26436 raft_consensus.cc:515] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.711237 26436 leader_election.cc:290] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:31.712145 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:31.712370 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6beef3502914b20bf0d7f6b89903b93" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:31.712893 26510 raft_consensus.cc:3055] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.712953 26584 raft_consensus.cc:3060] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.713222 26510 raft_consensus.cc:740] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:31.714068 26510 consensus_queue.cc:260] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.714993 26510 raft_consensus.cc:3060] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.719372 26584 raft_consensus.cc:2468] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:31.720533 26510 raft_consensus.cc:2468] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:31.720582 26402 leader_election.cc:304] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:31.721511 26675 raft_consensus.cc:2804] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.721911 26675 raft_consensus.cc:697] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:31.722621 26675 consensus_queue.cc:237] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.729851 26332 catalog_manager.cc:5697] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 1 to 2, leader changed from f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2) to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 2 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.830921 26633 raft_consensus.cc:993] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff: : Instructing follower 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:31.831491 26650 raft_consensus.cc:1081] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Signalling peer 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:31.833088 26436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:48420
I20260709 13:08:31.833654 26436 raft_consensus.cc:493] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.833962 26436 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.838953 26436 raft_consensus.cc:515] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.840924 26436 leader_election.cc:290] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 3 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:31.841645 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:31.841964 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddbebc16af5545ef990c3a43641f114e" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:31.842414 26511 raft_consensus.cc:3055] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:31.842568 26584 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.842875 26511 raft_consensus.cc:740] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:31.843837 26671 raft_consensus.cc:993] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097: : Instructing follower f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:31.843909 26511 consensus_queue.cc:260] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.844632 26670 raft_consensus.cc:1081] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Signalling peer f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:31.845491 26511 raft_consensus.cc:3060] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:31.846570 26510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:43352
I20260709 13:08:31.847218 26510 raft_consensus.cc:493] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.847599 26510 raft_consensus.cc:3060] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.849769 26584 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 3.
I20260709 13:08:31.850972 26402 leader_election.cc:304] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:31.851846 26716 raft_consensus.cc:2804] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:31.851981 26511 raft_consensus.cc:2468] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 3.
I20260709 13:08:31.852373 26716 raft_consensus.cc:697] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 3 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:31.853253 26716 consensus_queue.cc:237] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.854087 26510 raft_consensus.cc:515] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.856796 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:31.856926 26510 leader_election.cc:290] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:31.857129 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed916284f33f4976bcf48282267ebb51" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:31.857386 26436 raft_consensus.cc:3060] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.857996 26584 raft_consensus.cc:3055] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:31.858389 26584 raft_consensus.cc:740] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:31.859359 26584 consensus_queue.cc:260] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.860262 26332 catalog_manager.cc:5697] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 2 to 3, leader changed from f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2) to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 3 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.860656 26584 raft_consensus.cc:3060] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:31.864140 26436 raft_consensus.cc:2468] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:31.865422 26474 leader_election.cc:304] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:31.866123 26650 raft_consensus.cc:2804] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:31.866611 26650 raft_consensus.cc:697] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:31.867388 26650 consensus_queue.cc:237] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:31.870816 26584 raft_consensus.cc:2468] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:31.874961 26332 catalog_manager.cc:5697] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 1 to 2, leader changed from 0e26deddd9324b8b929a6eb224280097 (127.13.181.3) to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:31.945873 26436 raft_consensus.cc:1275] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:31.947492 26650 consensus_queue.cc:1048] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:31.958503 26584 raft_consensus.cc:1275] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:31.959993 26633 consensus_queue.cc:1048] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.049901 26510 raft_consensus.cc:1275] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.051390 26716 consensus_queue.cc:1048] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.059551 26584 raft_consensus.cc:1275] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.061097 26733 consensus_queue.cc:1048] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.105329 26584 raft_consensus.cc:1275] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.106506 26733 consensus_queue.cc:1048] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.115206 26510 raft_consensus.cc:1275] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.116716 26716 consensus_queue.cc:1048] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.187923 26436 raft_consensus.cc:1275] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.189404 26728 consensus_queue.cc:1048] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.194367 26584 raft_consensus.cc:1275] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.196038 26650 consensus_queue.cc:1048] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.317685 26584 raft_consensus.cc:1275] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 3 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:32.318958 26716 consensus_queue.cc:1048] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.326539 26510 raft_consensus.cc:1275] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:32.328017 26733 consensus_queue.cc:1048] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.330278 26436 raft_consensus.cc:1275] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.331925 26633 consensus_queue.cc:1048] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:32.343622 26584 raft_consensus.cc:1275] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:32.345036 26633 consensus_queue.cc:1048] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:34.894867 26334 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39092:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:34.897576 26334 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:34.951045 26423 tablet_service.cc:1511] Processing CreateTablet for tablet 496f7819d4ff40f6a767014fbfce75d9 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:34.952550 26498 tablet_service.cc:1511] Processing CreateTablet for tablet 496f7819d4ff40f6a767014fbfce75d9 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:34.953019 26423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496f7819d4ff40f6a767014fbfce75d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.954216 26498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496f7819d4ff40f6a767014fbfce75d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.955734 26571 tablet_service.cc:1511] Processing CreateTablet for tablet 496f7819d4ff40f6a767014fbfce75d9 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:34.957207 26571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496f7819d4ff40f6a767014fbfce75d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.961011 26572 tablet_service.cc:1511] Processing CreateTablet for tablet a75566f234864bcaa28975c6d76cd82a (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:34.961493 26497 tablet_service.cc:1511] Processing CreateTablet for tablet a75566f234864bcaa28975c6d76cd82a (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:34.963050 26572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75566f234864bcaa28975c6d76cd82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.963316 26497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75566f234864bcaa28975c6d76cd82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.969617 26421 tablet_service.cc:1511] Processing CreateTablet for tablet a75566f234864bcaa28975c6d76cd82a (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:34.971349 26421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a75566f234864bcaa28975c6d76cd82a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.976788 26426 tablet_service.cc:1511] Processing CreateTablet for tablet eb6ec2214c464967b136109f3affc0ff (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:34.978367 26426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6ec2214c464967b136109f3affc0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.979580 26575 tablet_service.cc:1511] Processing CreateTablet for tablet eb6ec2214c464967b136109f3affc0ff (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:34.981035 26575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6ec2214c464967b136109f3affc0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.985116 26501 tablet_service.cc:1511] Processing CreateTablet for tablet eb6ec2214c464967b136109f3affc0ff (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:34.986544 26501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb6ec2214c464967b136109f3affc0ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.996109 26424 tablet_service.cc:1511] Processing CreateTablet for tablet effec88fc44041bba5c5ce7734969d7b (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:34.997829 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effec88fc44041bba5c5ce7734969d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:34.998968 26573 tablet_service.cc:1511] Processing CreateTablet for tablet effec88fc44041bba5c5ce7734969d7b (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:35.000460 26573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effec88fc44041bba5c5ce7734969d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.001297 26422 tablet_service.cc:1511] Processing CreateTablet for tablet 614aa81f18ee411f928307541a4a2b77 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:35.002668 26422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614aa81f18ee411f928307541a4a2b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.002852 26574 tablet_service.cc:1511] Processing CreateTablet for tablet 614aa81f18ee411f928307541a4a2b77 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:35.004347 26574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614aa81f18ee411f928307541a4a2b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.004176 26499 tablet_service.cc:1511] Processing CreateTablet for tablet effec88fc44041bba5c5ce7734969d7b (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:35.005578 26499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet effec88fc44041bba5c5ce7734969d7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.008508 26570 tablet_service.cc:1511] Processing CreateTablet for tablet 7cba44c3ad3e41ca89957d62144f27ed (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:35.008772 26425 tablet_service.cc:1511] Processing CreateTablet for tablet 7cba44c3ad3e41ca89957d62144f27ed (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:35.010026 26570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cba44c3ad3e41ca89957d62144f27ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.009847 26500 tablet_service.cc:1511] Processing CreateTablet for tablet 614aa81f18ee411f928307541a4a2b77 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:35.011650 26420 tablet_service.cc:1511] Processing CreateTablet for tablet f6d8be372a1e4cd2b2f8e451d7aa4f02 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:35.012214 26496 tablet_service.cc:1511] Processing CreateTablet for tablet 7cba44c3ad3e41ca89957d62144f27ed (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:35.014364 26500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614aa81f18ee411f928307541a4a2b77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.019382 26496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cba44c3ad3e41ca89957d62144f27ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.020679 26419 tablet_service.cc:1511] Processing CreateTablet for tablet 375218808c054de596e244eda3539677 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:35.016942 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cba44c3ad3e41ca89957d62144f27ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.023854 26495 tablet_service.cc:1511] Processing CreateTablet for tablet f6d8be372a1e4cd2b2f8e451d7aa4f02 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:35.025194 26495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d8be372a1e4cd2b2f8e451d7aa4f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.027472 26420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d8be372a1e4cd2b2f8e451d7aa4f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.027835 26568 tablet_service.cc:1511] Processing CreateTablet for tablet 375218808c054de596e244eda3539677 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:35.028689 26494 tablet_service.cc:1511] Processing CreateTablet for tablet 375218808c054de596e244eda3539677 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:35.029539 26568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375218808c054de596e244eda3539677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.030117 26494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375218808c054de596e244eda3539677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.032862 26418 tablet_service.cc:1511] Processing CreateTablet for tablet 7a29e7bee0e0438fa4243f369787a41b (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:35.034102 26419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 375218808c054de596e244eda3539677. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.014289 26569 tablet_service.cc:1511] Processing CreateTablet for tablet f6d8be372a1e4cd2b2f8e451d7aa4f02 (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:35.041493 26569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6d8be372a1e4cd2b2f8e451d7aa4f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.041754 26418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a29e7bee0e0438fa4243f369787a41b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.074352 26493 tablet_service.cc:1511] Processing CreateTablet for tablet 7a29e7bee0e0438fa4243f369787a41b (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:35.076401 26493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a29e7bee0e0438fa4243f369787a41b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.086445 26567 tablet_service.cc:1511] Processing CreateTablet for tablet 7a29e7bee0e0438fa4243f369787a41b (DEFAULT_TABLE table=soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:35.088430 26567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a29e7bee0e0438fa4243f369787a41b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:35.134231 26758 tablet_bootstrap.cc:492] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.135565 26759 tablet_bootstrap.cc:492] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.150604 26758 tablet_bootstrap.cc:654] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.163992 26760 tablet_bootstrap.cc:492] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.164363 26759 tablet_bootstrap.cc:654] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.175688 26760 tablet_bootstrap.cc:654] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.178763 26758 tablet_bootstrap.cc:492] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.179399 26758 ts_tablet_manager.cc:1403] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.007s
I20260709 13:08:35.179459 26759 tablet_bootstrap.cc:492] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.180147 26759 ts_tablet_manager.cc:1403] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.007s
I20260709 13:08:35.181246 26760 tablet_bootstrap.cc:492] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.181697 26760 ts_tablet_manager.cc:1403] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.006s
I20260709 13:08:35.183070 26758 raft_consensus.cc:359] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.183283 26759 raft_consensus.cc:359] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.184079 26758 raft_consensus.cc:385] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.184152 26759 raft_consensus.cc:385] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.184289 26760 raft_consensus.cc:359] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.184540 26759 raft_consensus.cc:740] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.184508 26758 raft_consensus.cc:740] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.185150 26760 raft_consensus.cc:385] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.185529 26760 raft_consensus.cc:740] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.185705 26759 consensus_queue.cc:260] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.185771 26758 consensus_queue.cc:260] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.186513 26760 consensus_queue.cc:260] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.188859 26758 ts_tablet_manager.cc:1434] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:08:35.188894 26759 ts_tablet_manager.cc:1434] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:35.190008 26758 tablet_bootstrap.cc:492] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.190047 26759 tablet_bootstrap.cc:492] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.196267 26760 ts_tablet_manager.cc:1434] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:08:35.197281 26759 tablet_bootstrap.cc:654] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.197448 26760 tablet_bootstrap.cc:492] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.197731 26758 tablet_bootstrap.cc:654] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.206266 26760 tablet_bootstrap.cc:654] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.223135 26760 tablet_bootstrap.cc:492] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.223804 26760 ts_tablet_manager.cc:1403] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
I20260709 13:08:35.227751 26760 raft_consensus.cc:359] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.228739 26760 raft_consensus.cc:385] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.229130 26760 raft_consensus.cc:740] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.230324 26760 consensus_queue.cc:260] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.234149 26760 ts_tablet_manager.cc:1434] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:35.235615 26760 tablet_bootstrap.cc:492] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.240175 26759 tablet_bootstrap.cc:492] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.240736 26759 ts_tablet_manager.cc:1403] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.051s	user 0.020s	sys 0.028s
I20260709 13:08:35.243878 26759 raft_consensus.cc:359] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.244654 26759 raft_consensus.cc:385] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.244968 26759 raft_consensus.cc:740] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.245398 26760 tablet_bootstrap.cc:654] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.245918 26758 tablet_bootstrap.cc:492] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.245675 26759 consensus_queue.cc:260] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.246409 26758 ts_tablet_manager.cc:1403] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.025s
I20260709 13:08:35.248134 26759 ts_tablet_manager.cc:1434] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:08:35.249089 26759 tablet_bootstrap.cc:492] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.249531 26758 raft_consensus.cc:359] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.250342 26758 raft_consensus.cc:385] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.250645 26758 raft_consensus.cc:740] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.251413 26758 consensus_queue.cc:260] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.253859 26758 ts_tablet_manager.cc:1434] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:35.254851 26758 tablet_bootstrap.cc:492] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.259635 26759 tablet_bootstrap.cc:654] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.259624 26760 tablet_bootstrap.cc:492] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.260478 26760 ts_tablet_manager.cc:1403] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 13:08:35.261884 26758 tablet_bootstrap.cc:654] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.263837 26760 raft_consensus.cc:359] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.264576 26760 raft_consensus.cc:385] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.264882 26760 raft_consensus.cc:740] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.265748 26760 consensus_queue.cc:260] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.270335 26760 ts_tablet_manager.cc:1434] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:35.271381 26760 tablet_bootstrap.cc:492] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.278192 26760 tablet_bootstrap.cc:654] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.286404 26759 tablet_bootstrap.cc:492] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.287068 26759 ts_tablet_manager.cc:1403] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.015s
I20260709 13:08:35.289564 26758 tablet_bootstrap.cc:492] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.290154 26758 ts_tablet_manager.cc:1403] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.020s
I20260709 13:08:35.291558 26759 raft_consensus.cc:359] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.292208 26759 raft_consensus.cc:385] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.292510 26759 raft_consensus.cc:740] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.293318 26759 consensus_queue.cc:260] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.293836 26760 tablet_bootstrap.cc:492] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.293361 26758 raft_consensus.cc:359] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.294373 26760 ts_tablet_manager.cc:1403] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.023s	user 0.003s	sys 0.011s
I20260709 13:08:35.295894 26759 ts_tablet_manager.cc:1434] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:35.296614 26758 raft_consensus.cc:385] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.296900 26759 tablet_bootstrap.cc:492] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.297034 26758 raft_consensus.cc:740] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.297497 26760 raft_consensus.cc:359] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.298269 26760 raft_consensus.cc:385] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.297964 26758 consensus_queue.cc:260] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.298560 26760 raft_consensus.cc:740] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.299486 26760 consensus_queue.cc:260] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.300336 26758 ts_tablet_manager.cc:1434] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:08:35.301411 26758 tablet_bootstrap.cc:492] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.305133 26760 ts_tablet_manager.cc:1434] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:35.306219 26760 tablet_bootstrap.cc:492] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.308054 26758 tablet_bootstrap.cc:654] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.308346 26759 tablet_bootstrap.cc:654] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:35.316672 26611 tablet.cc:2406] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:35.317790 26760 tablet_bootstrap.cc:654] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.321517 26733 raft_consensus.cc:493] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.322108 26733 raft_consensus.cc:515] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.325060 26759 tablet_bootstrap.cc:492] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.325317 26758 tablet_bootstrap.cc:492] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.325640 26759 ts_tablet_manager.cc:1403] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.010s
I20260709 13:08:35.326066 26758 ts_tablet_manager.cc:1403] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:08:35.326788 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75566f234864bcaa28975c6d76cd82a" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.327531 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75566f234864bcaa28975c6d76cd82a" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:35.327670 26583 raft_consensus.cc:2468] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:35.328177 26510 raft_consensus.cc:2468] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:35.329095 26759 raft_consensus.cc:359] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.329874 26759 raft_consensus.cc:385] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.329655 26758 raft_consensus.cc:359] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.330420 26759 raft_consensus.cc:740] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.330858 26758 raft_consensus.cc:385] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.331281 26758 raft_consensus.cc:740] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.331646 26733 leader_election.cc:290] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.331301 26759 consensus_queue.cc:260] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.331492 26402 leader_election.cc:304] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:35.332388 26758 consensus_queue.cc:260] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.333472 26744 raft_consensus.cc:2804] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.333822 26759 ts_tablet_manager.cc:1434] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:35.335083 26759 tablet_bootstrap.cc:492] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.335340 26758 ts_tablet_manager.cc:1434] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:08:35.336519 26758 tablet_bootstrap.cc:492] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.343681 26759 tablet_bootstrap.cc:654] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.344770 26758 tablet_bootstrap.cc:654] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.344980 26760 tablet_bootstrap.cc:492] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.345706 26760 ts_tablet_manager.cc:1403] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.000s
I20260709 13:08:35.349687 26760 raft_consensus.cc:359] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.350677 26760 raft_consensus.cc:385] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.357241 26758 tablet_bootstrap.cc:492] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.333847 26744 raft_consensus.cc:493] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.358017 26758 ts_tablet_manager.cc:1403] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 13:08:35.358201 26760 raft_consensus.cc:740] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.357954 26744 raft_consensus.cc:3060] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.359613 26760 consensus_queue.cc:260] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.363454 26760 ts_tablet_manager.cc:1434] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:08:35.364905 26760 tablet_bootstrap.cc:492] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.367851 26758 raft_consensus.cc:359] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.368801 26758 raft_consensus.cc:385] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.369174 26758 raft_consensus.cc:740] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.369890 26752 raft_consensus.cc:493] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.370064 26758 consensus_queue.cc:260] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.370671 26752 raft_consensus.cc:515] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.373843 26758 ts_tablet_manager.cc:1434] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.008s
I20260709 13:08:35.375061 26758 tablet_bootstrap.cc:492] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.374985 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
W20260709 13:08:35.377424 26474 leader_election.cc:343] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.383862 26758 tablet_bootstrap.cc:654] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:35.384492 26382 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:35.388695 26650 raft_consensus.cc:493] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.389293 26650 raft_consensus.cc:515] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.392329 26650 leader_election.cc:290] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.392786 26759 tablet_bootstrap.cc:492] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.393966 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:35.394529 26759 ts_tablet_manager.cc:1403] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.023s
W20260709 13:08:35.395335 26474 leader_election.cc:343] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.396028 26752 leader_election.cc:290] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.397405 26759 raft_consensus.cc:359] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.397977 26759 raft_consensus.cc:385] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.398275 26759 raft_consensus.cc:740] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.398310 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.399020 26582 raft_consensus.cc:2468] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:35.399119 26759 consensus_queue.cc:260] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.393621 26760 tablet_bootstrap.cc:654] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.402765 26477 leader_election.cc:304] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:35.404577 26752 raft_consensus.cc:2804] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.405076 26752 raft_consensus.cc:493] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.405390 26752 raft_consensus.cc:3060] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.417186 26752 raft_consensus.cc:515] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.419654 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.420778 26583 raft_consensus.cc:2468] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:35.422961 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
W20260709 13:08:35.427109 26474 leader_election.cc:343] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.430902 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:35.431689 26582 raft_consensus.cc:3060] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.442566 26582 raft_consensus.cc:2468] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:35.443799 26781 raft_consensus.cc:493] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.443231 26752 leader_election.cc:290] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.460022 26477 leader_election.cc:304] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:35.461850 26477 leader_election.cc:304] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:35.462960 26650 raft_consensus.cc:2804] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.463459 26650 raft_consensus.cc:493] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.463877 26650 raft_consensus.cc:3060] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.468277 26752 raft_consensus.cc:2804] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.447757 26781 raft_consensus.cc:515] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.484833 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
W20260709 13:08:35.487205 26402 leader_election.cc:343] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.488179 26781 leader_election.cc:290] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.494923 26650 raft_consensus.cc:515] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
W20260709 13:08:35.506633 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:32995, user_credentials={real_user=slave}} blocked reactor thread for 97034.5us
I20260709 13:08:35.507161 26759 ts_tablet_manager.cc:1434] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.112s	user 0.018s	sys 0.034s
I20260709 13:08:35.508314 26759 tablet_bootstrap.cc:492] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.508471 26780 raft_consensus.cc:493] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.509006 26780 raft_consensus.cc:515] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.509907 26781 raft_consensus.cc:493] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.497087 26752 raft_consensus.cc:697] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:35.509927 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:35.510516 26781 raft_consensus.cc:515] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.511209 26752 consensus_queue.cc:237] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.513180 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
W20260709 13:08:35.515245 26474 leader_election.cc:343] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:35.516494 26401 leader_election.cc:343] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.517096 26401 leader_election.cc:304] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a; no voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:35.518075 26733 raft_consensus.cc:2749] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:35.519942 26781 leader_election.cc:290] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.519785 26744 raft_consensus.cc:515] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.521775 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.521816 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:35.522928 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75566f234864bcaa28975c6d76cd82a" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:35.523468 26780 leader_election.cc:290] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.521965 26744 leader_election.cc:290] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.523546 26510 raft_consensus.cc:3060] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.524307 26758 tablet_bootstrap.cc:492] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.525110 26758 ts_tablet_manager.cc:1403] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.150s	user 0.069s	sys 0.054s
I20260709 13:08:35.520105 26760 tablet_bootstrap.cc:492] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
W20260709 13:08:35.525781 26402 leader_election.cc:343] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.526502 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.528780 26760 ts_tablet_manager.cc:1403] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.164s	user 0.033s	sys 0.027s
I20260709 13:08:35.529065 26583 raft_consensus.cc:2468] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:35.530269 26402 leader_election.cc:304] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:35.527269 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a75566f234864bcaa28975c6d76cd82a" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:35.531327 26783 raft_consensus.cc:493] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.531486 26582 raft_consensus.cc:3060] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.531785 26758 raft_consensus.cc:359] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.531891 26783 raft_consensus.cc:515] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.532811 26758 raft_consensus.cc:385] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.533442 26758 raft_consensus.cc:740] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.534394 26758 consensus_queue.cc:260] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.534885 26783 leader_election.cc:290] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.536586 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:35.536985 26758 ts_tablet_manager.cc:1434] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:35.537325 26744 raft_consensus.cc:2804] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.537744 26744 raft_consensus.cc:493] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.538085 26744 raft_consensus.cc:3060] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.538475 26758 tablet_bootstrap.cc:492] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
W20260709 13:08:35.538893 26401 leader_election.cc:343] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.539423 26401 leader_election.cc:304] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a; no voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff
W20260709 13:08:35.538215 26474 leader_election.cc:343] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.541675 26780 raft_consensus.cc:2749] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:35.542042 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
W20260709 13:08:35.544008 26401 leader_election.cc:343] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.545562 26582 raft_consensus.cc:2468] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:35.546473 26758 tablet_bootstrap.cc:654] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.546921 26402 leader_election.cc:304] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:35.547616 26510 raft_consensus.cc:2468] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:35.545595 26650 leader_election.cc:290] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.549419 26780 raft_consensus.cc:2804] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.549965 26780 raft_consensus.cc:697] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:35.528163 26759 tablet_bootstrap.cc:654] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.550758 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.552953 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:35.553508 26583 raft_consensus.cc:3060] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.550803 26780 consensus_queue.cc:237] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
W20260709 13:08:35.563170 26477 leader_election.cc:343] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.563694 26477 leader_election.cc:304] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cc3405985542cc9b5bbfde63eb7cff; no voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:35.564894 26334 catalog_manager.cc:5697] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.560441 26744 raft_consensus.cc:515] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.567201 26752 raft_consensus.cc:2749] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:35.568693 26583 raft_consensus.cc:2468] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:35.570259 26477 leader_election.cc:304] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:35.574321 26744 leader_election.cc:290] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.532066 26760 raft_consensus.cc:359] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.575668 26760 raft_consensus.cc:385] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.575977 26760 raft_consensus.cc:740] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.576900 26760 consensus_queue.cc:260] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.577957 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:35.579378 26760 ts_tablet_manager.cc:1434] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
W20260709 13:08:35.579461 26401 leader_election.cc:343] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.576265 26332 catalog_manager.cc:5697] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 0 to 1, leader changed from <none> to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 1 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.580574 26760 tablet_bootstrap.cc:492] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.580549 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:35.583503 26758 tablet_bootstrap.cc:492] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.583627 26583 raft_consensus.cc:3060] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.584206 26758 ts_tablet_manager.cc:1403] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.010s
W20260709 13:08:35.586571 26457 debug-util.cc:398] Leaking SignalData structure 0x7b08001bc300 after lost signal to thread 14039
I20260709 13:08:35.592226 26758 raft_consensus.cc:359] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.593041 26758 raft_consensus.cc:385] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.593726 26759 tablet_bootstrap.cc:492] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.594261 26759 ts_tablet_manager.cc:1403] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.009s
I20260709 13:08:35.593336 26758 raft_consensus.cc:740] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.596127 26758 consensus_queue.cc:260] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
W20260709 13:08:35.597837 26457 debug-util.cc:398] Leaking SignalData structure 0x7b080008cd00 after lost signal to thread 26460
I20260709 13:08:35.597218 26759 raft_consensus.cc:359] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.603327 26759 raft_consensus.cc:385] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.603624 26759 raft_consensus.cc:740] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
W20260709 13:08:35.604005 26457 debug-util.cc:398] Leaking SignalData structure 0x7b0800065500 after lost signal to thread 26535
W20260709 13:08:35.605535 26457 debug-util.cc:398] Leaking SignalData structure 0x7b080028ff00 after lost signal to thread 26609
I20260709 13:08:35.599233 26758 ts_tablet_manager.cc:1434] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:08:35.607256 26758 tablet_bootstrap.cc:492] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.610484 26784 raft_consensus.cc:2804] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.611171 26784 raft_consensus.cc:697] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:35.597566 26583 raft_consensus.cc:2468] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:35.612054 26784 consensus_queue.cc:237] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.612435 26402 leader_election.cc:304] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:35.613724 26744 raft_consensus.cc:2804] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.614194 26744 raft_consensus.cc:697] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:35.602448 26760 tablet_bootstrap.cc:654] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.615015 26744 consensus_queue.cc:237] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.604377 26759 consensus_queue.cc:260] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.619222 26759 ts_tablet_manager.cc:1434] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:08:35.620296 26759 tablet_bootstrap.cc:492] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.622694 26782 raft_consensus.cc:493] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.623329 26782 raft_consensus.cc:515] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.626552 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
W20260709 13:08:35.628036 26474 leader_election.cc:343] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.630321 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.631278 26760 tablet_bootstrap.cc:492] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.631839 26760 ts_tablet_manager.cc:1403] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.002s
W20260709 13:08:35.631812 26477 leader_election.cc:343] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.632481 26477 leader_election.cc:304] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cc3405985542cc9b5bbfde63eb7cff; no voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:35.633344 26752 raft_consensus.cc:2749] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:35.634440 26782 leader_election.cc:290] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.636734 26758 tablet_bootstrap.cc:654] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.637203 26760 raft_consensus.cc:359] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.638080 26760 raft_consensus.cc:385] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.638398 26760 raft_consensus.cc:740] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.650277 26759 tablet_bootstrap.cc:654] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.649842 26332 catalog_manager.cc:5697] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 0 to 1, leader changed from <none> to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 1 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.653932 26334 catalog_manager.cc:5697] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.657773 26760 consensus_queue.cc:260] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.659170 26670 raft_consensus.cc:493] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.659885 26670 raft_consensus.cc:515] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.663727 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:35.664383 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:35.664935 26760 ts_tablet_manager.cc:1434] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.003s
I20260709 13:08:35.664404 26434 raft_consensus.cc:2468] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:35.669864 26548 leader_election.cc:304] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:35.665309 26510 raft_consensus.cc:2468] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:35.671092 26774 raft_consensus.cc:2804] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.671679 26774 raft_consensus.cc:493] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.672051 26774 raft_consensus.cc:3060] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.666159 26760 tablet_bootstrap.cc:492] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.666481 26670 leader_election.cc:290] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:35.666735 26759 tablet_bootstrap.cc:492] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.675822 26759 ts_tablet_manager.cc:1403] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.056s	user 0.007s	sys 0.006s
I20260709 13:08:35.676895 26758 tablet_bootstrap.cc:492] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.677393 26758 ts_tablet_manager.cc:1403] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.010s
I20260709 13:08:35.684993 26759 raft_consensus.cc:359] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.685798 26759 raft_consensus.cc:385] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.686090 26759 raft_consensus.cc:740] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.686854 26759 consensus_queue.cc:260] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.689544 26759 ts_tablet_manager.cc:1434] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:08:35.690596 26759 tablet_bootstrap.cc:492] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.686877 26774 raft_consensus.cc:515] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.695209 26760 tablet_bootstrap.cc:654] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.696671 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:35.697502 26434 raft_consensus.cc:3060] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.698091 26759 tablet_bootstrap.cc:654] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.693420 26774 leader_election.cc:290] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:35.700680 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:35.701314 26510 raft_consensus.cc:3060] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.705622 26760 tablet_bootstrap.cc:492] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.705750 26759 tablet_bootstrap.cc:492] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.706274 26760 ts_tablet_manager.cc:1403] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.008s
I20260709 13:08:35.706358 26759 ts_tablet_manager.cc:1403] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 13:08:35.709431 26510 raft_consensus.cc:2468] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:35.709465 26760 raft_consensus.cc:359] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.710508 26760 raft_consensus.cc:385] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.710842 26760 raft_consensus.cc:740] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.710908 26550 leader_election.cc:304] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:35.711967 26774 raft_consensus.cc:2804] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.711822 26760 consensus_queue.cc:260] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.712484 26774 raft_consensus.cc:697] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:35.696663 26758 raft_consensus.cc:359] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.713330 26774 consensus_queue.cc:237] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.715767 26758 raft_consensus.cc:385] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.716306 26758 raft_consensus.cc:740] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.716552 26434 raft_consensus.cc:2468] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:35.714231 26760 ts_tablet_manager.cc:1434] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:35.717959 26760 tablet_bootstrap.cc:492] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff: Bootstrap starting.
I20260709 13:08:35.714865 26759 raft_consensus.cc:359] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.718442 26758 consensus_queue.cc:260] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.723670 26759 raft_consensus.cc:385] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.723984 26759 raft_consensus.cc:740] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.724658 26759 consensus_queue.cc:260] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.725366 26758 ts_tablet_manager.cc:1434] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.003s
I20260709 13:08:35.726379 26758 tablet_bootstrap.cc:492] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097: Bootstrap starting.
I20260709 13:08:35.726603 26759 ts_tablet_manager.cc:1434] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.000s
I20260709 13:08:35.727622 26759 tablet_bootstrap.cc:492] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a: Bootstrap starting.
I20260709 13:08:35.730005 26760 tablet_bootstrap.cc:654] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.731489 26670 raft_consensus.cc:493] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.732548 26670 raft_consensus.cc:515] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.734658 26670 leader_election.cc:290] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:35.736145 26744 raft_consensus.cc:493] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.736644 26744 raft_consensus.cc:515] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.739786 26758 tablet_bootstrap.cc:654] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.739190 26744 leader_election.cc:290] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.743546 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375218808c054de596e244eda3539677" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.743779 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:35.744318 26583 raft_consensus.cc:2468] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:35.745900 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:35.746845 26511 raft_consensus.cc:2468] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:35.749820 26402 leader_election.cc:304] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:35.751889 26550 leader_election.cc:304] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:35.751948 26744 raft_consensus.cc:2804] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.752818 26744 raft_consensus.cc:493] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.744355 26434 raft_consensus.cc:2468] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 0.
I20260709 13:08:35.753363 26744 raft_consensus.cc:3060] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.759125 26760 tablet_bootstrap.cc:492] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff: No bootstrap required, opened a new log
I20260709 13:08:35.760027 26760 ts_tablet_manager.cc:1403] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.019s
I20260709 13:08:35.759835 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375218808c054de596e244eda3539677" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:35.752831 26670 raft_consensus.cc:2804] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:08:35.762882 26401 leader_election.cc:343] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:35.761816 26670 raft_consensus.cc:493] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.765404 26670 raft_consensus.cc:3060] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.766117 26759 tablet_bootstrap.cc:654] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:35.772902 26334 catalog_manager.cc:5697] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.776889 26760 raft_consensus.cc:359] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.780947 26670 raft_consensus.cc:515] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.781510 26760 raft_consensus.cc:385] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.778257 26758 tablet_bootstrap.cc:492] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097: No bootstrap required, opened a new log
I20260709 13:08:35.782899 26758 ts_tablet_manager.cc:1403] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.018s
I20260709 13:08:35.784375 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:35.785092 26434 raft_consensus.cc:3060] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.785881 26758 raft_consensus.cc:359] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.786604 26758 raft_consensus.cc:385] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.786857 26758 raft_consensus.cc:740] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.787611 26758 consensus_queue.cc:260] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.789979 26758 ts_tablet_manager.cc:1434] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:08:35.790717 26760 raft_consensus.cc:740] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.791631 26760 consensus_queue.cc:260] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.801340 26760 ts_tablet_manager.cc:1434] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:08:35.802282 26434 raft_consensus.cc:2468] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:35.801918 26744 raft_consensus.cc:515] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.804136 26511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:35.804798 26511 raft_consensus.cc:3060] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.805208 26744 leader_election.cc:290] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.802925 26670 leader_election.cc:290] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:35.806717 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375218808c054de596e244eda3539677" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:35.807384 26583 raft_consensus.cc:3060] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.807595 26548 leader_election.cc:304] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:35.810036 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375218808c054de596e244eda3539677" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:35.810698 26510 raft_consensus.cc:3060] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.813161 26670 raft_consensus.cc:2804] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.813939 26511 raft_consensus.cc:2468] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 1.
I20260709 13:08:35.815943 26759 tablet_bootstrap.cc:492] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a: No bootstrap required, opened a new log
I20260709 13:08:35.815976 26670 raft_consensus.cc:697] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:35.817575 26759 ts_tablet_manager.cc:1403] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.005s
I20260709 13:08:35.817458 26670 consensus_queue.cc:237] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.820881 26759 raft_consensus.cc:359] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.821620 26759 raft_consensus.cc:385] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:35.821923 26759 raft_consensus.cc:740] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Initialized, Role: FOLLOWER
I20260709 13:08:35.822646 26759 consensus_queue.cc:260] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.825371 26759 ts_tablet_manager.cc:1434] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:08:35.837044 26334 catalog_manager.cc:5697] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 1 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.838439 26510 raft_consensus.cc:2468] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:35.840068 26401 leader_election.cc:304] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:35.841090 26744 raft_consensus.cc:2804] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.841634 26744 raft_consensus.cc:697] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:35.842507 26744 consensus_queue.cc:237] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.847608 26583 raft_consensus.cc:2468] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:35.857270 26334 catalog_manager.cc:5697] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 0 to 1, leader changed from <none> to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 1 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.892292 26744 raft_consensus.cc:493] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.892871 26744 raft_consensus.cc:515] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.894654 26744 leader_election.cc:290] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.895577 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" is_pre_election: true
I20260709 13:08:35.895799 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:35.896356 26510 raft_consensus.cc:2468] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:35.896369 26583 raft_consensus.cc:2468] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 0.
I20260709 13:08:35.897641 26402 leader_election.cc:304] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:35.898432 26744 raft_consensus.cc:2804] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:35.898820 26744 raft_consensus.cc:493] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.899134 26744 raft_consensus.cc:3060] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.904749 26744 raft_consensus.cc:515] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.906500 26744 leader_election.cc:290] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:35.907398 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:35.907948 26510 raft_consensus.cc:3060] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.908157 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:35.908764 26583 raft_consensus.cc:3060] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.914544 26510 raft_consensus.cc:2468] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:35.915374 26583 raft_consensus.cc:2468] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 1.
I20260709 13:08:35.915732 26401 leader_election.cc:304] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:35.916671 26744 raft_consensus.cc:2804] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:35.917143 26744 raft_consensus.cc:697] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:35.917773 26744 consensus_queue.cc:237] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:35.926054 26334 catalog_manager.cc:5697] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 0 to 1, leader changed from <none> to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 1 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.945015 26784 consensus_queue.cc:1048] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:35.959052 26434 raft_consensus.cc:3060] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:35.969558 26752 consensus_queue.cc:1048] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.002836 26752 raft_consensus.cc:493] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.003515 26752 raft_consensus.cc:515] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.005411 26752 leader_election.cc:290] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.006319 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:36.006619 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:36.007053 26434 raft_consensus.cc:2468] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:36.007493 26583 raft_consensus.cc:2468] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 0.
I20260709 13:08:36.008323 26474 leader_election.cc:304] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.009112 26752 raft_consensus.cc:2804] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:36.009505 26752 raft_consensus.cc:493] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.009795 26752 raft_consensus.cc:3060] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.017230 26752 raft_consensus.cc:515] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.019272 26752 leader_election.cc:290] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.020211 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:36.020964 26434 raft_consensus.cc:3060] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.020889 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.021745 26583 raft_consensus.cc:3060] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.026979 26434 raft_consensus.cc:2468] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:36.028303 26474 leader_election.cc:304] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.029078 26752 raft_consensus.cc:2804] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:36.029564 26752 raft_consensus.cc:697] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.029981 26583 raft_consensus.cc:2468] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 1.
I20260709 13:08:36.030970 26752 consensus_queue.cc:237] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.040102 26334 catalog_manager.cc:5697] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 0 to 1, leader changed from <none> to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 1 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.056031 26434 raft_consensus.cc:3060] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.060667 26744 consensus_queue.cc:1048] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.064056 26782 consensus_queue.cc:1048] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.069685 26744 consensus_queue.cc:1048] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.078685 26782 consensus_queue.cc:1048] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.113241 26752 raft_consensus.cc:493] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.113948 26752 raft_consensus.cc:515] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.117733 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348bd127f30f46e1a84a78b57b66f77a" is_pre_election: true
I20260709 13:08:36.121069 26752 leader_election.cc:290] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.124822 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e26deddd9324b8b929a6eb224280097" is_pre_election: true
I20260709 13:08:36.126216 26584 raft_consensus.cc:2393] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f3cc3405985542cc9b5bbfde63eb7cff in current term 1: Already voted for candidate 348bd127f30f46e1a84a78b57b66f77a in this term.
I20260709 13:08:36.132207 26477 leader_election.cc:304] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f3cc3405985542cc9b5bbfde63eb7cff; no voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:36.140501 26584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9"
dest_uuid: "0e26deddd9324b8b929a6eb224280097"
mode: GRACEFUL
new_leader_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:56282
I20260709 13:08:36.147814 26584 raft_consensus.cc:606] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Received request to transfer leadership to TS 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:36.143467 26780 consensus_queue.cc:1048] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.148430 26782 raft_consensus.cc:3060] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:36.164520 26511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
mode: GRACEFUL
new_leader_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:43372
I20260709 13:08:36.165220 26511 raft_consensus.cc:606] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Received request to transfer leadership to TS 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:36.167438 26782 raft_consensus.cc:2749] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:36.167714 26774 consensus_queue.cc:1048] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.173753 26780 consensus_queue.cc:1048] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.178346 26511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
mode: GRACEFUL
new_leader_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:43372
I20260709 13:08:36.178941 26511 raft_consensus.cc:606] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Received request to transfer leadership to TS 348bd127f30f46e1a84a78b57b66f77a
I20260709 13:08:36.188800 26583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77"
dest_uuid: "0e26deddd9324b8b929a6eb224280097"
mode: GRACEFUL
new_leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:56282
I20260709 13:08:36.189416 26583 raft_consensus.cc:606] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Received request to transfer leadership to TS f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:36.199332 26434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
mode: GRACEFUL
new_leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:48444
I20260709 13:08:36.199986 26434 raft_consensus.cc:606] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Received request to transfer leadership to TS f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:36.207134 26780 raft_consensus.cc:993] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: : Instructing follower f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.207629 26780 raft_consensus.cc:1081] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Signalling peer f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.207063 26434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
mode: GRACEFUL
new_leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:48444
I20260709 13:08:36.209329 26434 raft_consensus.cc:606] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Received request to transfer leadership to TS f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:36.213464 26511 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:43362
I20260709 13:08:36.214083 26511 raft_consensus.cc:493] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.214463 26511 raft_consensus.cc:3060] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.220078 26434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "375218808c054de596e244eda3539677"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
mode: GRACEFUL
new_leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:48444
I20260709 13:08:36.220700 26434 raft_consensus.cc:606] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Received request to transfer leadership to TS f3cc3405985542cc9b5bbfde63eb7cff
I20260709 13:08:36.223271 26774 raft_consensus.cc:993] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: : Instructing follower f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.223697 26774 raft_consensus.cc:1081] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Signalling peer f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.227901 26507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:43352
I20260709 13:08:36.228997 26507 raft_consensus.cc:493] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.229403 26507 raft_consensus.cc:3060] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.234143 26508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
mode: GRACEFUL
new_leader_uuid: "0e26deddd9324b8b929a6eb224280097"
 from {username='slave'} at 127.0.0.1:43372
I20260709 13:08:36.234812 26508 raft_consensus.cc:606] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Received request to transfer leadership to TS 0e26deddd9324b8b929a6eb224280097
I20260709 13:08:36.238902 26670 consensus_queue.cc:1048] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.239441 26774 consensus_queue.cc:1048] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.239369 26507 raft_consensus.cc:515] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.243813 26507 leader_election.cc:290] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.244529 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:36.245177 26436 raft_consensus.cc:3060] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.246814 26511 raft_consensus.cc:515] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.247438 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614aa81f18ee411f928307541a4a2b77" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.248174 26583 raft_consensus.cc:3055] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.248459 26583 raft_consensus.cc:740] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:36.249225 26583 consensus_queue.cc:260] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.249536 26511 leader_election.cc:290] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.250403 26583 raft_consensus.cc:3060] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.253098 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:36.253767 26433 raft_consensus.cc:3055] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.254096 26433 raft_consensus.cc:740] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:36.254977 26433 consensus_queue.cc:260] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.256052 26433 raft_consensus.cc:3060] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.257682 26510 raft_consensus.cc:1240] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Rejecting Update request from peer 348bd127f30f46e1a84a78b57b66f77a for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:36.261463 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cba44c3ad3e41ca89957d62144f27ed" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.262140 26582 raft_consensus.cc:3060] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.268857 26436 raft_consensus.cc:2468] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:36.272040 26433 raft_consensus.cc:2468] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:36.271852 26774 consensus_queue.cc:1048] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.272557 26435 raft_consensus.cc:1240] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Rejecting Update request from peer 0e26deddd9324b8b929a6eb224280097 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:36.274173 26582 raft_consensus.cc:2468] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:36.274719 26474 leader_election.cc:304] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.275821 26474 leader_election.cc:304] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.275882 26782 raft_consensus.cc:2804] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.278748 26784 raft_consensus.cc:2804] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.279415 26784 raft_consensus.cc:697] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.280545 26784 consensus_queue.cc:237] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.287850 26583 raft_consensus.cc:2468] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:36.293774 26782 raft_consensus.cc:697] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.294916 26782 consensus_queue.cc:237] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.299676 26670 raft_consensus.cc:993] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: : Instructing follower 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:36.299839 26780 consensus_queue.cc:1048] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.300462 26774 raft_consensus.cc:1081] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Signalling peer 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:36.302150 26435 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:48432
I20260709 13:08:36.302740 26435 raft_consensus.cc:493] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.303145 26435 raft_consensus.cc:3060] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.319272 26435 raft_consensus.cc:515] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.324278 26434 raft_consensus.cc:1240] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Rejecting Update request from peer 0e26deddd9324b8b929a6eb224280097 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:36.328475 26435 leader_election.cc:290] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.328846 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.329551 26583 raft_consensus.cc:3055] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.329905 26583 raft_consensus.cc:740] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:36.330745 26583 consensus_queue.cc:260] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.334765 26583 raft_consensus.cc:3060] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.336184 26510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496f7819d4ff40f6a767014fbfce75d9" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:36.336799 26510 raft_consensus.cc:3060] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.337558 26781 raft_consensus.cc:993] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: : Instructing follower f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.338014 26781 raft_consensus.cc:1081] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Signalling peer f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.340217 26507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "375218808c054de596e244eda3539677"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:43362
I20260709 13:08:36.340817 26507 raft_consensus.cc:493] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.341185 26507 raft_consensus.cc:3060] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.344298 26510 raft_consensus.cc:2468] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:36.346900 26401 leader_election.cc:304] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.347996 26744 raft_consensus.cc:2804] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.348454 26744 raft_consensus.cc:697] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:36.349243 26744 consensus_queue.cc:237] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.350093 26330 catalog_manager.cc:5697] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 1 to 2, leader changed from 0e26deddd9324b8b929a6eb224280097 (127.13.181.3) to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.351580 26507 raft_consensus.cc:515] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.351787 26781 consensus_queue.cc:1048] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.354842 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375218808c054de596e244eda3539677" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:36.355510 26434 raft_consensus.cc:3055] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.355824 26434 raft_consensus.cc:740] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:36.353124 26330 catalog_manager.cc:5697] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 1 to 2, leader changed from 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1) to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.356554 26434 consensus_queue.cc:260] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.357489 26434 raft_consensus.cc:3060] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.359428 26583 raft_consensus.cc:2468] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:36.367971 26780 consensus_queue.cc:1048] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.370425 26511 raft_consensus.cc:1240] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Rejecting Update request from peer 348bd127f30f46e1a84a78b57b66f77a for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:36.387728 26780 consensus_queue.cc:1048] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:36.381620 26434 raft_consensus.cc:2468] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:36.388746 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "375218808c054de596e244eda3539677" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.390560 26474 leader_election.cc:304] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.388816 26507 leader_election.cc:290] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.391681 26821 raft_consensus.cc:2804] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.392248 26821 raft_consensus.cc:697] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.393102 26821 consensus_queue.cc:237] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.399140 26332 catalog_manager.cc:5697] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 1 to 2, leader changed from 0e26deddd9324b8b929a6eb224280097 (127.13.181.3) to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 2 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.444036 26821 consensus_queue.cc:1048] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.443892 26331 catalog_manager.cc:5697] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 1 to 2, leader changed from 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1) to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.458597 26744 raft_consensus.cc:993] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: : Instructing follower f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.459017 26744 raft_consensus.cc:1081] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Signalling peer f3cc3405985542cc9b5bbfde63eb7cff to start an election
I20260709 13:08:36.465385 26507 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
 from {username='slave'} at 127.0.0.1:43362
I20260709 13:08:36.466032 26507 raft_consensus.cc:493] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.466403 26507 raft_consensus.cc:3060] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.469099 26821 raft_consensus.cc:993] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: : Instructing follower 0e26deddd9324b8b929a6eb224280097 to start an election
I20260709 13:08:36.469615 26821 raft_consensus.cc:1081] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Signalling peer 0e26deddd9324b8b929a6eb224280097 to start an election
I20260709 13:08:36.471532 26583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b"
dest_uuid: "0e26deddd9324b8b929a6eb224280097"
 from {username='slave'} at 127.0.0.1:56266
I20260709 13:08:36.472149 26583 raft_consensus.cc:493] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.472533 26583 raft_consensus.cc:3060] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.473244 26507 raft_consensus.cc:515] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.474169 26510 raft_consensus.cc:1240] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Rejecting Update request from peer 348bd127f30f46e1a84a78b57b66f77a for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:36.476033 26507 leader_election.cc:290] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.476269 26584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.476892 26584 raft_consensus.cc:3060] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.480057 26744 consensus_queue.cc:1059] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.480955 26781 raft_consensus.cc:3055] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.481360 26781 raft_consensus.cc:740] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:36.480223 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6d8be372a1e4cd2b2f8e451d7aa4f02" candidate_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:36.482285 26781 consensus_queue.cc:260] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.483680 26781 raft_consensus.cc:3060] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.485051 26583 raft_consensus.cc:515] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.483704 26584 raft_consensus.cc:2468] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:36.487924 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:36.488521 26435 raft_consensus.cc:3060] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.489817 26582 raft_consensus.cc:1240] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Rejecting Update request from peer f3cc3405985542cc9b5bbfde63eb7cff for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:36.491214 26583 leader_election.cc:290] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:36.491878 26477 leader_election.cc:304] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.492419 26752 consensus_queue.cc:1048] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.493894 26752 raft_consensus.cc:2804] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.496479 26782 consensus_queue.cc:1059] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.497043 26435 raft_consensus.cc:2468] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 2.
I20260709 13:08:36.497398 26782 raft_consensus.cc:3055] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.497812 26782 raft_consensus.cc:740] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.498492 26548 leader_election.cc:304] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:36.499444 26774 raft_consensus.cc:2804] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.499577 26752 raft_consensus.cc:697] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Becoming Leader. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.499977 26774 raft_consensus.cc:697] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 2 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:36.500696 26752 consensus_queue.cc:237] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.500777 26774 consensus_queue.cc:237] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.498603 26782 consensus_queue.cc:260] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.505749 26782 raft_consensus.cc:3060] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.510253 26332 catalog_manager.cc:5697] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 1 to 2, leader changed from f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2) to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.515805 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a29e7bee0e0438fa4243f369787a41b" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:36.516983 26435 raft_consensus.cc:1240] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Rejecting Update request from peer f3cc3405985542cc9b5bbfde63eb7cff for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:08:36.518035 26331 catalog_manager.cc:5697] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff reported cstate change: term changed from 1 to 2, leader changed from 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1) to f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2). New cstate: current_term: 2 leader_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.524801 26434 raft_consensus.cc:2468] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3cc3405985542cc9b5bbfde63eb7cff in term 2.
I20260709 13:08:36.525776 26507 raft_consensus.cc:2468] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 2.
I20260709 13:08:36.563234 26821 raft_consensus.cc:993] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: : Instructing follower 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:36.563741 26782 raft_consensus.cc:1081] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Signalling peer 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:36.565518 26434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:48420
I20260709 13:08:36.566131 26434 raft_consensus.cc:493] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.566529 26434 raft_consensus.cc:3060] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.572556 26434 raft_consensus.cc:515] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.574110 26434 leader_election.cc:290] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.574842 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:36.575634 26507 raft_consensus.cc:3055] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.575798 26583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "effec88fc44041bba5c5ce7734969d7b" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.576010 26507 raft_consensus.cc:740] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.576470 26583 raft_consensus.cc:3060] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.576911 26507 consensus_queue.cc:260] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.578289 26507 raft_consensus.cc:3060] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.584028 26507 raft_consensus.cc:2468] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:36.585170 26401 leader_election.cc:304] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.585464 26583 raft_consensus.cc:2468] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:36.585862 26781 raft_consensus.cc:2804] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.586450 26781 raft_consensus.cc:697] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:36.587277 26781 consensus_queue.cc:237] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.594165 26331 catalog_manager.cc:5697] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 1 to 2, leader changed from f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2) to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 2 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.618630 26821 raft_consensus.cc:993] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: : Instructing follower 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:36.619167 26782 raft_consensus.cc:1081] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Signalling peer 348bd127f30f46e1a84a78b57b66f77a to start an election
I20260709 13:08:36.620838 26434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
 from {username='slave'} at 127.0.0.1:48420
I20260709 13:08:36.621310 26434 raft_consensus.cc:493] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.621593 26434 raft_consensus.cc:3060] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.626128 26434 raft_consensus.cc:515] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.628539 26434 leader_election.cc:290] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Requested vote from peers f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995), 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557)
I20260709 13:08:36.628850 26507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:36.629586 26507 raft_consensus.cc:3055] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:36.629544 26582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb6ec2214c464967b136109f3affc0ff" candidate_uuid: "348bd127f30f46e1a84a78b57b66f77a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0e26deddd9324b8b929a6eb224280097"
I20260709 13:08:36.630164 26507 raft_consensus.cc:740] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:36.630362 26582 raft_consensus.cc:3060] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.631088 26507 consensus_queue.cc:260] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.632468 26507 raft_consensus.cc:3060] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.638752 26507 raft_consensus.cc:2468] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:36.639047 26582 raft_consensus.cc:2468] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 348bd127f30f46e1a84a78b57b66f77a in term 2.
I20260709 13:08:36.639885 26401 leader_election.cc:304] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 348bd127f30f46e1a84a78b57b66f77a, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:36.640774 26781 raft_consensus.cc:2804] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:36.641271 26781 raft_consensus.cc:697] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Becoming Leader. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:36.642048 26781 consensus_queue.cc:237] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:36.650451 26331 catalog_manager.cc:5697] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a reported cstate change: term changed from 1 to 2, leader changed from f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2) to 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1). New cstate: current_term: 2 leader_uuid: "348bd127f30f46e1a84a78b57b66f77a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:36.689049 26434 raft_consensus.cc:1275] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.690301 26782 consensus_queue.cc:1048] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.703210 26582 raft_consensus.cc:1275] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.704660 26784 consensus_queue.cc:1048] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.781734 26434 raft_consensus.cc:1275] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.783072 26784 consensus_queue.cc:1048] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.791795 26583 raft_consensus.cc:1275] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.794355 26784 consensus_queue.cc:1048] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.830049 26434 raft_consensus.cc:1275] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.831008 26507 raft_consensus.cc:1275] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.831466 26784 consensus_queue.cc:1048] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:36.832628 26781 consensus_queue.cc:1048] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.842109 26583 raft_consensus.cc:1275] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.845146 26744 consensus_queue.cc:1048] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.852021 26584 raft_consensus.cc:3060] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:36.858934 26584 raft_consensus.cc:1275] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.861238 26821 consensus_queue.cc:1048] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:36.974004 26434 raft_consensus.cc:1275] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer 0e26deddd9324b8b929a6eb224280097: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.975466 26823 consensus_queue.cc:1048] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:36.993793 26507 raft_consensus.cc:1275] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Refusing update from remote peer 0e26deddd9324b8b929a6eb224280097: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:36.995872 26823 consensus_queue.cc:1048] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:37.059208 26583 raft_consensus.cc:1275] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:37.060504 26784 consensus_queue.cc:1048] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:37.070077 26434 raft_consensus.cc:1275] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer f3cc3405985542cc9b5bbfde63eb7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:37.071909 26784 consensus_queue.cc:1048] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:37.097536 26507 raft_consensus.cc:1275] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:37.099316 26781 consensus_queue.cc:1048] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:37.113409 26583 raft_consensus.cc:1275] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:37.115788 26744 consensus_queue.cc:1048] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:37.146726 26583 raft_consensus.cc:1275] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:37.148231 26744 consensus_queue.cc:1048] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:37.160228 26507 raft_consensus.cc:1275] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Refusing update from remote peer 348bd127f30f46e1a84a78b57b66f77a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:37.163847 26781 consensus_queue.cc:1048] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:39.238602 26332 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39092:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:08:39.264901 26332 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39092:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:08:39.325249 14036 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:39.564540 26332 catalog_manager.cc:5789] TS 0e26deddd9324b8b929a6eb224280097 (127.13.181.3:34557) does not have the latest schema for tablet 7a29e7bee0e0438fa4243f369787a41b (table soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]). Expected version 1 got 0
I20260709 13:08:39.582808 26887 tablet.cc:1724] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.599124 26889 tablet.cc:1724] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.604597 26892 tablet.cc:1724] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.640092 26895 tablet.cc:1724] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:39.655927 26877 log.cc:927] Time spent T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:39.655969 26890 tablet.cc:1724] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.659257 26507 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2"
dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
mode: GRACEFUL
new_leader_uuid: "0e26deddd9324b8b929a6eb224280097"
 from {username='slave'} at 127.0.0.1:33168
I20260709 13:08:39.659909 26507 raft_consensus.cc:606] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Received request to transfer leadership to TS 0e26deddd9324b8b929a6eb224280097
W20260709 13:08:39.678829 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.3:34557, user_credentials={real_user=slave}} blocked reactor thread for 100705us
W20260709 13:08:39.671185 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.181.2:32995, user_credentials={real_user=slave}} blocked reactor thread for 109615us
I20260709 13:08:39.699764 26897 tablet.cc:1724] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.666697 26896 tablet.cc:1724] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.708385 26332 catalog_manager.cc:5789] TS f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995) does not have the latest schema for tablet 7cba44c3ad3e41ca89957d62144f27ed (table soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]). Expected version 1 got 0
I20260709 13:08:39.709152 26332 catalog_manager.cc:5789] TS f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995) does not have the latest schema for tablet f6d8be372a1e4cd2b2f8e451d7aa4f02 (table soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]). Expected version 1 got 0
I20260709 13:08:39.724377 26902 tablet.cc:1724] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.742271 26887 tablet.cc:1724] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.756708 26889 tablet.cc:1724] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.788908 26894 tablet.cc:1724] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.792436 26898 raft_consensus.cc:993] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff: : Instructing follower 0e26deddd9324b8b929a6eb224280097 to start an election
I20260709 13:08:39.793085 26898 raft_consensus.cc:1081] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Signalling peer 0e26deddd9324b8b929a6eb224280097 to start an election
I20260709 13:08:39.804761 26584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2"
dest_uuid: "0e26deddd9324b8b929a6eb224280097"
 from {username='slave'} at 127.0.0.1:56266
I20260709 13:08:39.805310 26584 raft_consensus.cc:493] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.805631 26584 raft_consensus.cc:3060] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.813908 26584 raft_consensus.cc:515] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:39.818359 26584 leader_election.cc:290] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 2 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:39.819229 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:39.819962 26433 raft_consensus.cc:3060] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.820174 26899 tablet.cc:1724] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.821009 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75a5a607b33444d481012ba72e9fb7f2" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:39.821702 26509 raft_consensus.cc:3055] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:39.822014 26509 raft_consensus.cc:740] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f3cc3405985542cc9b5bbfde63eb7cff, State: Running, Role: LEADER
I20260709 13:08:39.823221 26509 consensus_queue.cc:260] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:39.825958 26509 raft_consensus.cc:3060] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:39.829445 26895 tablet.cc:1724] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.833225 26889 tablet.cc:1724] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.824254 26892 tablet.cc:1724] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.837800 26902 tablet.cc:1724] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.842398 26433 raft_consensus.cc:2468] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 2.
I20260709 13:08:39.844199 26896 tablet.cc:1724] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.845728 26903 tablet.cc:1724] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.866029 26434 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14"
dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
mode: GRACEFUL
new_leader_uuid: "0e26deddd9324b8b929a6eb224280097"
 from {username='slave'} at 127.0.0.1:37644
I20260709 13:08:39.866354 26548 leader_election.cc:304] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, 348bd127f30f46e1a84a78b57b66f77a; no voters: 
I20260709 13:08:39.866701 26434 raft_consensus.cc:606] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Received request to transfer leadership to TS 0e26deddd9324b8b929a6eb224280097
I20260709 13:08:39.867444 26774 raft_consensus.cc:2804] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:39.867980 26774 raft_consensus.cc:697] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 2 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:39.868147 14036 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:39.872376 26332 catalog_manager.cc:5789] TS 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961) does not have the latest schema for tablet eb6ec2214c464967b136109f3affc0ff (table soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]). Expected version 1 got 0
I20260709 13:08:39.874181 26332 catalog_manager.cc:5789] TS 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961) does not have the latest schema for tablet a75566f234864bcaa28975c6d76cd82a (table soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]). Expected version 1 got 0
I20260709 13:08:39.868949 26774 consensus_queue.cc:237] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:39.877795 26905 tablet.cc:1724] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.879925 26894 tablet.cc:1724] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.882033 14036 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:39.881872 26897 tablet.cc:1724] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.885113 26890 tablet.cc:1724] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.887157 26895 tablet.cc:1724] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.894683 26332 catalog_manager.cc:5789] TS 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961) does not have the latest schema for tablet 496f7819d4ff40f6a767014fbfce75d9 (table soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8]). Expected version 1 got 0
I20260709 13:08:39.903223 26887 tablet.cc:1724] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.907016 26896 tablet.cc:1724] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.906968 26332 catalog_manager.cc:5697] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 1 to 2, leader changed from f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2) to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 2 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:39.920034 26905 tablet.cc:1724] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.894369 26509 raft_consensus.cc:2468] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 2.
I20260709 13:08:39.933502 26899 tablet.cc:1724] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:39.973915 26331 catalog_manager.cc:6242] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af: soft_deleted_table [id=ee316eed87f9466a8d6cc408c417caa8] alter complete (version 1)
I20260709 13:08:40.269038 26509 raft_consensus.cc:1275] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Refusing update from remote peer 0e26deddd9324b8b929a6eb224280097: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:40.270236 26774 consensus_queue.cc:1048] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.280831 26434 raft_consensus.cc:1275] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Refusing update from remote peer 0e26deddd9324b8b929a6eb224280097: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:40.282505 26885 consensus_queue.cc:1048] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:40.310925 26918 raft_consensus.cc:993] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a: : Instructing follower 0e26deddd9324b8b929a6eb224280097 to start an election
I20260709 13:08:40.311439 26918 raft_consensus.cc:1081] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Signalling peer 0e26deddd9324b8b929a6eb224280097 to start an election
I20260709 13:08:40.313202 26579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14"
dest_uuid: "0e26deddd9324b8b929a6eb224280097"
 from {username='slave'} at 127.0.0.1:56280
I20260709 13:08:40.313800 26579 raft_consensus.cc:493] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.314150 26579 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.320313 26579 raft_consensus.cc:515] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:40.322214 26579 leader_election.cc:290] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 3 election: Requested vote from peers 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961), f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995)
I20260709 13:08:40.323246 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "348bd127f30f46e1a84a78b57b66f77a"
I20260709 13:08:40.323783 26509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0b63f8428fe4dce9b42560ca36d3b14" candidate_uuid: "0e26deddd9324b8b929a6eb224280097" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f3cc3405985542cc9b5bbfde63eb7cff"
I20260709 13:08:40.324015 26434 raft_consensus.cc:3055] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:40.324379 26509 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.324496 26434 raft_consensus.cc:740] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 348bd127f30f46e1a84a78b57b66f77a, State: Running, Role: LEADER
I20260709 13:08:40.325443 26434 consensus_queue.cc:260] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:40.326655 26434 raft_consensus.cc:3060] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:40.331769 26509 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 3.
I20260709 13:08:40.333251 26550 leader_election.cc:304] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e26deddd9324b8b929a6eb224280097, f3cc3405985542cc9b5bbfde63eb7cff; no voters: 
I20260709 13:08:40.333578 26434 raft_consensus.cc:2468] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e26deddd9324b8b929a6eb224280097 in term 3.
I20260709 13:08:40.334374 26914 raft_consensus.cc:2804] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:40.334894 26914 raft_consensus.cc:697] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 3 LEADER]: Becoming Leader. State: Replica: 0e26deddd9324b8b929a6eb224280097, State: Running, Role: LEADER
I20260709 13:08:40.335762 26914 consensus_queue.cc:237] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } }
I20260709 13:08:40.343405 26330 catalog_manager.cc:5697] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 reported cstate change: term changed from 2 to 3, leader changed from 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1) to 0e26deddd9324b8b929a6eb224280097 (127.13.181.3). New cstate: current_term: 3 leader_uuid: "0e26deddd9324b8b929a6eb224280097" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e26deddd9324b8b929a6eb224280097" member_type: VOTER last_known_addr { host: "127.13.181.3" port: 34557 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:40.746814 26433 raft_consensus.cc:1275] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 3 FOLLOWER]: Refusing update from remote peer 0e26deddd9324b8b929a6eb224280097: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:40.748240 26914 consensus_queue.cc:1048] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348bd127f30f46e1a84a78b57b66f77a" member_type: VOTER last_known_addr { host: "127.13.181.1" port: 36961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.750854 26509 raft_consensus.cc:1275] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Refusing update from remote peer 0e26deddd9324b8b929a6eb224280097: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:40.752439 26774 consensus_queue.cc:1048] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3cc3405985542cc9b5bbfde63eb7cff" member_type: VOTER last_known_addr { host: "127.13.181.2" port: 32995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:40.940043 14036 tablet_server.cc:179] TabletServer@127.13.181.1:0 shutting down...
I20260709 13:08:40.964821 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:40.965510 14036 tablet_replica.cc:333] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.966130 14036 raft_consensus.cc:2243] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.966965 14036 raft_consensus.cc:2272] T effec88fc44041bba5c5ce7734969d7b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.969692 14036 tablet_replica.cc:333] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.970630 14036 raft_consensus.cc:2243] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.971230 14036 raft_consensus.cc:2272] T 614aa81f18ee411f928307541a4a2b77 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.972962 14036 tablet_replica.cc:333] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.973469 14036 raft_consensus.cc:2243] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.973847 14036 raft_consensus.cc:2272] T 375218808c054de596e244eda3539677 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.975705 14036 tablet_replica.cc:333] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.976197 14036 raft_consensus.cc:2243] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.976879 14036 raft_consensus.cc:2272] T a75566f234864bcaa28975c6d76cd82a P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.978790 14036 tablet_replica.cc:333] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.979379 14036 raft_consensus.cc:2243] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.980090 14036 raft_consensus.cc:2272] T 496f7819d4ff40f6a767014fbfce75d9 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.981923 14036 tablet_replica.cc:333] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.982443 14036 raft_consensus.cc:2243] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.982949 14036 raft_consensus.cc:2272] T ed916284f33f4976bcf48282267ebb51 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.985015 14036 tablet_replica.cc:333] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.985642 14036 raft_consensus.cc:2243] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.986028 14036 raft_consensus.cc:2272] T b9762e66cc4a4bf386558b9e67c5979c P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.987948 14036 tablet_replica.cc:333] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.988495 14036 raft_consensus.cc:2243] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.989262 14036 raft_consensus.cc:2272] T ddbebc16af5545ef990c3a43641f114e P 348bd127f30f46e1a84a78b57b66f77a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.991250 14036 tablet_replica.cc:333] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.991742 14036 raft_consensus.cc:2243] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:40.992429 14036 raft_consensus.cc:2272] T eb6ec2214c464967b136109f3affc0ff P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.994546 14036 tablet_replica.cc:333] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.995297 14036 raft_consensus.cc:2243] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.995828 14036 raft_consensus.cc:2272] T ab16e189770a4778b4a878cb2edd6a89 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.998456 14036 tablet_replica.cc:333] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:40.999070 14036 raft_consensus.cc:2243] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:40.999487 14036 raft_consensus.cc:2272] T 75a5a607b33444d481012ba72e9fb7f2 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.001816 14036 tablet_replica.cc:333] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:41.002601 14036 raft_consensus.cc:2243] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.003120 14036 raft_consensus.cc:2272] T a56c20a706174c9d8477f6c80037f3be P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.005071 14036 tablet_replica.cc:333] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:41.005605 14036 raft_consensus.cc:2243] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.006019 14036 raft_consensus.cc:2272] T c0b63f8428fe4dce9b42560ca36d3b14 P 348bd127f30f46e1a84a78b57b66f77a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.008384 14036 tablet_replica.cc:333] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:41.008932 14036 raft_consensus.cc:2243] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.009424 14036 raft_consensus.cc:2272] T 7a29e7bee0e0438fa4243f369787a41b P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.011349 14036 tablet_replica.cc:333] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:41.011989 14036 raft_consensus.cc:2243] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.012413 14036 raft_consensus.cc:2272] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.014132 14036 tablet_replica.cc:333] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:41.014600 14036 raft_consensus.cc:2243] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.014988 14036 raft_consensus.cc:2272] T 7cba44c3ad3e41ca89957d62144f27ed P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.016825 14036 tablet_replica.cc:333] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:41.017262 14036 raft_consensus.cc:2243] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.018047 14036 raft_consensus.cc:2272] T f6beef3502914b20bf0d7f6b89903b93 P 348bd127f30f46e1a84a78b57b66f77a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.020138 14036 tablet_replica.cc:333] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a: stopping tablet replica
I20260709 13:08:41.020568 14036 raft_consensus.cc:2243] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.021382 14036 raft_consensus.cc:2272] T 729b05ee1c6649edb015253fb12fe4c4 P 348bd127f30f46e1a84a78b57b66f77a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:41.022982 26474 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 13:08:41.025919 26474 consensus_peers.cc:597] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.039083 26548 consensus_peers.cc:597] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.085258 14036 tablet_server.cc:196] TabletServer@127.13.181.1:0 shutdown complete.
I20260709 13:08:41.116017 14036 tablet_server.cc:179] TabletServer@127.13.181.2:0 shutting down...
W20260709 13:08:41.147710 26550 consensus_peers.cc:597] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 -> Peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Couldn't send request to peer f3cc3405985542cc9b5bbfde63eb7cff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.149711 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:41.150617 14036 tablet_replica.cc:333] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.151551 14036 raft_consensus.cc:2243] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.152053 14036 raft_consensus.cc:2272] T 496f7819d4ff40f6a767014fbfce75d9 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.153925 14036 tablet_replica.cc:333] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.154515 14036 raft_consensus.cc:2243] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.154930 14036 raft_consensus.cc:2272] T effec88fc44041bba5c5ce7734969d7b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.157172 14036 tablet_replica.cc:333] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.158071 14036 raft_consensus.cc:2243] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.158905 14036 raft_consensus.cc:2272] T 375218808c054de596e244eda3539677 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.161374 14036 tablet_replica.cc:333] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
W20260709 13:08:41.161429 26474 consensus_peers.cc:597] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.162295 14036 raft_consensus.cc:2243] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.162855 14036 raft_consensus.cc:2272] T a75566f234864bcaa28975c6d76cd82a P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:41.163565 26474 consensus_peers.cc:597] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.165016 14036 tablet_replica.cc:333] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.165603 14036 raft_consensus.cc:2243] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.166299 14036 raft_consensus.cc:2272] T 614aa81f18ee411f928307541a4a2b77 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.168241 14036 tablet_replica.cc:333] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.168756 14036 raft_consensus.cc:2243] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.169106 14036 raft_consensus.cc:2272] T 75a5a607b33444d481012ba72e9fb7f2 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.171614 14036 tablet_replica.cc:333] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.172125 14036 raft_consensus.cc:2243] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.172479 14036 raft_consensus.cc:2272] T ab16e189770a4778b4a878cb2edd6a89 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.174268 14036 tablet_replica.cc:333] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.174767 14036 raft_consensus.cc:2243] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.175259 14036 raft_consensus.cc:2272] T eb6ec2214c464967b136109f3affc0ff P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.177059 14036 tablet_replica.cc:333] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.177708 14036 raft_consensus.cc:2243] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.178529 14036 raft_consensus.cc:2272] T ed916284f33f4976bcf48282267ebb51 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:41.180347 26474 consensus_peers.cc:597] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.180823 14036 tablet_replica.cc:333] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.181447 14036 raft_consensus.cc:2243] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.182299 14036 raft_consensus.cc:2272] T b9762e66cc4a4bf386558b9e67c5979c P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.184464 14036 tablet_replica.cc:333] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.185017 14036 raft_consensus.cc:2243] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.185464 14036 raft_consensus.cc:2272] T ddbebc16af5545ef990c3a43641f114e P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.187630 14036 tablet_replica.cc:333] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.188181 14036 raft_consensus.cc:2243] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.188669 14036 raft_consensus.cc:2272] T 7a29e7bee0e0438fa4243f369787a41b P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.190460 14036 tablet_replica.cc:333] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.191005 14036 raft_consensus.cc:2243] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.191498 14036 raft_consensus.cc:2272] T c0b63f8428fe4dce9b42560ca36d3b14 P f3cc3405985542cc9b5bbfde63eb7cff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.194388 14036 tablet_replica.cc:333] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.195022 14036 raft_consensus.cc:2243] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.195897 14036 raft_consensus.cc:2272] T a56c20a706174c9d8477f6c80037f3be P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.197888 14036 tablet_replica.cc:333] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.198431 14036 raft_consensus.cc:2243] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.199342 14036 raft_consensus.cc:2272] T 7cba44c3ad3e41ca89957d62144f27ed P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.201215 14036 tablet_replica.cc:333] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.201725 14036 raft_consensus.cc:2243] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.202500 14036 raft_consensus.cc:2272] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.204483 14036 tablet_replica.cc:333] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.205021 14036 raft_consensus.cc:2243] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.205392 14036 raft_consensus.cc:2272] T 729b05ee1c6649edb015253fb12fe4c4 P f3cc3405985542cc9b5bbfde63eb7cff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.207355 14036 tablet_replica.cc:333] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff: stopping tablet replica
I20260709 13:08:41.207774 14036 raft_consensus.cc:2243] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.208149 14036 raft_consensus.cc:2272] T f6beef3502914b20bf0d7f6b89903b93 P f3cc3405985542cc9b5bbfde63eb7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.248409 14036 tablet_server.cc:196] TabletServer@127.13.181.2:0 shutdown complete.
W20260709 13:08:41.267179 26548 consensus_peers.cc:597] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.276726 26550 consensus_peers.cc:597] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 -> Peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Couldn't send request to peer f3cc3405985542cc9b5bbfde63eb7cff. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:32995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.283885 14036 tablet_server.cc:179] TabletServer@127.13.181.3:0 shutting down...
W20260709 13:08:41.306775 26548 consensus_peers.cc:597] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:41.314322 26550 consensus_peers.cc:597] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 -> Peer f3cc3405985542cc9b5bbfde63eb7cff (127.13.181.2:32995): Couldn't send request to peer f3cc3405985542cc9b5bbfde63eb7cff. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.2:32995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.318302 14036 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:41.318970 14036 tablet_replica.cc:333] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.319638 14036 raft_consensus.cc:2243] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.320122 14036 raft_consensus.cc:2272] T 614aa81f18ee411f928307541a4a2b77 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.321960 14036 tablet_replica.cc:333] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.322520 14036 raft_consensus.cc:2243] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.322960 14036 raft_consensus.cc:2272] T 496f7819d4ff40f6a767014fbfce75d9 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.324993 14036 tablet_replica.cc:333] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.325549 14036 raft_consensus.cc:2243] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.326108 14036 raft_consensus.cc:2272] T 375218808c054de596e244eda3539677 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.328294 14036 tablet_replica.cc:333] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.328838 14036 raft_consensus.cc:2243] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.329270 14036 raft_consensus.cc:2272] T a75566f234864bcaa28975c6d76cd82a P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.331223 14036 tablet_replica.cc:333] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.331790 14036 raft_consensus.cc:2243] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.332216 14036 raft_consensus.cc:2272] T ed916284f33f4976bcf48282267ebb51 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:41.332721 26548 consensus_peers.cc:597] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 -> Peer 348bd127f30f46e1a84a78b57b66f77a (127.13.181.1:36961): Couldn't send request to peer 348bd127f30f46e1a84a78b57b66f77a. Status: Network error: Client connection negotiation failed: client connection to 127.13.181.1:36961: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:41.334182 14036 tablet_replica.cc:333] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.334810 14036 raft_consensus.cc:2243] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.335266 14036 raft_consensus.cc:2272] T b9762e66cc4a4bf386558b9e67c5979c P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.337347 14036 tablet_replica.cc:333] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.337886 14036 raft_consensus.cc:2243] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.338301 14036 raft_consensus.cc:2272] T eb6ec2214c464967b136109f3affc0ff P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.340183 14036 tablet_replica.cc:333] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.340698 14036 raft_consensus.cc:2243] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.341440 14036 raft_consensus.cc:2272] T 75a5a607b33444d481012ba72e9fb7f2 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.343412 14036 tablet_replica.cc:333] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.343968 14036 raft_consensus.cc:2243] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.344720 14036 raft_consensus.cc:2272] T ab16e189770a4778b4a878cb2edd6a89 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.346578 14036 tablet_replica.cc:333] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.347154 14036 raft_consensus.cc:2243] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.347585 14036 raft_consensus.cc:2272] T a56c20a706174c9d8477f6c80037f3be P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.349474 14036 tablet_replica.cc:333] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.350270 14036 raft_consensus.cc:2243] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.350751 14036 raft_consensus.cc:2272] T effec88fc44041bba5c5ce7734969d7b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.352612 14036 tablet_replica.cc:333] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.353142 14036 raft_consensus.cc:2243] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.353565 14036 raft_consensus.cc:2272] T ddbebc16af5545ef990c3a43641f114e P 0e26deddd9324b8b929a6eb224280097 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.355728 14036 tablet_replica.cc:333] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.356243 14036 raft_consensus.cc:2243] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.356992 14036 raft_consensus.cc:2272] T 7a29e7bee0e0438fa4243f369787a41b P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.358801 14036 tablet_replica.cc:333] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.359411 14036 raft_consensus.cc:2243] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.360170 14036 raft_consensus.cc:2272] T c0b63f8428fe4dce9b42560ca36d3b14 P 0e26deddd9324b8b929a6eb224280097 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.362378 14036 tablet_replica.cc:333] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.362900 14036 raft_consensus.cc:2243] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.363389 14036 raft_consensus.cc:2272] T f6d8be372a1e4cd2b2f8e451d7aa4f02 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.365093 14036 tablet_replica.cc:333] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.365571 14036 raft_consensus.cc:2243] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.365990 14036 raft_consensus.cc:2272] T 7cba44c3ad3e41ca89957d62144f27ed P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.367769 14036 tablet_replica.cc:333] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.368247 14036 raft_consensus.cc:2243] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.368654 14036 raft_consensus.cc:2272] T 729b05ee1c6649edb015253fb12fe4c4 P 0e26deddd9324b8b929a6eb224280097 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.370465 14036 tablet_replica.cc:333] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097: stopping tablet replica
I20260709 13:08:41.370901 14036 raft_consensus.cc:2243] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:41.371411 14036 raft_consensus.cc:2272] T f6beef3502914b20bf0d7f6b89903b93 P 0e26deddd9324b8b929a6eb224280097 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.410308 14036 tablet_server.cc:196] TabletServer@127.13.181.3:0 shutdown complete.
I20260709 13:08:41.443579 14036 master.cc:562] Master@127.13.181.62:35903 shutting down...
I20260709 13:08:41.464396 14036 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:41.464970 14036 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:41.465308 14036 tablet_replica.cc:333] T 00000000000000000000000000000000 P fe2b18e926e94d2da2e9e91f28fde9af: stopping tablet replica
I20260709 13:08:41.486224 14036 master.cc:584] Master@127.13.181.62:35903 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13481 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26440 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (357329 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:08:41.542359 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 402 messages since previous log ~16 seconds ago
I20260709 13:08:41.542689 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 402 messages since previous log ~16 seconds ago
I20260709 13:08:41.542882 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 401 messages since previous log ~16 seconds ago
I20260709 13:08:41.543380 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:08:41.543607 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:08:41.543845 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~144 seconds ago
I20260709 13:08:41.544056 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 1 messages since previous log ~299 seconds ago
I20260709 13:08:41.544343 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:08:41.544703 14036 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~6 seconds ago
